The confidence level (information-referenced testing; IRT) design is an attempt to improve upon the multiple choice format by allowing students to express a level of confidence in the answers they choose. In this study, the author evaluated student perceptions of the ease of use and accuracy of and general preference for traditional multiple…

The purpose of this study was to determine the immediate and long-term effectiveness of a university level conceptually-based health-related (CBHR) fitness course on health-related fitness (HRF) knowledge. Two hundred and seventy-seven students served as subjects. Subjects were grouped according to the following criteria. Group 1 represented…

The present study examined how a reader's subject knowledge, the analogy versus nonanalogy difference in text type, and type of test (written recall, sentence completion, and multiple choice) affect first language (L1) and second language (L2) reading comprehension. There were three participant groups: (a) 53 native Costa Ricans enrolled in…

At the end of a lecturing period examinations are used to take a snapshot of the level of knowledge of a student. It is essential that this snapshot be taken at the right moment. Particularly when a student fails, it is important to make sure that it is because his level of knowledge is not adequate, not because, for example, he had a severe…

The World Wide Web has frequently been incorporated into second/foreign language (L2 hereafter) course instruction during the past decade. However, many teaching methods essentially employed it as a reactive mode of L2 instruction. Many other methods have been designed to facilitate constructive L2 production. They are, however, limited in their…

Model-based equating was compared to empirical equating of an Armed Services Vocational Aptitude Battery (ASVAB) test form. The model-based equating was done using item pretest data to derive item response theory (IRT) item parameter estimates for those items that were retained in the final version of the test. The analysis of an ASVAB test form…

Introduction of new teaching strategies often expands the expectations for student learning, creating a parallel need to redefine how teachers collect the evidence that assures both them and their students that these expectations are in fact being met. The default assessment strategy of the typical large, introductory, college-level science…

Online high schools are growing significantly in number, popularity, and function. However, little empirical data has been published about the effectiveness of these institutions. This research examined the frequency of group work and extended essay writing among online Advanced Placement Program® (AP®) students, and how these tasks may have…

In this technical report, the authors describe the development and piloting of reading comprehension measures as part of a comprehensive progress monitoring literacy assessment system developed in 2006 for use with students in Kindergarten through fifth grade. They begin with a brief overview of the two conceptual frameworks underlying the…

Whether the presence of bidimensionality has any effect on the adaptive recalibration of test items was studied through live-data simulation of computer adaptive testing (CAT) forms. The source data were examinee responses to the 298 scored multiple choice items of a licensure examination in a health care profession. Three 75-item part-forms,…

The primary goal of this project was to examine the predictability of Scholastic Aptitude Test (SAT) reading item difficulty (equated delta) for main idea items, and the predictability of main idea, inference, and explicit statement item types. A secondary purpose was to contrast the responses of high verbal and low verbal ability examinees.…

Contrasts between constructed response items and stem-equivalent multiple-choice counterparts typically have involved averaging item characteristics, and this aggregation has masked differences in statistical properties at the item level. Moreover, even aggregated format differences have not been explained in terms of differential cognitive…

In order to evaluate the Test of English as a Foreign Language (TOEFL) vocabulary item format and to determine the effectiveness of alternative vocabulary test items, this study investigated the functioning of eight different multiple-choice formats that differed with regard to: (1) length and inference-generating quality of the stem; (2) the…

This study examined the relationship of a machine-scorable, constrained free-response computer science item that required the student to debug a faulty program to two other types of items: multiple-choice and free-response requiring production of a computer program. The free-response items were from the College Board's Advanced Placement Computer…

Current conceptions of literacy and what being literate means are discussed, and the strengths and weaknesses of the standardized multiple-choice test as a tool for assessing literacy proficiency and a way to report learning progress are explored. The possible advantages of alternative assessment strategies are reviewed, and an assessment model is…