This study compared several item exposure control procedures for computerized adaptive test (CAT) systems based on a three-parameter logistic testlet response theory model (X. Wang, E. Bradlow, and H. Wainer, 2002) and G. Masters' (1982) partial credit model using real data from the Verbal Reasoning section of the Medical College Admission Test.…

Combined the methods of alpha-stratified adaptive testing and constrained adaptive testing with shadow tests. Outlines the advantages of this approach in reducing overexposure and underexposure of items in an item pool and illustrates these advantages with an example from the Law School Admission Test. (SLD)

Compared the properties of five methods of item exposure control in the context of estimating examinees' abilities in a computerized adaptive testing situation. Findings show advantages to the Stocking and Lewis conditional multinomial procedure (M. Stocking and C. Lewis, 1995) and, to a lesser degree, the Davy and Parshall method (T. Davey and C.…

Evaluated three strategies for assigning examinees to grading categories in computerized adaptive testing. The expected a posteriori-based method had more correct classifications in the middle range of grade levels and more errors for the extremes than the golden section search grading test and the Z-score grading test. (SLD)

This report presents the results of a research and development effort for SpeechRater? Version 1.0 (v1.0), an automated scoring system for the spontaneous speech of English language learners used operationally in the Test of English as a Foreign Language™ (TOEFL®) Practice Online assessment (TPO). The report includes a summary of the validity…

Computerized adaptive testing in personality assessment can improve efficiency by significantly reducing the number of items administered to answer an assessment question. Two approaches have been explored for adaptive testing in computerized personality assessment: item response theory and the countdown method. In this article, the authors…

The attrition of special education teachers greatly affects the quality of special education services districts can provide for students with disabilities and creates an ongoing challenge for educational leaders. It is essential to understand the factors influencing special education teachers' decisions to leave or remain in the field. If…

Measurement of quality of life is becoming increasingly important in health care. Self-reported quality of life is the preferred method of gathering this information, but children are often excluded from this process, their input being replaced by parent-proxy report. This feasibility study tested assessment of "daily" quality-of-life by a…

Text messaging has gained widespread popularity in higher education as a communication tool and as a means of engaging students in the learning process. In this study we report on the use of text messaging in a large, year-one introductory chemistry module where students were encouraged to send questions and queries to a dedicated text number both…

Information Integration Theory (IIT) is concerned with how people combine information into an overall judgment. A method is hereby presented to perform Functional Measurement (FM) experiments, the methodological counterpart of IIT, on the Web. In a comparison of Web-based FM experiments, face-to-face experiments, and computer-based experiments in…

Online peer assessment is an innovative evaluation method that has caught both educators' and practitioners' attention in recent years. The purpose of this study was to develop relevant questionnaires for teachers to understand student self-efficacy and motivation in online peer assessment learning environments. A total of 205 college students…

This paper reports on one part of the first year of a three-year study into the feasibility of using digital technologies to represent the output from practical assessment tasks in senior secondary courses. The aim was to improve the alignment of assessment with pedagogy and curriculum. Students in seven classes studying the "Applied…

Objective: The aim of this study was to evaluate staff experiences of the use of a computer-based concept for lifestyle testing and tailored advice implemented in routine primary health care (PHC). Design: The design of the study was a cross-sectional, retrospective survey. Setting: The study population consisted of staff at nine PHC units in the…

Stereotype threat research has demonstrated how presenting situational cues in a testing environment, such as raising the salience of negative stereotypes, can adversely affect test performance (Perry, Steele, & Hilliard, 2003; Steele & Aronson, 1995) and expectancy (Cadinu, Maass, Frigerio, Impagliazzo, & Latinotti, 2003; Stangor,…

We examined web-based ratings and open-ended comments of teaching-award winners (n = 120) and research-award winners (n = 119) to determine if teaching-award winners received more favourable ratings and comments on RateMyProfessors.com. As predicted, students rated teaching-award winners higher than research-award winners on measures of teaching…