This study investigates item parameter recovery, standard error estimates, and fit statistics yielded by the WINSTEPS program under the Rasch model and the rating scale model through Monte Carlo simulations. The independent variables were item response model, test length, and sample size. WINSTEPS yielded practically unbiased estimates for the…

Panelists in an operational standard-setting study were asked to share their thoughts in written form at important points in the process itself--before the meeting started, after training, after completing the 1st and 2nd sets of ratings, immediately following the discussion between Rounds 1 and 2, and so on. The item mapping method of Plake and…

This study examines the effect and validity of accommodations for limited English proficiency (LEP) students in the National Assessment of Educational Progress (NAEP) and the impact of language factors on the assessment and accommodation of these students. Results indicate that accommodations used in NAEP did not reduce the performance gap between…

The use of accommodations has been widely proposed as a means of including English language learners (ELLs) or limited English proficient (LEP) students in state and districtwide assessments. However, very little experimental research has been done on specific accommodations to determine whether these pose a threat to score comparability. This…

Having students express their understanding of difficult, new material in their own words is an effective method to deepen their comprehension and learning. Summary Street[R] is a computer tutor that offers a supportive context for students to practice this activity by means of summary writing, guiding them through successive cycles of revising…

Model-based equating was compared to empirical equating of an Armed Services Vocational Aptitude Battery (ASVAB) test form. The model-based equating was done using item pretest data to derive item response theory (IRT) item parameter estimates for those items that were retained in the final version of the test. The analysis of an ASVAB test form…

The purpose of this study was to investigate perceptions of the counseling needs of gifted children from the perspective of parents who sought help from a fee-based counseling center for gifted students. The counseling center provided assessment and educational and career guidance, as well as family social/emotional counseling, all of which were…

This article revisits the important issue raised by Peter Tymms where he challenges the official government reports of an impressive rise in standards in mathematics and English in primary schools in England since 1995, suggesting that the rise in scores, particularly since 2000, does not indicate rising standards. In order to substantiate its…

The present study investigated the effects of reducing the number of options per item on psychometric characteristics of a Japanese EFL university entrance examination. A four-option multiple-choice reading test used for entrance screening at a university in Japan was later converted to a three-option version by eliminating the least frequently…

States are establishing high stakes assessments to serve as a measurement tool of students' academic abilities. This study essentially explored and sought to understand some of Maryland's mathematics and science practitioners' perspectives on increase testing, and the No Child left Behind (NCLB) Act. Basically, the study sought to understand and…

The IRT (Item Response Theory) has been studied and applied in computer-based test for decades. However, almost of all these existing studies evaluated focus merely on test questions with text-based (or static text/graphic) type of presentation form illustrated exclusively. In this paper, we present our study on test questions using both…

The purpose of the study was to determine comparability of an online version to the original paper-pencil version of Defining Issues Test 2 (DIT2). This study employed methods from both Classical Test Theory (CTT) and Item Response Theory (IRT). Findings from CTT analyses supported the reliability and discriminant validity of both versions.…

Achieve launched this study to help inform the decisions states are making about high school assessments by providing greater insights into the world of college admissions and placement testing. Achieve analyzed more than 2,000 questions from college admissions and placement exams to determine how these tests compare to one another and how well…

More than any other of its aspects, assessment plays a central role in determining the quality of education. Quality of primary/basic education (QoE) can be viewed as the extent to which the process of education at the primary education level maximizes desirable outcomes in terms of cognitive, affective and psychomotor behaviour of the learners.…

Whether the presence of bidimensionality has any effect on the adaptive recalibration of test items was studied through live-data simulation of computer adaptive testing (CAT) forms. The source data were examinee responses to the 298 scored multiple choice items of a licensure examination in a health care profession. Three 75-item part-forms,…