Evidence-centered design (ECD) is an orientation towards assessment development. It differs from conventional practice in several ways and consists of multiple activities. Each of these activities results in a set of useful documentation: domain analysis, domain modeling, construction of the assessment framework, and assessment…

This article demonstrates how textbooks differ in their description of the term "experimental unit". Advanced Placement Statistics teachers and students are often limited in their statistical knowledge by the information presented in their classroom textbook. Definitions and descriptions differ among textbooks as well as among different…

The many-faceted Rasch (MFR) model has been used to evaluate the quality of ratings on constructed response assessments; however, it can also be used to evaluate the quality of judgments from panel-based standard setting procedures. The current study illustrates the use of the MFR model for examining the quality of ratings obtained from a standard…

Evidence-centered assessment design (ECD) explicates a transparent evidentiary argument to warrant the inferences we make from student test performance. This article describes how the vehicles for gathering student evidence--task models and test specifications--are developed. Task models, which are the basis for item development, flow directly…

In this study, the perceptions of parents (n = 14) and students (n = 47) enrolled in a blended learning course, the first of its kind at their school, were examined. Student performance in the blended and in the traditional portion of the course was examined, and the Educational Success Prediction Instrument (ESPRI) was administered to predict…

Discusses the Document Based Question (DBQ) as a way of assessing critical thinking skills. Examines several weaknesses with this type of test item and offers suggestions for overcoming them. Advocates the method continue to be used. (JDH)

Analyzes several questions and student answers, and the graders' evaluations of student responses on each of two advanced placement examinations--the one which tests Vergil and the one which tests Catallus and Horace. The percentages of participants scoring at each grade level of the exam are also presented. (SED)

This paper discusses the assumptions required by the item response theory (IRT) true-score equating method (with Stocking & Lord, 1983; scaling approach), which is commonly used in the nonequivalent groups with an anchor data-collection design. More precisely, this paper investigates the assumptions made at each step by the IRT approach to…

This report builds on and extends existent research on population invariance to new tests and issues. The authors lay the foundation for a deeper understanding of the use of population invariance measures in a wide variety of practical contexts. The invariance of linear, equipercentile and IRT equating methods are examined using data from five…