A psychological framework for different types of items commonly used with mixed-format exams is proposed. A choice model based on signal detection theory (SDT) is used for multiple-choice (MC) items, whereas an item response theory (IRT) model is used for open-ended (OE) items. The SDT and IRT models are shown to share a common conceptualization…

A multidimensional Bayesian item response model is proposed for modeling item position effects. The first dimension corresponds to the ability that is to be measured; the second dimension represents a factor that allows for individual differences in item position effects called persistence. This model allows for nonlinear item position effects on…

Reading comprehension is an essential skill for success in school and post-school life. However, despite the importance of this skill, a considerable number of students in the U.S. have shown difficulties in reading comprehension. According to the 2015 National Assessment of Educational Progress (NAEP) of the National Center for Education…

Changing the order of items between alternate test forms to prevent copying and to enhance test security is a common practice in achievement testing. However, these changes in item order may affect item and test characteristics. Several procedures have been proposed for studying these item-order effects. The present study explores the use of…

Large-scale testing programs involving classification decisions typically have multiple forms available and conduct equating to ensure cut-score comparability across forms. A test developer might be interested in the extent to which an examinee who happens to take a particular form would have a consistent classification decision if he or she had…

An operational framework and a set of empirical procedures for building achievement tests sensitive to the instructional effects of school programs are presented. Procedures are illustrated using data from a comparative study of alternative item formats for a criterion-referenced test. Important differences in instructional sensitivity are shown.…

The effectiveness of a strategy for improving performance on multiple-choice items for examinees was assessed using an aptitude-treatment interaction model. Results showed that for low-anxious examinees, generation of an answer before selecting a response led to higher performance, but not for highly anxious examinees. (Author/JAZ)

The purposes of this paper are to analyze some problems in using student test scores to evaluate teachers and to propose an achievement-based model for teacher evaluation that is effective, affordable, fair, legally defensible, and politically acceptable. The system is designed for detecting and documenting poor teacher performance. (Auth/JAZ)