As Rupp and Templin (2008) stated directly, diagnostic classification methods "are confirmatory in nature." Methods, though, are neither inherently confirmatory nor exploratory. Diagnostic classification modeling, with its analytical and computational obstacles eventually yielding as a comprehensive and potent discipline emerges, will…

We are pleased that our article prompted this series of four commentaries and that we have this opportunity to respond. We address each in turn. Duckworth and Kaufman and Agars discussed, respectively, two broad issues concerning the validity of selection systems, namely, the expansion of the predictor domain to include noncognitive predictors of…

This article investigates several questions regarding the impact of different item formats on measurement characteristics. Constructed response (CR) items and multiple choice (MC) items obviously differ in their formats and in the resources needed to score them. As such, they have been the subject of considerable discussion regarding the impact of…

This paper first presents an overview of the concepts of assessment and evaluation in Open and Distance Learning (ODL) environment. The large numbers of students and numerous courses make assessment and evaluation very difficult and administrative nightmare at Distance Learning (DL) institutions. These challenges informed exploring issues relating…

This paper reports on research that suggests a new view of assessment of the practicum in teacher education. By transcending the stereotypes of "failing" student teachers who do not achieve traditional benchmarks, this new lens highlights the complexity, diversity and inequality of experiences through listening to the voices of the…

The main purpose of this research is to examine the effectiveness of Student Evaluation of Teaching (SET) from a sample of university teachers' and students' view. The study adopts exploratory descriptive design. Participants of this research were 300 teachers and 600 graduate students from 3 Iranian higher education institutions. A 30-item format…

Grade inflation is among the oldest and thorniest problems in higher education. In 1894 a committee at Harvard University reported that A's and B's were awarded "too readily." But after more than a century of fulmination, there is little agreement on the cause or how to fix it. There is even contentious debate about whether the phenomenon of grade…

The assessment procedures within Response to Intervention (RTI) models have begun to supplant the use of traditional, discrepancy-based frameworks for identifying students with specific learning disabilities (SLD). Many RTI proponents applaud this shift because of perceived shortcomings in utilizing discrepancy as an indicator of SLD. However,…

This article examines the state of assessment in simulation and gaming over the past 40 years. While assessment has come slowly to many disciplines, members of the simulation and gaming community have been assessing the educational effectiveness of their experiential activities for years, in part because of skepticism from more traditional…

The paper by Rupp and Templin (2008) is an excellent work on the characteristics and features of cognitive diagnostic models (CDM). In this article, the authors comment on some substantial and methodological aspects of this focus paper. They organize their comments by going through issues associated with the terms "cognitive,"…

Item response theory was used to address gender bias in interest measurement. Differential item functioning (DIF) technique, SIBTEST and DIMTEST for dimensionality, were applied to the items of the six General Occupational Theme (GOT) and 25 Basic Interest (BI) scales in the Strong Interest Inventory. A sample of 1860 women and 1105 men was used.…

The purpose of this study was to examine the relationship between the size of high schools, their percentage of SED (socio-economic disadvantaged) students, and API (academic performance index) scores in California, and determine if teacher preparation is a contributing factor. The 2010 API scores and median income of all 52 counties, and the 2010…

Statewide exit examinations play an important role in discussions on school effectiveness. Referring to educational governance concepts, this paper presumes a relation between varying organizational structures of statewide examinations across states, and heterogeneous effects on school actors. It is assumed that their ability to affect work in…

Recently, educational researchers and practitioners have turned to value-added models to evaluate teacher performance. Although value-added estimates depend on the assessment used to measure student achievement, the importance of outcome selection has received scant attention in the literature. Using data from a large, urban school district, I…

New testing theories, concepts, and psychometric methods (e.g., item response theory, test equating, and item bank) developed during the past several decades have many advantages over previous theories and methods. In spite of their introduction to the field, they have not been fully accepted by physical educators. Further, the manner in which…