This study explores classification consistency and accuracy for mixed-format tests using real and simulated data. In particular, the current study compares six methods of estimating classification consistency and accuracy for seven mixed-format tests. The relative performance of the estimation methods is evaluated using simulated data. Study…

We examined whether students were accurate in predicting their test performance in both low-stakes and high-stakes testing contexts. The sample comprised U.S. high school students enrolled in an advanced placement (AP) statistics course during the 2017-2018 academic year (N = 209; M[subscript age] = 16.6 years). We found that even two months…

Whereas the importance of authenticity in relation to educational contexts has been highlighted, educational authenticity (EA) has mainly referred to a real-life/world convergence or the notion of teacher authenticity, implying that authenticity can be taught and learnt. This view, however, has largely overlooked philosophical considerations so…

This Research Brief summarizes the performance of Miami-Dade County Public Schools (MDCPS) students participating in the International Baccalaureate (IB) program. The IB program was offered at six M-DCPS high schools in 2019-2020. Over 2,900 assessments were completed by M-DCPS students in 28 subject areas in 2019-2020. The number of IB…

We examined whether students were accurate in predicting their test performance two testing contexts (low-stakes and high-stakes). The sample comprised U.S. high school students enrolled in an advanced placement (AP) statistics course during the 2017-2018 academic year (N=209; M[subscript age]=16.6 years). We found that even two months before…

Component Universe Score Profile analysis (CUSP) is introduced in this paper as a psychometric alternative to multivariate profile analysis. The theoretical foundations of CUSP analysis are reviewed, which include multivariate generalizability theory and constrained principal components analysis. Because CUSP is a combination of generalizability…

Broward County Public Schools' Research Services department uses logistic regression analysis to compute an indicator to predict student enrollment in advanced high school courses, for students entering ninth grade for the first time. This prediction indicator, along with other student characteristics, supports high school guidance staffs in…

In this study, we investigated a variety of Reader effects that may influence the validity of ratings assigned to AP® English Literature and Composition essays. Specifically, we investigated whether Readers exhibit changes in their levels of severity and accuracy, and their use of individual scale categories over time. We refer to changes in these…