The Gates-MacGinitie Reading Comprehension Test, fourth edition (GMRT-4) and the ACT Reading Tests (ACT-R) were administered to 423 high school students in order to explore the similarities and dissimilarities of data produced through classical test theory (CTT) and item response theory (IRT) analysis. Despite the many advantages of IRT…

This study compares two methods of defining groups for the detection of differential item functioning (DIF): (a) pairwise comparisons and (b) composite group comparisons. We aim to emphasize and empirically support the notion that the choice of pairwise versus composite group definitions in DIF is a reflection of how one defines fairness in DIF…

In preparation for online administration of the ACT® test, ACT conducted studies to examine the comparability of scores between online and paper administrations, including a timing study in fall 2013, a mode comparability study in spring 2014, and a second mode comparability study in spring 2015. This report presents major findings from these…

Professional standards for educational testing recommend that both the overall standard error of measurement and the conditional standard error of measurement (CSEM) be computed on the score scale used to report scores to examinees. Several methods have been developed to compute scale score CSEMs. This paper compares three methods, based on…

Various applications of item response theory often require linking to achieve a common scale for item parameter estimates obtained from different groups. This article used a simulation to examine the relative performance of four different item response theory (IRT) linking procedures in a random groups equating design: concurrent calibration with…

Presented at the national conference for AERA (American Educational Research Association) in April 2009. The large variability of SAT taker population across states makes state-by-state comparisons of the SAT scores challenging. Using a mixture modeling approach, therefore, the current study presents a method of identifying subpopulations in terms…

The benefits of item response theory (IRT) will only accrue to a testing program to the extent that model assumptions are met. Obtaining accurate item parameter estimates is a critical first step. However, the sample sizes required for stable parameter estimation are often difficult to obtain in practice, particularly for the more complex models.…

ACT college test publisher provided scores. On average, non-homeschoolers performed better than homeschoolers, by about two items, out of sixty items, on the ACT mathematics test that was analyzed. This result may be due to the different teaching/learning media used in teaching each of the two groups, to different teacher/student interaction, or…

The State of Florida Department of Education provides pre-and-post-graduation data for public high school graduates throughout Florida. These data were used for the present report to produce data sets for all M-DCPS regular high schools and charter high schools graduating students in 2009 and 2010. Summary data for the district are also provided.…

The State of Florida Department of Education provides pre-and-post-graduation data for public high school graduates throughout Florida. These data were used for the present report to produce data sets for all M-DCPS regular high schools and charter high schools graduating students in 2008 and 2009. Summary data for the district are also provided.…

The State of Florida Department of Education provides pre-and-post-graduation data for public high school graduates throughout Florida. These data were used for the present report to produce data sets for all M-DCPS regular high schools and charter high schools graduating students in 2007 and 2008. Summary data for the district are also provided.…

The "High School Feedback Report" prepared by the State of Florida's Department of Education provides pre-and-post-graduation data for public high school graduates throughout Florida. These data were used for the present report which contains individual data reports for all M-DCPS regular high schools and charter high schools graduating…

The "High School Feedback Report" prepared by the State of Florida's Department of Education provides pre-and-post-graduation data for public high school graduates throughout Florida. These data were used for this present report which contains individual data reports for all M-DCPS regular high schools and charter high schools graduating…