The United Kingdom's (UK's) Research Excellence Framework of 2014 was an expensive high stakes evaluation which had a range of impacts on higher education institutions across the country. One component was an assessment of the quality of research outputs where a major feature was a series of panels organised to read and rate the outputs of their…

We trace the development and analyze the generalizability of the Classroom Assessment of Sociocultural Interactions (CASI), an observation system designed to measure cultural dimensions of classroom interactions. We establish CASI measurement properties by analyzing panoramic videos of 4th and 5th grade classrooms from the Measures of Effective…

The aim of this study is to investigate the measurement invariance of PISA 2012 mathematical literacy among the OECD member countries, and gender and region groups in Turkey. Among cognitive test booklets implemented in PISA 2012, booklet 8 which was used commonly by all countries was selected for this correlational survey study. The study was…

In generalizability theory studies in large-scale testing contexts, sometimes a facet is very sparsely crossed with the object of measurement. For example, when assessments are scored by human raters, it may not be practical to have every rater score all students. Sometimes the scoring is systematically designed such that the raters are…

Traditional parallel analysis (T-PA) estimates the number of factors by sequentially comparing sample eigenvalues with eigenvalues for randomly generated data. Revised parallel analysis (R-PA) sequentially compares the "k"th eigenvalue for sample data to the "k"th eigenvalue for generated data sets, conditioned on"k"-…

Over the past decade, states and districts have updated teacher evaluation systems in response to federal incentives, such as waivers to No Child Left Behind and grants from Race to the Top. The use of multiple measures, however, raises an important issue for policymakers and practitioners: to what extent should different measures of a teacher's…

Classroom engagement is important to young children's academic and social development. Accurate methods of capturing this behavior are needed to inform and evaluate intervention efforts. This study compared the accuracy of interval durations (i.e., 5 s, 10 s, 15 s, 20 s, 30 s, and 60 s) of momentary time sampling (MTS) in approximating the…

The Gates-MacGinitie Reading Comprehension Test, fourth edition (GMRT-4) and the ACT Reading Tests (ACT-R) were administered to 423 high school students in order to explore the similarities and dissimilarities of data produced through classical test theory (CTT) and item response theory (IRT) analysis. Despite the many advantages of IRT…

Sparse-rated data are common in operational performance-based language tests, as an inevitable result of assigning examinee responses to a fraction of available raters. The current study investigates the precision of two generalizability-theory methods (i.e., the rating method and the subdividing method) specifically designed to accommodate the…

The purpose of the present study is to apply the item response theory (IRT) and testlet response theory (TRT) models to a reading comprehension test. This study applied the TRT models and the traditional IRT model to a seventh-grade reading comprehension test (n = 8,815) with eight testlets. These three models were compared to determine the best…

IPEDS graduation rates have become de facto means for higher education accountability in the United States, used by the federal government, state and local agencies, non-profits and media to compare and rank institutions. IPEDS uses a limited subset of students, as well as an institutional perspective to measure graduation rate. Under this model,…

Item response theory (IRT) has so many advantages than its precedent Classical Test Theory (CTT) such as non-changing item parameters, ability parameter estimations free from the items. However, in order to get these advantages, some assumptions should be met and they are; unidimensionality, normality and local independence. However, it is not…

The Reynolds Intellectual Assessment Scales (RIAS) measures general intelligence and its two main components, verbal and nonverbal intelligence, each comprising of two subtests. The RIAS has been recently standardized in Denmark, Germany, Switzerland, and Spain. Using the standardization samples of the U.S. (n = 2,438), Danish (n = 983), German (n…

This study was carried out to investigate the discrepancies that international students' geographical region could create on the relationships of adjustment attitude, attachment attitude, and intention after graduation with psychological and sociocultural adaptations. As such, multi-group analysis was performed using partial least squares…

In this study, the effect of mathematics teacher candidates' locus of control on math anxiety was tested, along with the effects of gender, achievement and class level moderators. The study was carried out according to a causal design in which locus of control was taken as an independent variable, while math anxiety was taken as the dependent…