Multidimensional achievement tests are recently gaining more importance in educational and psychological measurements. For example, multidimensional diagnostic tests can help students to determine which particular domain of knowledge they need to improve for better performance. To estimate the characteristics of candidate items (calibration) for…

Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional…

The aim of the study is to examine the effect of polytomous item ratio on ability estimation in different conditions in multistage tests (MST) using mixed tests. The study is simulation-based research. In the PISA 2018 application, the ability parameters of the individuals and the item pool were created by using the item parameters estimated from…

There is ongoing debate regarding what performance on the number line estimation task represents and its role in mathematics learning. The patterns followed by children's estimates on the number line task could provide insight into this. This study investigates children's estimation patterns on the number line task and assesses whether mathematics…

Correct specifications of hierarchical attribute structures in analyses using diagnostic classification models (DCMs) are pivotal because misspecifications can lead to biased parameter estimations and inaccurate classification profiles. This research is aimed to demonstrate DCM analyses with various hierarchical attribute structures via Bayesian…

As low-stakes testing contexts increase, low test-taking effort may serve as a serious validity threat. One common solution to this problem is to identify noneffortful responses and treat them as missing during parameter estimation via the effort-moderated item response theory (EM-IRT) model. Although this model has been shown to outperform…

The Mantel-Haenszel estimator is one of the most popular techniques for measuring differential item functioning (DIF). A generalization of this estimator is applied to the context of DIF to compare items by taking the covariance of odds ratio estimators between dependent items into account. Unlike the Item Response Theory, the method does not rely…

In this new era, computational thinking is becoming increasingly intriguing for indepth study. The 2022 PISA framework illustrates that computational thinking can play a significant role in solving real-world mathematical problems, both in formulating problems and in mathematical reasoning processes. Many countries have integrated computational…

The introduction of computing education into curricula worldwide requires multi-year assessments to evaluate the long-term impact on learning. However, no single Computational Thinking (CT) assessment spans primary school, and no group of CT assessments provides a means of transitioning between instruments. This study therefore investigated…

This paper extends existing work on teacher weighting in student-centered surveys by looking into aspects of practical implementation of deriving and using weights for teacher-centered analysis in the Trends in International Mathematics and Science Study (TIMSS) and the Progress in International Reading Literacy Study (PIRLS). The formal…

In the target article, Xing and colleagues (2021) claimed that 6- to 8-year-olds who spontaneously referenced the midpoint of 0-100 number lines made more accurate magnitude estimates and scored higher on a standardized math achievement test than other children. Unlike previous studies, however, the authors found no relation between accuracy on…

In this investigation, the extent to which differences were present in the mathematics achievement by the ethnicity/race of Grade 3 students in Texas were analyzed. Data obtained from the Texas Education Agency Public Education Information Management System for all Texas Grade 3 students who took the State of Texas Assessment of Academic Readiness…

I investigated the relationships between mathematics achievement on the Iowa Assessments and the mastery of four epistemic actions: selecting, analyzing, computing, and representing. These epistemic actions play a crucial role in characterizing mathematical reasoning and are essential for solving mathematics problems in the Iowa Assessments across…

This article describes an extension to the use of heteroskedastic ordered probit (HETOP) models to estimate latent distributional parameters from grouped, ordered-categorical data by pooling across multiple waves of data. We illustrate the method with aggregate proficiency data reporting the number of students in schools or districts scoring in…

With the growing attention on large-scale educational testing and assessment, the ability to process substantial volumes of response data becomes crucial. Current estimation methods within item response theory (IRT), despite their high precision, often pose considerable computational burdens with large-scale data, leading to reduced computational…