Correct specifications of hierarchical attribute structures in analyses using diagnostic classification models (DCMs) are pivotal because misspecifications can lead to biased parameter estimations and inaccurate classification profiles. This research is aimed to demonstrate DCM analyses with various hierarchical attribute structures via Bayesian…

Assessing achievement is a complex task due to its dependence on multiple factors and the hierarchical structure of educational data, yet surveys like TIMSS offer valuable insights into its determining factors like students' mathematics anxiety. However, disregarding the nested structure of data and ignoring the assumptions of models causes poor…

A psychological framework for different types of items commonly used with mixed-format exams is proposed. A choice model based on signal detection theory (SDT) is used for multiple-choice (MC) items, whereas an item response theory (IRT) model is used for open-ended (OE) items. The SDT and IRT models are shown to share a common conceptualization…

Algebraic Thinking Skills (ATS) are one of the skills that students need to master in order to solve nonroutine problems. These skills are also necessary as a foundation for students preparing to enter university studies and fields of work that require logical and analytical thinking. However, Malaysian students' performance in solving algebraic…

In this article, we extend Liao's test for across-group comparisons of the fixed effects from the generalized linear model to the fixed and random effects of the generalized linear mixed model (GLMM). Using as our basis the Wald statistic, we developed an asymptotic test statistic for across-group comparisons of these effects. The test can be…

This article presents a latent class model for multilevel data to identify latent subgroups and estimate heterogeneous treatment effects. Unlike sequential approaches that partition data first and then estimate average treatment effects (ATEs) within classes, we employ a Bayesian procedure to jointly estimate mixing probability, selection, and…

Science academic achievement is a key construct for examining students' science learning outcomes. While international comparative assessments like TIMSS and PISA have shown high science achievement of Korean middle school students, there is a lack of comprehensive investigation of factors influencing the achievement using domestic data.…

Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…

In educational and psychological research, it is common to use latent factors to represent constructs and then to examine covariate effects on these latent factors. Using empirical data, this study applied three approaches to covariate effects on latent factors: the multiple-indicator multiple-cause (MIMIC) approach, multiple group confirmatory…

Understanding whether or not different types of students master various attributes can aid future learning remediation. In this study, two-level diagnostic classification models (DCMs) were developed to represent the probabilistic relationship between external latent classes and attribute mastery patterns. Furthermore, variational Bayesian (VB)…

Multidimensional item response theory (MIRT) models have generated increasing interest in the psychometrics literature. Efficient approaches for estimating MIRT models with dichotomous responses have been developed, but constructing an equally efficient and robust algorithm for polytomous models has received limited attention. To address this gap,…

Modelling ability is one of the essential elements of the latest educational reforms, and Trends in International Mathematics and Science Study (TIMSS) is a curriculum-based assessment which allows educational systems worldwide to inspect the curricular influences. The aims of this study were to examine the role of modelling ability in the…

The purpose of the study is to analyze the affective traits that affect mathematics achievement through Structural Equation Modeling (SEM) as a traditional regression model and Multivariate Adaptive Regression Splines (MARS), as one of the data mining methods. Structural Equation Modeling, one of the regression-based methods, is quite popular for…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

Recognizing the limitations of the existing frameworks and models applied to estimate the learning loss caused by COVID-19 across the world by different studies, and the urgent need for estimating such loss at the different education levels, this paper, employs the Education Value Chain Analysis ( EVCA) approach as a new paradigm, attempts to…