The question of integrating learning content into a serious game is a recurring one, although no clear theoretical framework has yet been provided. It is often argued that integration should occur at the core mechanic level, but this simple statement conceals the complexity of serious game design. The authors therefore propose a theoretical…

Many large-scale assessments model proficiency with a latent regression on contextual variables. Item-response data are used to estimate the parameters of the latent variable model and are used in conjunction with the contextual data to generate plausible values of individuals' proficiency attributes. These models typically incorporate numerous…

Background: Adoption of the Whole School, Whole Community, Whole Child (WSCC) model has been slowed by a lack of available tools to support implementation. The Wellness School Assessment Tool (WellSAT) WSCC is an online assessment tool that allows schools to evaluate the alignment of their policies with the WSCC model. This study assesses the…

Recently, Bayesian diagnostic classification modeling has been becoming popular in health psychology, education, and sociology. Typically information criteria are used for model selection when researchers want to choose the best model among alternative models. In Bayesian estimation, posterior predictive checking is a flexible Bayesian model…

In learnersourcing, automatic evaluation of student-generated content (SGC) is significant as it streamlines the evaluation process, provides timely feedback, and enhances the objectivity of grading, ultimately supporting more effective and efficient learning outcomes. However, the methods of aggregating students' evaluations of SGC face the…

This study conducted a comprehensive comparison of Item Response Theory (IRT) linking methods applied to a bifactor model, examining their performance on both multiple choice (MC) and mixed format tests within the common item nonequivalent group design framework. Four distinct multidimensional IRT linking approaches were explored, consisting of…

Complex Machine Learning (ML) models used to support decision-making in peer-to-peer (P2P) lending often lack clear, accurate, and interpretable explanations. While the game-theoretic concept of Shapley values and its computationally efficient variant Kernel SHAP may be employed for this aim, similarly to other existing methods, the latter makes…

The rapid development of higher education in China has significantly advanced physical education within universities, contributing to students' comprehensive development and national health improvement. However, the expansion of university enrollment has introduced challenges such as a decrease in per capita sports resources and declines in…

This paper begins by establishing the A+ Inquiry model as a theoretical lens for assessing needs related to program assessment workload by demonstrating its alignment with elements of five published frameworks associated with higher education assessment. Then, it uses the model as a frame of reference to explore faculty needs related to program…

A source of contestation in higher education curricula is the multiplicity of demands they serve and purposes they seek to fulfil. In this paper, we see this contestation as actively shaping assessment theory and practice, resulting in paradoxes of valorisation and vilification of everyday assessment practices. We address the plethora of…

False alarming, or detecting an error when there is not one, is a pervasive problem across numerous industries. The present study investigated the role of elaboration, or additional information about non-error differences in complex visual displays, for mitigating false error responding. In Experiment 1, learners studied errors and non-error…

Large language models are increasingly used in educational and psychological measurement activities. Their rapidly evolving sophistication and ability to detect language semantics make them viable tools to supplement subject matter experts and their reviews of large amounts of text statements, such as educational content standards. This paper…

Background and Context: Students' programming projects are often assessed on the basis of their tests as well as their implementations, most commonly using test adequacy criteria like branch coverage, or, in some cases, mutation analysis. As a result, students are implicitly encouraged to use these tools during their development process (i.e., so…

This study focuses on evaluating the quality of competency transfer through various assessment methods and results, considering diverse stakeholder perspectives. The research aims to introduce an innovative approach for validating assessment outcomes, leveraging predicted sub-measurements, and transforming Boolean parameters' symbols into a binary…

Meta-analyses examining dichotomous outcomes often include single-zero studies, where no events occur in intervention or control groups. These pose challenges, and several methods have been proposed to address them. A fixed continuity correction method has been shown to bias estimates, but it is frequently used because sometimes software (e.g.,…