Multimodal learning analysis emphasizes using diverse data from various sources and forms for precise examination of learning patterns. Despite recent rapid advancements in this field, conventional learning analysis remains predominantly cross-sectional and group-focused, which is insufficient for understanding continuous and personalized learning…

In recent years, educators, administrators, policymakers, and measurement experts have called for assessments that support educators in making better instructional decisions. One promising approach to measurement to support instructional decision-making is diagnostic classification models (DCMs). DCMs are flexible psychometric models that…

A source of contestation in higher education curricula is the multiplicity of demands they serve and purposes they seek to fulfil. In this paper, we see this contestation as actively shaping assessment theory and practice, resulting in paradoxes of valorisation and vilification of everyday assessment practices. We address the plethora of…

False alarming, or detecting an error when there is not one, is a pervasive problem across numerous industries. The present study investigated the role of elaboration, or additional information about non-error differences in complex visual displays, for mitigating false error responding. In Experiment 1, learners studied errors and non-error…

Large language models are increasingly used in educational and psychological measurement activities. Their rapidly evolving sophistication and ability to detect language semantics make them viable tools to supplement subject matter experts and their reviews of large amounts of text statements, such as educational content standards. This paper…

Traditional assessment design focuses on outcomes and often disregards how students perceive their abilities, process emotions, or self-express. This indifference can undermine assessment outcomes and evaluation reliability (Hattie, 2023; Nilson, 2023; Reibel 2022). This paper introduces "empathetic assessment design" (EAD), a framework…

Background and Context: Students' programming projects are often assessed on the basis of their tests as well as their implementations, most commonly using test adequacy criteria like branch coverage, or, in some cases, mutation analysis. As a result, students are implicitly encouraged to use these tools during their development process (i.e., so…

This study focuses on evaluating the quality of competency transfer through various assessment methods and results, considering diverse stakeholder perspectives. The research aims to introduce an innovative approach for validating assessment outcomes, leveraging predicted sub-measurements, and transforming Boolean parameters' symbols into a binary…

Meta-analyses examining dichotomous outcomes often include single-zero studies, where no events occur in intervention or control groups. These pose challenges, and several methods have been proposed to address them. A fixed continuity correction method has been shown to bias estimates, but it is frequently used because sometimes software (e.g.,…

The large scale expansion of online courses has led to the crisis of course quality issues. In this study, we first established an evaluation index system for online courses using factor analysis, encompassing three key constructs: course resource construction, course implementation, and teaching effectiveness. Subsequently, we employed factor…

In this study, the accuracy of the artificial neural network (ANN) was assessed considering the uncertainties associated with the randomness of the data and the lack of learning. The Monte-Carlo algorithm was applied to simulate the randomness of the input variables and evaluate the output distribution. It has been shown that under certain…

Current approaches used in educational research and practice to evaluate the quality of written arguments often rely on structural analysis. In such assessments, credit is awarded for the presence of structural elements of an argument, such as claims, evidence, and rebuttals. In this article, we discuss limitations of such approaches, including…

This paper proposes to evaluate learning efficiency by implementing the flipped classroom and automatic source code evaluation based on the Kirkpatrick evaluation model in students of CS1 programming course. The experimentation was conducted with 82 students from two CS1 courses; an experimental group (EG = 56) and a control group (CG = 26). Each…

In this digital ITEMS module, Dr. Stella Kim provides an overview of multidimensional item response theory (MIRT) equating. Traditional unidimensional item response theory (IRT) equating methods impose the sometimes untenable restriction on data that only a single ability is assessed. This module discusses potential sources of multidimensionality…

Example-generation tasks have been suggested as an effective way to both promote students' learning of mathematics and assess students' understanding of concepts. E-assessment offers the potential to use example-generation tasks with large groups of students, but there has been little research on this approach so far. Across two studies, we…