Investigators often rely on the proportion of correct responses in an assessment when describing the impact of early mathematics interventions on child outcomes. Here, we propose a shift in focus to the relative sophistication of problem-solving strategies and offer methodological guidance to researchers interested in working with strategies. We…

Background: Competency models provide useful frameworks for organizing learning and assessment programs, but their construction is both time intensive and subject to perceptual biases. Some aspects of model development may be particularly well-suited to automation, specifically natural language processing (NLP), which could also help make them…

Across the Higher Education sector, there is growing interest regarding the 'value for money' of a university education, and in response to this, universities may need to consider how to evaluate the perceived learning of students alongside their actual learning. "Learning Gain" maybe helpful in this regard, but there is currently no…

Open-ended questions in mathematics are commonly used by teachers to monitor and assess students' deeper conceptual understanding of content. Student answers to these types of questions often exhibit a combination of language, drawn diagrams and tables, and mathematical formulas and expressions that supply teachers with insight into the processes…

In this paper we provide a description of the project DrIVE-MATH, highlighting the main goals, intellectual outputs, outcomes, the involved partners, and activities and reports from the three-years' project. At the end we discuss the impact of the new proposed Education models at various levels, from students, to HEIs, to stakeholders.

New knowledge tracing models are continuously being proposed, even at a pace where state-of-the-art models cannot be compared with each other at the time of publication. This leads to a situation where ranking models is hard, and the underlying reasons of the models' performance -- be it architectural choices, hyperparameter tuning, performance…

This article describes and justifies a reporting standard to improve data use documentation in Agent-Based Modelling. Following the development of reporting standards for models themselves, empirical modelling has now developed to the point where these standards need to take equally effective account of data use (which previously has tended to be…

Differential item functioning (DIF) analysis refers to procedures that evaluate whether an item's characteristic differs for different groups of persons after controlling for overall differences in performance. DIF is routinely evaluated as a screening step to ensure items behavior the same across groups. Currently, the majority DIF studies focus…

This QUAL-quant study explores the school experience of nine teachers and three principals in three northern New England elementary schools, each with a strong professional learning community (PLC) model in place. The study used reflexive thematic analysis (Braun & Clarke, 2021), to collect and analyze the qualitative data. The Professional…

One of the most widely used communication tools in evaluation is the logic model. Despite its extensive use, there has been little research into the visualization aspect of the logic model. To assess the impact that design modifications would have on its effectiveness, we applied established visualization principles to revise a program model.…

Scholars have lamented that current methods of assessing student performance do not align with contemporary views of learning as situated within students, contexts, and time. Here, we introduce and describe one theoretical--psychometric paradigm--termed "dynamic measurement"--designed to provide a valid representation of the way students…

Context modeling is the keystone to enable the intelligent system to adapt its functionalities properly to different situations. As such, a representation mechanism that allows an adequate manipulation of this kind of information is required, and diverse approaches have been introduced; however, what takes more value and is being positioned as a…

There is increased use of Bayesian networks (BN) in educational assessment. In psychometrics, BN serves as a measurement model with high flexibility, suitable to model educational assessment data with a complex structure. BN is a novel psychometric approach and not all aspects of its application are well-known. The article aims to provide the…

Peer assessment has been widely applied across diverse academic fields over the last few decades, and has demonstrated its effectiveness. However, the advantages of peer assessment can only be achieved with high-quality peer reviews. Previous studies have found that high-quality review comments usually comprise several features (e.g., contain…

The evidence continuum is a five-domain model for building evidence through needs assessment, program theory, process evaluation, outcomes and impact evaluation, and optimization studies. In this conceptual article, the first two domains of the evidence continuum are used to design a learner centered course on advanced research methods, and…