Educational research outcomes frequently rely on an assumption that measurement metrics have interval-level properties. While most investigators know enough to be suspicious of interval-level claims, and in some cases even question their findings given such doubts, there is a lack of understanding regarding the measurement conditions that create…

Agent-based models (ABMs) often rely on psychometric constructs such as 'opinions', 'stubbornness', 'happiness', etc. The measurement process for these constructs is quite different from the one used in physics as there is no standardized unit of measurement for opinion or happiness. Consequently, measurements are usually affected by 'psychometric…

In massive open online course (MOOC) environments, computer-based analysis of course reviews enables instructors and course designers to develop intervention strategies and improve instruction to support learners' learning. This study aimed to automatically and effectively identify learners' concerned topics within their written reviews. First, we…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

Traditionally, students' various educational characteristics are evaluated according to the grades they get or the results of their answers to the scales. There are some limitations in making an evaluation based on the results. The fuzzy logic approach, which tries to eliminate these limitations, has recently been used in the field of education.…

The Engagement Model was launched in January 2020, endeavouring to address the weaknesses of the P-scales assessment for students not yet involved in a subject-specific curriculum. This paper will discuss how and if the tensions between previously adopted assessment systems as discussed in teacher interviews can be reconciled through the…

Missing data are exceedingly common across a variety of disciplines, such as educational, social, and behavioral science areas. Missing not at random (MNAR) mechanism where missingness is related to unobserved data is widespread in real data and has detrimental consequence. However, the existing MNAR-based methods have potential problems such as…

Investigators often rely on the proportion of correct responses in an assessment when describing the impact of early mathematics interventions on child outcomes. Here, we propose a shift in focus to the relative sophistication of problem-solving strategies and offer methodological guidance to researchers interested in working with strategies. We…

There is increased use of Bayesian networks (BN) in educational assessment. In psychometrics, BN serves as a measurement model with high flexibility, suitable to model educational assessment data with a complex structure. BN is a novel psychometric approach and not all aspects of its application are well-known. The article aims to provide the…

The recent integration of visual capabilities into Large Language Models (LLMs) has the potential to play a pivotal role in science and technology education, where visual elements such as diagrams, charts, and tables are commonly used to improve the learning experience. This study investigates the performance of ChatGPT-4 Vision, OpenAI's most…

With problem-solving as the focus and wisdom as the goal, the concept of giftedness is reconceptualized in the 21st century context. The two most prominent constructs in the field of education for the gifted, creativity and intelligence, are integrated into a view of exceptional talent as consisting of the ability and willingness to solve complex…

Aim/Purpose: The purpose of this paper is to develop and evaluate a debiasing-based approach to assessing the learning materials in problem-based learning (PBL) environments. Background: Research in cognitive debiasing suggests nine debiasing strategies improve decision-making. Given the large number of decisions made in semester-long,…

Problem solving plays an essential role in all scientific disciplines, and solving problems can reveal essential concepts that underlie those disciplines. Thus, problem solving serves both as a common tool and desired outcome in many science classes. Research on teaching problem solving offers principles for instruction that are guided by learning…

The use of learner modelling approaches is critical for providing adaptive support in educational computer games, with predictive learner modelling being among the key approaches. While adaptive supports have been shown to improve the effectiveness of educational games, improperly customized support can have negative effects on learning outcomes.…