As Information Systems courses have become both more data-focused and student numbers have increased, there has emerged a greater need to assess technical and analytical skills more efficiently and effectively. Multiple-choice examinations provide a means for accomplishing this, though creating effective multiple-choice assessment items within a…

A simulation study was conducted to explore the impact of differential item functioning (DIF) on general factor difference estimation for bifactor, ordinal data. Common analysis misspecifications in which the generated bifactor data with DIF were fitted using models with equality constraints on noninvariant item parameters were compared under data…

The dimensionality is one of the most investigated concepts in the psychological assessment, and there are many ways to determine the dimensionality of a measured construct. The Automated Item Selection Procedure (AISP) and the DETECT are non-parametric methods aiming to determine the factorial structure of a data set. In the current study,…

Differential item functioning (DIF) analysis refers to procedures that evaluate whether an item's characteristic differs for different groups of persons after controlling for overall differences in performance. DIF is routinely evaluated as a screening step to ensure items behavior the same across groups. Currently, the majority DIF studies focus…

Analyzing heterogeneous treatment effects (HTEs) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and preintervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a…

This study presents the development and validation of a novel multiple-choice test designed to assess university students' conceptual understanding of electric field, force, and flux. The test of understanding of electric field, force, and flux was constructed based on the results of previous studies using a phenomenographic approach to classify…

The present study has aimed to develop and validate a protein concept inventory (PCI) consisting of 25 multiple-choice (MC) questions to assess students' understanding of protein, which is a fundamental concept across different biology disciplines. The development process of the PCI involved a literature review to identify protein-related content,…

Metacognition is one of the key learning skills in the 21st century, with a strong potential to help students succeed in science learning. Until now, this metacognitive awareness is less empowered by lecturers in learning. This study aimed to analyze the problem-based learning (PBL) reading-questioning-answering (PBLRQA) model's effect on…

The Big Three Perfectionism Scale (BTPS) was created to integrate different aspects of perfectionism, including the newly conceptualized concept of narcissistic perfectionism. The goal of our two studies (N = 1341) was to examine the psychometric properties of the Polish adaptation of the BTPS, supporting the validity and portability of the…

One of the goals of the educational system is to promote the well-being of students due to its associated on their academic performance. This research aims to shed light on the main role of well-being variables (introduced by PISA 2018 for the first time, as far as our knowledge) in the mathematical competence throughout of the PISA 2018…

The purpose of the present study is to analyze the digital competence of Higher Education students, as a function of their academic performance (have either repeated or a not previously), as well as to predict its significant predictors. For this, an ex-post factor and a sample of 17301 students from Chile (Latin America) were utilized. A…

This study has three main objectives. The first is to know to which degree engagement, as a person variable, and each of its modalities--agency, behavior, cognition, and emotion--are affected by the interaction with several learning situations, listening to a lecture, carrying out practical tasks alone, reading a text while studying, working in…

There has been increasing interest in applying integrative data analysis (IDA) to analyze data across multiple studies to increase sample size and statistical power. Measures of a construct are frequently not consistent across studies. This article provides a tutorial on the complex decisions that occur when conducting harmonization of measures…

Girls, more than boys, experience a decrease in the severity of autism symptoms during childhood. It is unclear, however, which specific autistic behaviors change more for girls than for boys. Trajectories of autism symptoms were evaluated using the Autism Diagnostic Observation Schedule-calibrated severity scores (ADOS-CSS). Change in the…