The present study evaluated the validity of the Online Learner Satisfaction Instrument (OLSI) in terms of construct and convergent validity, and measurement invariance across demographic groups. The study results revealed that the factor structures generally confirmed to the original factor structure proposed in the instrument. Also, some…

Background: Meta-analyses of educational interventions have consistently documented the importance of methodological factors related to the choice of outcome measures. In particular, when interventions are evaluated using measures developed by researchers involved with the intervention or its evaluation, the effect sizes tend to be larger than…

The purpose of this synthesis study was to assess the reliability and validity of the Draw-A-Scientist Test (DAST) and its variations across multiple studies, aiming to understand limitations and propose modifications for future application within and beyond the science domain. Given the existence of multiple DAST versions, this study quantified…

Purpose: Since the onset of the COVID-19 pandemic in China, student engagement in online learning has been a critical issue for all educational institutions. The university student engagement inventory (USEI) is the most used scale for assessing the construct of student engagement. The present study aimed to evaluate the psychometric properties of…

Recently, psychometricians and researchers have voiced their concern over the exploration of language test items in light of Messick's validation framework. Validity has been central to test development and use; however, it has not received due attention in language tests having grave consequences for test takers. The present study sought to…

Most research on the course experience questionnaire (CEQ) has been conducted through conventional exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) within the independent cluster model framework (ICM-CFA). However, very few studies have focused on examining its multidimensionality using more flexible psychometric frameworks…

In this digital age, digital multimodal composing (DMC) has permeated the L2 classroom as a technology-enhanced L2 writing task. Despite the learning potential of DMC for L2 students, instruments that measure L2 students' DMC competence are rare. As such, the present study sought to develop and validate an L2 student DMC competence scale in the…

As artificial intelligence (AI) receives wider attention in education, examining teachers' acceptance of AI (TAAI) becomes essential. However, existing instruments measuring TAAI reported limited validity evidence and faced some design challenges, such as missing informed definitions of AI to participants. To fill this gap, this study developed…

Learning approaches are assumed as the utmost important aspect in all academic proceedings. With the identification of students' learning approaches, relevant institutes can devise appropriate instructional strategies. Many models have been used to explore learning approaches and styles among students, but mostly in the developed world. Literature…

Research on growth mindset shows a positive trend in the recent years. The importance of the growth mindset for students is growing to be a center in education, but the valid scale to assess the variable in Indonesia is still limited. The study aims to measure the validity and reliability of the adaptation mindset scale in the Indonesian context.…

We present a validation study of fifteen new math anxiety scale items designed to augment the widely-used Revised Mathematics Anxiety Scale (RMARS). While the RMARS and other standard instruments measure students' anxiety in response to computation, test situations, and math course activities such as buying a textbook or watching a lecture, the…

The Pearson Test of English Academic (PTE-A), a widely used high-stakes language proficiency test for university admissions and migration purposes, underwent a notable change from a three-hour to a two-hour version in November 2021. The implementation of the new version has prompted inquiries into the washback effects on various stakeholders.…

Generative artificial intelligence (GenAI) has profoundly reshaped how graduate students conceptualise, design and conduct academic research in higher education. While current metrics predominantly focus on technology acceptance and usage patterns, they often neglect the diverse cognitive engagements in graduate students' integration of GenAI…

With recent technological advances, researchers have begun to explore the potential use of spoken dialog systems (SDSs) for L2 oral communication assessment. While several studies support the feasibility of building these systems for various types of oral tasks, research on the construct validity of SDS-delivered tasks is still limited. Thus, this…

The purpose of this study was to establish construct validity of a college and career readiness measure using a sample of youth with (n = 356) and without (n = 1,599) disabilities from five high schools across three U.S. states. We established content validity through expert item review, structural validity through initial field-testing, and…