We developed and provided initial validation for a 15-item scale for use with academics. In Phase 1, we utilized a review of the literature, focus groups, and expert feedback to generate 36 items. In Phase 2, we conducted item and exploratory factor analyses to reduce the number of items and assess the factor structure (N = 212; 51.4% female; mean…

This study introduces a new chi-square test statistic for testing the equality of response frequencies among distracters in multiple-choice tests. The formula uses the information from the number of correct answers and wrong answers, which becomes the basis of calculating the expected values of response frequencies per distracter. The method was…

When a researcher proposes an SEM model to explain the dynamics among some latent variables, the real question in model evaluation is the fit of the model's structural part. A composite index that lumps the fit of the structural part and measurement part does not directly address that question. The need for more attention to structural-level fit…

Frailty is a health concern for many adults with intellectual disability and should be measured to detect at-risk conditions, monitor disease, plan treatment, and gauge mortality. This descriptive pilot study evaluated measurement consistency (inter-rater agreement) of the Intellectual Disability-Frailty Index Short Form among multiple assessors…

Effective teacher listening is critical in establishing a culturally responsive and equitable learning environment for all students. Teacher listening orientations are ways in which teachers are situated to listen to students. Measurements of their orientations during classroom discourse is an important yet under-researched tool for enhancing both…

I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

Purpose: This article describes the development and validation of a survey designed to measure the vision of European agricultural advisors towards innovation. Design/Methodology/Approach: The items of the instrument were developed based on the conceptual framework provided by the position paper for the Transformative Innovation Policy Consortium.…

The home environment is a significant factor that greatly influences the motor development of children. This study aims to examine the cultural adaptation validity and reliability of the Affordances in the Home Environment for Motor Development (AHEMD-SR) for Turkish children aged 18--42 months. The study included 103 Turkish children (mean age =…

Dynamic assessments (DAs) of word reading skills demonstrate strong criterion reference validity with word reading measures (WRMs). However, DAs vary in the skills they assess, their format and administration method, and the type of words and symbols used in test items. These characteristics may have implications on assessment validity. To compare…

The main aim of our study was to adapt the Questionnaire on Teacher Interaction (QTI) to an Estonian context. The QTI was translated and evaluated by three educational researchers and validated with a sample of 508 students from grades 6 and 9 in 13 middle schools. When statistical analyses were utilized to investigate reliability and validity of…

Given the lack of cultural consideration of studies on digital natives, this study reports on a large-scale validation of the Digital Native Assessment Scale (DNAS) among university students from three regions of Greater China: Chinese mainland, Macau, and Taiwan, to examine measurement invariance and latent mean differences in the four constructs…

Universal screening to predict students' risk for reading problems is a foundational component of the Multi-Tiered Systems of Support framework and is required by law in many US states. School or district administrators are tasked with selecting screening assessments that are both technically adequate and feasible given the resources of their…

Despite agreement about the central importance of validity for educational and psychological testing, consensus regarding the definition of validity remains elusive. Differences in the definition of validity are examined and reveals that a potential cause of disagreement stems from differences in word use and meanings given to key terms commonly…

This module is designed for educators, educational researchers, and psychometricians who would like to develop an understanding of the basic concepts of validity theory, test validation, and documenting a "validity argument." It also describes how an in-depth understanding of the purposes and uses of educational tests sets the foundation…

Background: For peer assessment, reliability (i.e., consistency in ratings across peers) and validity (i.e., consistency of peer ratings with instructors or experts) are frequently examined in the research literature to address a central concern of instructors and students. Although the average levels are generally promising, both reliability and…