I consider recent attempts to establish standards, principles, and goals for artificial intelligence (AI) through the lens of educational measurement. Distinctions are made between generative AI and AI-adjacent methods and applications of AI in formative versus summative assessment contexts. While expressing optimism about its possibilities, I…

As technology becomes a more central support for students with disabilities in inclusive schools, there is a need to understand fidelity of implementation of technology-delivered interventions. We propose a framework for conceptualizing fidelity of the Goal Setting Challenge App, a technology-delivered, intervention based on the Self-Determined…

This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

Unlike other aspects of Obstetrics and Gynecology (OBGYN) residency training, the research education curriculum and requirements are not standardized. It is unclear what constitutes core curricula in educational research programs, which components are most useful and efficacious, and how to use these findings to adapt existing programs. A…

There is continuing demand from practitioners, standard setters, and regulators for accountants to have the knowledge and competencies to contribute to sustainable business practices, reporting, and assurance. Educators at all levels of the accounting curricula have a responsibility to upskill. This research examines the extent of sustainability…

Effective communication skills are pivotal in health care, particularly when conveying distressing information to patients and their families. However, medical education still lacks the adoption of a universal model that can be incorporated into the curricula to train and assess students in effectively communicating with patients. This study aims…

The subjective aspect of standard-setting is often criticized, yet data-driven standard-setting methods are rarely applied. Therefore, we applied a mixture Rasch model approach to setting performance standards across several testing programs of various sizes and compared the results to existing passing standards derived from traditional…

Performance standards have important consequences for all the stakeholders in the assessment of L2 academic writing. These standards not only describe the level of writing performance but also provide a basis for making evaluative decisions on the academic writing. Such a high-stakes role of the performance standards requires the enhancement of…

Despite the popularity of traditional fit index cutoffs like RMSEA [less than or equal to] 0.06 and CFI [greater than or equal to] 0.95, several studies have noted issues with overgeneralizing traditional cutoffs. Computational methods have been proposed to avoid overgeneralization by deriving cutoffs specifically tailored to the characteristics…

With student and staff wellbeing a growing concern, several authors have asked whether existing data might help institutions provide better support. By analogy with the established field of Learning Analytics, this might involve identifying causes of stress, improving access to information for those who need it, suggesting options, providing rapid…

The indefinite nature of test fairness and different interpretations and definitions of the concept have stirred a lot of controversy over the years, necessitating the reconceptualization of the concept. On this basis, this study aimed to explore the empirical validity of Kunnan's (2008) Test Fairness Framework (TFF) and revisit the established…

Purpose: This paper seeks to illustrate how interventionist education reforms shape dis/trust-building processes and their impact on teacher professionalism in vocational education and training (VET) across national contexts. Using trust as the object of analysis, we discuss the affective mechanisms of becoming a professional in a standards-based…

This study used the standard setting to establish cutscores for the fidelity of implementation of an evidence-based intervention, the Self-Determined Learning Model of Instruction (SDLMI) designed to enhance goal-directed actions in secondary students with and without disabilities. Cutscores were then applied to fidelity data from a large,…

This paper is a retrospective look at the last ten years of development in online third-party arrangements within the Australian higher education sector. A total of 42 higher education providers are reviewed. The analysis initially focuses on the state of online third-party arrangements in Australian higher education. It then investigates the…

The field of research impact assessment (RIA) has seen remarkable growth over the past three decades. Increasing numbers of RIA frameworks have been developed and applied by research funders and new technologies can capture some research impacts automatically. However, RIAs are too different to draw comparable conclusions about what type of…