The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

This multilevel mixed methods investigation examines the experiences of developing self-evaluation skills for simulation fellows in an interprofessional simulation fellowship program. Interprofessional fellows (N = 12) and faculty (N = 4) engaged in a three-phase study using video-assisted learning tools to explore the differences in…

For decades, evaluators have noted that it is difficult for stakeholders to accept negative evaluation results (Carter, 1971; Taut & Brauns, 2003). There is a need for additional research on evaluation to better understand when and why stakeholders reject negative or critical evaluation findings. Drawing on social identity theory (SIT), the…

Two-year colleges provide access and opportunity for students with various academic backgrounds to pursue a post-secondary education. While two-year colleges take pride in admitting any student with a high school diploma or equivalent, in recent years colleges have been under scrutiny for low completion and graduation rates. Particular attention…

Purpose: This study sought to examine how preservice physical educators conceptualize and intend to use standards-based grading (SBG) after receiving a 1-hr workshop on implementing SBG into a physical education (PE) setting. Methods: Using a qualitative descriptive approach, the researchers utilized class reflection assignments, a perceptions…

A challenge for professional psychology programs is the assessment of students' professional competence. Despite its potential, objective structured clinical examination (OSCE) has not gained widespread use in the psychological field. However, at Umeå University and Örebro University in Sweden, the OSCE has been introduced at the Clinical…

With the goal of working towards decolonizing educational practices, this article considers the Indigenous medicine wheel as inspiration for a cyclical model for learning and assessment. Many current assessment practices highlight individual achievement rather than ongoing and relational learning. This article suggests using a "Learning…

This comprehensive guide illuminates the art and science of educational assessment, blending ancient alchemical wisdom with modern AI innovations. Part one lays the foundation, exploring essential principles of assessment and evaluation and its pivotal role in shaping learning outcomes. Part two delves into diverse assessment types, from formative…

Classroom observation rubrics are a widely adopted tool for measuring the quality of teaching and provide stable conceptualisations of teaching quality that facilitate empirical research. Here, we present four statistical approaches for analysing data from classroom observations: Factor analysis, Rasch modelling, latent class or profile analysis,…

Emerging technologies are transforming educational practices, but successful integration requires improving the quality and efficiency of learning. New technology emerges in hype cycles but adoption and performance lag over time. A strategy development framework is needed for decision-makers to understand the complex interaction of all the factors…

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

Medical science is a dynamic field of knowledge that is constantly broadening with upcoming clinical research and analysis. Traditional medical education has been focused on textbook-based recall assessments--closed book assessment (CBA). However, the availability of newer technologies has made the accessibility to encyclopedic knowledge…

In an era of test-based accountability, school inspections can offer a more nuanced understanding of why schools fail. Yet, we have limited knowledge of how inspectors arrive at their decisions on school quality. Analyzing inspectors' decision-making can reveal the underlying views regarding school accountability and open opportunities for school…

Over the last decade, teachers in France have been increasingly pressured to use digital learning environments, and to shift from grade-based to skill-based assessment. Educational dashboards, which measure student input electronically, could foster such a transition by providing insights into learners' performances. However, such dashboards could…

Purpose: The ability to measure cognitive load in the workplace provides several opportunities to improve workplace learning. In recent years, virtual reality (VR) has seen an increase in use for training and learning applications due to improvements in technology and reduced costs. This study aims to focus on the use of simulation task load index…