Practical examinations are commonly implemented to assess student knowledge of human gross anatomy. The in-person timed cadaveric practical is a classic assessment tool; however, several new approaches, like online or oral practical assessments, have become increasingly popular in recent years due to time, space, and/or financial constraints.…

The pervasive nature of media multitasking in the last fifteen years has sparked extensive research, revealing a nuanced but predominantly negative association with executive function. Given the cognitive demands and technological landscape of the modern battlefield, there is a critical interest in understanding how these findings may or may not…

Assessments play a pivotal role in Mathematics education, serving as vital gauges of students' mathematical proficiency and informing teaching strategies. Despite calls for contextualization, some educators still rely on abstract teaching methods and decontextualized tasks. This study aims to address these concerns by designing and implementing a…

This position paper introduces the idea of cognicy, the foundational ability to think and understand in a process that decouples cognitive processes from their tangible outcomes. Generative artificial intelligence (AI) can produce output often nearly indistinguishable from a human product, which presents a problem for educational assessment.…

The release of ChatGPT and other Artificial Intelligence (AI) tools has raised significant and challenging questions around the ethics of artificial intelligence in higher education. The initial concerns regarding AI in higher education centered on academic integrity, and the literature reflects this initial response. However, the multifaceted…

This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on…

Accomplishing a communication task in the real world requires the ability not only to do the task per se but also to manage aspects of the context in which it occurs. For this reason, simulations of target language use contexts have been incorporated into the design of communicative language tests as a way of enhancing the authenticity of…

This study uses narrative analysis to track undergraduates' proof schemes throughout a transition proofs course at a research 1 university in the Midwest, with a focus on student example use and how it influences their schemes. Assessment data and cognitive interviews were conducted at four points throughout the semester in order to track the…

Pilot training and certification have largely remained the same since the Practical Test Standards (PTS) were issued more than twenty years ago by the Federal Aviation Administration (FAA). Within the last several years, the general aviation training sector has acquired the capability to collect and analyze digital data from certain training…

Gender gaps in mathematics achievement persist in many contexts and when visible, these gaps are paradoxical. Low-stakes measures of mathematics achievement such as grades and study behaviors favor girls, while gaps tend to reverse on assessments/ competitions. We explore whether different impacts of raising performance stakes could be one…

Gender gaps in mathematics achievement persist in many contexts and when visible, these gaps are paradoxical. Low-stakes measures of mathematics achievement such as grades and study behaviors favor girls, while gaps tend to reverse on assessments/competitions. We explore whether different impacts of raising performance stakes could be one…

Background and Aims: In educational measurement, performance assessments occupy a niche for offering a true-to-life format that affords the measurement of high-level cognitive competencies and the evidence to draw inferences about intellectual capital. However, true-to-life formats also introduce myriad complexities and can skew if not outright…

Executive function (EF) is a term used to describe the processes responsible for purposeful, goal-directed behavior and has been described as the "air traffic controller" or "CEO" of the brain. EFs are an important factor in overall quality of life, including school and job success. EFs are measured predominately through two…

Standardised educational assessments are now widespread, yet their development has given comparatively more consideration to what to assess than how to optimally assess students' competencies. Existing evidence from behavioural studies with children and neuroscience studies with adults suggest that the method of assessment may affect neural…

Visual expertise in medicine has been a subject of research since many decades. Interestingly, it has been investigated from two little related fields, namely the field that focused mainly on the visual search aspects whilst ignoring higher-level cognitive processes involved in medical expertise, and the field that mainly focused on these…