Universities administer assessments for accountability and program improvement. Student effort is low during assessments due to minimal perceived consequences. The effects of low effort are compounded by assessment context. This project investigates validity concerns caused by minimal effort and exacerbated by contextual factors. Systematic…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…

Background: The proliferation of computer-based learning platforms (CBLPs) has caused an increased focus on understanding how to build scalable systems that optimize learning. Thus, CBLPs often rely on close response questions (e.g., multiple choice questions, "select all that apply," "arrange in the correct order," etc.) for…

Students learn large amounts of information, but not all of it is remembered after courses end -- meaning that valuable class time is often spent reviewing background material. Crucially, laboratory research suggests different strategies will be effective when reactivating previously learned information (i.e. "marginal knowledge"), as…

Does reviewing previous answers during multiple-choice exams help examinees increase their final score? This article formalizes the question using a rigorous causal framework, the potential outcomes framework. Viewing examinees' reviewing status as a treatment and their final score as an outcome, the article first explains the challenges of…

Multiple-choice questions (MCQs) continue to be relied upon for the efficient assessment of students' learning in higher education. However, the use of MCQs has not been without criticism. Poor design of MCQs, testing only lower-level learning outcomes such as information recall, and encouraging students to focus on these rote and reproductive…

Equating the scores from different forms of a test requires collecting data that link the forms. Problems arise when the test forms to be linked are given to groups that are not equivalent and the forms share no common items by which to measure or adjust for this group nonequivalence. We compared three approaches to adjusting for group…

The use of mixed-format tests made up of multiple-choice (MC) items and constructed response (CR) items is popular in large-scale testing programs, including the National Assessment of Educational Progress (NAEP) and many district- and state-level assessments in the United States. Rater effects, or raters' scoring tendencies that result in…

Elaborative feedback (EF) containing explanations on students' responses benefits learning. Computer-based environments provide learners with EF in different ways, for example, on an immediate question-by-question basis or after answering a set of questions. Recent findings also suggest that delaying EF enhances learning. However, it is unclear to…

Background: Multiple-choice item (MCI) assessments are burdensome for instructors to develop. Artificial intelligence (AI, e.g., ChatGPT) can streamline the process without sacrificing quality. The quality of AI-generated MCIs and human experts is comparable. However, whether the quality of AI-generated MCIs is equally good across various domain-…

This book provides another perspective to the way educators think about and use educational technologies in secondary and tertiary classrooms. Technology in learning settings has often been used in cautious ways, typically replicating existing, non-technological educational processes. This book proposes that educators be more ambitious with the…

This study aims to investigate the effectiveness of a research-based learning management plan microbiology and its impact on vocational education certificate students in the Animal Science department at Mahasarakham College of Agriculture and Technology. The research instruments included five research-based learning plans of microorganisms and…

While formative assessment is a widely valued instructional approach to support meaningful learning, putting it into classroom practice remains a challenge, also because the time resources required may conflict with other goals. In a cluster-randomized controlled intervention study with 29 teachers and 604 students (mean age 15.6 years) at…

Natural selection is a fundamental scientific process, yet students and educators alike demonstrate misconceptions of the process. Though images are used often in science to facilitate learning, it is less common to assess learners' understanding through their own drawings. This study utilizes a multiple-choice assessment of evolutionary processes…