In response to a call for more research on evaluator education, this paper explores the use of role-play as an in-class activity for students in a graduate course in evaluation. We describe the activity in detail and use the Structure of Observed Learning Outcomes taxonomy as a tool to describe the cognitive complexity of student responses in the…

The rapid digital transformation of vocational education and training (VET) has underscored the need to adapt traditional assessment methods to digital formats. However, when transitioning to digital modes, it is crucial to consider factors beyond mere technical implementation, particularly the potential impact of altered presentation formats on…

Purpose: The ability to measure cognitive load in the workplace provides several opportunities to improve workplace learning. In recent years, virtual reality (VR) has seen an increase in use for training and learning applications due to improvements in technology and reduced costs. This study aims to focus on the use of simulation task load index…

Background: Cognitive load during AR use has been measured conventionally by performance tests and subjective rating. With the growing interest in physiological measurement using non-invasive biometric sensors, unbiased real-time detection of cognitive load in AR is expected. However, a range of sensors and parameters are used in various subject…

This study investigated how and how often to present prompts to enhance students' source evaluation and multiple-text comprehension. Participants were 72 undergraduates who read a set of digital texts on a controversial topic of smartphone use and mental health, wrote a justification statement for their selection of trustworthy texts, and answered…

Despite their importance, dynamic and diagnostic assessments (DigAs) have received little attention in phycological aspects of foreign language teaching and learning settings; therefore, this study compared the effects of dynamic and diagnostic assessment (DigA) on Afghan EFL learners' speaking fluency and accuracy (SFA), learning anxiety (LA),…

This study aimed to reveal the attitudes of the students who were subjected to measurement and evaluation in an online testing environment towards the computer based testing (CBT) platform and the factors that affect their attitudes. It also examined the students' cognitive loads in the exam designed with multimedia elements from message design…

We report on and validate a system for ranking the cognitive demand of mathematical tasks. In our framework, task rankings are determined by the sequences of units and unit transformations students might use to solve each task. Using this framework, we ranked a set of 10 fractions tasks. We then interviewed 12 pre-service teachers to assess the…

In 2013, the Council of Chief State School Officers (CCSSO), working collaboratively with state education agencies, released a set of criteria for states to use to evaluate and procure high-quality assessments. The mathematics section of the document included five content-specific criteria to evaluate alignment of assessments to college- and…

Since the development of the technological pedagogical content knowledge (TPACK) framework, researchers have been developing a variety of instruments to measure the TPACK of pre-service and in-service teachers. The task of developing an efficient, reliable, and valid instrument is difficult. Even validated instruments require guidance for…

Artificial intelligence (AI) technology has been progressively utilized in educational environments in recent years, due to the advances in computing and information processing techniques. The automatic speech recognition technique (ASR) provides students with instantaneous feedback and interactive oral practice for supporting a context with…

In 2013, the Council of Chief State School Officers (CCSSO), working collaboratively with state education agencies, released a set of criteria for states to use to evaluate and procure high-quality assessments. The mathematics section of the document included five content-specific criteria to evaluate alignment of assessments to college- and…

Mathematical calculations are an important part of chemistry. Those problems are difficult for students, especially if the task is set with a limiting reactant. The aim of this study was development of a Procedure for evaluation of cognitive complexity of the Stoichiometric Tasks with a Limiting Reactant. The procedure created included an…

Objective: Little is known about cognition's effect on jump-landing movement patterns. Design: Participants completed three baseline cognitive tasks. Then, participants performed three jump-landing trials per condition (dual-task trials (DT)): Stroop Color Word test (SCWT), Symbol Digits Modalities test (SDMT), Brooks Visuospatial task (BVT), and…

Assessment is a key lever for educational improvement. Assessments can be used to monitor, signal, and influence science teaching and learning -- provided that they are of high quality, reflect the rigor and intent of academic standards, and elicit meaningful student performances. Since the release of "A Framework for K-12 Science…