Conversational agents have been designed to improve instruction quality and support student learning. In addition to their instructional use, they can be incorporated into assessment--conversation-based assessment (CBA). This study primarily introduces a CBA with selected-response and constructed-response tests as a formative assessment tool for…

The highly adaptive testing (HAT) design is introduced as an alternative test design for the Programme for International Student Assessment (PISA). The principle of HAT is to be as adaptive as possible when selecting items while accounting for PISA's nonstatistical constraints and addressing issues concerning PISA such as item position effects.…

Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…

Dynamic assessment (DA) breaks the traditional dichotomy between assessment and instruction by including mediation in assessment procedures ((Poehner "Dynamic assessment: A Vygotskian approach to understanding and promoting second language development." Springer, Berlin, Germany, 2008)). The focus of DA is on how students or test-takers…

Over the last 20 years, many methods have been proposed to use process data (e.g., response time) to detect changes in engagement during the test-taking process. However, many of these methods were developed and evaluated in highly similar testing contexts: 30 or more single-select multiple-choice items presented in a linear, fixed sequence in…

This research explores using blogs as an innovative assessment tool to enhance authentic learning and professional skill development in students. Unlike traditional methods, blogs foster active knowledge building and peer interaction, making learning more engaging and aligned with industry contexts. The study involved third-year planning students,…

In order to better manage alternative assessment procedures, incorporating suitable technology can help teachers facilitate an easier, more productive practice in unique and innovative ways. The purpose of this article is, therefore, to provide ideas and resources for technology-facilitated alternative assessment in physical education.

Purpose: Anomia, or word-finding difficulty, is a prevalent and persistent feature of aphasia, a neurogenic language disorder affecting millions of people in the United States. Anomia assessments are essential for measuring performance and monitoring outcomes in clinical settings. This study aims to evaluate the reliability of response time (RT)…

This study examined the effect of mobile-mediated dynamic assessment on reading comprehension and reading fluency skills of Iranian L2 learners. With 50 Iranian L2 learners, randomly assigned to the experimental and control groups, a pretest-posttest control group design was used. Whereas the control group received traditional instructor…

Research on dynamic assessment (DA) has been conducted on the efficiency of either face-to-face (F2F) or mobile-assisted (MA) DA sessions. However, studies investigating the difference between these sessions conducted in the foreign language learning context are scarce. Thus, this study aims to explore the differences between F2F- and MA-DA…

The shift to successful online learning requires online assessment strategies that could facilitate the learning and teaching process and determine the achievement of learning outcomes. This study examined how students' achievement was assessed in an online learning environment during the COVID-19 pandemic and how the College of Education (COE)…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…

Automated scoring for divergent thinking (DT) seeks to overcome a key obstacle to creativity measurement: the effort, cost, and reliability of scoring open-ended tests. For a common test of DT, the Alternate Uses Task (AUT), the primary automated approach casts the problem as a semantic distance between a prompt and the resulting idea in a text…

This study compared traditional methods of college-level instruction, including lecture and class discussion followed by assessment via course content exams, with a variety of other instructional techniques. The intent was to evaluate whether more contemporary instructional techniques are significantly correlated with improved average exam scores…

Written assignments for large classes pose a far more significant challenge in the age of the GenAI revolution. Suggestions such as oral exams and formative assessments are not always feasible with many students in a class. Therefore, we conducted a study in South Africa and involved 280 Honors students to explore the usefulness of Turnitin's AI…