This paper reports on a set of three recent experiments utilizing large-scale speech models to assess the oral reading fluency (ORF) of students in Ghana. While ORF is a well-established measure of foundational literacy, assessing it typically requires one-on-one sessions between a student and a trained rater, a process that is time-consuming and…

Academic writing is a salient skill for medical students all over the world. Academic writing starts with composing effective paragraphs, laying the foundation for students' advancement in writing during college. This study investigated common mistakes in English paragraph writing committed by the first-year medical students of the Medicine…

The aim of the research is to investigate the academic achievement of ChatGPT, an artificial intelligence based chatbot, in a national mathematics exam. For this purpose, 3.5 and 4 versions of ChatGPT were asked mathematics questions in a national exam. The method of the research is a case study. In the research, 3.5 and 4 versions of ChatGPT were…

We analyse the PISA-reported convergence in the performance of private and public schools in Portugal. When PISA sampling weights are used, the number of students enrolled in those types of schools and specific grades/tracks of study differs significantly from official population figures. To account for those differences, we apply a…

This article presents a 3-D medical simulation that employs reinforcement learning (RL) and interactive RL (IRL) to teach and assess the procedure of donning and doffing personal protective equipment (PPE). The simulation is motivated by the need for effective, safe, and remote training techniques in medicine, particularly in light of the COVID-19…

Although writing and translation are closely related text productions, their interface has rarely been studied in translator training. This study examined student translators' writing and translation products in terms of their quality, errors and self-perceived mental workload. Data were collected from 11 intermediate-level translation students at…

Collaborative learning offers numerous benefits to learners, largely due to the dialogue that is unfolding between them. However, there is still much to learn about the structure of collaborative dialogue, and especially little is known about co-creative dialogues during learning. This paper reports on a study with learners engaged in co-creative…

Orlando and Thissen (2000) introduced the "S - X[superscript 2]" item-fit index for testing goodness-of-fit with dichotomous item response theory (IRT) models. This study considers and evaluates an alternative approach for computing "S - X[superscript 2]" values and other factors associated with collapsing tables of observed…

The purpose of this study was to examine the effects of score study and conducting gesture on collegiate musicians' ability to detect errors in a choral score. Is there a combined effect of gesture and score study that impacts undergraduate conductors' identification of errors in a score? Participants (N = 53) viewed a sequence of four choral…

This article extends multivariate generalizability theory (MGT) to tests with different random-effects designs for each level of a fixed facet. There are numerous situations in which the design of a test and the resulting data structure are not definable by a single design. One example is mixed-format tests that are composed of multiple-choice and…

The current study expands on previous research on gender differences and similarities in science test scores. Using three different approaches -- differential item functioning, differential distractor functioning, and decision tree analysis -- we examine a high school science assessment administered to 3,849 10th-12th graders, of whom 2,021 are…

Although intelligibility is a core concept in second language (L2) speech assessment and teaching research, the vast majority of previous work relies on audio-only stimuli. The current study set out to examine how linguistic and visual information jointly interact to determine the degree of speech intelligibility. Both first language (L1) and L2…

Reliability is the consistency of a set of scores that are designed to measure the same thing. Reliability is a statistical property of scores that must be demonstrated rather than assumed.

This study examines the impact of the College, Career, and Community Writers Program (C3WP) on upper-elementary students' first draft writing quality, addressing the challenges teachers face in providing timely and effective feedback on extensive student writing, particularly in spelling, grammar, mechanics, and cohesion. The hypothesis posits…

Background: Bilingual assessment is particularly difficult in the very first period of children's second language (L2) exposure. This exploratory, longitudinal study examined L2 learning after 1 and 2 years of L2 exposure by young immigrants and how it is affected by their age at first exposure to the L2 (AoE). Method: Participants were 18…