Background: Increasingly, students are using ChatGPT to assist them in learning and even completing their assessments, raising concerns of academic integrity and loss of critical thinking skills. Many articles suggested educators redesign assessments that are more 'Generative-AI-resistant' and to focus on assessing students on higher order…

Categorical growth models describe examinee growth in terms of performance-level category transitions, which implies that some percentage of examinees will be misclassified. This paper introduces a new procedure for estimating the classification accuracy of categorical growth models, based on Rudner's classification accuracy index for item…

Accurate self-evaluation leads to better regulation of learning and better performance in elementary school children and acts as a predictor of future academic success. The present study investigates the conditions under which preschoolers' self-evaluation accuracy can be enhanced. In the empirical research, 111 children were assigned to one of…

While multiple theories exist to explain the diagnostic process, there are few available assessments that reliably determine diagnostic competence in trainees. Most methods focus on aspects of the process of diagnostic reasoning, such as the relation between case features and diagnostic hypotheses. Inevitably, detailed elucidation of aspects of…

This research investigates the effects of rater experience on performance ratings in language testing using a systematic review of studies published from 1985 to 2017. Based on a comprehensive literature search of 14 databases, we identified sixteen relevant papers. With these we conducted a narrative review to conceptualize a theoretical…

Providing instructional explanations is a central skill of teachers. Using interactive simulations, we examined the explaining skills of 48 prospective teachers attending a teacher education program for accounting in vocational schools in Germany. We used a performance-based assessment that relies on explanatory quality as an indicator of teacher…

The ability to solve authentic real-world problems in science, engineering, and medicine is an important goal in post-secondary education. Despite extensive research on problem solving and expertise, the teaching and assessing of advanced problem-solving skills in post-secondary students remains a challenge. We present a template for creating…

When compared to high performers, low performers generally have more difficulty to accurately estimate their own performance. This has been explained by low performers being both unskilled and unaware about their performance. However, Miller and Geraci "Journal of Experimental Psychology: Learning, Memory, and Cognition," 37(2), 502-506,…

After countless petitions and complaints from end users, live subtitling quality is slowly attracting the attention of broadcasters, regulators, the subtitling industry and scholars working in Media Accessibility. These stakeholders share an interest in providing better live subtitles, but their quality assessment is a thorny issue. Although…

Effective assessments guide student learning, refine teaching practices, ensure curriculum alignment, and foster workforce readiness. However, the emergence of generative artificial intelligence (GenAI) tools, such as ChatGPT, has significantly disrupted traditional assessment processes, raising concerns about academic integrity and necessitating…

Background and Aims: In educational measurement, performance assessments occupy a niche for offering a true-to-life format that affords the measurement of high-level cognitive competencies and the evidence to draw inferences about intellectual capital. However, true-to-life formats also introduce myriad complexities and can skew if not outright…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

There are several student performances assessed in Intensive English Programs (IEPs) worldwide in each academic year. These student performances are mostly graded by human raters with a certain degree of error. However, the accuracy of these performance assessments is of utmost importance because they feed data into some high stakes decisions…

Purpose: This study aimed to develop and test a measure of real-time continuous speech understanding to be used with natural dialogues. Method: The measure was based on a category monitoring paradigm and employed five existing recordings of natural dialogues from which the different test categories and associated target words were derived. For…

The purpose of this research was to explore the perceptions of non-Arab preschool teachers' experiences in assessing Arabic-English dual language learners (DLLs) in classrooms using a well-established, teacher scored authentic assessment of early childhood holistic development. Moreover, this study explored parents' experiences by discussing these…