Cognitive Diagnostic Assessment (CDA) is an alternative assessment which can give a clear picture of pupils' learning process and cognitive structures to education stakeholders so that appropriate instructional strategies can be designed to tailored pupils' needs. Coincide with this function, the Ordered Multiple-Choice (OMC) items were…

In line with the widespread proliferation of digital technology in everyday life, many countries are now beginning to use computer-based exams (CBEs) in their post-primary education systems. To ensure that these CBEs are delivered in a manner that preserves their fairness, validity, utility and credibility, several factors pertaining to their…

The instructional lab setting has been found to be dominated by prescribed tasks and pre-prepared lab kits. This was explained by teachers' need to guide students to simultaneously progress through a lab curriculum, which prompts them to standardize the lab experience. Nevertheless, prominent professional associations have persistently called to…

The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns…

The literature provides multiple measures of diversity along a single demographic dimension, but when it comes to studying the interaction of multiple diversity types (e.g. age, gender, and race), the field of useable measures diminishes. We present the use of decision trees as a machine learning technique to automatically identify the…

This study investigates the comparability of three parallel translation tasks selected from a College English Test Band-6 (CET-6) and explores the major linguistic features contributing to translation difficulty. Data obtained from the participants' subjective rating, eye-tracking, and performance evaluation were triangulated to measure the…

Teaching simulations such as scriptwriting tasks offer a novel way to support pre-service teachers in gaining diagnostic competencies and in guiding students to work through difficulties. We first report on the theory-driven development of a scriptwriting task, specifically the theoretically-founded language- and accompanying content-related…

This study examines the dimensionality of a new measure of international students' adjustment using a sample of 189 international students. Drawing on earlier conceptualizations of cross-cultural adjustment as a person-environment fit and a previous scale measuring adjustment from the expatriate literature, this study shows that this scale can be…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

Vocabulary size measures serve important functions, not only with respect to placing learners at appropriate levels on language courses but also with a view to examining the progress of learners. One of the widely reported formats suitable for these purposes is the Yes/No vocabulary test. The primary aim of this study was to introduce and provide…

Artificial intelligence (AI) technologies have the potential to reduce the workload for the second language (L2) teachers and test developers. We propose two AI distractor-generating methods for creating Chinese vocabulary items: semantic similarity and visual similarity. Semantic similarity refers to antonyms and synonyms, while visual similarity…

Technology-enhanced items (TEIs) are innovative, computer-delivered test items that allow test takers to better interact with the test environment compared to traditional multiple-choice items (MCIs). The interactive nature of TEIs offer improved construct coverage compared with MCIs but little research exists regarding students' performance on…

Acadience Reading (AR) is a screener for early detection of reading problems in elementary students. Limited research exists, however, on its technical adequacy for evaluation of English Learners (ELs). In this study, we tested the long-term predictive validity and diagnostic accuracies of AR and examined the differences between native…

In this qualitative study, I followed four urban early childhood teachers through their participation in a teacher education program designed to enhance their linguistically responsive teaching and into the first four months of the new school year. Using the concept of "take-up" presented by Buehler et al. (2009), I identified what the…

The instructions in this manual explain the responsibilities of school administrators for the New York State Testing Program (NYSTP) Grades 3-8 English Language Arts and Mathematics Field Tests, and the Elementary-level (Grade 5) and Intermediate-level (Grade 8) Science Field Tests. School administrators must be thoroughly familiar with the…