One major aim of international large-scale assessments (ILSA) like PISA is to monitor changes in student performance over time. To accomplish this task, a set of common items (i.e., link items) is repeatedly administered in each assessment. Linking methods based on item response theory (IRT) models are used to align the results from the different…

In recent years, the use of external proficiency-based tests to measure learners' language ability has increased significantly, in part thanks to the Seal of Biliteracy movement. However, there exists very limited research investigating the influence of such tests and their subsequent outcomes data on teachers' practices. As such, this study…

In undergraduate research settings, students are likely to encounter anomalous data, that is, data that do not meet their expectations. Most of the research that directly or indirectly captures the role of anomalous data in research settings uses post-hoc reflective interviews or surveys. These data collection approaches focus on recall of past…

The English learner (EL) student population has grown steadily for the past 20 years. During this time, the use of standardized assessments has increased as well. Teacher understanding of assessment accommodations that best support ELs is low, despite the research that shows the unreliability of standardized achievement tests that measure the…

The article reports three simulation studies conducted to find out whether the effect of a time limit for testing impairs model fit in investigations of structural validity, whether the representation of the assumed source of the effect prevents impairment of model fit and whether it is possible to identify and discriminate this method effect from…

Researchers are often inclined to test agreement or discrepancy hypotheses using difference scores. This commentary explains 2 mathematical-statistical principles underlying associations with difference scores and 2 conceptual-interpretation problems that make difference scores inappropriate for testing such hypotheses. The commentary provides…

In this paper, we address the following questions: What misconceptions do high school students exhibit in their first encounter with significance test problems through a repeated sampling approach? Which theory or framework could explain the presence and features of such patterns? With brief prior instruction on the use of Fathom software to…

Many large-scale educational surveys have moved from linear form design to multistage testing (MST) design. One advantage of MST is that it can provide more accurate latent trait [theta] estimates using fewer items than required by linear tests. However, MST generates incomplete response data by design; hence, questions remain as to how to…

This study investigates washback effects of IELTS test on university teachers' adoption of teaching materials in the classroom in China and see how a high-stake language exam affects their teaching practices and how they and their students perceive the effectiveness of the pedagogic adjustments. To this end, individual interview to five teacher…

Understanding the IELTS washback on learning in English as a Foreign Language (EFL) in higher education contexts remains limited. To fill in this research gap, this study investigated washback effects of the International English Language Testing System (hereafter called IELTS) as an English language proficiency exit test for final-year English…

Nearly all multidimensional models of communication competence have pragmatic competence at their core. Proper assessment of second language (L2) pragmatics makes many demands on L2 teachers, both in terms of understanding the construct and in language test development. Therefore, being assessment literate helps teachers in developing effective…

Reclassification is a critical threshold when English Learners (ELs) exit specialized language services and access all-English mainstream classrooms. Despite the mandates of the Every Student Succeeds Act, reclassification rates and time remain a pressing problem. A product of this malfunctioning system has been long-term ELs (LTELs). This article…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

International large-scale assessments (ILSAs) are one of the most important tools policymakers and other educational stakeholders have to inform evidence based decision making for educational reform. Despite this, and the widespread use of ILSA data, results are sometimes misunderstood or misinterpreted. Here, we offer a brief guide to ILSAs and…

Documents are usually circulated as carriers of transparent information. They can serve as evidence of accountability. In fact, they embody the most desired value of managerialism, where the culture of audit and compliance is fully served and delivered in written and textual form. This article explores assessment by attending to its principal…