Examinees who attempt the same test multiple times are often referred to as "repeaters." Previous studies suggested that repeaters should be excluded from the total sample before equating because repeater groups are distinguishable from non-repeater groups. In addition, repeaters might memorize anchor items, causing item drift under a…

This paper examines recent reforms in English-language testing in Japan using a policy distraction framework. We identify the term 'washback (effect)' and other related discourses as major distractors and investigate how 'washback' discourses have functioned as political slogans or catchphrases in policy deliberation processes and how they have…

With the introduction of a new initiative in a teaching and learning environment there is an ethical responsibility to consider whether the impact of the introduction has met its intended goals, and whether it has harmed those who are influenced by it. Technology and infrastructure developments have encouraged a continued growth in the development…

The philosophy of comprehensive education embedded in Scottish policy has long been recognised as an exemplary feature. The commitment to language learning is evident in recent policy supporting primary pupils who will learn two languages as well as the language of their school. For most children, this will involve English and two other languages,…

Measures of socioeconomic status (SES) are widely used in educational research and policy applications in no small part because of a deeply rooted belief of the importance of SES. This paper argues that the usefulness of common SES measures can be undermined by (a) an atheoretical approach to conceptualizing SES and selecting measures, which…

The entrance exams to Japanese universities have long been criticised for creating negative "washback" on English education in high schools in Japan, as teachers have often focused their teaching efforts on teaching grammar to prepare students for these exams rather than helping students to develop competency in spoken English. Many…

This paper is the first in a series of Analytical Insights papers, which provide accessible, up-to-date analysis of educational datasets. This insights paper draws on the latest National Assessment Program Literacy and Numeracy (NAPLAN) data to discuss student participation and engagement with the tests -- factors which impact the quality and…

In "The Testing Charade: Pretending to Make Schools Better", the author's new book from which this article is drawn, the failures of test-based accountability are documented and some of the most egregious misuses and outright abuses of testing are described, along with some of the most serious negative effects. Neither good intentions…

Wollack, Cohen, and Eckerly suggested the "erasure detection index" (EDI) to detect fraudulent erasures for individual examinees. Wollack and Eckerly extended the EDI to detect fraudulent erasures at the group level. The EDI at the group level was found to be slightly conservative. This article suggests two modifications of the EDI for…

Originally an editorial for "English in Education," this short article summarises key issues in the imposition of a separate test for grammar, punctuation and spelling. It illustrates the poor foundations, lack of clarity and distortion of curriculum which invalidate the test.

Competence data from low-stakes educational large-scale assessment studies allow for evaluating relationships between competencies and other variables. The impact of item-level nonresponse has not been investigated with regard to statistics that determine the size of these relationships (e.g., correlations, regression coefficients). Classical…

Item nonresponses are prevalent in standardized testing. They happen either when students fail to reach the end of a test due to a time limit or quitting, or when students choose to omit some items strategically. Oftentimes, item nonresponses are nonrandom, and hence, the missing data mechanism needs to be properly modeled. In this paper, we…

The use of differences scores to assess agreement/disagreement has a long and contentious history. Laird (2020) notes, however, that developmentalists have been particularly resistant to discontinue the use of difference scores. One area of developmental science where difference scores are still in regular use is that of parental differential…

Since 2000, the PISA test implemented by OECD has become the prime benchmark for international comparisons in education. The 2015 PISA edition introduced methodological changes that altered the nature of its results. PISA made no longer valid non-reached items of the final part of the test, assuming that those unanswered questions were more a…

This study aims to present the washback effect of the undergraduate English placement examination in Turkiye on teachers who are considered one of the highest stakeholders of the test. The data were collected through questionnaires from 110 participants and follow-up face-to-face interviews with 24 English language teachers having teaching…