With the rapid development of generative artificial intelligence (AI) frameworks (e.g., the generative pre-trained transformer [GPT]), a growing number of researchers have started to explore its potential as an automated essay scoring (AES) system. While previous studies have investigated the alignment between human ratings and GPT ratings, few…

Construct validity and building validity arguments are some of the main challenges facing the language assessment community. The notion of construct validity and validity arguments arose from research in psychological assessment and developed into the gold standard of validation/validity research in language assessment. At a theoretical level,…

Considers how far a code of ethics makes language testing an open profession and notes the dangers of face validity and of hypocrisy. Discusses the need for a code of practice to provide detailed guidance to language testers with regard to their professional responsibilities. (Author/VWL)

The article examines changes in language testing textbooks in English since Lado (1961) and proposes that two trends may be discerned. The first shows how the growing professionalism of the field has required an expansion in teaching materials to meet the need for new training programmes. What the expansion also shows is the desire, again a mark…

Examines language assessment from a critical perspective. Argues that alternative assessment, as distinct from testing, offers a partial response to the challenges presented by a critical perspective on language assessment. Critical language testing is discussed as an adequate response to the critical challenge. Suggests that important ethical…

Links the theory of washback with the broader concept of impact in educational measurement and to the recent debate on construct validity associated with Messick. Notes that for many years it was asserted that language tests negatively impacted teaching and learning, an impact known as washback. (25 references) (Author/CK)

Addresses the role of ethics and its limits in professional activities such as language testing. Consideration is given to language testing as a means of political control, the definition of the test construct, the effects of language tests on the various stakeholders involved, and criteria for promoting ethicality in language testing. (six…

Discusses the need for a strong ethical foundation in the social sciences, which include language testing. Proposes the need for a professional morality and explains the importance of such morality to individuals and other stakeholders. It is argued that the intrusive nature of language testing and the normative role of language tests raises…

Reviews developments in language testing research and practice over the last 20 years, and suggests future directions in the areas of professionalizing the field and validation research. Argues that concerns for ethical conduct must be grounded in valid test use, so that professionalization and validation research are inseparable. (Author/VWL)

Argues that language tests employing methods not fair to all test takers are unethical. Ways of reducing sources of unfairness in language testing is discussed. (15 references) (Author/CK)

Argues that tests have always been used as a means of political and social control. Maintains that test results are unreliable, especially at the extremes, that their predictive power is weak and that language testers need to be skeptical and need to insist on complete information on candidates' backgrounds for selection decision making. (10…

Addresses the question of whether any test can be defended as ethical or moral. Defines ethicality in terms of issues such as harm, consent, confidentiality of data, and fairness and presents frameworks for determining equity of educational opportunity. An assessment project in Australia is examined in relation to these concerns. (24 references)…