In 2016, the Office of the Higher Education Commission issued a directive requiring all higher education institutions in Thailand to have their students take a standardized English proficiency test. According to the directive, the test's results had to align with the Common European Framework of Reference for Languages (CEFR). In response to this…

Studies from various disciplines have reported that spatial location of options in relation to processing order impacts the ultimate choice of the option. A large number of studies have found a primacy effect, that is, the tendency to prefer the first option. In this paper we report on evidence that position of the key in four-option…

Following Richards's (2015) ideas of using movie clips, videos, and games as valuable technological tools for language learning, the present study was conducted to investigate the effectiveness of using novel extracts and computer game cutscenes based on the same story to develop the vocabulary knowledge of English as a foreign language (EFL)…

The main objective of the article is to compare several methods of evaluating multiple-choice options through classical item analysis. The methods subjected to examination include the tabulation of choice distribution, the interpretation of trace lines, the point-biserial correlation, the categorical analysis of trace lines, and the investigation…

Previous studies on lexical focus on form (FonF) have mostly centred on FonF in reading with a few pre-selected lexical items. This study investigated the contribution of oral incidental FonF to developing learners' lexical knowledge in a free discussion EFL class. Incidental FonF was provided to 15 upper-intermediate learners who participated in…

The calibration of test materials generally involves the interaction between empirical analysis and expert judgement. This paper explores the extent to which scale familiarity might affect expert judgement as a component of test validation in the calibration process. It forms part of a larger study that investigates the alignment of the…

The purpose of this article of reflection is to raise awareness of how poor design of language assessments may have detrimental effects, if crucial qualities and technicalities of test design are not met. The article first discusses these central qualities for useful language assessments. Then, guidelines for creating listening assessments, as an…

The Interface Hypothesis (Sorace, 2000) developed in line with the Minimalist theory of grammar (Chomsky, 1995 et seq.) supports the view of L2 acquisition that syntactic properties are acquired early while the acquisition of interface properties is delayed. One of the interface properties is inflectional morphology on English verbs, which…

Investigating the processes underlying test performance is a major source of data supporting the explanation inference in the validity argument (Chappelle, 2021). One way of modeling the cognitive processes underlying test performance is by constructing a Q-matrix, which is essentially about summarizing the attributes explaining test-takers'…

The article aims to outline and analyze the most demanding parts of computer-based exams for the students of the Ural Federal University named after the first President of Russian B.N. Yeltsin (Ekaterinburg, Russia) during one exam session of spring of 2016-2017. For this research, a quantitative method of mean scores for reading, listening, and…

The new requirement placed on students in tertiary settings in Spain to demonstrate a B1 or a B2 proficiency level of English, in accordance with the Common European Framework of Reference for Languages (CEFRL), has led most Spanish universities to develop a program of certification or accreditation of the required level. The first part of this…

On-going bilingual programs without regard to needs analysis; little research on the actual effects of CLIL in Colombia and vague awareness or knowledge about the necessary considerations for effective CLIL programs, underpin the need to address a particular issue of curriculum as it is summative assessment. This small scale study takes place in a…

In a developing nation like Turkey, the English language plays a significant role in educational and socioeconomic mobility. English is acquired and taught as a foreign language (EFL) primarily in the classrooms. However, the ways in which English language is represented in classroom instruction have been hardly examined and understood. With that,…

This dissertation reports development and validation studies of a Web-based standardized test of Japanese as a foreign language (JFL), designed to measure learners' off-line grammatical and pragmatic knowledge in multiple-choice format. Targeting Japanese majors in the U.S. universities and colleges, the test is designed to explore possible…

Some educational contexts almost mandate the application of multiple-choice (MC) testing techniques, even if they are deplored by many practitioners in the field. In such contexts especially, research into how well these types of item perform and how their performance may be characterised is both appropriate and desirable. The focus of this paper…