Listening comprehension in English, as one of the most fundamental skills, has an essential role in the process of learning English. Mokken scale analysis (MSA) is a probabilistic-nonparametric approach to item response theory (IRT) which determines the one-dimensionality and scalability of test. Mokken scaling techniques are a useful tool for…

There has been a surge in employing artificial intelligence (AI) in all areas of language pedagogy, not the least among them language testing and assessment. This study investigated the effects of AI-powered tools on English as a Foreign Language (EFL) learners' speaking skills, psychological well-being, autonomy, and academic buoyancy. Using a…

Drawing on critical discourse analysis methodologies, this study examines the discursive conflicts and strategies employed by newspaper media surrounding the National English Ability Test (NEAT) in Korea. NEAT was reported to cause severe competition among young learners of English and lacked public support. Discursive conflicts over whether NEAT…

The current study aims to explore the cognitive validity of the iBT TOEFL reading test by investigating test takers' eye movements on individual items. It is assumed that successful test takers would adopt the intended reading processes, the same types and levels of cognitive processes that they would use for real-world reading tasks. Forty-seven…

Background: Validity is a notable concept in language testing which has concerned many researchers and scholars in the field of language testing due to its importance in decision making process. Tests' results always introduce consequences to test takers' lives which emphasizes the need to ensure their validity. Detecting and delineating the…

Admission in English-medium universities or institutions of higher education depends on the results obtained by candidates in large-scale proficiency tests including Test of English as a Foreign Language (TOEFL) internet-based test (iBT). The structure and administration procedure of the TOEFL iBT speaking test leaves no room for carrying out…

Background: This study aims to empirically answer the question of whether the role of sub-reading skills changes depending on the test format (e.g., multiple-choice vs. open-ended reading questions). The test format effect also addresses the issue of test validity--whether the reading test properly elicits construct-relevant reading skills or…

Background: The present study aims to investigate which variables affect English as a foreign language (EFL) students' listening comprehension test performance. It examines two types of variables: (1) test formats and (2) test materials. Methods: First, three types of test formats are investigated: (1) questions are not written but given orally…

The National Center Test is a test that high school graduates take in order to be matriculated into the majority of universities in Japan. Its English section (NCT), though, is scheduled to be replaced by commercially available private English tests of four skills (reading, listening, speaking, writing) due to the fact that NCT currently measures…

Background: This study examined the factor structure of the Test of English for Academic Purposes (TEAP®) test--a recently developed academic English test measuring four skills among Japanese university applicants--and compared the structure to that of the Test of English as a Foreign Language Internet-based test (TOEFL iBT®), to investigate the…

Almost no language test is void of grammar items, and the reason is probably the assumption that there exists a positive correlation between examinees' grammar knowledge and the actual demonstrable level of accuracy in communication. Meanwhile, examples abound where many examinees relatively do well on grammar knowledge tests despite failing to…

This study aims to investigate the applicability of C-test in vocabulary assessment. Doing so four C-tests, two different in terms of their lexical richness (measured through P_Lex) and the other two different in terms of their lexical variation (measured through type/token ratio), were developed and the performance of 74 and 77 Iranian TEFL MA…

Among sundry factors influencing an individual score "Environmental factors" and "Test rubric" play significant roles. The present article attempted to investigate the influence of "time of administration" and "language of instruction", each relating to the above-mentioned factors respectively on the Iranian…