This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

This study examines the efficacy of artificial intelligence (AI) in creating parallel test items compared to human-made ones. Two test forms were developed: one consisting of 20 existing human-made items and another with 20 new items generated with ChatGPT assistance. Expert reviews confirmed the content parallelism of the two test forms.…

The current article evaluates a national English language proficiency test known as the "MSRT test" which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have…

In recent years, language practitioners have paid increasing attention to artificial intelligence (AI)'s role in language programs. This study investigated the impact of AI-assisted language assessment on L2 learners' foreign language anxiety (FLA), attitudes, motivation, and writing skills. The study adopted a sequential exploratory mixed-methods…

Few empirical research has attempted to determine the impact of Intelligent Computer-Assisted Language Assessment (ICALA) in philosophy-based language instruction (PBLI) on critical thinking, self-evaluation, and academic resilience, despite the significant role that higher-order thinking skills play in influencing English as a Foreign Language…

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing…

Background: Variations in the skill profiles of learners have become an important research area in recent years. However, there is a lack of empirical research on this topic in Japan. We conducted three studies to address this gap. Methods: Study 1 investigated the characteristics of the flat and uneven skill profiles of Japanese learners of…

This study aimed to examine the effect of test format on test performance by comparing Multiple Choice (MC) and Constructed Response (CR) vocabulary tests in an EFL setting. Also, this paper investigated the function of gender in MC and CR vocabulary measures. To this end, five 20-item stem-equivalent vocabulary tests (CR, and 3-, 4-, 5-, and…

Background: This study aims to empirically answer the question of whether the role of sub-reading skills changes depending on the test format (e.g., multiple-choice vs. open-ended reading questions). The test format effect also addresses the issue of test validity--whether the reading test properly elicits construct-relevant reading skills or…

Background: The present study aims to investigate which variables affect English as a foreign language (EFL) students' listening comprehension test performance. It examines two types of variables: (1) test formats and (2) test materials. Methods: First, three types of test formats are investigated: (1) questions are not written but given orally…

Among several factors affecting the performance of testees on a test is the sequence of the test items. The present study served as an attempt to shed light on the effect of test item sequence on Iranian EFL learners' performance on a test of grammar. To achieve such a purpose, 70 language learners of English at Pooyesh Institute in Shiraz (the…