The present study explored the comparability in performance scores between the computer-delivered and face-to-face modes for the two speaking tests in the Vietnamese Standardized Test of English Proficiency (VSTEP) (the VSTEP.2 and VSTEP.3-5 Speaking tests) according to Vietnam's Six-Level Foreign Language Proficiency Framework (VNFLPF) and test…

This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

This research explores how paper and online assessments (OA) can affect EFL learners' personal development variables such as self-esteem, mindfulness, demotivation, and language learning development. Sixty intermediate English as a foreign language (EFL) students participated in the current research and were randomly grouped into the experimental…

A challenging aspect of online education is assessment since academic integrity could be violated due to students' cheating behaviors. The current qualitative research investigated English teachers' perceptions of why students cheat in online assessments. Besides, it attempted to find strategies to reduce cheating in online assessments. Twelve…

This study examines the efficacy of artificial intelligence (AI) in creating parallel test items compared to human-made ones. Two test forms were developed: one consisting of 20 existing human-made items and another with 20 new items generated with ChatGPT assistance. Expert reviews confirmed the content parallelism of the two test forms.…

The current article evaluates a national English language proficiency test known as the "MSRT test" which is used to determine the eligibility of candidates for admission to and completion of higher education programs in Iran. Students in all majors take this standardized, high-stake criterion-referenced test to determine if they have…

In recent years, language practitioners have paid increasing attention to artificial intelligence (AI)'s role in language programs. This study investigated the impact of AI-assisted language assessment on L2 learners' foreign language anxiety (FLA), attitudes, motivation, and writing skills. The study adopted a sequential exploratory mixed-methods…

Few empirical research has attempted to determine the impact of Intelligent Computer-Assisted Language Assessment (ICALA) in philosophy-based language instruction (PBLI) on critical thinking, self-evaluation, and academic resilience, despite the significant role that higher-order thinking skills play in influencing English as a Foreign Language…

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing…

Background: Variations in the skill profiles of learners have become an important research area in recent years. However, there is a lack of empirical research on this topic in Japan. We conducted three studies to address this gap. Methods: Study 1 investigated the characteristics of the flat and uneven skill profiles of Japanese learners of…

This study aimed to examine the effect of test format on test performance by comparing Multiple Choice (MC) and Constructed Response (CR) vocabulary tests in an EFL setting. Also, this paper investigated the function of gender in MC and CR vocabulary measures. To this end, five 20-item stem-equivalent vocabulary tests (CR, and 3-, 4-, 5-, and…

Background: This study aims to empirically answer the question of whether the role of sub-reading skills changes depending on the test format (e.g., multiple-choice vs. open-ended reading questions). The test format effect also addresses the issue of test validity--whether the reading test properly elicits construct-relevant reading skills or…

Background: This study examined the comparability of reading and writing tasks of two English language proficiency tests--the General English Proficiency Test-A (GEPT-A) developed by Language Training Center, Taipei and the Internet-Based Test of English as a Foreign Language (iBT) developed by Educational Testing Service, Princeton. Methods: Data…

Background: The present study aims to investigate which variables affect English as a foreign language (EFL) students' listening comprehension test performance. It examines two types of variables: (1) test formats and (2) test materials. Methods: First, three types of test formats are investigated: (1) questions are not written but given orally…

The overall study from which findings are presented gave stem-equivalent short answer and multiple choice tests of English structure and reading to students at Prince of Songkla University, Thailand. A comparison of scores, facility, discrimination, reliability and validity from 3-, 4- and 5-option versions of the multiple choice test found little…