This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

This study explores the efficacy of ChatGPT-3.5, an AI chatbot, used as an Automatic Essay Scoring (AES) system and feedback provider for IELTS essay preparation. It investigates the alignment between scores given by ChatGPT-3.5 and those assigned by official IELTS examiners to establish its reliability as an AES. It also identifies the strategies…

This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…

Little is known about what academics focus on when providing assessment feedback to international students for whom English is an additional language (EAL). This study examines written assessment feedback provided to 11 EAL-speaking international students throughout a two-year Master of Social Work programme and investigates their perspectives of…

This study examines four learner engagement dimensions (behavioural, cognitive, emotional and social) in pedagogical task performance and provides insights into the effects of two task types (information-seeking and direction-giving) and topic familiarity on learner engagement in a semester-long English course. A total of 28 foreign language…

Mobile-assisted Language Learning (MALL) has been widely adopted in teaching and learning, yet there has been scant research concerning speaking test adaptation. An emerging type of mobile application is designed to facilitate test takers' performance in a high-stakes speaking test (e.g., the International English Language Testing System (IELTS)).…

Comparing language tests and test preparation materials holds important implications for the latter's validity and reliability. However, not enough studies compare such materials across a wide range of indices. Therefore, this study investigated the text complexity of IELTS academic reading tests (IRT) and IELTS reading practice tests (IRPrT).…

Grounded in the activity theory, we adopted a sequential explanatory mixed-methods approach to explore the impact of automated written corrective feedback (AWCF) on English as a foreign language (EFL) learners' academic writing skills (i.e. task achievement, coherence and cohesion, lexicon, and grammatical range and accuracy). To this end, two…

Background: Research in the field of writing pedagogy within higher education has extensively examined the significant roles that feedback plays in the development of students' writing skills. However, comparative studies that investigate the efficacy of teacher-provided written and oral feedback, both with and without the aid of technology,…