A much-debated question in the L2 assessment field is if computer familiarity should be considered a potential source of construct-irrelevant variance in computer-based writing (CBW) tests. This study aims to make a partial validity argument for an online source-based writing test (OSWT) designed for English placement testing (EPT), focusing on…

Cognitive diagnostic assessment (CDA) intends to identify learners' strengths and weaknesses in latent cognitive attributes to provide personalized remedial instructions. Previous CDA studies on English as a Foreign Language (EFL)/English as a Second Language (ESL) writing have adopted dichotomous cognitive diagnostic models (CDMs) to analyze data…

While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…

In this Brief Report, we describe an evaluation of and revisions to a rubric adapted from the Jacobs et al.'s (1981) ESL COMPOSITION PROFILE, with four rubric categories and 20-point rating scales, in the context of an intensive English program writing placement test. Analysis of 4 years of rating data (2016-2021, including 434 essays) using…

This study employed a multi-methods design to investigate the impact of preparation on Chinese test-takers' perceptions of the integrated TOEFL iBT speaking and writing design. Combining results from over 1700 surveys and 10 interviews, it was found that these Chinese test-takers, who are the most vulnerable group in the multimillion testing…

In the past two decades, corpora have been proposed as valuable computer-assisted tools for teaching and learning academic writing in English at the university level. This article reports on an empirical study that sought to examine the effectiveness of direct corpus consultation in overcoming vocabulary errors in academic writing. This study is…

In many high-stakes testing situations, test-takers are not allowed to draw on external writing resources while writing, a practice observed more frequently in classroom settings. This may pose problems with the representativeness of test tasks and score interpretations. This study investigates the domain definition of one particular test known as…

The writing module of the IELTS has proven to be a challenging section for test takers. Part of this difficulty may stem from the divergence between what test takers expect to learn in such courses and what is delivered by instructors. To address this issue, a 24-item questionnaire (Student Questionnaire A) relating to IELTS writing preparation…

This report describes the development of efficient second language (L2) writing assessment tasks designed specifically for low-proficiency learners of English to be included in the "TOEFL® Essentials"™ test. Based on the can-do descriptors of the Common European Framework of Reference for Languages for the A1 through B1 levels of…

The present study investigates the relationship between L2 metalinguistic knowledge and L2 achievement among intermediate-level adult Turkish EFL learners studying at a large scale Turkish university. Metalinguistic knowledge refers to the ability to correct a grammatically incorrect structure in English and explain why it is incorrect, and…

Canadian post-secondary classrooms are linguistically diverse. This diversity comes from immigration, more access to higher education for marginalized and minority groups, and international student recruitment. An institute's language prerequisites serve as tools to help admissions decide who is linguistically prepared for study in English.…

For educational tests, it is critical to maintain consistency of score scales and to understand the sources of variation in score means over time. This practice helps to ensure that interpretations about test takers' abilities are comparable from one administration (or one form) to another. This study examines the consistency of reported scores…

This study investigated the efficacy of explicit lexical collocation instruction via the Corpus of Contemporary American English (COCA). To improve competence in lexical collocation and writing performance and to examine whether collocational competence and writing performance have a linear interrelation, 16 international English for Academic…

Background: The CEFR, ever since its inception, has had profound impact on language teaching, learning, and assessment not only in Europe but also in other parts of the world. This study focuses on the adaptability of CEFR writing descriptors in the context of Test for English Majors (TEM). Methods: First, we constructed a questionnaire based on…

The continuation task, a new form of reading-writing integrated task in which test-takers read an incomplete story and then write the continuation and ending of the story, has been increasingly used in writing assessment, especially in China. However, language-test developers' understanding of the effects of important task-related factors on…