Over the years, we have been witnessing the burgeoning of interdisciplinary interest in the use of ideological discourses and enactment of representations through linguistic and semiotic choices in positioning, (re)constructing and expressing identities. In this picture, there is an evident paucity of research investigating the kinds of…

This study investigates the effects of four online vocabulary tasks on second language (L2) vocabulary acquisition among learners of different proficiency levels. While tasks are widely used to support L2 vocabulary learning, the efficacy of a task depends on the interplay between task and learner factors. Thus, choosing an appropriate task…

Arabic is one of the largest donor languages to Malay and Persian. This study explores the benefits of Arabic vocabulary in teaching Malay words of Arabic origin to Persian-speaking students using a vocabulary survey containing 40 Malay words of Arabic origin, most of which retain phonetic or semantic similarity in Persian. Participants were 20…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

The Multiple-choice (MC) item format is commonly used in educational assessments due to its economy and effectiveness across a variety of content domains. However, numerous studies have examined the quality of MC items in high-stakes and higher-education assessments and found many flawed items, especially in terms of distractors. These faulty…

This study investigates meaning-making processes in language and literacy assessments. Using a social semiotic perspective, it examines how adult second language learners with emerging literacy self-articulate their understanding of multimodal elements and components utilized in low-stakes assessments, and the strategies they use to make meaning…

This study investigates the effects of linguistic knowledge (vocabulary knowledge) and cognitive abilities (metacognitive knowledge and cognitive styles) on the second language (L2) listening comprehension at different proficiency levels. The study has also sought to investigate whether or not cognitive abilities and L2 linguistic knowledge are…

Background: We adopted a theoretical framework that the acquisition of a scientific concept comprises the development of connections among conceptual elements associated with a scientific term within a mental semantic network. Given this framework, the hypothesis that the surrounding words connected with a scientific term are relevant to the…

Although an accurate measure of vocabulary size is integral to understanding the proficiency of language learners, the validity of multiple-choice (M/C) vocabulary tests to determine this has been questioned due to users guessing correct answers which inflates scores. In this paper the nature of guessing and partial knowledge used when taking the…

This cross-sectional study examined the effects of English language proficiency on Jordanian EFL students' production and comprehension of apology strategies. The participants were 270 Jordanian EFL learners and 90 native speakers of English. Data were collected using Written Discourse Completion Test (WDCT) and Multiplechoice Discourse Completion…

Stewart questioned vocabulary size estimation methods proposed by Beglar and Nation for the Vocabulary Size Test, further arguing Rasch mean square (MSQ) fit statistics cannot determine the proportion of random guesses contained in the average learner's raw score, because the average value will be near 1 by design. He illustrated this by…

High stakes testing, such as IELTS, is designed to select individuals for decision-making purposes (Fulcher, 2013b). Hence, there is a slow-growing stream of research investigating the subskills of IELTS listening and, in feedback terms, its effects on individuals and educational programs. Here, cognitive diagnostic assessment (CDA) performs it…

This study aimed to examine the effect of test format on test performance by comparing Multiple Choice (MC) and Constructed Response (CR) vocabulary tests in an EFL setting. Also, this paper investigated the function of gender in MC and CR vocabulary measures. To this end, five 20-item stem-equivalent vocabulary tests (CR, and 3-, 4-, 5-, and…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020…

Testing organizations are faced with increasing demand to provide subscores in addition to the total test score. However, psychometricians argue that most subscores do not have added value to be worth reporting. To have added value, subscores need to meet a number of criteria: they should be reliable, distinctive, and distinct from each other and…