In recent years, language practitioners have paid increasing attention to artificial intelligence (AI)'s role in language programs. This study investigated the impact of AI-assisted language assessment on L2 learners' foreign language anxiety (FLA), attitudes, motivation, and writing skills. The study adopted a sequential exploratory mixed-methods…

The computerized adaptive tests (CAT) apply an adaptive process in which the items are tailored to individuals' ability scores. The multidimensional CAT (MCAT) designs differ in terms of different item selection, ability estimation, and termination methods being used. This study aims at investigating the performance of the MCAT designs used to…

Technology, constantly present in current society and education, needs to make use of the most effective digital resources to optimize the teaching-learning process. Despite the growing body of literature on the pedagogical effectiveness of digital resources in a second language (L2) context, limited research has been conducted when working with…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

The use of accommodations is often recommended to remove barriers to academic testing among English Learners (ELs). However, it is unclear whether accommodations are particularly effective at improving ELs' test scores. A growing foundation of empirical work has explored this topic. We conducted a meta-analysis that examined several possible…

In three experiments, we used a masked prime in a verification task to investigate the processing stages occurring during multiplication fact retrieval. We aimed to investigate the retrieval process by overlapping its execution with the processing of a masked prime consisting of a number. Participants evaluated the correctness of multiplication…

The use of digital environments for both learning and assessment is becoming prevalent. This often leads to incongruent situations, in which the study medium (eg, printed textbook) is different from the testing medium (eg, online multiple-choice exams). Despite some evidence that incongruent study-test situations are associated with inferior…

Studies examining visuospatial working memory (WM) in individuals with congenital deafness have yielded inconsistent results, and tactile WM has rarely been examined. The current study examined WM span tasks in the two modalities among 20 individuals with congenital deafness and 20 participants with typical hearing. The congenital deafness group…

Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

The top-down approach to designing a multistage test is relatively understudied in the literature and underused in research and practice. This study introduced a route-based top-down design approach that directly sets design parameters at the test level and utilizes the advanced automated test assembly algorithm seeking global optimality. The…

The final step of the typical process of developing educational and psychological tests is to place the selected test items in a formatted form. The step involves the grouping and ordering of the items to meet a variety of formatting constraints. As this activity tends to be time-intensive, the use of mixed-integer programming (MIP) has been…

Increasing student engagement and improving learning outcomes are ongoing issues in higher education worldwide. These issues were particularly pertinent during the COVID-19 pandemic when remote learning was selected as the primary instructional learning setting. This study aims to assess the impact of gamification-based quiz instruction in driving…

The COVID-19 pandemic has brought the rapid transition to online quantitative education, leading to unique challenges and opportunities in assessments for both students and instructors. Focusing on undergraduate students and teaching staff at a Canadian university, this study investigates and compares their experiences and perspectives regarding…