Typical print formatting provides no information regarding the linguistic features of a text, although texts vary considerably with respect to grammatical complexity and readability. Complex texts may be particularly challenging for individuals with weak language knowledge, such as English language learners. This paper investigates the usefulness…

This study evaluated the validity of the Michigan English Test (MET) Listening Section by investigating its underlying factor structure and the replicability of its factor structure across multiple test forms. Data from 3255 test takers across four forms of the MET Listening Section were used. To investigate the factor structure, each form was…

Exploratory cognitive diagnosis models (CDMs) estimate the Q matrix, which is a binary matrix that indicates the attributes needed for affirmative responses to each item. Estimation of Q is an important next step for improving classifications and broadening application of CDMs. Prior research primarily focused on an exploratory version of the…

Learning a second language (L2) is dependent upon numerous external and internal factors, among which motivation plays a relevant role. In fact, motivation has been recognized as crucial in the L2 learning process (Ushioda, 2012). Such has been its importance that interest in L2 motivation has led to the development of theories such as the L2…

In language assessment and in educational measurement more broadly, there is a tendency to interpret scores from single-administration tests as accurate indicators of a latent trait (e.g., reading ability). Even in contexts where learners receive multiple formative assessments throughout the year, estimates of student ability are determined based…

Prior research has shown that, under certain conditions, Human-Agent (H-A) alignment exists to a stronger degree than that found in Human-Human (H-H) communication. In an H-H Second Language (L2) setting, evidence of alignment has been linked to learning and teaching strategy. We present a novel analysis of H-A and H-H L2 learner dialogues using…

Item Response Theory (IRT) is a ubiquitous model for understanding humans based on their responses to questions, used in fields as diverse as education, medicine and psychology. Large modern datasets offer opportunities to capture more nuances in human behavior, potentially improving test scoring and better informing public policy. Yet larger…

A few studies suggest that gifted children with dyslexia have better literacy skills than averagely intelligent children with dyslexia. This finding aligns with the hypothesis that giftedness-related factors provide compensation for poor reading. The present study investigated whether, as in the native language (NL), the level of foreign language…

Considering the increasing importance of adaptive approaches in CALL systems, this study implemented a machine learning based student modeling middleware with Bayesian networks. The profiling approach of the student modeling system is based on Felder and Silverman's Learning Styles Model and Felder and Soloman's Index of Learning Styles…

In light of a recent revelation that Gersten (1985) included erroneous information on one of two programs for English Language Learners (ELLs), the authors re-calculate results of their earlier meta-analysis of program effectiveness studies for ELLs in which Gersten's studies had behaved as outliers (Rolstad, Mahoney & Glass, 2005). The correction…

Two procedures were developed to determine whether examinees in a given test center were affected by a testing irregularity on the Listening Comprehension section of the Test of English as a Foreign Language (TOEFL). One approach employed analysis of covariance (ANCOVA) on Listening Comprehension (Section 1) means using scores on Structure and…

Instructional sensitivity indices are compared from four perspectives: (1) criterion-referenced testing; (2) classical test theory; (3) item response theory; and (4) Bayesian theory. Instructional sensitivity is defined as the tendency of a test item to vary in difficulty as a function of instruction. The instructional sensitivity of the items in…

This article asks whether children enrolled in a bilingual education program learn English in a reasonable amount of time, and whether older children learn English faster than younger children. Children (N = 89) were found to achieve parity with native English speakers in a range of 1 to 6.5 years and in an average of 3.31 years on measures of…