NotesFAQContact Us
Collection
Advanced
Search Tips
Showing all 6 results Save | Export
"How Do Raters Learn to Rate?" Many-Facet Rasch Modeling of Rater Performance over the Course of a Rater Certification Program
Peer reviewed Peer reviewed
Direct linkDirect link
Yan, Xun; Chuang, Ping-Lin – Language Testing, 2023
This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…
Descriptors: Evaluators, Interrater Reliability, Item Response Theory, Certification
Dimensionality of Speech Fluency: Examining the Relationships among Complexity, Accuracy, and Fluency (CAF) Features of Speaking Performances on the Aptis Test
Peer reviewed Peer reviewed
Direct linkDirect link
Yan, Xun; Kim, Ha Ram; Kim, Ji Young – Language Testing, 2021
Speech fluency has been extensively researched as a core construct for second language (L2) speaking assessment. Despite the broad consensus on its multifaceted nature, few researchers have empirically explored the dimensionality of this construct. Operationalizations of fluency vary across research and practice, using both holistic and…
Descriptors: Language Fluency, Language Tests, Accuracy, Speech Communication
"Am I Qualified to Be a Language Tester?": Understanding the Development of Language Assessment Literacy across Three Stakeholder Groups
Peer reviewed Peer reviewed
Direct linkDirect link
Yan, Xun; Fan, Jason – Language Testing, 2021
Recent investigations into language assessment literacy (LAL) suggest that stakeholder groups might differ in interests, needs, and expectations in assessment practice, resulting in different LAL profiles. This qualitative study furthers this line of research by examining the effect of contextual and experiential factors on the LAL profiles and…
Descriptors: Evaluators, Language Tests, Language Teachers, Second Language Learning
Factor Analysis for Fairness: Examining the Impact of Task Type and Examinee L1 Background on Scores of an ITA Speaking Test
Peer reviewed Peer reviewed
Direct linkDirect link
Yan, Xun; Cheng, Lixia; Ginther, April – Language Testing, 2019
This study investigated the construct validity of a local speaking test for international teaching assistants (ITAs) from a fairness perspective, by employing a multi-group confirmatory factor analysis (CFA) to examine the impact of task type and examinee first language (L1) background on the internal structure of the test. The test consists of…
Descriptors: Scores, Language Tests, Teaching Assistants, Culture Fair Tests
Elicited Imitation as a Measure of Second Language Proficiency: A Narrative Review and Meta-Analysis
Peer reviewed Peer reviewed
Direct linkDirect link
Yan, Xun; Maeda, Yukiko; Lv, Jing; Ginther, April – Language Testing, 2016
Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…
Descriptors: Second Language Learning, Language Proficiency, Meta Analysis, Effect Size
Interpreting the Relationships between TOEFL iBT Scores and GPA: Language Proficiency, Policy, and Profiles
Peer reviewed Peer reviewed
Direct linkDirect link
Ginther, April; Yan, Xun – Language Testing, 2018
This study examines the predictive validity of the TOEFL iBT with respect to academic achievement as measured by the first-year grade point average (GPA) of Chinese students at Purdue University, a large, public, Research I institution in Indiana, USA. Correlations between GPA, TOEFL iBT total and subsection scores were examined on 1990 mainland…
Descriptors: Correlation, Computer Assisted Testing, Profiles, English (Second Language)