ERIC Number: EJ1462419
Record Type: Journal
Publication Date: 2025
Pages: 32
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-1094-3501
Available Date: 0000-00-00
Are We Testing What We Think We Are? A Multi-Site Investigation of Typed and Handwritten L2 Chinese Writing Assessments
Language Learning & Technology, v29 n2 p190-221 2025
The extent to which writing modality (i.e., hand-writing vs. keyboarding) impacts second-language (L2) writing assessment scores remains unclear. For alphabetic languages like English, research shows mixed results, documenting both equivalent and divergent scores between typed and handwritten tests (e.g., Barkaoui & Knouzi, 2018). However, for non-alphabetic languages like Chinese, typed responses consistently outscore handwritten ones across proficiency levels (e.g., Bourgerie et al., 2023; Liao, 2023; Zhang & Min, 2019; Zhu et al., 2016), and advanced proficiency groups. This study examined whether this scoring differential exists at the intermediate level. Writing samples were collected from 60 intermediate-level university L2 Chinese learners (N = 120), with counter-balanced prompts and modalities. Two certified raters used a three-criterion analytic rubric for scoring. A linear mixed-effects model showed that regardless of modality or prompt order, test takers produced more content and achieved higher scores on typed responses, even when controlling for language proficiency, multilingual experiences, and Chinese writing/typing habits. These findings suggest that handwritten and typed L2 Chinese test tasks may assess different constructs, carrying implications for various assessment contexts (classroom assessment, placement testing, proficiency tests) and assessment research.
Descriptors: Computer Assisted Testing, Paper and Pencil Tests, Second Language Learning, Chinese, Writing Tests, Writing Achievement, Differences, Language Tests, Public Colleges, Undergraduate Students
National Foreign Language Resource Center at University of Hawaii. 1859 East-West Road #106, Honolulu, HI 96822. e-mail: llt@hawaii.edu; Web site: https://www.lltjournal.org/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A