ERIC Number: EJ1472029
Record Type: Journal
Publication Date: 2025-Jun
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0731-1745
EISSN: EISSN-1745-3992
Available Date: 2025-04-21
Applications and Modeling of Keystroke Logs in Writing Assessments
Mo Zhang1; Paul Deane1; Andrew Hoang1; Hongwen Guo1; Chen Li1
Educational Measurement: Issues and Practice, v44 n2 p5-19 2025
In this paper, we describe two empirical studies that demonstrate the application and modeling of keystroke logs in writing assessments. We illustrate two different approaches of modeling differences in writing processes: analysis of mean differences in handcrafted theory-driven features and use of large language models to identify stable personal characteristics. In the first study, we examined the effects of test environment on writing characteristics: at-home versus in-center, using features extracted from keystroke logs. In a second study, we explored ways to measure stable personal characteristics and traits. As opposed to feature engineering that can be difficult to scale, raw keystroke logs were used as input in the second study, and large language models were developed to infer latent relations in the data. Implications, limitations, and future research directions are also discussed.
Descriptors: Writing Tests, Computer Assisted Testing, Keyboarding (Data Entry), Writing Processes, Individual Differences, Individual Characteristics, Context Effect, Artificial Intelligence, Models
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www-wiley-com.bibliotheek.ehb.be/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Educational Testing Service