ERIC Number: EJ1111046
Record Type: Journal
Publication Date: 2005-Mar
Pages: 67
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Available Date: N/A
An Investigation of the Impact of Composition Medium on the Quality of TOEFL Writing Scores. TOEFL® Research Report. RR-72. ETS RR-04-29
Wolfe, Edward W.; Manalo, Jonathan R.
ETS Research Report Series, Mar 2005
This study examined scores from 133,906 operationally scored Test of English as a Foreign Language™ (TOEFL®) essays to determine whether the choice of composition medium has any impact on score quality for subgroups of test-takers. Results of analyses demonstrate that (a) scores assigned to word-processed essays are slightly more reliable than scores assigned to handwritten essays and exhibit higher correlations with TOEFL multiple-choice subscores; (b) female test-takers, examinees whose native language is not based on a Roman/Cyrillic alphabet, and examinees with lower English proficiency are more likely to choose the handwriting medium; (c) the probability of choosing handwriting as the composition medium increases with age for Asian examinees, but decreases with age for most European examinees; and (d) examinees with lower TOEFL multiple-choice scores tend to have higher handwritten than word-processed essay scores, while examinees with higher TOEFL multiple-choice scores tend to have similar scores in either medium.
Descriptors: English (Second Language), Language Tests, Second Language Learning, Scores, Essay Tests, Word Processing, Reliability, Correlation, Gender Differences, Limited English Speaking, Handwriting, Probability, Asians, Age Differences, Multiple Choice Tests, Computer Assisted Testing, Regression (Statistics), Statistical Analysis
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A
Author Affiliations: N/A