ERIC Number: EJ971110
Record Type: Journal
Publication Date: 2012-Aug
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0266-4909
EISSN: N/A
Available Date: N/A
Detecting Breakdowns in Local Coherence in the Writing of Chinese English Learners
Wang, Y.; Harrington, M.; White, P.
Journal of Computer Assisted Learning, v28 n4 p396-410 Aug 2012
This paper introduces "CTutor", an automated writing evaluation (AWE) tool for detecting breakdowns in local coherence and reports on a study that applies it to the writing of Chinese L2 English learners. The program is based on Centering theory (CT), a theory of local coherence and salience. The principles of CT are first introduced and then the design and function of "CTutor" are described. The effectiveness and reliability of the program was evaluated in a study that compared performance by "CTutor" and two human raters on the analysis of local incoherence and provision of revision on learner essays. Intermediate Chinese English as a foreign language learners (n = 52) were divided into two groups: one receiving "CTutor" feedback and the other receiving feedback from human raters. Learners in both groups completed three essays; each of which involved the submission of a first draft, revision with feedback on local coherence quality and re-submission. Our results from the comparison between "CTutor" and human experts showed that this software tool is able to detect local coherence breakdowns with moderate accuracy (F1-measure is around 0.4). There was also little difference between participants' responses to "CTutor" feedback and human feedback in terms of revision behaviour, with both feedback modes resulting in similar revision pattern. Potential use of the program in instructional settings is discussed.
Descriptors: Foreign Countries, Educational Technology, Expertise, Feedback (Response), Writing Evaluation, Second Language Learning, Essays, English (Second Language), Reliability, Computer Software, Revision (Written Composition), Computer Software Evaluation, Computer Uses in Education, Comparative Analysis
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com.bibliotheek.ehb.be/WileyCDA/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: China
Grant or Contract Numbers: N/A
Author Affiliations: N/A