The purpose of the current study was to analyze the relationship between automated essay scoring (AES) and human scoring in order to determine the validity and usefulness of AES for large-scale placement tests. Specifically, a correlational research design was used to examine the correlations between AES performance and human raters' performance.…

The present study employed multi-faceted Rasch measurement (MFRM) to explore the rater bias patterns of native English-speaker (NES) raters when they rate EFL essays. Forty NES raters rated 40 essays written by female Japanese university students on a single topic adapted from the TOEFL Test of Written English (TWE). The essays were assessed using…

This study of 118 students who placed into basic skills sections of College English suggests that students' self-beliefs may be a particularly important predictor of success in weak writers in first-semester courses. Two types of writing self-efficacy scales--a writing tasks/skills scale and an approach-to-writing scale--were developed to follow…

The authors surveyed graduate programs to see how they use the Graduate Record Examination Analytic Writing (GRE-AW) Test. Only 35% of the graduate programs that responded use the GRE-AW test in their admission policy; of the programs not using it, most do not plan to do so. The programs using the GRE-AW rated it as medium or low in importance in…

This paper is an examination of statewide district writing achievement gain data from the Nebraska Statewide Writing Assessment system and implications for statewide assessment writing models. The writing assessment program is used to gain compliance with the United States No Child Left Behind Law (NCLB), a federal effort to influence school…

This article explores the use of scoring rubrics in the context of deteriorating material conditions of writing instruction. The author hopes to offer a consideration of rubrics that enables a revision of rubric designs, in order to facilitate teacher response to student writing, and that offers suggestions for uses of rubrics that account for…

This study examined the reliability of scores assigned to the essays written by Kentucky students to meet the University Writing Requirement (UWR) at Eastern Kentucky University. Two sets of essays, 50 each, on the same prompt that had been read and scored in 1989 and 1997 by trained UWR scorers were read by 7 UWR scorers in 2000. A correlation…

Discusses the heavy demand on teachers and students for making sense of writing test scores. Illustrates the interpretive demands of going beyond writing test scores to make sense of the scores. Suggests that these demands point to the need for professional development in this area. (RS)

Discusses various reasons why teachers should pay attention to religious writing from students. Uses examples taken from proficiency exam reader-training sessions. (NH)

Used an analytic rubric to score 120 writing samples from Georgia's 11th grade writing assessment. Raters augmented scores by adding a "+" or "-" to the score. Results indicate that this method of augmentation tends to improve most indices of interrater reliability, although the percentage of exact and adjacent agreement…

This paper provides information about New Mexico High School Competency Examination (NMHSCE), a minimum competency test. Its purpose is to meet a state mandate. It will be replaced by the Grade 11 Standards Based Assessment/High School Graduation Assessment (SBA/HSGA) in spring 2011 as the state's high school exit exam. The NMHSCE was administered…

Presented at the national conference for AERA (American Educational Research Association) . This study examined whether there are distinct differences in the demographic characteristics, HSGPA, first-year college performance, and second-year college retention rates among students who have discrepant CR-W performance.

In order to motivate university students to improve their English proficiency, the Hong Kong government decided to adopt a common exit English language test for all graduating students. In the process of selecting a suitable measure for this purpose, an empirical study with a sample of over 240 students was conducted to compare two English…

Since the 1980s, composition studies have considered the steps to be taken before assessment: designing the test essay question. While large-scale assessment has little control over writing variables (such as students' learning styles, their reading ability, and their interpretation of the topic), the content or the topic of the writing prompt and…

This paper reports on the myriad difficulties in getting rid of an unsatisfactory writing examination in place at Western Washington University. First, the paper provides background information on how and why the exam (the Junior Writing Exam) came to be adopted in the 1980s (as a diagnostic test only) and explains what the exam was meant to…