Automated Writing Evaluation (AWE) provides automatic writing feedback and scoring to support student writing and revising. The purpose of the present study was to analyze a statewide implementation of an AWE software (n = 114,582) in grades 4-11. The goals of the study were to evaluate: (1) to what extent AWE features were used; (2) if equity and…

Categorizes students' self-selected topics in a state writing assessment. Finds that fifth graders chose "animals"; eighth graders chose "sports"; high-school students chose "social problems" and "sports" until twelfth grade, when "school/learning" issues replaced "sports." (RS)

Examined a scoring anomaly that became apparent in a state-mandated writing assessment. Results for 3,660 essays by sixth graders show that using a spiral model for training raters and scoring papers results in higher mean ratings than does using a sequential model for training and scoring. Findings demonstrate the importance of making decisions…

The purpose of this study was to examine rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scores. Twenty rates were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia High School Writing Test. All of the raters…

The purpose of this study was to describe the Rasch model for measurement and apply the model to examine the relationship between raters, domains of written compositions, and student writing ability. Twenty raters were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia…

The effect of rapid feedback for a state writing assessment on subsequent writing performance was investigated. In addition, the agreement between teachers' scores for the state writing assessment and state department scores was analyzed. Eighth grade English teachers (n=8) were trained in analytic trait scoring of writing assessments. They then…

In 1990, the state of Kentucky created a new school system through the Kentucky Educational Reform Act (KERA). While KERA mandates wide-ranging progressive reform, testing through the Kentucky Instructional Results Information System (KIRIS) makes sure teachers get the job done. Though all Kentucky teachers are involved in writing, those at the…

This study invesitigated possible reasons for the low performance on the text-based writing assessment of the Delaware Student Testing Program (DSTP) in 2000, especially for grades 3 and 5, and considered ways to improve classroom instruction. In the first part of the study, a panel of teachers reviewed the anchor papers from the assessment and…

The effects of presenting a choice of writing tasks on the quality of essays produced by eleventh graders were studied with 34,200 students in Georgia. The choice condition had no substantive effect on the quality of essays, but race, gender, and the writing task variable did. (SLD)

The purpose of this report is to provide information about the level of student performance in the area of writing based on results for 1998-99 from the annual on-demand writing sample of the North Carolina Writing Assessment at grades 4, 7, and 10 (English II). It notes student performance increased at grades 4 and 7 when compared to student…

This survey of educators examined validity issues in Arizona's program of authentic assessment of written communication. The paper concludes that authentic measures lack meaningful standards. Major flaws were reported in the areas of "fairness,""transfer and generalizability,""content quality," and…

Studied the amount of measurement error in a state's performance-based writing task as it relates to high-stakes decision reproducibility. Using 175 eighth-grade writing samples, the study finds moderate correlations between the two raters' scores, with significant differences for the rates for the handwritten, but not the typed, essays.(SLD)

Florida requires all students in grades 3, 5, 8, and 11 to demonstrate mastery of minimum performance standards using the Florida Student State Assessment Test (SSAT) forms for the appropriate grade level. The tests are administered in October and cover reading, writing, and mathematics. Current practices used to prepare students for the SSAT…

The relationship between student scores on standardized achievement tests taken in the eighth grade and the Ohio Ninth Grade Proficiency Test (ONGPT) was studied to determine whether standardized achievement test cut-off scores can be used in place of the ONGPT. Students enrolled in the eighth grade in an urban school district in the spring of…

Two studies investigated the performance of Florida high school seniors on the Tests of General Educational Development (GED Tests). The GED Test Battery, as revised in 1980, consists of 290 items in 5 subject areas (writing, social studies, science, reading, and mathematics). In the first study, the performance of 1,200 Florida students was…