Automated Writing Evaluation (AWE) provides automatic writing feedback and scoring to support student writing and revising. The purpose of the present study was to analyze a statewide implementation of an AWE software (n = 114,582) in grades 4-11. The goals of the study were to evaluate: (1) to what extent AWE features were used; (2) if equity and…

Two methods to establish a common scale across grades within a content area using a common item design (separate and concurrent) have previously been studied under simulated conditions. Separate estimation is accomplished through separate calibration and grade-by-grade chained linking. Concurrent calibration established the vertical scale in a…

Examined a scoring anomaly that became apparent in a state-mandated writing assessment. Results for 3,660 essays by sixth graders show that using a spiral model for training raters and scoring papers results in higher mean ratings than does using a sequential model for training and scoring. Findings demonstrate the importance of making decisions…

Studied the impact of experience scoring the Maryland School Performance Assessment tasks on teachers' instructional and classroom assessment practice. Interview data, questionnaires, classroom observation, and classroom artifacts from approximately 5 teacher-scorers demonstrated that teachers' appropriation of performance-based instruction may be…

Under a Congressional mandate, the General Accounting Office (GAO) studied the costs of implementing tests that will be required under the No Child Left Behind Act (NCLBA) and the reauthorization of the Title I program. In passing the legislation, Congress increased the frequency with which states are to measure student achievement in mathematics…

Since the passage of the 1997 amendments to the Individuals with Disabilities Education Act, inclusion of all students with disabilities in accountability systems has been mandatory. By 2001, school personnel began to understand that alternate assessment needed to focus on students' performance on state standards, and nearly all states had created…

The purpose of this study was to examine rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scores. Twenty rates were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia High School Writing Test. All of the raters…

An analytic framework is presented for examining the properties and objectives of assessments and scoring systems piloted in a number of state and district testing programs. The article explores the application of this framework, which considers the cognitive components of competence described in studies of expertise, to the analysis of science…

During the fall of 1979 the University of Texas Department of Government requested that the credit-by-examination program for a basic survey of American government be examined. The course, Government 310L, was developed out of previous policies and earlier validity studies of the College-Level Examination Program (CLEP) tests. The present validity…

The effect of rapid feedback for a state writing assessment on subsequent writing performance was investigated. In addition, the agreement between teachers' scores for the state writing assessment and state department scores was analyzed. Eighth grade English teachers (n=8) were trained in analytic trait scoring of writing assessments. They then…

This report describes the procedures followed in scoring the October 1978 Florida Minimal Writing Production Skills Assessment and reports the results of that assessment. The assessment was conducted on a sample of Florida public school students in grades 3, 5, 8, and 11. Sections include descriptions of the rating scale and scorer's guide as well…

Under contract with the Oregon State Department of Education, Educational Testing Service (ETS) assisted in the preparation of a fourth grade reading assessment test based on, or modified from, Instructional Objectives Exchange materials. ETS produced test books, answer sheets, and all required ancillary materials necessary for test distribution…

This study invesitigated possible reasons for the low performance on the text-based writing assessment of the Delaware Student Testing Program (DSTP) in 2000, especially for grades 3 and 5, and considered ways to improve classroom instruction. In the first part of the study, a panel of teachers reviewed the anchor papers from the assessment and…

The studies reported here focus on the effects of mode of administration of the Massachusetts Comprehensive Assessment System (MCAS) in grades 4, 8, and 10. These studies, which draw on earlier studies, also examine the mode of administration effect at different levels of keyboarding speed and for students who received special education (SPED)…

This paper examined the status of assessment of writing as it is currently performed in the United States. All fifty states and the District of Columbia responded to a survey requesting information on their testing programs. Twenty-six states and the District of Columbia were found to assess writing on the statewide level, and eight states were in…