Recently, Northwest Evaluation Association (NWEA) completed a study to connect the scale of the Minnesota Comprehensive Assessments (MCA) Testing Program used for Minnesota's mathematics and reading assessments with NWEA's RIT (Rasch Unit) scale. Information from the state assessments was used in a study to establish performance-level scores on…

One method to correct for selection bias in comparing Scholastic Aptitude Test (SAT) scores among states is presented, which is a modification of J. J. Heckman's Selection Bias Correction (1976, 1979). Empirical results suggest that sample selection bias is present in SAT score regressions. (SLD)

To help teachers, administrators, and parents understand student performance in writing, a state-level report is prepared each year to analyze students writing scores and provide guidelines for the interpretation of the results. This report compares students scores on the 2001 Delaware Student Testing Program (DSTP) with scores on the 2000 DSTP…

In response to concerns that Title I, the largest source of federal funding for education, was not significantly improving the educational achievement of at-risk students, Congress, in 1994, mandated major changes, including changes to the ways in which states measure student performance. This report provides a snapshot of how close states had…

Discusses issues associated with the use of holistic and analytic scoring methods in large-scale student assessments. Reviews the education literature and describes the recent Saskatchewan study comparing the results of the two scoring approaches applied to an achievement test taken by about 1,600 third graders. (SLD)

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

Cost factors associated with the development, administration, and scoring of performance assessment tasks are examined in the context of a statewide or other large-scale assessment program. Resources of money, time, and expertise are discussed. (SLD)

This paper contributes to the body of knowledge on new forms of assessment by examining the impact of teacher involvement in the scoring of standards-based performance assessments. Researchers studied 250 of 500 teachers who participated in a New York state project to pilot new state assessment prototypes. The National Center for Restructuring…

Portfolios are the centerpiece of Vermont's statewide assessment program in mathematics. Portfolio scores in the first two years were not reliable enough to permit the reporting of student-level results, but increasing the number of readers or the number of portfolio pieces is not operationally feasible. (SLD)

Writing assessment began in Alaska in the 1970s, and the Alaska Writing Assessment (AWA) that was piloted in 1997 built on previous efforts. The 1997 AWA involved more than 20,000 students in grades 5, 7, and 10 from 43 school districts, and the mandatory assessment planned for 1998 will include approximately 28,000 students. This review of the…

Results are presented from a study of portfolio use for large-scale assessment in the Pittsburgh (Pennsylvania) public schools that are more encouraging for the use of this form of assessment than many other studies have been. Requirements for the psychometric integrity of portfolio assessment are discussed. (SLD)

This study examines the impact of the Pennsylvania writing assessment policy on writing instruction and teaching methodology. Drawing on self-reported teacher perceptions and classroom practices, the study also attempts to identify the factors that influence teacher beliefs and their use of materials and processes related to the state writing…

Four threats to validity of an alternative objective test item format, the multiple-mark format, were studied with data from a state-mandated assessment with about 30,000 students at each of three grade levels. Reliability and validity coefficients show that the format has promise as an objective format that can be aligned with new curriculum…

Teachers' reactions to the administration and scoring of the Maryland School Performance Assessment Program tests (MSPAP) were studied, focusing on their direct and indirect exposure to tasks and evaluative criteria through the experience of scoring the MSPAP. Since its inception in 1991, the MSPAP has been scored in-state by certified teachers…

In the initial article by Edward Roeber, performance assessment is defined as an exercise in which the student demonstrates specific skills and competencies rather than selecting one of several predetermined answers to an exercise. Such as assessment contains four components: (1) a reason for the assessment; (2) a particular peformance to be…