Automated Writing Evaluation (AWE) provides automatic writing feedback and scoring to support student writing and revising. The purpose of the present study was to analyze a statewide implementation of an AWE software (n = 114,582) in grades 4-11. The goals of the study were to evaluate: (1) to what extent AWE features were used; (2) if equity and…

Most experts in the testing community have presumed that the $350 million promised by the U.S. Department of Education to support common assessments would promote those that made greater use of open-ended items capable of measuring higher-order critical-thinking skills. But as measurement experts consider the multitude of possibilities for an…

One method to correct for selection bias in comparing Scholastic Aptitude Test (SAT) scores among states is presented, which is a modification of J. J. Heckman's Selection Bias Correction (1976, 1979). Empirical results suggest that sample selection bias is present in SAT score regressions. (SLD)

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)

Examined a scoring anomaly that became apparent in a state-mandated writing assessment. Results for 3,660 essays by sixth graders show that using a spiral model for training raters and scoring papers results in higher mean ratings than does using a sequential model for training and scoring. Findings demonstrate the importance of making decisions…

"Test Scoring" provides insight into psychometric procedures as used by a professional testing company or in large-scale projects. The book contains an overview of standard test theory, a discussion of factor analytic theory, and an exploration of special applications and problems. (SLD)

Studied the impact of experience scoring the Maryland School Performance Assessment tasks on teachers' instructional and classroom assessment practice. Interview data, questionnaires, classroom observation, and classroom artifacts from approximately 5 teacher-scorers demonstrated that teachers' appropriation of performance-based instruction may be…

Discusses issues associated with the use of holistic and analytic scoring methods in large-scale student assessments. Reviews the education literature and describes the recent Saskatchewan study comparing the results of the two scoring approaches applied to an achievement test taken by about 1,600 third graders. (SLD)

An analytic framework is presented for examining the properties and objectives of assessments and scoring systems piloted in a number of state and district testing programs. The article explores the application of this framework, which considers the cognitive components of competence described in studies of expertise, to the analysis of science…

A variety of methods are used to assess secondary school seniors in Australia to determine college admission: locally-developed achievement tests in curricular subjects; external achievement tests; and general aptitude tests, such as the Australian Scholastic Aptitude Tests. Testing problems include aggregating and rescaling of scores. (GDC)

Cost factors associated with the development, administration, and scoring of performance assessment tasks are examined in the context of a statewide or other large-scale assessment program. Resources of money, time, and expertise are discussed. (SLD)

The new Florida Master Teacher Program in which the state provides bonuses directly to qualified teachers is described. Three measurement issues in implementing the program are discussed: (1) evaluating a teacher's classroom performance; (2) evaluating a teacher's subject area knowledge; and (3) combining scores to determine which teachers…

Portfolios are the centerpiece of Vermont's statewide assessment program in mathematics. Portfolio scores in the first two years were not reliable enough to permit the reporting of student-level results, but increasing the number of readers or the number of portfolio pieces is not operationally feasible. (SLD)

Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

Five methods of equating minimum-competency tests were compared using the Florida Statewide Student Assessment Test, Part II, for 1984 and 1986. Four of five methods yielded essentially comparable results for the highest scoring 84% of the students. Different lengths of anchor items were compared, using the concurrent item response theory equating…