While numerous recent authors have studied the effects of school accountability systems on student test performance, there has been very little research with regards to school mobility with school performance grades in an A-F system. For the purpose of this study, mobility is defined as a school's ability to have an increase or decrease in their…

We used meta-analysis to examine the criterion validity of four scoring procedures used in curriculum-based measurement of written language. A total of 22 articles representing 21 studies (N = 21) met the inclusion criteria. Results indicated that two scoring procedures, correct word sequences and correct minus incorrect sequences, have acceptable…

Survey results from a national sample of economics instructors describe the grading policies and practices in principles of economics courses. The survey results provide insights about absolute and relative grading systems used by instructors, the course components and their weights that determine grades, and the type of assessment items used for…

Automated scoring models for the "e-rater"® scoring engine were built and evaluated for the "GRE"® argument and issue-writing tasks. Prompt-specific, generic, and generic with prompt-specific intercept scoring models were built and evaluation statistics such as weighted kappas, Pearson correlations, standardized difference in…

A rational approach to standard transformed scores which always results in the numerical to letter grade correspondence for any chosen hypothetical grade distribution model is developed. (Author/LMO)

For idealized item configurations, equal item weights are often virtually as good for a particular predictive purpose as the item weights that are theoretically optimal. What has not been clear, however, is what happens to the similarity when the item configuration's variance structure is complex. (Author/CTM)

The High School Longitudinal Study of 2009 (HSLS:09) is the fifth in a series of National Center for Education Statistics (NCES) secondary longitudinal studies. The core research questions for HSLS:09 explore secondary to postsecondary transition plans and the evolution of those plans; the paths into and out of science, technology, engineering,…

The use of Guttman weights in scoring tests is discussed. Scores of 2,500 men on one subtest of the CEED-SAT-Verbal Test were examined using cross-validated Guttman weights. Several scores were compared, as follows: Scores obtained from cross-validated Guttman weights; Scores obtained by rounding the Guttman weights to one digit, ranging from 0 to…

Option weighting is an alternative to increasing test length as a means of improving the reliability of a test. The effects on test reliability of option weighting procedures were compared in two empirical studies using four independent sets of items. Biserial weights were found to be superior. (Author/CTM)

The reliabilities yielded by several differential option weighting scoring procedures were compared among themselves as well as against conventional testing. It was found that increases in reliability due to differential option weighting were a function of inter-item correlations. Suggestions for the implementation of differential option weighting…

This paper outlines a technique for differentially weighting options of a multiple choice test in a fashion that maximizes the item predictive validity. The rule can be applied with different number of categories and the "optimal" number of categories can be determined by significance tests and/or through the R2 criterion. Our theoretical analysis…

Data from five separate samples were weighted using the vertical percent method (England) and the rare response method (Telenson, Alexander, and Barrett) to investigate their relative effectiveness for scoring biographical information blanks. Vertical percent scoring yielded significant validity coefficients for all samples, while rare response…

This pilot study compared two empirically-derived, option-weighting methods and the resultant effect on the reliability and validity of multiple choice test scores as compared with conventional rights-only scoring. (MM)

The purpose of this article is to discuss some recent developments in the scoring of multiple-choice items from two angles. The first consists of the recent developments in the test instructions of the conventional scoring procedures, and the second consists of a discussion of new scoring methods and formulas. (Author)