Procedures for correcting for guessing and for assessing partial knowledge (correction-for-guessing, three-decision scoring, elimination/inclusion scoring, and confidence or probabilistic scoring) are discussed. Mean scores and internal consistency reliability estimates were compared across three administration and scoring procedures for…

This study identifies critical elements of the front dive half-twist that judges are likely to look for when they score springboard diving competitions. Videotapes of divers at a 1979 intercollegiate diving meet were made and analyzed, using grid scoring procedures, to isolate components of the dives that would help predict judges' scores.…

Adapted the scoring matrix, a method used to facilitate community participation in planning and monitoring development projects, to a university course in participatory resource management. Suggests the matrix is an example of how discipline-specific tools can be adapted to serve the dual purposes of promoting experiential learning of…

After establishing a theoretical depiction of the domain of literature learning, a study developed test packages which examined: (1) the relationship among multiple choice, short open-ended, and long open-ended responses; (2) whether there would be differences according to the genres; (3) the relationship between literary and non-literary texts,…

Based on the responses of 50 ESL instructors to a composition-scoring exercise, a detailed method of scoring compositions was developed that divides the writing into basic components (structure, content, vocabulary, organization, and mechanics) and provides a scoring mechanism for each component for each of three competency levels. (MSE)

This study evaluated a "substantively driven" method for scoring NAEP writing assessments automatically. The study used variations of an existing commercial program, e-rater[R], to compare the performance of three approaches to automated essay scoring: a "brute-empirical" approach in which variables are selected and weighted solely according to…

The advantages and disadvantages of grade equivalent (GE) scores are explored, including appropriate uses for GE type scores and how to bring current GE scales closer to the type of information educators appear to desire. Although GE scores are not an equal interval scale, not comparable across school subjects, and do not indicate the grade level…

There have been many attempts to formulate a procedure for extracting information from incorrect responses to multiple choice items, i.e., the assessment of partial knowledge. The results of these attempts can be described as inconsistent at best. It is hypothesized that these inconsistencies arise from three methodological problems: the…

Presents both logical and empirical evidence to illustrate that the conventional scoring algorithm for ranking tasks significantly underestimates the initial level of group ability and that Slevin's alternative scoring algorithm significantly overestimates the initial level of ability. Presents a modification of Slevin's algorithm which authors…

Due to the high stakes that my be attached to placement decisions, it is imperative that the placement process be as solid and defensible as possible. An integral part of the placement process is the identification and use of cut scores, the point(s) on the score scale that classify students into adjacent categories for placement decisions. This…

The Outside World Experience (OWE) Index--a weighted index of industrial, government, business, consulting, or other experience outside academia--is discussed as an important assessment measure for department faculty. Formulas for calculating the OWE Index as applied to schools, departments, and individual faculty members are included. (SF)

This report identifies the methods and issues in the evaluation of student writing in classrooms and large scale assessments using an analytical scoring system from the Illinois Inventory of Educational Progress (IIEP). This guide is written for staff in state offices of education conducting large-scale writing assessments, and also for personnel…

The use of a computerized system is described in which students rate each other's term papers via the computer program PEERRATE, which creates a matrix of intervals between ratings received and calculates final ratings incorporating a mean and standard deviation selected by the instructor for the class. As described, the program includes: (1)…