There are four reasons why comparative data is needed for student ratings of faculty performance: (1) the considerable inflation of student ratings; (2) the great variability in the way students rate different items; (3) because student rating systems must be flexible and comparable; and (4) because of factors (such as student motivation, class…

This study compares the validity of three cloze procedures (traditional, limited, and least-major-constituent limited) when reading comprehension is defined as cognitive change. Over 400 seventh and eighth graders from public schools in North Carolina and Arizona were randomly assigned to one of the three cloze formats for either fiction or…

Instructors who develop classroom examinations that require students to provide a numerical response to a mathematical problem are often very concerned about the appropriateness of the multiple-choice format. The present study augments previous research relevant to this concern by comparing the difficulty and reliability of multiple-choice and…

The purpose of the investigation was to obtain some relationships among (1) test lengths, (2) shape of domain-score distributions, (3) advancement scores, and (4) several criterion-referenced test score reliability and validity indices. The study was conducted using computer simulation methods. The values of variables under study were set to be…

A STUDY OF FIVE DIFFERENT ESSAY EVALUATION PROCEDURES WAS CONDUCTED TO DETERMINE THE INTRARELIABILITY OF EACH AND TO USE THESE RELIABILITY SCORES AS A BASIS FOR COMPARING THE FIVE PROCEDURES. TEN THEMES WERE ASSIGNED TO FIVE RATING GROUPS, EACH USING A DIFFERENT EVALUATION PROCEDURE--(1) THE CALIFORNIA ESSAY SCALE, (2) THE CLEVELAND COMPOSITION…

First grade children from two Head Start (HS) groups and one non-Head Start (NHS) group were administered a battery of tests for the purposes of (1) comparing the developmental status of HS and NHS subjects, (2) examing patterns of specific learning disabilities among HS and NHS children, (3) determining the stability coefficients of selected…

An analysis was made of quality ratings of elementary level standardized tests. Applying multidimensional scaling to intercorrelations of quality ratings, it was found that the criterion of content and construct validity was a central element in the evaluation of elementary tests. In addition, several types of validity and reliability were found…

This study empirically determined the optimizing weight to be applied to the Wrongs Total Score in scoring rubrics of the general form = R - kW, where S is the Score, R the Rights Total, k the weight and W the Wrongs Total, if reliability is to be maximized. As is well known, the traditional formula score rests on a theoretical framework which is…

A 40-item flexilevel test and a 40-item conventional test were compared using data obtained through (1) computer-administration of the two tests to three groups of college students, and (2) monte carlo simulation of test response patterns. Results indicated the flexilevel score distribution better reflected the underlying normal distribution of…

This study investigated correlations between the Qualitative score of the Porteus Maze Test and age and rates of recidivism of correctional institution inmates. In addition, the study was structured to provide answers to the following questions: (1) Is there a relationship between age and rates of recidivism and the Conformity-Variability score of…

This study investigated the extent to which trained nonprofessional personnel under nursing supervision could effectively conduct health screening of Head Start children. Results of screening by nonprofessionals were compared with results of the traditional pediatric examinations. The nonprofessionals were trained by a pediatrician and a…

The purpose of this study was to determine the validity of the American College Test (ACT) in predicting academic achievement of students from an area which is culturally, economically, and educationally depressed. The population, chosen from 6 community colleges serving the Appalachian region of Kentucky, consisted of 1,127 full time (12 or more…

The purpose of this study was to provide test-retest reliability data for Holland's Self Directed Search for Educational and Vocational Planning (SDS). Sixty-five subjects were administered the SDS 7-10 months after they completed it during freshman orientation. Results indicated little change in summary codes obtained by subjects. Median…

This study develops and tests an instrument to assess the fidelity of the intended program, i.e., experimental treatment in the evaluation of a preschool program. During the school year (1972-73) CEMREL (Central Midwestern Educational Lab) investigated the consequences of different levels of training on implementation of the Demonstration and…

Holland hypothesized that personality pattern consistency is related to vocational satisfaction, stability, and success. The viability of this key construct in Holland's theory of careers is examined in light of the expected relationship between level of consistency and frequency of occurrence of 2-letter Holland personality codes. Results are…