The Netherlands' secondary education system is highly differentiated, with four different school types for four scholastic ability levels. Final examinations must accommodate these four levels, and require a test-independent definition of the intended final ability levels as well as a sample-free evaluation of the range of ability levels at which…

The reliability of item bias estimates was studied for four methods: (1) the transformed delta method; (2) Shepard's modified delta method; (3) Rasch's one-parameter residual analysis; and (4) the Mantel-Haenszel procedure. Bias statistics were computed for each sample using all methods. Data were from administration of multiple-choice items from…

Longitudinal studies of test wiseness (TW) were conducted to determine: (1) the relationship between TW and grade level, (2) the relationship between TW and sex, and (3) the stability of TW. Aspects of TW observed included stem cue and specific determiner identification and usage and the elimination of similar and absurd options. Subjects were…

The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

Generalizability theory is described and applied to data collection methods for student ratings of instruction. Three generalizability coefficients (generalizing over both students and items, generalizing over students only, and generalizing over items only) are defined, and the appropriateness of each for various purposes is discussed.…

The implications of a mathematical model of test scores are explored where the data are limited to a random sample of items without replacement from an indefinitely large population or item domain in which items are scored either zero or one. The purpose is to obtain an unbiased estimate of a student's proportion of items correct in the item…

An analysis was made of quality ratings of elementary level standardized tests. Applying multidimensional scaling to intercorrelations of quality ratings, it was found that the criterion of content and construct validity was a central element in the evaluation of elementary tests. In addition, several types of validity and reliability were found…

This study empirically determined the optimizing weight to be applied to the Wrongs Total Score in scoring rubrics of the general form = R - kW, where S is the Score, R the Rights Total, k the weight and W the Wrongs Total, if reliability is to be maximized. As is well known, the traditional formula score rests on a theoretical framework which is…

The Mastery-Learning test model is extended. Methods for estimating prior probabilities are described. The use of an adjustment matrix to transform a probability of mastery measure and empirical methods for estimating adjustment matrix parameters are derived. Adjustment matrices are interpreted as indicators of instructional effectiveness and as…

The Instructional Improvement Questionnaire (IIQ) is a student rating form designed to provide evaluative feedback to instructors about their teaching. The IIQ was first developed at Southern Illinois University at Carbondale in 1969 and revised in 1972. The documents included here describe the development of the IIQ and research associated with…

The 1972-73 Michigan Educational Assessment Program (MEAP) provided information on 22 measures of students and schools. While some of the data were gathered in routine Michigan Department of Education reports, student performance data were gathered using the Michigan Assessment of Basic Skills battery, Form VMT during January 1973. The battery…

Employed were a small sample of fifth graders to examine techniques for assessing the validity of psychosocial maturity (PSM) and the scales used to measure it. Three validation techniques were examined: (1) Data obtained from self-report scales, teacher ratings, and peer ratings were used to generate three multitrait-multimethod matrices (total…

The purpose of this study was to determine the validity of the American College Test (ACT) in predicting academic achievement of students from an area which is culturally, economically, and educationally depressed. The population, chosen from 6 community colleges serving the Appalachian region of Kentucky, consisted of 1,127 full time (12 or more…

A discussion of selected applications of new tests developed within the context of a large-scale curriculum for educable mentally retarded (EMR) children, the Social Learning Curriculum (SLC), is presented in this paper which investigates three types of reliability that need to be demonstrated in order to provide a basis of these applications. The…

In order to assess achievement in technical drawing at the secondary school level, an experimental examination was conducted using 333 boys and 2 girls from 13 schools. The objectives of the course in order of importance were: (1) Understanding and Comprehension; (2) Use; and (3) Communication. Three papers were formed: Paper I, an objective…