A detailed description is provided of the variable general implementation of the instructional programming model (GOSA), which is part of the analysis in phase I of the Evaluation of Practices in Individualized Schooling. The variable is defined; the questionnaires on which the variable is based are listed; the procedures used to scale the…

Longitudinal measures of change are the most important kinds of estimates being produced from the National Longitudinal Study of the High School Class of 1972 (NLS). Several topics are presented in this report, most of which build on previous variance components analyses. The major areas covered are effects of stratification and clustering,…

The concept under investigation was the reliability of estimates of mean scores of groups under various assumptions of multiple-matrix sampling when reliabilities are computed according to procedures based on generalizability theory. Four different cases were compared with respect to the generalizability coefficients depending upon whether pupils…

Generalizability theory is described and applied to data collection methods for student ratings of instruction. Three generalizability coefficients (generalizing over both students and items, generalizing over students only, and generalizing over items only) are defined, and the appropriateness of each for various purposes is discussed.…

A general process for testing the feasibility of applying alternative mathematical or statistical models to the solution of a practical problem is presented and flowcharted. The system is used to compare five models for test equating: (1) anchor test equating using classical test theory; (2) anchor test equating using the one-parameter logistic…

The implications of a mathematical model of test scores are explored where the data are limited to a random sample of items without replacement from an indefinitely large population or item domain in which items are scored either zero or one. The purpose is to obtain an unbiased estimate of a student's proportion of items correct in the item…

An analysis was made of quality ratings of elementary level standardized tests. Applying multidimensional scaling to intercorrelations of quality ratings, it was found that the criterion of content and construct validity was a central element in the evaluation of elementary tests. In addition, several types of validity and reliability were found…

This study empirically determined the optimizing weight to be applied to the Wrongs Total Score in scoring rubrics of the general form = R - kW, where S is the Score, R the Rights Total, k the weight and W the Wrongs Total, if reliability is to be maximized. As is well known, the traditional formula score rests on a theoretical framework which is…

The Mastery-Learning test model is extended. Methods for estimating prior probabilities are described. The use of an adjustment matrix to transform a probability of mastery measure and empirical methods for estimating adjustment matrix parameters are derived. Adjustment matrices are interpreted as indicators of instructional effectiveness and as…

The Instructional Improvement Questionnaire (IIQ) is a student rating form designed to provide evaluative feedback to instructors about their teaching. The IIQ was first developed at Southern Illinois University at Carbondale in 1969 and revised in 1972. The documents included here describe the development of the IIQ and research associated with…

The 1972-73 Michigan Educational Assessment Program (MEAP) provided information on 22 measures of students and schools. While some of the data were gathered in routine Michigan Department of Education reports, student performance data were gathered using the Michigan Assessment of Basic Skills battery, Form VMT during January 1973. The battery…

Employed were a small sample of fifth graders to examine techniques for assessing the validity of psychosocial maturity (PSM) and the scales used to measure it. Three validation techniques were examined: (1) Data obtained from self-report scales, teacher ratings, and peer ratings were used to generate three multitrait-multimethod matrices (total…

The purpose of this study was to determine the validity of the American College Test (ACT) in predicting academic achievement of students from an area which is culturally, economically, and educationally depressed. The population, chosen from 6 community colleges serving the Appalachian region of Kentucky, consisted of 1,127 full time (12 or more…

In order to assess achievement in technical drawing at the secondary school level, an experimental examination was conducted using 333 boys and 2 girls from 13 schools. The objectives of the course in order of importance were: (1) Understanding and Comprehension; (2) Use; and (3) Communication. Three papers were formed: Paper I, an objective…

The purpose of the present study was to extend the construct validity of a scale designed to measure attitude toward technology. A revision of the Mechanization Scale (Goldman, Platt & Kaplan, 1972) was administered to 89 undergraduate students with instructions to respond as if each were a member of a specified occupational group. The target…