The preliminary draft of a formal program evaluation model for special education operations in Pennsylvania is presented. Beginning chapters provide a review of literature on norm-referenced measurement, an illustration of formal and informal program evaluation in a learning disabilities context, descriptions of general implementation strategies…

An attempt is made to explore the use of subjective probabilities in the analysis of item data, especially criterion-referenced item data. Two assumptions are implicit: (1) one wants to obtain a maximum amount of information with respect to an item using a minimum number of subjects; and (2) once the item is validated, it may well be administered…

Livingston's reliability coefficients and Harris' indices of efficiency were computed along with the classical internal consistency coefficients, KR-20's (Kuder-Richardson internal consistency coefficient), for 678 criterion-referenced tests in the A through E levels of an individualized mathematics program. The coefficients were carefully studied…

Four applications of ordering theory analysis in the formative evaluation of an instructional program which is being developed for retarded children are described. Data from the pilot-testing of this program demonstrated two uses of ordering theory directly related to the formative evaluation of instruction: the testing of hypothesized…

Students at four grade levels (4,7,10, and 12) were tested using a criterion-referenced measure of reading literacy based on the Bormuth literacy model. Cloze test passages were selected to represent a cross section of ten content domains of readers material (e.g., textbooks, consumer safety, occupational, etc.). A multimatrix sampling design was…

Groups of approximately 300 undergraduate educational psychology students participated in an instructional program, involving weekly instructional objectives, weekly exams, remedial exams, and a point system of scoring. It was assumed that the percentage of students not attaining the passing criterion on the initial exam but returning for the…

Reading diagnosis aims at determining a student's present stage of development and how to help him toward his next stage of development. Reading diagnosis should analyze three things: what the student is expected to read, how the student handles these expectations, and how the student can be helped most effectively. Currently there are five areas…

The current emphasis on objectives and test item banks for constructing more effective tests is being augmented by increasingly sophisticated computer software. Items can be catalogued in numerous ways for retrieval. The items as well as instructional objectives can be stored and test forms can be selected and printed by the computer. It is also…

Data required for evaluating a Criterion Referenced Measurement (CRM) is described with a matrix. The information within the matrix consists of the "pass-fail" decisions of two CRMs. By differentially defining these two CRMs, different concepts of reliability and validity can be examined. Indices suggested for analyzing the matrix are listed with…

Criterion-referenced measurement has been hailed as one of the most significant developments in the recent history of educational evaluation. Its presence should be felt in the social studies over the next few years. The first part of the paper illustrates the differences between criterion-referenced and norm-referenced measurement--purpose for…

A project was devised to extend the applicability of a previously developed computer-assisted instruction (CAI) course in instrumental musicianship (see ED 035 314), and to assess its effects through the development and implementation of criterion referenced measures. Twenty-five intermediate level students of treble clef wind instruments…

Since the primary purpose of classical testing is to rank order examinees consistently, the absolute value of the true score has been relatively unimportant. However, the major purpose of criterion referenced testing is to estimate the true capabilities of examinees to perform specific tasks. Hence, the problems of true score determination assume…

Offers practical rules for writing and using tests in order to reduce pupils' anxiety, improve their study skills and help them master course objectives. (Author/CW)

The author reviews the accomplishments of American elementary and secondary education. Among the issues addressed are the government's role in education and the positive and negative aspects of different types of achievement tests. (GC)

School psychologists frequently are involved in assessment programs for children entering kindergarten. A comparison is made between screening and assessment related to norm-based and criterion-referenced assessment. (Author)