Consideration is given to the degree of congruence between objectives and test items in the evaluation of objective-based testing. An analytic technique that measures congruence is described, and a bibliography is provided. (CK)

This paper describes the development of a criterion-referenced test. The Prescriptive Mathematics Inventory (PMI) was developed to measure 400 stated behavioral objectives. The test consists of three overlapping levels with the objectives chosen to cover 90 to 95 per cent of the mathematics curriculum nominally taught in grades 4 through 8. Each…

These rating scales are intended for evaluation of student pilot performance. Each student is evaluated individually on the basis of video recordings of the student in flight. Ten point rating lines are used for the ten criterion performance elements of each of three maneuvers, (1) Final Turn to Landing, (2) Lazy Eight, and (3) Vertical S "A".…

The desirable characteristics of criterion referenced test items and sets of items are described. A two-stage item tryout and item selection procedure are also described. The paper presents the results of using the procedure as compared with traditional item selection procedures used in selecting items for norm referenced tests. It was found that…

Criterion referenced testing has received considerable theoretical, but only limited practical, application. Grand Forks School District has developed mathematics criterion referenced tests for grades three to nine. The tests are keyed to a hierarchical set of approximately 50 performance objectives and 40 individualized contracts per grade level.…

Because of misconceptions regarding appropriate measurement strategies, it is necessary to draw distinctions between two major measurement methodologies, norm-referenced and criterion-referenced measurement, as they relate to determining basic academic capabilities. Norm-referenced measures are used to ascertain an individual's performance in…

A progress report describes the design and demonstration of the computer-based Instructional Management Systems (IMS) for the period March 1, 1967, through February 29, 1968. The rationale and design considerations of IMS, development of its system components, functioning of the components during the first field trial, and data collected during…

Several alternative indexes of item usefulness were empirically compared. They were: (1) item discrimination based on high and low groups on a postinstructional measure, (2) shift in item difficulty from a pre- to a postinstruction measure, and (3) item discrimination based on pre- and posttest performances. A typical classroom final examination…

The 1972 assessment activities in the Massachusetts schools concentrated on the areas of citizenship and science, utilizing two seventh grade samples of 10,000 students each, with each group completing only one assessment form. The testing program utilized National Assessment Items for age 13, as well as a few items from the Measurement Research…

This paper argues that the technology of the systems approach to instruction (using performance objectives) demands a "rules" or structured organizational climate in which high productivity will most likely result from detailed supervision. The author focuses, albeit briefly, on performance as a function of the interaction between…

Under the guidance of an advisory committee from the American Association for Respiratory Therapy (AART), The Psychological Corporation developed three forms of two criterion-referenced proficiency examinations to measure the skills, understandings, and knowledge required in entry level jobs for two levels of respiratory therapy personnel. The…

Attention has recently been focused on the need to design and validate instructional materials that guarantee competent student performance. In preparing such products, developers have come to rely on competency-based achievement tests. Unfortunately, expertise for constructing reliable and valid competency-based instruments is not currently…

This manual contains the criteria against which the Manpower and Community College Counselor Training Program pre-assessments are evaluated. These pre-assessments are conducted using materials that have been designed to assess the entry level knowledge and skills of program counselor trainees. The criteria are viewed as the best collective…

The development and evaluation of prototype hands-on equipment, job sample performance tests for a high skilled technical Military Occupational Specialty (MOS) are described. An electronic maintenance MOS (26C20) was used as the research vehicle. The results led to the conclusion that valid and reliable performance tests could be constructed, but…

Criterion referenced measurement is one method which can be utilized to evaluate the learner's achievement of the objectives of continuing education programs and an invaluable mechanism whereby program effectiveness can be evaluated. How to set up an instructional module using a criterion referenced base (subject matter, objectives, test…