One solution to the problem of obtaining test scores in order to assess multiple outcomes of educational programs is a basically simple technique called matrix sampling. Matrix sampling is the estimation of total test score statistics by administering random subsets of test items to randomly selected students. This chapter lays out the specific…

Multiple matrix sampling of items and examinees was applied to an 18-item rank order instrument administered to a randomly assigned group and compared to the ordering and ranking of all items by control subjects. High correlations between ranks suggest the methodology may viably reduce respondent effort on long rank ordering tasks. (Author/CM)

During the last 2 years (1980-82), selected schools in the Broward County School District in Florida participated in the National Sex Equity Demonstration Project (NSEDP) to create a model for demonstration of curricular materials, educational practices, and program arrangements that feature gender-fair instruction and associated educational…

Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

Multiple matrix sampling is a data collection technique that ensures accuracy and efficiency in group performance. It has been widely used in large-scale curriculum evaluation since the 1980s. However, the design does not always fully embrace the dynamics of local evaluation demands. The purpose of this study is to introduce a modified matrix…

A review of four areas in which the computer has influenced the theory and practice of achievement testing: a) test scoring and item analysis, b) item sampling, c) item generation, and d) the sequencing of items resulting in various types of adaptive testing. Also, reference is made to the impact of computer assisted achievement testing upon the…

As a new program is developed, information must be collected to identify weaknesses, to guide the staff in the revision process, and to formulate decision-making procedures, i.e., formative evaluation techniques are essential. A set of criteria for the information needed in formative evaluation is set-up and a practical strategy for meeting these…

This guide is designed to help college students understand educational states, portfolio assessment, competency matrices, and self-evaluation as it relates to the presentation of technical materials in the engineering sciences. Part 1 discusses definitions of education and learning, the concept of lifelong learning, and educational states…

Two different methods for collecting course-specific data on class learning and growth are discussed. The first, Item/Student Sampling, is directly dependent upon assessing class performance both prior to and following instruction. This procedure relies on multiple matrix sampling techniques. The second method, referred to as Self-Report of Course…

The National Education Association's Task Force on Testing has stated its opinion that standardized tests are overused. The task force suggests that the application of sampling techniques and a variety of alternatives to current testing practices would accomplish the same purposes. Representatives of the testing industry have indicated that the…

Representing a set of required readings for those who would keep abreast of developments in the field of educational evaluation, this book presents nine chapters, each written by a recognized scholar on the topic being considered. Several chapters are also available as separate booklets, thereby increasing the flexibility with which the materials…

The measurement information generated by CRT's is designed for use in instructional management systems where classifications of pupils for treatment are to be decided on the basis of minimal data consistent with predetermined limits for the errors of misclassification. The measures obtained are content specific estimates of proficiency useful for…

The second section of a four-part technical report of Florida's statewide program for assessing reading-related skills in grades 2 and 4 provides statistical and scoring information. Item and student sampling, a test re-scoring study, reporting statewide assessment data (percentage of achievement, types of tables used), and standard error…

This paper is about the structural equation modelling of quantitative measures that are obtained from a multiple facet design. A facet is simply a set consisting of a finite number of elements. It is assumed that measures are obtained by combining each element of each facet. Methods and traits are two such facets, and a multitrait-multimethod…

A new Joint Comprehensive Evaluation System for the assessment of 15 different federal programs has been developed by the U.S. Office of Education. In this system these diverse program services will be thought of as resources available to meet the needs of critical target groups. Using this approach, a set of nine crucial questions that need to be…