Multiple matrix sampling is a sampling design in which both test items and examinees are randomly sampled from their respective populations. This study was designed to develop and assess a method for computing an estimate of a correlation coefficient when a multiple matrix sampling design is used. The examinee populations included 212 third-grade…

THE RELATIVE EFFECTIVENESS OF TASK SCORES VERSUS IQ AS PREDICTORS OF ACADEMIC ACHIEVEMENT WAS INVESTIGATED, AND THE CORRELATIONS BETWEEN TASK SCORES AND IQ RE-EXAMINED. SUBJECTS WERE 99 UPPER-MIDDLE CLASS ELEMENTARY SCHOOL CHILDREN WITH A MEAN STANFORD-BINET IQ OF 126 (SD EQUALS 19). THE INSTRUMENTS USED WERE DUNN'S OBJECT SORTING TASK (OST),…

The Children's Interaction Matrix, Intermediate and Primary Forms, are designed to identify the preferred work and content styles of children in group situations. These factors aid the researcher, teacher, and counselor in understanding the individual's preferred mode of behavior in groups as well as indicating the students' reaction to group…

When classes are the units of analyses, estimates of the reliability of class means are needed. Using classical test theory it is difficult to treat this problem adequately. Generalizability theory, however, provides a natural framework for dealing with the problem. Each of four possible formulas for the generalizability of class means is derived…

This self-instructional manual for psychological assessment focuses on the following topics: (1) general statistics, (2) central tendency, (3) random, continuous, and discrete variables, (4) variability, (5) measuring variability, (6) sampling, (7) derived scores, (8) covariation, (9) reliability and validity, and (10) standard error of…

A method for developing statistically parallel tests based on the analysis of unique item variance was developed. A test population of 907 basic airmen trainees were required to estimate the angle at which an object in a photograph was viewed, selecting from eight possibilities. A FORTRAN program known as VARSEL was used to rank all the test items…

An attempt is made to indicate why the concept of "true score" naturally leads to the belief that test validity must increase with an increase in test and/or average item reliability, and why this is correct for the classical single-factor model first introduced by Spearman. The statistical model used by Loevinger is introduced to…

This report shows how Beta weights for the J-Coefficient may be easily developed without a formal validity study, and indicates how indications of ability other than tests can be used to measure the same abilities that are measured by tests. See also TM 001 163-64,166 for further information on job elements (J-Scale) procedures. (Author/DLG)

This report presents the final scope, methods, and results of the evaluation of proficiency measures in occupational therapy. The intended purpose of the investigation was to evaluate and analyze the reliability and validity of measurements that are predictive of competence and proficiency at entry levels in occupational therapy. Each level of the…

Responses to a sample test were simulated for examinees under free-response and multiple-choice formats. Test score sets were correlated with randomly generated sets of unit-normal measures. The extent of superiority of free response tests was sufficiently small so that other considerations might justifiably dictate format choice. (Author/DWH)

Reports preliminary findings of a study which used a modified Admissible Probability Measurement (APM) test scoring system in the design of computer based instructional management systems. The use of APM for curriculum analysis is discussed, as well as its value in enhancing individualized learning. (Author/LRW)

A study of the reliability of a computer-assisted test of optometric clinical diagnostic skills that uses actual patient cases revealed that the test is most useful when used in conjunction with subjective clinical grading for evaluating problem-solving skills. (MSE)

Linguistic and statistical analyses of cloze tests as a measure of second language competence revealed qualitative and quantitative differences between the performances of Anglophone immersion and French control groups. The diagnostic limitations of the procedure and the usefulness of the linguistic information derived from it are discussed. (MSE)

A revised version of the IDEA form for collecting student ratings of instructional processes and outcomes has been administered since the fall term of the 1998-99 school year. Results from all administrations of the device from August 1998, through August 2001, constitute the basic data of this report. A total of 122 institutions of higher…

When conducting a profile analysis of the Peabody Individual Achievement Test, only those subtests in which the subtest specific variance equals or exceeds 25 percent of the total variance and exceeds error variance should be considered for interpretation. Behavioral factors and testing conditions also should be considered. (Author/BEF)