Although advances have improved our ability to describe the measurement precision of a test, it often remains challenging to summarize how well a test is performing overall. Reliability, for example, provides an overall summary of measurement precision, but it is sample-specific and might not reflect the potential usefulness of a test if the…

The conventional approach for testing the equality of two normal mean vectors is to test first the equality of covariance matrices, and if the equality assumption is tenable, then use the two-sample Hotelling T[superscript 2] test. Otherwise one can use one of the approximate tests for the multivariate Behrens-Fisher problem. In this article, we…

Some aspects of test reliability are discussed. Topics covered are: (1) how high should a reliability coefficient be?; (2) two factors affecting the interpretation of reliability coefficients--range of talent and interval between testings; (3) some common misconceptions--reliability of speed tests, part vs. total reliability, reliability for what…

Outlines the purposes of statistical analysis and types of research questions that can be answered. Defines data types as a guide for choosing statistical tools. Describes a hypothetical research study on teaching computer software to illustrate the use of analytical tools. (SK)

Ten item discrimination indices, across a variety of item analysis situations, were compared, based on the validities of tests constructed by using each of the indices to select 40 items from a 100-item pool. Item score data were generated by a computer program and included a simulation of guessing. (Author/CTM)

The present study examined the reliability of the WISC-R subtests and IQ scales when administered to Mexican-American children. In an effort to extrapolate these findings to the individual child, this study also attempted to ascertain the standard errors of measurement for each subtest and IQ scale. (Author)

The basic concepts, practices, and considerations in assessment are outlined in order to provide the reader with a beginning knowledge of assessment techniques and procedures. Discussion includes the goals of assessment, types of tests, criteria for instrument selection, test construction, data collection procedures, and statistical analysis of…

An analysis was made of quality ratings of elementary level standardized tests. Applying multidimensional scaling to intercorrelations of quality ratings, it was found that the criterion of content and construct validity was a central element in the evaluation of elementary tests. In addition, several types of validity and reliability were found…

Three methods of item selection were used to select sets of 38 items from a 50-item verbal analogies test and the resulting item sets were compared for internal consistency, standard errors of measurement, item difficulty, biserial item-test correlations, and relative efficiency. Three groups of 1,500 cases each were used for item selection. First…

The relationship between the Instructional Process, Instructional Objectives, and Assessment Tasks, identified at the School City of Gary, Indiana, necessitate an effective testing program. Four characteristics perceived crucial to a sound program were: (1) The program should be continuous, (2) The testing program should be comprehensive, (3)…

Two types of student response inventories for appraising instruction, the Student Instruction Report (SIR) and the Inventory of Student Perceptions of Instruction (ISPI) were administered to 554 students in 30 classes at two Georgia colleges. Mean responses to items were used in principal components analyses with varimax rotation. The two…

This chapter should not only acquaint the reader with the present state of the art on Criterion-Referenced (CR) measurement but also suggest possible directions for further inquiry. The goal of the first part of this chapter is to deal with the definitional dilemma of CR measurement by proceeding from the more traditional view of CR measurement to…

The Beginning Teacher Evaluation Study (BTES), Phase II, was a research project on effective teaching behavior--what teachers do that significantly affects what and how pupils learn. The purposes of Phase II were to (1) develop an assessment system for measuring teacher and student behaviors and other factors which could influence each of them and…