This study investigated the application of multidimensional item response theory (IRT) models to validate test structure and dimensionality. Multiple content areas or domains within a single subject often exist in large-scale achievement tests. Such areas or domains may cause multidimensionality or local item dependence, which both violate the…

Scores are the most visible and widely used products of a testing program. The choice of score scale has implications for test specifications, equating, and test reliability and validity, as well as for test interpretation. At the same time, the score scale should be viewed as infrastructure likely to require repair at some point. In this report…

It is suggested that funders revise the manner in which accountability is determined regarding both program superiority and the way in which special school programs are evaluated. In any alternative mode of showing accountability, preoccupation with dollars and amount learned should not take precedence over humaneness in the classroom. (Author)

Differential functioning of males and females on achievement test items was studied in a sample of 110,000 students in kindergarten through grade 12. First, item parameters and ability estimates for these parameters were obtained from LOGIST computer program runs for the entire group. Predicted performance for each item for each group was…

This procedures manual for the North Carolina Test Development Program details the tasks involved in test development. The basic steps are described in an introductory section; they are (1) to specify the institutional objectives of the curriculum and ensure their instructional validity; and (2) to specify the characteristics, such as the purpose…

This technical report describes the development of the College-Level Academic Skills Test (CLAST), an instrument designed to measure Florida college students' achievement of the computation and communication skills expected by the completion of their sophomore year. Section I covers CLAST's background and purpose, the requirement that all students…

Much of the intrinsic wealth of planning and instructional information available from achievement testing programs goes untapped in typical reporting procedures. Large-scale programs reporting only pupil scores and the results of aggregating those scores stop far short of the purposes intended and fail to realize the potential of such information.…

This handbook exists to assist the staff of a Springfield, Illinois school district in implementing the district assessment program and to assist other local school units in developing and assessing an implementation program. Chapter 1 presents information on the philosophical and pragmatic background of comprehensive assessment programs, with…

This manual is presented to assist local districts in complying with the requirements of the Massachusetts Policy on Basic Skills Improvement, whose principal goal is to help students master basic skills prior to high school graduation. The policy requires schools to evaluate student achievement in the basic skills at least once during the early…

Before an item bank is constructed, several curriculum and testing considerations should be addressed. Such issues include the number of students enrolled in the selected subject area; number of desired objectives and items per objective; method of storing the items; and how and when to train how many teachers in item writing. The following steps…

Latent trait model calibration procedures were used on data obtained from a group testing program. The one-parameter model of Wright and Panchapakesan and the three-parameter logistic model of Wingersky, Wood, and Lord were selected for comparison. These models and their corresponding estimation procedures were compared, using actual and simulated…

The "A" testing program of the Beginning Teacher Evaluation Study, Phase III-B, is summarized. A sample of 150 second grade and 134 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales regarding reading, mathematics, and school. The administration procedures, test results, and psychometric…

The Comprehensive Tests of Basic Skills, Expanded Edition (CTBS), was administered in 1984 to students in the District of Columbia Public Schools. This report includes: (1) an overview covering the purpose of testing, a description of the subject areas tested by the CTBS, and a glossary of technical terms; (2) a narrative and tabular summary of…

The "B" testing program of the Beginning Teacher Evaluation Study, Phase III-B, is summarized. A sample of 146 second grade and 128 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales pertaining to reading, mathematics, and school. The administration procedures, test results, and psychometric…

The "C" testing program, which followed the "A" and "B" tests of the Beginning Teacher Evaluation Study, is summarized. A sample of 139 second grade and 123 fifth grade students completed the reading and mathematics achievement battery, as well as affective scales regarding reading, mathematics, and school. The administration procedures, test…