Four discrimination indices were compared, using score distributions which were normal, bimodal, and negatively skewed. The score distributions were systematically varied to represent the common circumstances of a military training situation using criterion-referenced mastery tests. Three 20-item tests were administered to 110 simulated subjects.…

Sex-related bias on the Scholastic Aptitude Test (SAT) was studied in a sample of 1,112 students in SAT coaching classes who took the SAT. Of these, 1,028 answered an additional questionnaire (Appendix A of this report) about high school grade point average, perceived abilities, and background. Almost all of the subjects were 11th graders (97.8%),…

This study investigated the measurement integrity of the "Heart Smart" cognitive tests. Designed for fourth, fifth, and sixth graders, the tests measure health-related knowledge involving physiology, nutrition, exercise, and behavioral skills. The report presents tables of specifications, test floors and ranges, a demographic profile of…

This manual is designed to accompany Pennsylvania's Educational Quality Assessment (EQA) elementary school reports to assist in their interpretation and understanding. The normative sample is described as stratified on two dimensions: district enrollment and wealth. Administration procedures are summarized. The cognitive and non-cognitive areas…

This manual is designed to accompany Pennsylvania's Educational Quality Assessment (EQA) secondary school reports to assist in their interpretation and understanding. The normative sample is described as stratified on two dimensions: district enrollment and wealth. Administration procedures are summarized. The cognitive and non-cognitive areas…

This study investigated the effects of verbal factors on item performance in mathematics tests. Experimental tryout units were constructed that varied the verbal load of each of 21 mathematics test items. Each tryout unit was randomly assembled to include A, B and C versions of items so that no examinee took a unit of only one item format. Each…

A study was made to determine characteristics of teacher-composed classroom tests, with emphasis placed on describing the levels of knowledge addressed by the test items. In this preliminary investigation, 19 mathematics and 16 science teachers working in 4 high schools in a mixed suburban/rural school district were asked to: (1) complete a brief…

This Technical Report provides descriptions and summary data that assist measurement specialists in assessing the procedures used in developing New Jersey's High School Proficiency Test (HSPT), the technical qualities of the tests, and the statewide results obtained from its use. The data summarized in this report were collected during the various…

A multi-purpose, multi-user evaluation system was designed to improve the quality of the reporting of information gathered in testing and evaluation practices. One part of the system, the reporting system for information resulting from a district standardized testing program, was described. The Student-Problem Package software was modified to…

This manual is presented to assist local districts in complying with the requirements of the Massachusetts Policy on Basic Skills Improvement, whose principal goal is to help students master basic skills prior to high school graduation. The policy requires schools to evaluate student achievement in the basic skills at least once during the early…

This report describes the initial development of the Vocational Interest Survey (VIS), which is comprised of six experimental scales for the measurement of Holland's vocational typology. The initial item pool was generated by the free-association written responses of high school students. Occupational titles were selected for inclusion in a pilot…

This paper reviews recent research in the Netherlands on the application of decision theory to test-based decision making about personnel selection and student placement. The review is based on an earlier model proposed for the classification of decision problems, and emphasizes an empirical Bayesian framework. Classification decisions with…

The Test of English as a Foreign Language (TOEFL) was used in this study, which attempted to develop a new methodology for assessing the speededness of right-scored tests. Traditional procedures of assessing speededness have assumed that the test is scored under formula-scoring instructions; this approach is not always appropriate. In this study,…

This report of the evaluation of the Office of Instructional Resources Teaching Center at the University of Florida describes an approach to the problem of assessing an instructional program developed for students who do not meet the admission requirements of the state university system. The program evaluation design not only provides a model to…

An adaptive testing strategy is described for achievement tests covering multiple content areas. The strategy combines adaptive item selection both within and between the subtests in the multiple-subtest battery. A real-data simulation was conducted to compare the results from adaptive testing and from conventional testing, in terms of test…