This project explored the possible applications of new technology to standardized testing. Because the multimedia approach is particularly promising for music, the Graduate Record Examination (GRE) music test was chosen as the context for this project. The basic system for administering the test and recording the results was written using…

The study described in this paper is part of an effort to improve understanding of the science assessment of the National Assessment of Educational Progress (NAEP). It involved the coding of all the items in the 1996 NAEP science assessments, which included 45 blocks (15 each for grades 4, 8, and 12) and over 500 items. Each of the approximately…

This paper describes an approach that states and local districts might use to develop a coordinated assessment system so that information collected at state and local levels about programs under Title I of the Improving America's Schools Act (IASA) would be complementary and not redundant. The reauthorization of Title I provides a unique…

This research summarizes differential item functioning (DIF) results for student produced response (SPR) items, a nonmultiple-choice mathematical item type in the Scholastic Aptitude Test I (SAT I). DIF data from 4 field trial pretest administrations (620 SPR items) and 10 final forms (100 SPR items with samples ranging from about 58,000 to over…

Drawing from a review of the literature and direct experience, this paper discusses key issues in developmental mathematics placement. First, the controversial practice of mandatory placement is examined, citing research results that support the practice and those that do not. Next, the diversity of developmental math placement standards is…

The quality of fit between the data and the measurement model is fundamental to any discussion of results. Fit has been the subject of inquiry since as early as the 1920s. Most early explorations concentrated on assessing global fit or subset fits on fixed length, traditional paper and pencil tests given as a single unit. The detection of aberrant…

In 1993, the Centre for Instructional Development at Centennial College, Ontario, Canada received funding to investigate the effects of student diversity on prior learning assessment evaluation processes and to develop guidelines to respond to any effects demonstrated. A review of the literature identified six barriers to equitable evaluation:…

Sensing an urgency among faculty and administrators to design writing assessment programs, this book presents a programmatic approach to writing assessment that combines holistic scoring with a programmatic emphasis and on-going program evaluation. The program described in the book was successfully conducted with rising juniors at a rural…

As high-stakes use of tests increases, it becomes vital that test developers and test users communicate clearly about the accuracy and limitations of the scores generated by a test after it is assembled and used. A procedure is described for portraying the accuracy of test scores. It can be used in setting accuracy targets during form construction…

Whether the shaping of test items can itself result in qualitative differences in examinees' comprehension of reading passages was studied using the Pearson-Johnson item classification system. The specific practice studied incorporated, within an item stem line, references that point the examinee to a specific location within a reading passage.…

Testing guidelines based on teachers' experience and on a review of literature concerning approaches to the testing of oral second language skills, are presented in this paper. Considerations in developing the test included coordination with the syllabus, choice of format, grading, and administration. Suggestions are offered from the practices of…

To investigate the psychometric feasibility of replacing a paper-and-pencil licensing examination with a computer-administered test, a validity study was conducted. The computer-administered test (Cadm) was a common set of items for all test takers, distinct from computerized adaptive testing, in which test takers receive items appropriate to…

To test the assumption that questions measuring literal comprehension and those measuring inferential comprehension are equally valid indices for both oral and silent reading tests at all skill levels, questions from the Analytic Reading Inventory were classified as either literal or inferential. Subjects, 94 children in grades two to five, read…

A series of six papers and an introduction which present the results and tentative analyses of studies investigating such constructs as self-esteem, perceptions of control, and competence are included in this document. These papers are: (1) "Multiple Dimensions of Locus of Control and Their Relationship To Standardized Achievement Scores in Fifth…

Tailored Response Testing (TRT) is a new type of test that has demonstrated its applicability to the evaluation of human performance in a wide variety of occupations and work settings. The Navy is using TRT to measure the technical proficiency of job incumbents in three of its jobs. The methodology holds great promise for testing aboard ships as…