This paper clarifies important distinctions in item writing and item scoring and considers the implications of these distinctions for developing guidelines related to test construction for training teachers. The terminology used to describe and classify paper and pencil test questions frequently confuses two distinct features of questions:…

Direct assessments of the accuracy with which raters can use a rating instrument are presented. This study demonstrated how surplus behavioral incidents scaled during the development of Behaviorally Anchored Rating Scales (BARS) can be used effectively in the evaluation of the newly developed scales. Construction of scenarios of hypothetical…

At Michigan State University (MSU) we have developed and are testing a faculty survey instrument to gather institution-wide information on outreach activity. We have sought to define consistent quantitative measures that can be used both to describe the whole institution's investment of resources in engagement activities and to establish…

The educational assessment movement holds considerable promise for encouraging college faculty to exercise collective responsibility to improve the quality of learning. Current efforts toward improving higher education include the Association of American Colleges' report, "Integrity in the College Curriculum"; William J. Bennett's…

The validity of educational tests used as critical measures of educational outcomes within a dynamic system is discussed. Validity becomes a problem if an educational system adapts itself to the characteristics of the outcome measures. The concept of systematically valid tests is introduced; these tests induce curricular and instructional changes…

Any systematic approach to the assessment of students' ability implies the use of a model. The more explicit the model is, the more its users know about what they are doing and what the consequences are. The Rasch model is a strong model where measurement is a bonus of the model itself. It is based on four ideas: (1) separation of observable…

A study of general student performance in England, Wales, and Northern Ireland undertaken in 1975 is described, and efforts toward developing a new system of school-leaving examinations are discussed. The study was designed to assess existing student evaluation instruments, create new evaluation techniques and instruments, promote cooperation…

Current issues in the literature on the testing of linguistic and communicative proficiency are reviewed and discussed in relation to reading comprehension testing. Several theoretical issues in language testing are discussed, including testing purposes and test validity. Areas of concern regarding methods of testing reading comprehension are then…

Contradictions are inherent in the evaluation of placement test writing, contradictions that at once value and devalue writers and writing, readers and reading. In testing, the evidence for the essay's effectiveness rests almost entirely on the writer's choice of linguistic forms. The characteristics that distinguish evaluation in competency…

The effectiveness of Mississippi's Assistant Teacher Program (ATP) was evaluated after its third year of operation, determining: (1) whether first graders who were exposed to teachers and assistant teachers who had been in ATP for three years continued to make progress in academic achievement; (2) the effectiveness of ATP in fostering achievement…

The publisher's perspective of testing and the curriculum can be described in terms of the criteria for selecting norm-referenced standardized achievement tests: (1) market need--what the customer needs and wants; (2) product match--whether the product neets the need; (3) distribution--whether or not the product can be sold; and (4) end user…

At the request of the Oklahoma Department of Education, the Technical Assistance Center 3 West conducted a statewide review of local Chapter 1 evaluation data to provide possible explanations for the unusual standardized test score gains or losses reported by a number of local school districts. During the two months of quality control visits, 35…

Communicative competence is often characterized as an integrated control of language reflected in the speaker's ability to understand and use language appropriately for communication in various situations. The theoretical basis for the communicative competence construct is the anthropological, sociolinguistc, and pragmatic view of language.…

This article presents the perspective that the quality of teacher-made, small classroom tests has not improved, and may have declined in recent years. This decline may be due to the fact that teachers have come to believe that the kinds of objective items used in national standardized tests are the only item types appropriate for classroom use.…

Research on assessing the cultural fairness of individual test items is reviewed, with emphasis on Birnbaum's three-parameter logistic model. As defined in this review, differential item characteristics are exhibited when examinees from one group have a lower probability of answering correctly than do examinees of equal ability from another group.…