When a college or university needs an assessment instrument, it has two choices: select an existing instrument or develop a new one. Since the cost of instrument development in both time and human resources is often prohibitive, many assessment programs rely on existing instruments. The challenge then becomes choosing one that provides the best…

The use of student evaluations of teaching (SETs) to assess teaching effectiveness remains controversial. Without clear guidelines regarding how to best document effective teaching, faculty members may wonder how to convincingly demonstrate teaching effectiveness in preparation for promotion and tenure review. Based on a study that examined the…

It is commonly believed that highly subjective humans ultimately perform all testing and grading efforts and that all testing and grading is completely subjective. However, Quentin Durham argues that there is no such thing as objective testing or grading. With wit and clarity, "The Realities of Classroom Testing and Grading" suggests that all…

Introduction: The College of Physicians and Surgeons of Ontario, the regulatory authority for physicians in Ontario, Canada, conducts peer assessments of physicians' practices as part of a broad quality assurance program. Outcomes are summarized as a single score and there is no differentiation between performance in various aspects of care. In…

The content and construct validity and reliability of the Revised Science Attitude Scale for Preservice Teachers as a scale for measuring the attitude of preservice elementary teachers toward the teaching of science were re-examined. The instrument is intended to measure four subcomponents: comfort-discomfort, need, time, and equipment. Data were…

In an address to the National Council on Measurement in Education, R. M. Jaeger (1987) commented that there appears to be a fundamental difference in measurement philosophy between those on the two sides of the debate over the Rasch model. Jaeger's observations are explicated by contrasting the views on measurement of B. D. Wright and E. F.…

This study surveyed educators involved in mainstreaming students with disabilities into regular elementary classrooms, to determine their perceptions of the necessary characteristics of a successful mainstreaming program. Their responses were used to formulate a model for a mainstreaming program. The study began with a review of the literature and…

Discusses the problem of measuring the validity of interview ratings in the American Council on the Teaching of Foreign Languages (ACTFL) Oral Proficiency Interviews (OPI), proposes frameworks to distinguish abilities from testing methods, and considers factors affecting test performance. Suggestions for research and development on the ACTFL OPI…

Kentucky's accountability system includes a school-processes audit known as Standards and Indicators for School Improvement (SISI), which is in a nascent stage of validation. Content validity methods include comparison to instruments measuring similar constructs as well as other techniques such as job analysis. This study used a two-phase process…

The experience of the National Board for Professional Teaching Standards illustrates how issues of assessing the content representativeness of performance assessment can be addressed to ensure validity for certification procedures. Explores the challenges of collecting validation evidence when expert judgments of content are used. (SLD)

Describes the Test of English as a Foreign Language (TOEFL) and the Advanced Placement in International English Language (APIEL) and evaluates both tests on three basic types of validity criteria: content, construct, and criterion-related. Concludes that the TOEFL has serious limitations, and that the APIEL may be more useful. (EV)

Techniques for quantifying the degree of fit between test items and curricula are classified according to the purposes of assessing: overall fit, fit of individual items to content domain, and the impact of test specifications on performance. Procedures for calculating each index and their properties are included. (SLD)

This article discusses the main purposes of reading comprehension assessment and identifies the key features of good assessment. The article also identifies pitfalls that clinicians and educators should avoid to conduct valid assessments of reading comprehension, such as the degree to which the measure taps the constructive and integrative…

Educational tests used for accountability purposes must represent the content domains they purport to measure. When such tests are used to monitor progress over time, the consistency of the test content across years is important for ensuring that observed changes in test scores are due to student achievement rather than to changes in what the test…

This article describes the development and revision of the Ethical Decision-Making Scale. Construct and content validity are reported. In addition, the results of a test-retest and a principal component factor analysis are provided. Suggestions for future research are discussed.