The purpose of this statement is to inform those using or considering the use of value-added models (VAM) about their scientific and technical limitations in the evaluation of educators and programs that prepare teachers. The statement briefly reviews the background and current context of using VAM for evaluations, enumerates specific psychometric…

Describes the characteristics of a statewide principal evaluation system. Even when an evaluation system is detailed, specific, and statewide, inconsistencies develop because of the special nature of principals' work. The system breaks down in the sampling of performance and outputs, and in the communication of negative feedback. (PS)

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

Reports on a review of empirical research reports submitted over the past several years to the "American Journal of Distance Education" that identified common analytic problems and errors often overlooked by distance education researchers. Topics discussed include significance testing; assessment issues, including reliability and…

Assessment of learning is critical to the learners, teachers, and designers of learning environments. Current assessment techniques in web-based distance learning apply age-old techniques to a new medium and are not adequate for web-based distance learning environments (WBDLE). The goals of this article are to extend existing critiques of…

Ways to improve the validity of assessment of college students are discussed. Validity problems often have occurred because the purpose of assessment was not clear. Traditionally, college students have been tested for admission and placement. However, the results of these tests have been used for other purposes, such as comparing institutions.…

Examines problems of instructional evaluation in urban schools using signal-receptor assessment theory analysis and a new type of test scoring procedure called Modified Confidence Weighted-Admissible Probability Measurement (MCW-APM). Discusses advantages of MCW-APM. (FMW)

Examines the use of portfolio assessment in a distance education program for research information skills at the University of South Africa. Discusses the assessment of information literacy and online searching skills; portfolio assessment criteria; student attitudes; validity and reliability of portfolio assessment; and problems. (LRW)

Considers the competing demands placed on evaluators in relation to the service (characteristics of the intervention), the sample (people participating), and methodology or research design. Explores compromises that may be required between scientific ideals and real-world limitations, and assesses implications for obtaining meaningful results in…

Highlights issues and controversies concerning current race-related educational research. Contends that some critics believe research sacrifices empirical objectivity for political goals. Partisan research supporters respond that all research begins with untested assumptions and an acknowledgment of purpose does not signify a skewed methodology.…

Early identification of problem readers and appropriate interventions would reduce subsequent failure and would enhance reading skills. Screening instruments measure the risk/probability that reading problems will occur. In this article we discuss certain aspects with regard to the most important indices of screening measures: predictive accuracy,…