Discusses Bauman's (1991) evaluation of stability of Wechsler Intelligence Scale for Children (Revised) IQs in children with learning difficulties. Argues that some procedures produced magnified estimates of instability. Presents reanalysis of data that suggests that, although stability coefficients were high, approximately 25 percent of sample…

Considers relationship between statistically and clinically significant change. Sees Jacobson and Truax's index of clinically significant change as neglecting possible confounding of improvement rate estimates by regression to the mean. Describes alternative method (Edwards-Nunnally method) that incorporates an adjustment that minimizes this…

Reviews methods for analyzing outcome data when some data are missing. Presents approach for comparing outcome results in two-group, randomized design with missing data. Proposed analysis is based on concept of "modeling our ignorance" by examining all possible outcomes, given known number of missing results with binary outcome, and then…

Three commercial job evaluation firms rated the same set of 27 jobs. Statistical analysis indicated that evaluators differed in which job traits they used to evaluate inherent job worth. Comparable worth may thus be sensitive to the choice of evaluator. (Contains 24 references.) (Author/SK)

Shanghai Jiao Tong University has published on the Internet an Academic Ranking of World Universities that has attracted worldwide attention. Institutions are ranked according to academic or research performance and ranking indicators include major international awards, highly cited researchers in important fields, articles published in selected…

The five papers in this special issue of the "Journal of Applied Testing Technology" address fundamental issues of validity when tests are modified or accommodations are provided to English Language Learners (ELL) or students with disabilities. Three papers employed differential item functioning (DIF) and factor analysis and found the…

Extensive education research on the contribution of teachers to student achievement produces two generally accepted results. First, teacher quality varies substantially as measured by the value added to student achievement or future academic attainment or earnings. Second, variables often used to determine entry into the profession and…

Research indicated that students often graduate from colleges and universities without encountering critical thinking skills in undergraduate coursework. The first national report raising concerns over the declining quality of education stemmed from the National Commission on Excellence in Education (1983), and findings based on disappointing test…

A report from the School Choice Demonstration Project examines issues concerning the funding formula used for the Milwaukee Parental Choice Program (MPCP). It finds that the program generates a net saving to taxpayers in Wisconsin but imposes a significant fiscal burden on taxpayers in Milwaukee. However, these findings depend significantly on how…

Some students are less accurately measured by typical reading tests than other students. By asking teachers to identify students whose performance on state reading tests would likely underestimate their reading skills, this study sought to learn about characteristics of less accurately measured students while also evaluating how well teachers can…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

The utility of value-added estimates of teachers' effects on student test scores depends on whether they can distinguish between high- and low-productivity teachers and predict future teacher performance. This article studies the year-to-year variability in value-added measures for elementary and middle school mathematics teachers from five large…

Purpose: The purpose of this paper is to investigate a possible favourable response pattern on scaled forms used as a means of evaluating training courses. Design/methodology/approach: In part one of the study evaluation forms were examined referring to courses were completed by 879 students attending 15 university level courses and 531 students…

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

Taking the position that science is not value-free has certain consequences. There are both risks and rewards inherent when evaluators relinquish an objective, non-involved role for a more subjective, partisan role in an evaluation where issues of class, gender, and race are intertwined. It is important for evaluators to consider how their…