The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

Selection bias pervades the evaluation of supplemental instruction (SI) in non-experimental settings. This brief note provides a formal framework to understand this issue. The objective is to contribute to the accumulation of credible evidence on the impact of SI.

This paper is meant to highlight the occurrence of Simpson's Paradox when using aggregated data obtained from two IEA studies in Israel, while ignoring the effect of a powerful intervening variable in the local context--the ethnicity factor. It will demonstrate faulty conclusions regarding either the absence of relationships between a contextual…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

The paper states that quantification is neither ethical nor unethical, but is ethically neutral. It is the behavior or intent of the human being that is clearly a matter of ethical concern. Like numerology and the sects of inumerates and qualitatives, there is not so much an unethical practice that is supported as there is a lack of vision and…

This commentary on the mismeasurement of language and reading comprehension abilities argues that quantitative measures of complex behaviors and subsequent ranking of individual performance often do not accurately reflect the abstract constructs they purport to measure, and inappropriate quantification and ranking create and perpetuate potentially…

The Individuals with Disabilities Education Improvement Act of 2004 allows schools to use a child's response to research-based intervention (RTI) as a part of procedures to identify students with learning disabilities. This paper considers whether RTI-based assessment models meet ethical and legal standards for acceptable assessment practices.…

The purpose of this book is to make it possible for measurement specialists to solve practical testing problems through the use of item response theory (IRT). The topics, organization, and presentation are those used in a 4-week seminar held each summer for the past several years. The material is organized to facilitate understanding; all related…

A year-long case study of the effects of an educational and vocational rehabilitation program in a youth training center was discussed in terms of fourteen issues which might threaten the validity of an evaluation or research project. This correctional institution housed women aged 14 to 21 who were long-term wards of the state, held on remand, or…

Notes that, very early in program planning, budgets are estimated for major program components, including evaluation. Proposes heuristic for establishing reasonable evaluation estimates in initial planning. Describes logical sources of information from which to construct such a heuristic. Recommends that, for typical programs and projects, initial…

Two innovative methods for collecting and analyzing qualitative data are vignettes and pre-structured cases. Vignettes are descriptions of situations or problems written by a professional, with a suggested outline and comments provided by a researcher. Advantages of this method are strength of impact of the written descriptions and efficiency of…

Elaborates on the article "Synthesis of Research on the Effectiveness of Intellectual Skills Programs: Snake-Oil Remedies or Miracle Cures?" by Sternberg and Bhana. Encourages the development of a theory that could provide a guide to the infusion of thinking instruction into any area of inquiry. (IW)

The effectiveness of an Education Consolidation Improvement Act Chapter 1 program was studied in a large urban school district. A common problem in evaluating remedial programs is that pretest/posttest achievement gains often indicate the effects of the entire curriculum, rather than those specific to the remedial class. In this district, over…

Reviews the research on the effectiveness of five thinking skills training programs: Instrumental Enrichment, Philosophy for Children, Structure-of-Intellect (SOI), Problem Solving and Comprehension: A Short Course in Analytical Reasoning, and Odyssey. Compares and contrasts the content of each program and describes the relative lack of adequate…

Highlights issues and controversies concerning current race-related educational research. Contends that some critics believe research sacrifices empirical objectivity for political goals. Partisan research supporters respond that all research begins with untested assumptions and an acknowledgment of purpose does not signify a skewed methodology.…