Using the split-middle methods of trend estimation, evaluates the accuracy of interpretation of single subject data by comparing raters' visual analysis of behavior change with statistical determination of behavior change. Results indicate visual analysis accuracy was less than chance. Rater and student characteristics largely did not affect the…

Points out that variability in focus, method, and conceptual level of case studies causes difficulties in validating such studies. Notes method variations raise questions about validity. Claims the validity of case studies lies in their usefulness as projective models. States teachers can generate their own theories where practical educational…

This commentary on EC 602 595 questions cognitive referencing's validity as a model for allocating special services to young children with disabilities. The paper raises methodological issues in studies supporting use of the cognitive referencing model. These issues include the construct of delayed development, subject description, and use of a…

Six potential problems with the use of randomized experiments to evaluate programs in the field are addressed. Problems include treatment dilution, treatment contamination or confounding, inaccurate case flow and power estimates, violations of the random assignment processes, changes in the environmental context, and changes in the treatment…

Tests an educational-effectiveness model by reanalyzing a large-scale dataset containing (Dutch) elementary school data of subsequent student cohorts, their teachers, and their schools. Researchers found some expected positive achievement effects of individual classroom and school factors, but these were unstable across school subjects and student…

Bias due to attrition of respondents poses a threat to the internal and external validity of research findings. Discusses methods of detecting attrition bias in longitudinal family research, and presents Heckman's procedure to correct attrition bias. Data from the University of California Longitudinal Study of Generations are used to illustrate…

This annotated bibliography on the use of facilitated communication with people unable to express themselves was developed as part of a statewide training and technical assistance project in Maine. The 75 citations are listed alphabetically by author and date from 1986 through 1993. The items listed report on the use of facilitated communication…

When comparing the DACUM (Developing a Curriculum) and curriculum conference methods of curriculum development, one finds that the product goals of the two methods differ but the process goals are similar. Both seek to generate information from a select group on which to base curriculum development, but the end product of DACUM is a chart that…

As the number and scope of school-based clinics grow, interest in their evaluation increases. Evaluation of a comprehensive school-based clinic program in New York City revealed methodological issues in evaluation of these programs. The first issue involves program goals and objectives. Even before program implementation, the evaluator should…

Because research in speech communication is predominantly the study of human behavior, a major goal of researchers in the field is to provide sound communication propositions about people in general or specific groups of people. A review of recent speech communication research reported in journals reveals that researchers in the social and…

Although important progress has been made in educational evaluation during the past decade new problems believed to be more serious threaten the progress that has been made. These problems are said to be a mixture of logistics and politics and are in large part an outgrowth of the increasing pluralism of American society. (Author/AM)

Reviews research to show that researchers with stopwatches may miss many aspects of reading instruction, including (1) that students continue reading and learning outside of the reading group, (2) that learning to read involves feelings, and (3) that learning to read is more than time spent looking at words. (FL)

Methods for selecting relevant and appropriate quasi-experimental studies for inclusion in research synthesis using the threats-to-validity approach are presented. Effects of including and excluding studies are evaluated. (BS)

A recent article by William R. Dunlap on admissions criteria is presented to illustrate applied statistical misuse. It is the basis for discussion of severe methodological problems including range truncation, dummy coding, identifying race and sex bias, measuring professional potential, and generalization of findings. The author's response is…

Current writings on death and dying are trichotomized into prescientific, quasi-scientific, and scientific. Research findings should not be treated as equally valid; some methods may be used to supply hypotheses, others to test them, and still others to further validate the previous findings. (Author)