In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

Current economic conditions and the increasing competition for government funding are leading to an increased focus on the impact of research. Measuring the impact of research is difficult because not all impacts are direct and some can be negative or result from the identification of problems that require a non-research response. The time between…

The purpose of this study is to identify the self-reported research-based instructional and assessment practices used by third through fifth grade teachers among rural school environments in Western Pennsylvania which have attained Adequate Yearly Progress (AYP) pursuant to statewide assessments. Specifically, this study examines the…

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

Presents the role of human resource development practitioners as organizational researchers. Describes a model for validating instruments, constructs, and strategies, based on communication theory. Cites common errors and issues in the validation of measurement and demonstrates uses of the heuristic validation model. (SK)

Methodological deficiencies inherent in expert-novice reading research make it impossible to draw inferences about curriculum change. First, comparisons of intact groups are often used as a basis for making causal inferences about how observed characteristics affect behaviors. While comparing different groups is not by itself a useless activity,…

Twelve specific suggestions for evaluators concerning development, presentation, and followup of improved evaluation recommendations are discussed. Offering effective recommendations requires special skills that need to be recognized, studied carefully, and passed along to practitioners and students. (TJH)

Presents some of the conventional arguments against computer assisted instruction (CAI) in language education and explores humanistic concerns raised in the works of Marshall McLuhan. It is concluded that CAI is introduced into the instructional process before proper research has demonstrated that this method of teaching is not harmful for…

Evaluation utilization problems encountered and remedial strategies are discussed by a director of several government evaluation studies and evaluation manager. Political and behavioral prerequisites to evaluation utilization as well as on-going organizational requirements are emphasized. (TJH)

Interest in strengthening the impact and value of education research has been growing around the world. Here I outline a view of the nature of "impact" and point to instances where research has had a positive impact in education, but always within a larger social and political framework. A three element "model" of research impact is developed and…

One of a series of booklets on disability research, this paper is intended as an introduction to the role of evaluation in the utilization process. Its purpose is to help disability researchers grasp the importance of incorporating a focus on assessing use into plans for disseminating research outcomes. The paper begins by examining basic…

Argues research on the efficacy of special education is poor. Describes key flaws including (1) lack of proper control groups; (2) studies that utilize matching of similarly disabled students rather than random selection; (3) measurements of effectiveness; and (4) studies that have become outdated as the functional definitions of labels have…

This perspective on how testing and evaluation data are used and could be used for school improvement is based partly on the experience of the Austin (Texas) Public Schools and partly on their goals. Four conditions are necessary for the effective use of evaluation information: (1) real need; (2) trust in the evaluators and in the information…

Highlights issues and controversies concerning current race-related educational research. Contends that some critics believe research sacrifices empirical objectivity for political goals. Partisan research supporters respond that all research begins with untested assumptions and an acknowledgment of purpose does not signify a skewed methodology.…