Becker (1967) poses the question "Whose side are we on?," a question which has become an enduring part of discussions within social scientific methodology. This paper explores the key issues in Becker's argument and considers its relevance to researchers today, locating this within a consideration of evaluation-based research and policy.…

In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

This "Instructor's Corner" describes a step forward on the journey to write, review, and publish high-quality qualitative research manuscripts. This article examines two existing perspectives on generating high-quality qualitative manuscripts and then compares and contrasts the different elements of each. First, an overview of Rocco's (2010) eight…

Schools and school systems throughout the nation are increasingly experimenting with using various instructional technologies to improve productivity and decrease costs, but evidence on both the effectiveness and the costs of education technology is limited. A recent report published by the Thomas B. Fordham Institute sets out to describe "the…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

Recommends that when repeated-measures Latin-square designs are used to counterbalance treatments across a procedural variable or to reduce the number of treatment combinations given to each participant, effects be analyzed statistically, and that in all uses, researchers consider alternative interpretations of the variance associated with the…

The new "Weighted Student Formula Yearbook 2009" from the Reason Foundation provides a simple framework for touting the successes of states and urban school districts that grant greater fiscal autonomy to schools. The report defines the Weighted Student Formula (WSF) reform extremely broadly, presenting a variety of reforms under the WSF umbrella.…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

Conducted studies using two perspectives for obtaining evidence relevant to validity of autobiographical data. In Study 1, construct validity of standard psychological constructs (assertiveness, trustworthiness) obtained from autobiographies was equal to that of standard instruments designed to assess these constructs. Evidence for validity of…

The current prevailing professional opinion is that the prevalence rates of alcohol abuse among the elderly are low compared to the general population. The prevalence of alcohol abuse among the elderly was examined through a review of the empirical research. This review revealed a number of serious methodological problems. The most important of…

Reviewed and evaluated parent training research conducted between 1975 and 1990. Analyzed 148 published studies regarding effectiveness of parent training as intervention. Case studies reviewed exhibited several methodological shortcomings. Group studies reviewed also did not routinely collect treatment integrity information, and 50 percent of…

Provides introduction to special section of journal on new ideas about how to analyze change. Reviews Rogosa's (1988) myths of longitudinal research. Includes overview of other articles in the section that emphasizes what is new and improved in design and analysis of change. (Author/NB)

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Examines the construct and action validity of the use of simple checklists to assess the declarative knowledge component of adult's literacy by telephone. Finds significant relationships among knowledge when assessed either by listening (telephone) or by reading (mailed questionnaire) modality. Concludes that the telephone method may provide a…