In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

Eight articles review and report on research involving computers and problem solving skills. Topics discussed include research design; problem solving skills and programing languages, including BASIC and LOGO; computer anxiety; diagnostic programs for arithmetic problems; and relationships between ability and problem solving scores and between…

Deliberations about social policy often center on estimates of harm or benefit generated by different interest groups. Problems in what is measured and how it is measured are illustrated by a discussion of research into sexual abuse and rape. Advocacy research is an unreliable foundation for social policy formation. (SLD)

Youth First conducted focus groups and participatory "youth tribunals" across New Zealand, examining experiences of growing up rural. Common themes included "not being listened to," exclusion from citizen participation, and anxiety about the future. Remarkable differences in experience and views were often found in the same…

This document describes the flaws in an October 2007 Wisconsin Policy Research Institute (WPRI) report on public school choice and parental involvement, "Fixing the Milwaukee Public Schools: The Limits of Parent-Driven Reform." Because the report claims that public school choice and parental involvement have little effect on student…

Counterfactuals are routinely used in physical and biological sciences to develop and evaluate sophisticated, non-linear models. They have been used with telling effect in the study of economic history and American politics. For some historians, counterfactual arguments have no scholarly standing. They consider them flights of fancy, fun over a…

R. D. Howell, E. Breivik, and J. B. Wilcox (2007) have argued that causal (formative) indicators are inherently subject to interpretational confounding. That is, they have argued that using causal (formative) indicators leads the empirical meaning of a latent variable to be other than that assigned to it by a researcher. Their critique of causal…

Statistical reform in school psychology research is discussed in terms of research designs, measurement issues, statistical modeling and analysis procedures, interpretation and reporting of statistical results, and finally statistics education.

Learning how to conduct qualitative research may seem daunting for those new to the task, especially given the paradigm's emphasis on complexity and emergent design. Although there are guidelines in the literature, each project is unique and ultimately the individual researcher must determine how best to proceed. Reflexivity is thus considered…

This commentary considers some of the challenges of applying mixed methods research in undergraduate research degrees, especially in professions with a clinical health focus. Our experience in physiotherapy academia is used as an example. Mixed methods research is increasingly appreciated in its own right as a "third paradigm," however the success…

The article addresses a hypothetical dilemma confronted by an evaluator of a transition from welfare program regarding inclusion of a small immigrant/language minority group in the study. The article advocates for inclusion of diverse groups. Three important aspects of diversity are discussed that have particular relevance to transition from…

Cross-cultural adaptation of study instruments is a difficult, time-consuming, but arguably cost-effective process. If conducted properly, it has the advantage that the translated study instruments are accurate, easy to understand, accessible, and culturally appropriate to the target audience and produce reliable and valid data. This article…

The increased use of multiple regression analysis in research warrants closer examination of the coefficients produced in these analyses, especially ones which are often ignored, such as structure coefficients. Structure coefficients are bivariate correlation coefficients between a predictor variable and the synthetic variable. When predictor…

In response to a Congressional request, the General Accounting Office (GAO) investigated drug use measurement by reporting the drug use patterns of targeted groups in three nationally prominent drug studies, assessing the methodological strengths and limitations of the studies, and developing recommendations for the improvement of drug prevalence…

Analysis of covariance (ANCOVA) is a data analysis method that is often used to control extraneous sources of variation in non-equivalent group designs. It is commonly believed that as long as the covariate is highly correlated with the dependent variable there is nothing to lose in using ANCOVA, even in non-randomized studies. This paper examines…