Because educational researchers are becoming interested in the uses of ethnographic field methods, the author examines some of the theoretical disputes and methodological problems being experienced in contemporary anthropology, such as hypothesis testing, observer bias, and reliability. (Part of a theme issue on anthropology of education.) (SJL)

Research in written composition must not only face up to the fact that composition tests must meet the same requirements for validity and reliability that other tests must meet, but it also faces the unique difficulty of figuring out a way to give a valid and reliable pretest. (DD)

Presents a method for the collection and analysis of collateral data about research subjects (i.e., measurements of events in subjects' lives that may affect outcome measures and/or lead to attrition). A six-step procedure evaluates bias resulting from subject attrition from a study using data from lost and retained subjects. (SLD)

This poem, with stanzas in limerick form, refers humorously to the many threats to validity posed by problems in research design, including problems of sample selection, data collection, and data analysis. (SLD)

Sees important aspect of graduate education as learning how to evaluate quality and validity of research. Notes that study of families presents particular challenges. Examines three methods to teach students to critique family research. Sees all three as holding promise in teaching students how to evaluate family research and notes that all three…

Examines the construct and action validity of the use of simple checklists to assess the declarative knowledge component of adult's literacy by telephone. Finds significant relationships among knowledge when assessed either by listening (telephone) or by reading (mailed questionnaire) modality. Concludes that the telephone method may provide a…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

The Center for Research on Education Outcomes (CREDO) at Stanford University conducted a large-scale analysis of the impact of charter schools on student performance. The center's data covered 65-70% of the nation's charter schools. Although results varied by state, 17% of the charter school students have significantly higher math results than …

Traditional research literature distinguishes between two general types of threats to the generalizability of experimental findings: Internal validity and external validity. Relatively minor importance has been attached to external validity in educational literature. Bracht and Glass elaborate on external validity and deal with two types:…

Notes that major changes have occurred in the factors investigated and the data collection procedures employed in teacher effectiveness research and that the generalizability of significant findings continues to be limited by methodological and experimental design problems. (FL)

Reports that the McCall-Crabbs Standard Test Lessons in Reading were never sufficiently standardized to justify their widespread use as the basis for readability formulae. (DD)

Describes a classroom demonstration that illustrates the error of using an inappropriate test to conclude that a specific ability does not exist within a subject or a population. Shows ways to expand the lesson to cover the issue of null conclusions. Points out social and methodological implications of the demonstration. (Author/LS)

Looks at the sociopolitical factors that influence the implementation of clinical intervention studies in long-term care settings and suggests ways of minimizing threats to a study's internal validity. (Author)

Schools should adopt reform programs on the basis of research, not ideology, checking for control groups, the number of participating schools, actual results, and independent resources. Two federal programs, the Comprehensive School Reform Demonstration Program and the 1998 Reading Excellence Act, stress adoption of research-based reforms. (MLH)