Evaluation takes place in a social context that influences research design, selection of variables, the written report, and the timing of its release. There are also consequences for program implementors and evaluators. Historical accounts of the school systems in Gary, Indiana and New York, New York illustrate these influences. (Author/CTM)

Notes that the most common educational research methods (large-scale surveys and field observations) have failed to examine the processes by which school participants create school structures. Advocates constitutive ethnography as a new approach and presents examples of its application in examining classrooms, lessons, educational testing, and…

Type/Token Ratios (TTRs) frequently fail to discriminate between children at widely different stages of language development, and may fall as children get older. Such effects are caused by a negative, though non-linear, relationship between sample size and TTR. Standardization of the number of tokens before computing TTRs is recommended.…

Addresses the implicit assumption that instructional media represent meaningful experimental variables independent of instructional content or strategy. Results of computer-based instruction (CBI) studies (both well-designed and flawed) and meta-analyses are reviewed to support the authors' position that this assumption is invalid, and new…

Critiques comparative research and evaluation methods used to assess effectiveness of interactive video and proposes alternative models of research design that go beyond comparative analysis into understanding and control of the effective dimensions of interactive video, i.e., controlled correlation; instructional events, cognitive psychology, and…

Examines and assesses Marxist debates over schooling and societal reproduction. Argues that, if Marxists insist on using functional analysis to explain schools in capitalist society, the accuracy of these explanations must be empirically assessed. (FMW)

Describes a researcher's subjective experience of fieldwork conducted among other women graduate students. Focuses on interactions between the researcher and her informants, and discusses how these interactions affected the research, the findings, and the researcher. The emotional stresses and ethical dilemmas encountered by a feminist researcher…

This critique of H. Lee Swanson's "Toward a Metatheory of Learning Disabilities" comments on Swanson's concept of learning disabilities, cognitive science, and information processing theory. A different research and theory-building agenda is proposed, focusing on society's definition of learning disabilities and instructional issues and…

Methodological tools such as analysis of variance designs can reflect bias. Difficulties in the interpretation of cross-cultural differences can be avoided only if the researcher considers all external variables which account for the variance. No variance should be left to be explained in terms of culture. (VM)

Describes a study done by Herbert White that resulted in rankings of library and information science programs based on perceptual assessments by faculty and library directors. Problems with this methodology are discussed, and further findings based on extensive interviews with subjects of the White study are reported. (CLB)

Research consumers, both individuals and groups, can benefit or lose from early intervention research endeavors, and their needs and priorities should be considered. Researchers' decisions and actions create consumer winners and losers in three areas of research activity: conceptualization of research, design of research studies, and dissemination…

Discusses the use of standardized achievement scores to measure the quality of practice-oriented school improvement activities in school districts. Focuses on four areas of concern: the multiple functions of schooling; documentation and data collection; real world complexities; and ethics. Recommends that cautions be taken against exclusive…

The central thesis of this article is that the process of eliminating validity threats depends fundamentally on no-difference findings, a fact that has not been made explicit by researchers. The implications of this neglect are explored using examples from a number of different substantive areas such as psychology, health, and medicine.…

Although "quality of education" issues are currently popular in educational evaluation, the author argues for an empirically resolvable evaluation paradigm: Given the target population, program goals, and boundary conditions, how do educational treatments compare in terms of learning effects? Agreement on pre-set specifications and the…

This critical examination of the assumption that computer-based instruction enhances student learning and performance over traditional means summarizes arguments from past and present analyses of research, examines media attributes or symbol system theories, and presents evidence that much research is susceptible to rival hypotheses. (MBR)