Observer's paradox, the basic problem facing any analyst interested in understanding how people talk to each other within naturally occurring contexts, is discussed. In observer's paradox, by recording or observing everyday interaction, one is contaminating interaction by process of observation. An extension to sociolinguistic method is suggested…

Reviews the role of statistical hypothesis testing in research, discusses the problems with multiple t tests, indicates when they are a problem, and suggests a compromise solution. (one reference) (JL)

Disputes Moon, Dillon, and Sprenkle's (1990) claims regarding advantages of qualitative methods and limitations of quantitative approaches for family therapy research. Supports role of qualitative research in theory development and concurs that exclusive allegiance to standard methods may limit attention to important family therapy processes; but…

A persistent limitation of school administration research results from the use of myriad unrelated concepts, making research outcomes hard to generalize or synthesize. Reconsideration of superintendent vulnerability and efficiency suggests that these concepts can be replaced with others (such as emulation) to integrate at least some research…

Three criticisms of conventional uses of structural significance testing are elaborated; and alternatives for augmenting statistical significance tests are reviewed, which include emphasizing effect size, evaluating statistical significance in a sample size context, and evaluating result replicability. Among ways of estimating result…

Sees important aspect of graduate education as learning how to evaluate quality and validity of research. Notes that study of families presents particular challenges. Examines three methods to teach students to critique family research. Sees all three as holding promise in teaching students how to evaluate family research and notes that all three…

Discusses the importance of establishing the reliability of independent observers' judgments. Argues that the percentage of agreement measure is more difficult to interpret than are correlation measures. Recommends that the field of literacy research adopt correlation as the standard method for estimating the reliability of observers' judgments.…

Analysis of 20 research studies of critical thinking in nursing, 1977-1995, found that the Watson Glaser Critical Thinking Appraisal was used in 18. There was no consistent evidence that nursing education increases critical thinking. Research design flaws, inconsistent definition of critical thinking, and lack of an appropriate measurement tool…

Discusses three recent studies of the validity of Rorschach test (H. Rorschach, 1921) that have not evaluated methodological issues carefully. Identifies methodological errors in each study and offers specific information for the interpretation of Rorschach results. (SLD)

Findings from empirical research on evaluation ethics indicate an apparent lack of consensus within the field concerning what constitutes an ethical issue, the frequent occurrence of problems in the later stages of evaluation projects, and the perceived ethical significance of the tendency of evaluators to be more responsive to some stakeholders…

Considers the study of stress in school principals from three perspectives. Analyzes three critical reviews of studies dependent on questionnaires and correlational analysis; acknowledges several Australian studies using observational and physical measurement techniques; and suggests possible future methodologies that combine both methods…

Surveys are a commonly-used tool for measuring satisfaction with staff-development workshops. The four main sources of error and bias in most surveys are sampling slips, non-response nonsense, time-slice traps, and questionable questions. The paper discusses several typical survey problems and presents tips for making surveys into effective tools.…

Examines effectiveness of standardized time-out (TO) procedures and time-out procedures modified to incorporate the contingent delay when children continue to misbehave during their punishment. Both regular and modified TO procedures resulted in significant reduction in noncompliant episodes. Generalization of study's results was hindered by…

Proposes the subsuming theory criterion for experiments on common ground in mutual knowledge (i.e., the design must keep common information constant and only vary whether or not it is common). Demonstrates how doing so makes stronger claims. Illustrates how experiments can be designed to satisfy the criterion by evaluating some earlier studies…

Despite Slavin and Madden's mountains of data, questions about Success for All results remain unanswered. Belief in SFA's unique success has caused Congress to reshape Title I policy in favor of comprehensive schoolwide reform models, influenced state and court program mandates, and restricted teachers' choices in serving disadvantaged students.…