In response to a frequently articulated call for "ecological" validity from instructional communication investigations, this paper reports on methodological issues which evolved during the development and application of a coding scheme for content analyzing teacher compliance-gaining messages. Starting with a consideration of the…

A number of potential threats to internal validity in true experiments are discussed. Programmatic research efforts proceeding from established correlational findings to experiments employing random assignment are described and used as referents in discussions of validity considerations. The collection of observational data is recommended for use…

Methods of achieving compromises between the classical laboratory experiment, and the constrictions affecting educational researchers conducting experiments to build upon correlational process-outcome data are suggested. Ecological validity is achieved through partnership relationships between researchers and the teachers implementing treatments,…

Three common methodological problems in the analysis of observational data include: (1) failure to base degrees of freedom for the analysis on the appropriate sampling unit; (2) the validity of the design and data are inconsistent with the generalizations reached; (3) the statistic used to calculate coder reliability is often inappropriate and…