As the education reform movement increasingly focuses on teachers and teaching, educators, policy-makers, and researchers need valid and reliable measures that can be used to evaluate individual teachers, provide guidance for improving teaching performance, and support research in ways that advance instruction and classroom dialog and practice. A…

Forty-seven young children, 15 with disabilities, were observed 4 times for types and levels of engagement. Results indicated that engagement is difficult to measure through molecular data collection techniques because of error in dependability measures. The number of observed sessions could be increased to achieve generalizability, but increases…

This paper contends that behavior observation data relating to speech-language pathology are reliable if they are not affected by differences among observers or other variations in the recording context. The theoretical bases of methods used to estimate reliability for observational data are reviewed, and suggestions are provided for improving the…

Covert checks of observational methodology reveal declines in reliability of observations. This appears to be particularly true when complex codes are used to track social interaction. The present study was undertaken to see whether reliability could be maintained through a combination of technological advancements and the development of improved…

Examines the tendency of observers to make less reliable recordings of behavorial events when a calibrating observer is absent. Using four different multicategory systems, 26 experienced observers coded 200 hours of videotaped family interactions. Concludes that observers lapse into a less attentive "set" prior to coding without a…

Nine comprehensive observations were conducted of 24 preschoolers (8 with disabilities) in free play settings, with social behavior categories based on the work of Strain. Comparison of partial and complete observational records demonstrated that at least five observations were required to represent the children's social behavior adequately.…

Two methods of researching second language learning are described, analyzed, and compared: student diaries giving a first-person account of the second language learning experience; and participant observation, in which the observer is in the language learning situation recording in descriptive terms all possible data about the situation.…

Reports results of a study of the ways in which undergraduate and graduate music majors evaluated the teaching methods of graduate associate music instructors. Reports that evaluators gave instructors high marks for characteristics including enthusiasm, interest in the student, and patience. Concludes that untrained evaluators can reliably analyze…

Twelve trained observers were randomly assigned to one of two methods of data collection in scoring teacher-student interactions. Results indicated no overall difference in observer accuracy between momentary time sampling and continuous data collection when scoring behaviors that differed along the dimensions of frequency and predictability.…

Given the complexity of classroom reading observations, maintenance of measurement reliability is a concern to researchers. Sources of variation contributing to the unreliability of many measurements may be either (1) lasting and specific, (2) lasting and general, (3) temporary and specific, or (4) temporary and general. Lasting-specific sources…

Generalizability theory, which subsumes classical measurement theory as a special case, provides a general model for estimating the reliability of observational rating data by estimating the variance components of the measurement design. Research data from the "Heart Smart" health intervention program were analyzed as a heuristic tool.…

Quality measures were originally developed for research aimed at describing the settings that children spend time in and identifying the characteristics of these environments that contribute to children's development. They were also developed to guide improvements in practice. Increasingly, however, measures of quality are being used for further…

The stability of teaching behavior was examined by observing student/teacher interaction over one academic year. One teacher was studied using a time-series analysis. He had 14 years experience and taught physical education in grades K-6 in a single school. Data were collected over one academic year using the Cheffers Adaptation of Flanders…

In this book, which applies the state of the art in qualitative research to special education, qualitative research is used as a generic term for investigative methodologies described variously as ethnographic, naturalistic, anthropological, field research, or participant-observer research. Chapter 1 introduces and defines qualitative research and…