The work presented in this case study results from a study conducted in 2012-2014 examining a newly created teacher evaluation system to determine the inter-rater reliability of the classroom observation instrument. The teacher evaluation system was the result of a partnership between the school district and the university in the same city…

Presents an overview of the goals and procedures of qualitative research, and discusses linkages between epistemologies and methodology. Reviews possible guidelines involved in the several steps of the evaluation process of qualitative research, emphasizing naturalistic research with families. Reviews common problems with qualitative research.…

Reviews the seven papers presented at a symposium entitled "Perennial Issues in Qualitative Research," part of the Annual Meeting of the American Educational Research Association (San Francisco, California, 1986), and included in this issue. Discusses the demonstrated usefulness of qualitative methods in educational research, and also…

Data from a parent training outcome study demonstrated three types of subject reactivity noted by observers while collecting naturalistic observation data in family homes. Suggestions are made for future research, including the systematic collection of reactivity data during the course of observations and the examination of covariations between…

The purpose of this paper is to summarize some of the author's logical and empirical reflections on the practice of using naturalistic techniques to conduct evaluations. The main assertion to be supported by these reflections is that naturalistic evaluation is possible and in some cases powerful. This assertion is supported through a review of (1)…

A number of problems are identified and questions raised about the usefulness of conventional instruments of educational and psychological measurement in curriculum evaluation and research. Four purposes of curriculum evaluation data are identified: (1) advancement of science, (2) curriculum revision, (3) provision of data for the formulation of…

Methodological incarceration occurs when research and investigation are restricted by the traditional concepts of how a study should be designed and are hampered by those notions which dictate what research is. This paper examines several reasons why social science research in general--reading research in particular--is considered by some to be…

Egon G. Guba and Yvonna S. Lincoln were among the first to develop a set of extensive criteria for establishing naturalistic inquiry as a disciplined research methodology. The naturalistic paradigm--also called post-positivist, ethnographic, phenomenological, and qualitative--has gained acceptance as a legitimate alternative to the previously…

Article is a description of an evaluation conducted by the center for New Schools for an innovative program in the Cleveland Heights, Ohio schools. The rationale for the use of ethnographic methods and problems that arose from the CNS experiences are discussed. (RW)

Argues that what we need to do in the future is: (1) to continue to validate broader methodological approaches to evaluation; (2) to defend alternative scientific approaches and at the same time to indicate how they differ from essentially nonscientific views of the world; (3) to recognize the difference between methodological familiarity and…

This article critically analyzes research investigating the use of antecedent events in the functional assessment process, with an emphasis on interventions conducted in natural settings. An analysis of 17 articles found that research on antecedent-based interventions lacks a consistent conceptual framework. Suggestions for future research are…

Model identification of time-series data is essential to valid statistical tests of intervention effects. Model identification is, at best, inexact in the social and behavioral sciences where one is often confronted with small numbers of observations. These problems are discussed, and the results of independent identifications of 130 social and…

Four researchers argue the merits of qualitative methodology and its particular relevance to those in special education who seek to move beyond a deficit perspective. Unconstrained by defined variables and decontextualized settings, qualitative methods allowed the researchers to extend the scope of their studies beyond originally stated research…

Two methodologies for teacher-focused process evaluation--rating scales and systematic observation--are discussed and comments are made about their characteristics and effective utilization to improve teachers' performance. Process evaluation, referring specifically to the act of evaluating what teachers do in their classrooms, may be of formative…

Research on teacher evaluation and teacher effectiveness indicates that there are serious problems with the reliability of presage, process, and product findings. Quality in teaching can best be assessed by measuring process in the classroom and by using observation instruments which record the occurrence of specific, well-defined behaviors. (PP)