Since the early 2000s, the proliferation of cameras, whether in mobile phones or CCTV, led to a sharp increase in visual recordings of human behavior. This vast pool of data enables new approaches to analyzing situational dynamics. Application is both qualitative and quantitative and ranges widely in fields such as sociology, psychology,…

Data analysis is a significant methodological component when conducting quantitative education studies. Guidelines for conducting data analyses in quantitative education studies are common but often underemphasize four important methodological components impacting the validity of inferences: quality of constructed measures, proper handling of…

The use of video surveillance footage presents a new possibility in educational research as a reliable and valid source of learning and teaching activities in classrooms. However, the unique nature of surveillance footage requires different approaches and poses distinctive challenges in utilizing it in research, yet no methodological guides are…

Considering scoring validity as encompassing both reliable rating scale use and valid descriptor interpretation, this study reports on the validation of a CEFR-based scale that was co-constructed and used by novice raters. The research questions this paper wishes to answer are (a) whether it is possible to construct a CEFR-based rating scale with…

The purpose of this study was to examine the quality of quantitative articles published in the "Journal of Counseling & Development." Quality concerns arose in regard to omissions of psychometric information of instruments, effect sizes, and statistical power. Type VI and II errors were found. Strengths included stated research…

Purpose: Single-subject experimental designs (SSEDs) represent an important tool in the development and implementation of evidence-based practice in communication sciences and disorders. The purpose of this article is to review the strategies and tactics of SSEDs and their application in speech-language pathology research. Method: The authors…

The purpose of this paper is to describe the process of conducting ethnographic research. Methodology definition and key characteristics are given. The stages of the research process are described including preparation, data gathering and recording, and analysis. Important issues such as reliability and validity are also discussed.

Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

In recent decades, proponents of naturalistic and/or critical modes of inquiry advocating the use of ethnographic techniques for the narrative-based study of phenomena within pedagogical contexts have challenged the central methodological paradigm of educational research: that is, the tendency among its practitioners to adhere to quantitative…

The Education Trust research report "Stuck Schools" suggests a framework for identifying chronically low-performing schools in need of turnaround. The study uses Maryland and Indiana to show that some low-performing schools make progress while others remain stagnant. The report has four serious problems of reliability and validity,…

This highly readable text demystifies the qualitative research process--and helps readers conceptualize their own studies--by organizing the different research paradigms and traditions into coherent clusters. Real-world examples and firsthand perspectives illustrate the research process; instructive exercises and activities build on each other so…

This paper addresses a variation of the traditional validity question asked of qualitative researchers. Here the question is not "How do we know the qualitative researcher's question is valid?" but rather, "How does the qualitative researcher choose from among a multitude of apparently valid or at least plausible…

It is generally believed that the correction formula will yield exact correlational values only when the regression of z on x is both linear and homoscedastic. The formula is shown to hold for nonlinear heteroscedastic relationships. A simple sufficient condition for formula validity and estimation predictions is demonstrated in a numerical…

Describes a study of reliability among coders of information for meta-analysis (a quantitative procedure for synthesizing data in primary research reports) of research on life satisfaction in American adults. Identifies sources and areas of disagreement among coders and discusses measures that can be used to enhance intercoder consistency.…

Presents a method for the collection and analysis of collateral data about research subjects (i.e., measurements of events in subjects' lives that may affect outcome measures and/or lead to attrition). A six-step procedure evaluates bias resulting from subject attrition from a study using data from lost and retained subjects. (SLD)