This article examines an important and thorny problem in interview research: How to assess whether what people say motivated their actions actually did so? We ask three questions: What specific challenges are at play? How have researchers addressed them? And how should those strategies be evaluated? We argue that such research faces at least five…

"Using Education Indicators: A Forum Guide for State and Local Education Agencies" was developed to provide timely and useful information on education indicators, how their collection and use have changed over time, and how agencies use them strategically. Since the publication of the 2005 document "Forum Guide to Education…

This article is developed from the contents from one of the chapters the researcher has written as part of her PhD thesis. It discusses various methodological challenges the researcher had to face during the phase of data collection in the prisons of Kerala, India, and the strategies adopted to overcome these challenges. This article is intended…

This paper presents best practices for conducting survey research using Amazon Mechanical Turk (MTurk). Readers will learn the benefits, limitations, and trade-offs of using MTurk as compared to other recruitment services, including SurveyMonkey and Qualtrics. A synthesis of survey design guidelines along with a sample survey are presented to help…

Although social scientists devote considerable effort to mitigating measurement error during data collection, they often ignore the issue during data analysis. And although many statistical methods have been proposed for reducing measurement error-induced biases, few have been widely used because of implausible assumptions, high levels of model…

The purpose of this article is to inform researchers about and encourage the use of longitudinal designs to further understanding of human resource development and organizational theory. This article presents information about a variety of longitudinal research designs, related statistical procedures, and an overview of general data collecting…

Walking readers step by step through complex concepts, this book translates missing data techniques into something that applied researchers and graduate students can understand and utilize in their own research. Enders explains the rationale and procedural details for maximum likelihood estimation, Bayesian estimation, multiple imputation, and…

Focusing on expanding technical capabilities and new collaborative possibilities, we address 4 challenges for scientists who collect and use video records to conduct research in and on complex learning environments: (a) Selection: How can researchers be systematic in deciding which elements of a complex environment or extensive video corpus to…

The use of numerical/quantitative data in qualitative research studies and reports has been controversial. Prominent qualitative researchers such as Howard Becker and Martyn Hammersley have supported the inclusion of what Becker called "quasi-statistics": simple counts of things to make statements such as "some," "usually," and "most" more…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

The purpose of this paper is to discuss ways in which developmental psychology suffers from the lack of an appropriate technology of measurement and statistical analysis. The paper begins by noting that developmental psychology is the study of change; that individuals develop through a succession of "stages" which are separated by…

Two innovative methods for collecting and analyzing qualitative data are vignettes and pre-structured cases. Vignettes are descriptions of situations or problems written by a professional, with a suggested outline and comments provided by a researcher. Advantages of this method are strength of impact of the written descriptions and efficiency of…

This paper reviews the prominent concepts of the stuttering event and concerns about the reliability of stuttering event measurements, specifically interjudge agreement. Recent attempts to resolve the stuttering measurement problem are reviewed, and the implications of developing an improved measurement system are discussed. (Author/JDD)

After the terms "qualitative research" and "quantitative research" are defined, this paper considers why it makes sense to integrate these approaches, at least under some circumstances. This discussion necessitates attention to the issue of whether quantitative and qualitative research are inextricably linked to incompatible…

Covert checks of observational methodology reveal declines in reliability of observations. This appears to be particularly true when complex codes are used to track social interaction. The present study was undertaken to see whether reliability could be maintained through a combination of technological advancements and the development of improved…