This dissertation is composed of projects on three aspects of gathering and learning from data in the social sciences: drawing representative samples, taking valid measurement, and making warranted inductive inferences. Chapter one studies the challenge of drawing representative human samples. It is well documented that most samples used by…

Noncredit enrollment at community colleges has grown significantly over the past two decades. However, unlike credit bearing programs, noncredit programs are seldomly empirically examined and evaluated, particularly those that are not grant funded. The lack of data results in a gap in knowledge about program effectiveness, as well as the students…

Evidence-based assessment (EBA) requires that investigators employ scientific theories and research findings to guide decisions about what domains to measure, how and when to measure them, and how to make decisions and interpret results. To implement EBA, investigators need high-quality assessment tools along with evidence-based processes. We…

Recommendations from multiple professional organizations (e.g., American Psychological Association, Council for Exceptional Children, National Association of School Psychologists) suggest that collection of data on the social validity in practice and research is necessary. The purpose of this study was to systematically review the inclusion of…

For the past two decades, educational intervention research has rallied around the common goal of determining "what works in education" to inform education practice and policy (U.S. Department of Education, 2017). To study individual, contextual, and implementation processes and their interaction with educational interventions requires…

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In…

The use of video surveillance footage presents a new possibility in educational research as a reliable and valid source of learning and teaching activities in classrooms. However, the unique nature of surveillance footage requires different approaches and poses distinctive challenges in utilizing it in research, yet no methodological guides are…

This study measured the salience of, sentiment of, and topics about schools in social media. Based on a mixed-methods approach, results indicated that school districts do not appear to be discussed often or widely, but the small numbers of people who communicate about districts do so repeatedly, positively, and in concentration. Larger and…

The growing prominence of value-added models for measuring teacher effectiveness has prompted a recent surge in policies that consider students' classroom performance part of a teacher's evaluation. Yet, in light of the criticism and limitations of the current models, whether and how evaluation systems will adapt over time is unclear. This paper…

For better or worse, many educational decisions that were once handled on a personal level by teachers or administrators now increasingly rely upon data and information. To be successful in this era, educators need to understand this broad sociotechnical revolution and how it is realigning traditional roles and responsibilities. In this book, the…

This commentary discusses the implication of child and adolescent development research for public policy in Latin America. As illustrated by the articles in this special issue, even though the research of child and adolescent development in Latin America is making significant progress, still more research is needed. Developmental research in the…

The OECD's international education indicators have become very influential in contemporary education policies. Although these indicators are now routinely, annually published in the form of "Education at a Glance," the calculability upon which the indicators depend was an achievement that involved the mobilisation of a huge machinery of…

In recent years, there has been increased interest in engagement during learning. This is of particular interest in the science, technology, engineering, and mathematics domains, in which many students struggle and where the United States needs skilled workers. This article lays out some issues important for framing research on this topic and…

Despite, and perhaps because of its amorphous nature, the term "academic success" is one of the most widely used constructs in educational research and assessment within higher education. This paper conducts an analytic literature review to examine the use and operationalization of the term in multiple academic fields. Dominant…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…