Physical activity (PA) promotion is an ideal intervention target for public health because it has the potential to help individuals feel better, sleep better, and perform daily tasks more easily, in addition to providing disease prevention benefits. There is strong evidence that individual-level theory-based behavioral interventions are effective…

This tutorial uses publicly available data from drug makers and the Food and Drug Administration to guide learners to estimate the confidence intervals of COVID-19 vaccine efficacy rates with a Bayesian framework. Under the classical approach, there is no probability associated with a parameter, and the meaning of confidence intervals can be…

This guidance updates Training and Employment Guidance Letter (TEGL) 10-16, Change 2, published September 15, 2022, and developed jointly by the U.S. Departments of Labor (DOL) and Education (ED) (the Departments). Within ED, the Office of Career, Technical, and Adult Education (OCTAE) will update Program Memorandum (PM) 17-2, and the…

Educator micro-credentials present a unique opportunity to link professional learning to practice. Through each competency-based credential, educators demonstrate application of their learning. School districts are seeing the value of embedding micro-credentials in existing professional learning pathways to promote educator agency, recognize…

The What Works Clearinghouse (WWC) Standards Briefs explain the rules the WWC uses to evaluate the quality of studies for practitioners, researchers, and policymakers. Attrition (loss of sample) occurs when individuals initially included in a study are not included in the final study analysis. Attrition is a common issue in education research and…

As an assessment method based on a constructivist approach, peer assessment has become popular in recent years. However, in peer assessment, a problem remains that reliability depends on the rater characteristics. For this reason, some item response models that incorporate rater parameters have been proposed. Those models are expected to improve…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

We describe the construction and initial demonstration of a new instructional tool called ROXI (Research Opportunity through eXperimental Instruction). The system interfaces a series of electronic sensors to control software via the Arduino platform. The sensors have been designed to enable low-cost data collection in laboratory courses. Data are…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

Researchers have been making use of ecological momentary assessment (EMA) and other study designs that sample feelings and behaviors in real time and in naturalistic settings to study temporal dynamics and contextual factors of a wide variety of psychological, physiological, and behavioral processes. As EMA designs become more widespread,…

An overview of a course on modeling and simulation offered at the Nanotechnology Engineering undergraduate program at the University of Waterloo. The motivation for having this course in the undergraduate nanotechnology curriculum, the course structure, and its learning objectives are discussed. Further, one of the computational laboratories…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

In recent work, the author has estimated the rate of return for several workforce development programs in the State of Washington, including secondary and postsecondary career and technical education (CTE; Hollenbeck, 2008). The returns are based on estimates of the net impact of CTE on individuals' labor market experiences and government income…

The present article provides a primer on using effect sizes in research. A small heuristic data set is used in order to make the discussion concrete. Additionally, various admonitions for best practice in reporting and interpreting effect sizes are presented. Among these is the admonition to not use Cohen's benchmarks for "small," "medium," and…

This Technical Report is designed to provide technical detail to support the analysis and findings presented in the "Head Start Impact Study Final Report" (U.S. Department of Health and Human Services, January 2010). Chapter 1 provides an overview of the Head Start Impact Study and its findings. Chapter 2 provides technical information on the…