In this article, we discuss the methodological implications of data and theory integration for Theory-Based Evaluation (TBE). TBE is a family of approaches to program evaluation that use program theories as instruments to answer questions about whether, how, and why a program works. Some of the groundwork about TBE has expressed the idea that a…

Expanded learning intermediaries are nonprofit organizations dedicated to making after-school and summer programs better and more accessible for children and youth. They do this by coordinating efforts and resources in a given community, knitting programs together into a cohesive system, helping individual programs function at a high level, and…

National College Access Network (NCAN) has heard repeatedly and consistently over the years that one of the best aspects of network membership is the ability to collaborate with and learn from other members. In an effort to further the transfer of ideas, in the summer of 2016 NCAN hosted a series of four Idea Incubators across the country, which…

People providing services to schools, teachers, and students want to know whether these services are effective. With that knowledge, a project director can expand services that work well and adjust implementation of activities that are not working as expected. When finding that an innovative strategy benefits students, a project director might…

The Local Child Outcomes Measurement System (L-COMS) is a framework that identifies seven key components of a high-quality child outcomes measurement system at the local level. The L-COMS framework was designed to apply to all local programs regardless of their specific child outcomes measurement approach. Development of the L-COMS originated with…

Career Technology Education (CTE) program evaluations have been mostly completed for compliance and monitoring purposes. Hence, they have limited use in establishing program effectiveness or for program improvement. Moreover, engaging in program evaluations can be time consuming and costly, especially for programs that have not been evaluated in…

We report on the implementation experience of carrying out data collection and other activities for a public health evaluation study on whether U.S. President's Emergency Plan for AIDS Relief (PEPFAR) investment improved utilization of health services and health system strengthening in Uganda. The retrospective study period focused on the PEPFAR…

The City University of New York (CUNY) is the largest urban public university system in the United States with approximately 100,000 students enrolled in associate degree programs. Similar to trends nationwide, many associate degree students come to CUNY underprepared for college-level classes and are assigned to take remedial or developmental…

This chapter provides examples of innovative methods and tools to collect, analyze, and report both quantitative and qualitative data in student affairs assessment.

There is demand among policy-makers for the use of state education longitudinal data systems, yet laws and policies regulating data disclosure limit access to such data, and security concerns and risks remain high. Well-developed synthetic datasets that statistically mimic the relations among the variables in the data from which they were derived,…

As a precursor to this annual report, in February 2018, the Department issued its "U.S. Department of Education Strategic Plan for Fiscal Years [FY] 2018-22" ("Strategic Plan") (see ED586968). The "Strategic Plan" establishes four broad, overarching goals--one goal each in the areas of K-12 education, postsecondary…

A statewide survey of the infrastructure of teacher education program assessment systems in North Carolina, which include electronic portfolios as a component in the assessment system, measured their ability to meet current and anticipated future data demands for state approval and national accreditation. Almost two-thirds of the 46 teacher…

Major advances in the number, capabilities, and quality of state, national, and transnational databases have opened up new opportunities for evaluators. Both large-scale data sets collected for administrative purposes and those collected by other researchers can provide data for a variety of evaluation-related activities. These include (a)…

The need to manage, analyze, and extract knowledge from data is pervasive across industry, government, and academia. Scientists, engineers, and executives routinely encounter enormous volumes of data, and new techniques and tools are emerging to create knowledge out of these data, some of them capable of working with real-time streams of data. The…

This document, "Book Two of Four: Planning and Developing an LDS", is the second installment of this Forum (National Forum on Education Statistics) series of guides on longitudinal data systems (LDS). This second book in the guide series delves into the planning, implementation, and evaluation phases of a longitudinal data system (LDS)…