In this practice paper I examine the evaluation of one project and ask whether or not the evaluation failed. I suggest that because I was unaware of the larger connections between the grant agency and the grantee I made tactical errors in the presentation of findings, which resulted in not simply disagreement but anger and resentment. I conclude…

National College Access Network (NCAN) has heard repeatedly and consistently over the years that one of the best aspects of network membership is the ability to collaborate with and learn from other members. In an effort to further the transfer of ideas, in the summer of 2016 NCAN hosted a series of four Idea Incubators across the country, which…

Successive UK government policies have strengthened the phonics element of the National Curriculum for English in England. The policies have included inviting publishers to submit completed self-assessments of their systematic phonics programmes. The self-assessment criteria focus on what is deemed to be 'high-quality provision', as defined in the…

Studies that examine the impacts of education interventions on key student, teacher, and school outcomes typically collect data on large samples and on many outcomes. In analyzing these data, researchers typically conduct multiple hypothesis tests to address key impact evaluation questions. Tests are conducted to assess intervention effects for…

The purpose and direction of the Office of Student Financial Aid (OSFA) quality improvement program are described. The background and context for the Pell Grant quality control (QC) design study and the meaning of QC are reviewed. The general approach to quality improvement consists of the following elements: a strategic approach that enables OSFA…

A preliminary design for a quality control (QC) system for the Pell Grant Program is proposed, based on the needs of the Office of Student Financial Assistance (OSFA). The applicability of the general design for other student aid programs administered by OSFA is also considered. The following steps included in a strategic approach to QC system…

Due to a concern regarding the validity of Chicago public elementary schools standardized test scores on the Iowa Tests of Basic Skills, a test audit was conducted. The audit was limited to 40 schools. Two schools were selected from each of the 20 administrative districts, with each school testing one seventh- and one eighth-grade class. These…

This report describes TORUS, a computer-based program for elementary school students with learning disabilities which analyzes student work samples in addition and subtraction and provides individual profiles of student misconceptions and weaknesses. Initially, work samples from 236 middle school students with learning disabilities were analyzed…

Quality Control (QC) regulations for the following federal entitlement programs are discussed: Aid to Families with Dependent Children (AFDC), Medicaid, Supplemental Security Income Program, and Food Stamp Program. Implications of these QC procedures and for the Department of Education's approach to QC regulations are also considered. Each set of…

The purpose and direction of the quality improvement program of the U.S. Department of Education's Office of Student Financial Aid (OSFA) are described. The improvement program was designed to develop a systematic approach to identify, measure, and correct errors in the student aid delivery system. Information is provided on the general approach…

The issues, options, and procedures for annually measuring overall payment error in the Pell Grant program are specified in detail. Guidelines for establishing a definition of Pell Grant payment error are provided, and the design issues related to error measurement are examined. A comparison is made of options for selecting a study sample and for…