With the recent reauthorization of the Strengthening Career and Technical Education for the 21st Century Act (Perkins V), unprecedented philanthropic investment in career pathways, and the urgent economic needs of the COVID-19 (coronavirus) pandemic, the career readiness field is at a critical moment in time. To meet this moment, states,…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This report describes how big data and an evidence framework can align across five contexts of educational improvement. It explains that before working with big data, there is an important prerequisite: the proposed innovation should align with deeper learning objectives and should incorporate sound learning sciences principles. New curriculum…

The classification by many scholars of numerical research processes as quantitative and other research techniques as qualitative has prompted the construction of a third category, that of "mixed methods", to describe studies that use elements from both processes. Such labels might be helpful in structuring our understanding of phenomena. But they…

Instruments for evaluating the implementation of inquiry science in K-12 classrooms are necessary if evaluators and researchers are to know the extent to which programs are implemented as intended and the extent to which inquiry science teaching accounts for student learning. For evaluators and researchers to be confident about the quality of…

The "gold standard" for evaluating human immunodeficiency virus (HIV) prevention programs is a partner-by-partner sexual behavior assessment that elicits information about each sex partner and the activities engaged in with that partner. When collection of detailed partner-by-partner data is not feasible, aggregate data (e.g., total…

This article introduces a bootstrap generalization to the Modified Parallel Analysis (MPA) method of test dimensionality assessment using factor analysis. This methodology, based on the use of Marginal Maximum Likelihood nonlinear factor analysis, provides for the calculation of a test statistic based on a parametric bootstrap using the MPA…

All evaluators face the challenge of striving to adhere to the highest possible standards of ethical conduct. Translating the AEA's Guiding Principles and the Joint Committee's Program Evaluation Standards into everyday practice, however, can be a complex, uncertain, and frustrating endeavor. Moreover, acting in an ethical fashion can require…

The Office of Institutional Research (OIR) is uniquely poised to assist an institution of higher education in conducting an effective, efficient, and meaningful self-study for reaccreditation. Drawing on the experiences of William Paterson University, New Jersey, this paper describes the steps an OIR can take to help ensure that the self-study…

This monograph describes three types of evaluation that are potentially useful to school-based clinics: needs assessments, process evaluations, and impact evaluations. Two important methodological principles are involved: (1) collecting multiple kinds of data with multiple methods; and (2) collecting comparison data. Student needs can be…

Examples from the evaluation of a program in which data collection systems were developed jointly by the program's staff and evaluators are described. The Louisiana SPUR (Special Plan Upgrading Reading) Project was evaluated by the Louisiana Department of Education Bureau of Evaluation. SPUR involves 63 of the state's 66 public school systems and…

A conceptual model of quality of life, developed at the Centre for Health Promotion at the University of Toronto (Canada), and associated instrumentation for collecting data from persons with developmental disabilities are presented. Results from a preliminary study with 41 participants support the reliability and validity of the model's…

Thirty studies on supported employment for people with disabilities were evaluated using a proposed Social Validity Matrix. Results suggested further research should investigate alternative strategies for assessing social validity, develop systematic procedures for collecting and using social validity data, and establish functional variables…

In this article the authors discuss issues faced by early career researchers, including the dichotomy, which many research textbooks and journal articles create and perpetuate between qualitative and quantitative research methodology despite considerable literature to support the use of mixed methods. The authors review current research literature…

Designed to assist evaluators in selecting the appropriate software for the generation of various data collection instruments, this guide discusses such key program characteristics as text entry, item storage and manipulation, item retrieval, and printing. Some characteristics of a good instrument generation program are discussed; these include…