Policymakers have expressed increased interest in program-level higher education accountability measures as a supplement to, or in place of, institution-level metrics. But it is unclear what these measures should look like. In this report, we assess the ways program-level data could be developed to facilitate federal accountability. Evidence shows…

This paper presents a case study on the adoption and the impact of new modules in a learning analytics dashboard supporting the dialogue between student advisors and students when advising on a study plan for the next academic semester in Escuela Superior Politecnica del Litoral, a higher education institute in Ecuador. The impact and the adoption…

The rapidly growing number of learning materials and repositories makes the issue of how to find the most relevant and best quality resources to be integrated in teaching and learning offers. Thus, effective quality assessment tools are more and more needed. In the present paper, a case-study focusing on quality assurance in a Virtual Mobility…

Within Extension, certain personnel, facilitators, and volunteers expected to conduct research in the form of program evaluation may have little or no training in effective research design and practices. This circumstance can lead to difficulties in the implementation of evaluation procedures, particularly with regard to program evaluation…

Career Technology Education (CTE) program evaluations have been mostly completed for compliance and monitoring purposes. Hence, they have limited use in establishing program effectiveness or for program improvement. Moreover, engaging in program evaluations can be time consuming and costly, especially for programs that have not been evaluated in…

This study sought to better understand present-day relationships between institutional and programmatic characteristics and their impact on student outcomes at postsecondary career and technical schools. This is critical given: (a) the existence of a significant middle-skills gap impacting the U.S. economy; (b) a lack of research and guidance for…

This article outlines how Master of Public Administration (MPA)/Master of Public Policy (MPP) programs can integrate a project-based learning opportunity to study curricular design and accreditation needs in their quantitative courses. Bridging together theory and the practical implications of data collection and analysis is important for…

The objective of the audit was to determine whether the Florida Department of Education (Florida) established and implemented systems of internal control that ensured (1) displaced student count data provided to the U.S. Department of Education were accurate and complete, (2) Temporary Emergency Impact Act (EIA) program funds were appropriately…

Supplemental Instruction (SI) is a voluntary, non-remedial, peer-facilitated, course-specific intervention that has been widely demonstrated to increase student success, yet concerns persist regarding the biasing effects of disproportionate participation by already higher-performing students. With a focus on maintaining access for all students, a…

Analysis of student-level data to inform policy and promote student success is a core function of executive higher education agencies. Postsecondary data systems have expanded their collection of data elements for use by policymakers, institutional staff and the general public. State coordinating and governing boards use these data systems for…

This paper reports on the external evaluation of a two-year project aimed at improving educational opportunities for Aboriginal Education Workers (AEWs) through technology-based pedagogy. A design-based approach was selected by the research team to increase the relevance of the research for both praxis and practice, with emphasis on improvement of…

Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

A growing body of research focuses on what outcomes to assess in makerspaces, and appropriate formats for capturing those outcomes (e.g. reflections, surveys, and portfolios). Linguistic analysis as a data mining technique holds promise for revealing different dimensions of learning exhibited by students in makerspaces. In this study, student…

Purpose: The purposes of this paper are to provide a description of AI and to document and compare two applications of AI, one in program evaluation and another in an applied research study. Design/methodology/approach: Focus groups, interviews and observations were used to gather rich qualitative data which was used to detail Appreciative…

The Welsh Baccalaureate qualification has been adopted by most secondary schools within Wales. In years 12 and 13 (ages 16-18), 50% of the qualification requires students to collect primary data and also conduct secondary data analysis to write a 5000 word investigative report. To help teachers develop effective teaching strategies and resources,…