As evaluators, we are often asked to determine whether policies and programs provide value for the resources invested. Addressing that question can be a quandary, and, in some cases, evaluators question whether cost-benefit analysis is fit for this purpose. With increased interest globally in social enterprise, impact investing, and social impact…

The purpose of this qualitative case study was to describe/summarize the perceptions of the North Carolina Educator Evaluation System (NCEES) for 10 educational leaders in two small rural school districts in eastern North Carolina. This study was conducted through the problem definition lens. The 10 educational leaders for this study included two…

This article describes and theorizes a failed writing program assessment study to question the influence of "the rhetoric of agreement," or reliability, on writing assessment practice and its prevalence in validating institutional mandated assessments. Offering the phrase "dwelling in disagreement" as a queer perspective, the…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

In the area of early childhood gifted education and effective interventions for young children identified as intellectually gifted, there appears to be a persistent lack of research. There is also very little research on the characteristics and social-emotional development of young gifted children, particularly those of preschool age. The small…

Efforts to promote professionalism in evaluation, whether through certification, credentialing, or other path, are not new, but there is a new push to adopt sets of essential evaluator competencies, both in the United States and globally, that are intended to advance professionalism of the field. This emphasis on professionalism is relevant to the…

In response to Eleanor Chelimsky's inspiring plenary address 3 years ago, and with generous support from the Robert Wood Johnson Foundation, the Eastern Evaluation Research Society launched the Eleanor Chelimsky Forum at its 2013 Annual Conference. The objective of this annual Forum, which has become a hallmark event in the evaluation world, is to…

Selection bias pervades the evaluation of supplemental instruction (SI) in non-experimental settings. This brief note provides a formal framework to understand this issue. The objective is to contribute to the accumulation of credible evidence on the impact of SI.

Practitioners are being placed under increasing pressure to evaluate the success of their outreach activities, both by government and by their own universities. Based in a reductionist doctrine of "evidence-based practice", there is a desire to demonstrate the effectiveness and value-for-money across activities that now account for…

The search for necessary and sufficient causes of some outcome of interest, referred to as "configurational comparative research," has long been one of the main preoccupations of evaluation scholars and practitioners. However, only the last three decades have witnessed the evolution of a set of formal methods that are sufficiently…

In relation to teaching and learning approaches that improve student learning outcomes, threshold concepts have generated substantial interest in higher education. They have been described as "portals" that lead to a transformed way of understanding or thinking, enabling learners to progress, and have been enthusiastically adopted to…

Institutional assessment of student learning objectives has become a fact-of-life in American higher education and the Association of American Colleges and Universities' (AAC&U) VALUE Rubrics have become a widely adopted evaluation and scoring tool for student work. As faculty from a variety of disciplines, some less familiar with the…

Effective assessment practice requires clearly defining and operationalizing terminology. We illustrate the importance of this practice by focusing on academic "undermatching"--when students enroll in colleges that are less academically selective than those for which they are academically prepared. Undermatching has been viewed as a…

Karabatsos compared the power of 36 person-fit statistics using receiver operating characteristics curves and found the "H[superscript T]" statistic to be the most powerful in identifying aberrant examinees. He found three statistics, "C", "MCI", and "U3", to be the next most powerful. These four statistics,…

Purpose: The purpose of this paper is to focus on assessing individuals' problems in learning groups/teams and should lead to the assessment of the group/team itself as a learning entity. Design/methodology/approach: In this paper, an extension of the IMS-Learning Design (IMS-LD) meta-model is proposed in order to support the assessment of…