The purpose of this paper is to elaborate and comment on some themes related to construct validity, construct choice, and construct respecification in the Campbellian validity system. It is argued that Reichardt's [(2008, November). An alternative to the Campbellian conceptualization of validity. (Paper presentation). Evaluation 2008 Conference,…

Fuzzy regression-discontinuity evaluations of college remediation often find negative and null estimates of local average treatments effects (LATEs), but with substantial heterogeneity. We find that a remedial quantitative skills course at Wellesley College has a modestly positive LATE on participation in mathematically intensive fields of…

This study employed repeated measures ANOVA to assess the reliability of an instrument designed to measure utilization, awareness, and perception of AI in research among 150 undergraduate students. Validated instruments with robust psychometric properties were used for the study. Data collection occurred in three phases spaced two weeks apart,…

Discussions of what it means to be an effective outdoor leader are common in outdoor education literature (Martin et al., 2025; Smith, 2021). Research has identified core competencies (Martin et al., 2025), conceptual frameworks (Pomfret et al., 2023), and course curricula/qualifications for effective leadership (Baker & O'Brien, 2019; Seaman…

Qualitative thematic analysis is a commonly used and widely applicable form of qualitative analysis, though it can be challenging to implement. Due to its use across research questions, qualitative traditions, and fields, thematic analysis is also prevalent in mixed methods studies. Despite its widespread use, the term "thematic…

We study the external validity of instrumental variable estimation. The key assumption we impose for external validity is conditional external unconfoundedness among compliers, which means that the treatment effect and target selection are independent among compliers conditional on covariates. We study this assumption with a case study about the…

Meta-analysis of diagnostic test accuracy (DTA) is a powerful statistical method for synthesizing and evaluating the diagnostic capacity of medical tests and has been extensively used by clinical physicians and healthcare decision-makers. However, publication bias (PB) threatens the validity of meta-analysis of DTA. Some statistical methods have…

Classical evaluation methods, assessments, exams, and so forth accentuate the perception of one against all, professor versus learners. Including students in the assessment process, allows transforming the professor from an opponent to a critical friend, with the role of helping students to recognize both their strengths and weaknesses. However,…

Evaluators are often called upon to assess the effects of programs. To assess a program effect, evaluators need a clear understanding of how a program effect is defined. Arguably, the most widely used definition of a program effect is the counterfactual one. According to the counterfactual definition, a program effect is the difference between…

Missing data in scientific research go hand in hand with assumptions about the nature of the missingness. When dealing with missing values, a set of beliefs has to be formulated about the extent to which the observed data may also hold for the missing parts of the data. It is vital that the validity of these missingness assumptions is verified,…

Background: Views can be collected from individuals (self-report) or others on their behalf (proxy-report). Objective: We aimed to review the literature on methods and statistical approaches used to evaluate observer versus self-report responses from individuals with intellectual disability or Down syndrome. Methods: A series of key questions…

The purpose of this article is to provide researchers with a framework for promoting high quality mixed methods school-based consultation research. Furthermore, this article is intended for researchers and practitioners interested in evaluating their practice. To meet these objectives, we address quality criteria for quantitative (validity) and…

Quality assessment systems have recently expanded, serving as indicators for the assessment and ranking of higher education institutions worldwide. The growing development of new educational methodologies, like Blended Learning, requires the design and validation of tools that allow for their assessment. The objective of this article is to…

Experimental psychology is witnessing an increase in research on individual differences, which requires the development of new tasks that can reliably assess variations among participants. To do this, cognitive researchers need statistical methods that many researchers have not learned during their training. The lack of expertise can pose…

Educational reform priorities such as emphasis on quantitative modelling (QM) have positioned undergraduate biology instructors as designers of QM experiences to engage students in authentic science practices that support the development of data-driven and evidence-based reasoning. Yet, little is known about how biology instructors adapt to the…