There is growing interest in incorporating multiple voices and ways of knowing into assessment efforts. Attention to incorporating multiple approaches to measuring student learning increases equity in assessment (Montenegro and Jankowski 2017) and promotes engagement with a variety of stakeholders with diverse perspectives on knowledge. However,…

The aim of the current paper is to offer a unique perspective on eye movement analysis in reading research by applying techniques from social network analysis to examine integration processes between sentences during reading. In a first step, we explored how network measures relate to the often-used duration measures in reading research in order…

Despite continued research into the Community of Inquiry (CoI) framework, the best way to measure each presence of the framework, and in particular social presence, has not been effectively settled in prior research. The purpose of this study was to evaluate the validity of the social presence items in the CoI framework and its subscales, as well…

Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

This study argues that readability formulas should be used as one measure of linguistic equivalence when adapting psychometric scales from one language to another. Assuming that the psychological structure being measured was not changed, it was observed that calculated readability levels and interpretations were different for two different…

The leaders of Networks for School Improvement (NSIs) have complex, challenging jobs which require constant learning and adaptation. To support these leaders, the contributors to this volume have developed a survey-based data visualization system--the Improvement Network Health Development (INHD) Information System--designed to generate insight…

This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no…

Previous researchers have demonstrated that using stimuli identified via daily brief preference assessments may produce more responding under concurrent-schedule arrangements than using stimuli identified via lengthy, pre-treatment preference assessments (DeLeon et al., 2001). To date, this has not been evaluated within the context of skill…

ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

The present work assessed a quizzing method that combines the benefits of retrieval practice and feedback, whereby learners must continue taking quizzes until they achieve a perfect score with feedback provided (i.e., "mastery quizzing"). Across four experiments (n = 952; age 18-76, M = 37.10, SD = 11.61; 50% female, 48% male, 2% other…

Regression discontinuity (RD) designs are increasingly used for causal evaluations. However, the literature contains little guidance for conducting a moderation analysis within an RDD context. The current article focuses on moderation with a single binary variable. A simulation study compares: (1) different bandwidth selectors and (2) local…

Background: The peer review process plays a vital role in the advancement of engineering educational research because it is largely through this process that the field determines which knowledge claims are considered valid. Unfortunately, peer review processes may reinforce inequities when peer reviewers, as readers, are not reflective about the…

This paper extends the growing conversations around creativity's metamorphic capacities for good to propose and explore Social Change Creativity (SCC) as a distinct creative domain in which individuals and communities engage in the creative process to combat social injustice and manifest equitable social outcomes. SCC involves the use of creative…

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems…

In this Point of Departure, the idea of authentic assessment is examined and troubled by drawing on Derrida's hauntology. The spectres of higher education invite us to reconsider what is 'real' about past, present, and future assessment practices. Such spectres do not lecture or produce a single, definitive interpretation. Rather, these spectres…