There is growing interest in incorporating multiple voices and ways of knowing into assessment efforts. Attention to incorporating multiple approaches to measuring student learning increases equity in assessment (Montenegro and Jankowski 2017) and promotes engagement with a variety of stakeholders with diverse perspectives on knowledge. However,…

The aim of the current paper is to offer a unique perspective on eye movement analysis in reading research by applying techniques from social network analysis to examine integration processes between sentences during reading. In a first step, we explored how network measures relate to the often-used duration measures in reading research in order…

Despite continued research into the Community of Inquiry (CoI) framework, the best way to measure each presence of the framework, and in particular social presence, has not been effectively settled in prior research. The purpose of this study was to evaluate the validity of the social presence items in the CoI framework and its subscales, as well…

Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

This study argues that readability formulas should be used as one measure of linguistic equivalence when adapting psychometric scales from one language to another. Assuming that the psychological structure being measured was not changed, it was observed that calculated readability levels and interpretations were different for two different…

The leaders of Networks for School Improvement (NSIs) have complex, challenging jobs which require constant learning and adaptation. To support these leaders, the contributors to this volume have developed a survey-based data visualization system--the Improvement Network Health Development (INHD) Information System--designed to generate insight…

This article presents the Renger System Test (RST) as a method for assessing whether a system evaluation approach is suitable for evaluating complex interventions. The RST has three criteria: (1) the intervention includes multiple components, (2) these components operate interdependently, and (3) their interdependence produces an outcome that no…

Rapid approaches are essential when resources are limited and when findings are required in real-time to inform decisions. Limitations exist in their design and implementation, which can lead to a reduced level of trust in findings. This review sought to map the methods used across rapid evaluations and research to facilitate timeliness and…

Previous researchers have demonstrated that using stimuli identified via daily brief preference assessments may produce more responding under concurrent-schedule arrangements than using stimuli identified via lengthy, pre-treatment preference assessments (DeLeon et al., 2001). To date, this has not been evaluated within the context of skill…

ETS scientists developed a human-centered AI (HAI) framework that combines data on how students interact with assessments--such as task navigation and time spent--with their performance, providing deeper insights into student performance in large-scale assessments.

Effective communication skills are essential for success in both academic and professional contexts. This concept paper presents a novel framework designed to operationally define and support the development of assessments of communication skills with a specific emphasis on K-12 settings. Through discussions on important considerations for the…

The present work assessed a quizzing method that combines the benefits of retrieval practice and feedback, whereby learners must continue taking quizzes until they achieve a perfect score with feedback provided (i.e., "mastery quizzing"). Across four experiments (n = 952; age 18-76, M = 37.10, SD = 11.61; 50% female, 48% male, 2% other…

Background: The peer review process plays a vital role in the advancement of engineering educational research because it is largely through this process that the field determines which knowledge claims are considered valid. Unfortunately, peer review processes may reinforce inequities when peer reviewers, as readers, are not reflective about the…

This paper extends the growing conversations around creativity's metamorphic capacities for good to propose and explore Social Change Creativity (SCC) as a distinct creative domain in which individuals and communities engage in the creative process to combat social injustice and manifest equitable social outcomes. SCC involves the use of creative…

Regression discontinuity (RD) designs are increasingly used for causal evaluations. However, the literature contains little guidance for conducting a moderation analysis within an RDD context. The current article focuses on moderation with a single binary variable. A simulation study compares: (1) different bandwidth selectors and (2) local…