Even though agent-based modelling is seen as committing to a mechanistic, generative type of causation, the methodology allows for representing many other types of causal explanations. Agent-based models are capable of "integrating" diverse causal relationships into coherent causal mechanisms. They mirror the crucial, multi-level…

Instructional strategies employing complex problem-solving examine how learners represent the problem space and argue for decisions. Unlike problems with few solutions (e.g., multiple choices), instructors struggle to evaluate solutions to ill-structured problems quickly and consistently across students. This prevents instructors to provide timely…

Studying Biblical Hebrew is increasingly considered a viable option for students with dyslexia. This presents particular challenges not just for the students but also for their teachers, because the pedagogical methods for teaching ancient languages have traditionally depended on strategies that create difficulties for dyslexic students. This…

Agent-based models (ABMs) often rely on psychometric constructs such as 'opinions', 'stubbornness', 'happiness', etc. The measurement process for these constructs is quite different from the one used in physics as there is no standardized unit of measurement for opinion or happiness. Consequently, measurements are usually affected by 'psychometric…

Asymmetric Likert-type items in research studies can present several challenges in data analysis, particularly concerning missing data. These items are often characterized by a skewed scaling, where either there is no neutral response option or an unequal number of possible positive and negative responses. The use of conventional techniques, such…

We explore the various Mathematica functions for performing Gaussian elimination, specifically when the linear system contains input parameters. On the one hand, we want the solution, perhaps heuristically found, to be in terms of the input parameters, and as general as possible. On the other hand, we must adhere to all necessary conditions and…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

Since 2007, two taxonomies have been proposed to identify the components of evaluation practice that may be specified in an evaluation policy. Little is known, however, about how these taxonomies align with evaluation policies developed by philanthropic foundations. Through thematic analysis, this article first compares 12 foundation evaluation…

In this edition of Assessment News, Charles Darr uses a case study from the National Monitoring Study of Student Achievement (NMSSA) to highlight how students can benefit from activating deliberate thinking in assessments. The key message underscores the value of using assessment information to generate insights that inform better teaching and…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

For a librarian with an innovator's mindset, inquiry can be a collaborative strategy for continual growth. When a librarian innovates with their community, radical, human-centered change is possible. According to the author, school librarians see the needs in the communities across grades, content areas, and demographics. The best advocacy is…

The rapid integration of artificial intelligence (AI) in higher education has been significantly propelled by developments in generative AI tools, which hold considerable promise for transforming teaching and assessment methodologies. This paper explores the distinctive opportunities and challenges associated with the incorporation of generative…

Though there is an extensive research literature on understanding and assessing individual modeling competencies, less attention has been given to characterizing the social context of the classroom in which modeling occurs. Yet a classroom's culture of modeling--its negotiated system of beliefs and values about the nature of modeling and what…

This issue of "Assessment Update" presents a three part series on fixing assessments. Assessment means different things, but it almost always includes accreditation reporting. In Part 1: David Eubanks describes what went wrong with the accreditation standards on learning assessment and the compliance culture that they created. This…

This issue of "Assessment Update" presents a three part series on fixing assessments. In Part 1, David Eubanks advocates for a collaborative model of assessment as the field enters a fourth decade of low return on investment. In Part 2, Megan R. Good laments the opportunity cost of continuing the define-measure-improve assessment model…