The purpose of this study is to assess the impact of aberrant responses on the estimation accuracy in forced-choice format assessments. To that end, a wide range of aberrant response behaviors (e.g., fake, random, or mechanical responses) affecting upward of 20%--30% of the responses was manipulated under the multi-unidimensional pairwise…

Purpose: The purpose of this paper is to present computational algorithms as potential bearers of biases and also tools for reflection, and to advance strategies for engaging with them in education. Design/methodology/approach: Three example games (Dwarf Fortress, RimWorld, FreeCiv) are provided for introducing algorithms as meaningful and…

This methodological paper examines current conceptions of reliability in chemistry education research (CER) and provides recommendations for moving beyond the current reliance on reporting coefficient alpha (a) as reliability evidence without regard to its appropriateness for the research context. To help foster a better understanding of…

In many prekindergarten classes, children begin the day by singing a song as part of their opening routine. In reflecting on opening routines in public prekindergarten classrooms across Michigan, the authors have been struck by how often small changes in teachers' routines or materials could enrich the mathematical engagement of children. The goal…

Design-based methods have recently been developed as a way to analyze randomized controlled trial (RCT) data for designs with a single treatment and control group. This article builds on this framework to develop design-based estimators for evaluations with multiple research groups. Results are provided for a wide range of designs used in…

The aim of this article is to provide an overview of the opportunities for developing computational thinking in young learners. It includes a review of empirical studies on the educational technologies used to develop computational thinking in young learners, and analyses and descriptions of a selection of commercially available technologies for…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…

In the core of computational thinking (CT) practices is problem-solving. However, there is little research on connecting CT with problem solving processes. We developed a computer-based assessment on CT that can log students' problem-solving processes and administered it to a group of fifth graders as a pre- and post- measure of a robotics…

In Huggins-Manley & Han (2017), it was shown that WLSMV global model fit indices used in structural equating modeling practice are sensitive to person parameter estimate RMSE and item difficulty parameter estimate RMSE that results from local dependence in 2-PL IRT models, particularly when conditioning on number of test items and sample size.…

The use of learner modelling approaches is critical for providing adaptive support in educational computer games, with predictive learner modelling being among the key approaches. While adaptive supports have been shown to improve the effectiveness of educational games, improperly customized support can have negative effects on learning outcomes.…

The aim of this study was to investigate current trends in research of math anxiety (MA) through bibliometric perspective. Three main clusters were formed based on author keywords: cognitive correlates (working memory, attention, numerical cognition, mental arithmetic), psychological factors and effects (self-concept and self-efficacy, motivation,…

Cyberinfrastructure (CI) empowers the foundational computation resources underlying data analytics, spatial modeling, and many other domains serving the growing knowledge economy in the United States. In every part of these interactions with CI, questions of how to seamlessly integrate CI training into educational programs exist. In this article,…

We present a question bank consisting of over 250 multiple-choice and true--false questions covering a broad range of material typically taught in an introductory undergraduate course in numerical analysis or computational science. The questions are ideal for polling students during lectures by means of a student response system that uses…

New York City is one of several large school districts around the country that are actively working to promote "computer science for all" students. Launched in 2015, NYC's CS4All initiative aims to ensure that all public school students learn computer science--especially female, Black, and Latinx students, who are starkly…

Background: Early exposure to Computer Science (CS) and Computational Thinking (CT) for all is critical to broaden participation and promote equity in the field. But how does the introduction of CS and CT into primary school curricula impact learning, perception, and gaps between groups of students? Methodology: We investigate a CS-curricular…