Contrast analysis is a relatively simple but effective statistical method for testing theoretical predictions about differences between group means against the empirical data. Despite its advantages, contrast analysis is hardly used to date, perhaps because it is not implemented in a convenient manner in many statistical software packages. This…

The purpose of this study is to assess the impact of aberrant responses on the estimation accuracy in forced-choice format assessments. To that end, a wide range of aberrant response behaviors (e.g., fake, random, or mechanical responses) affecting upward of 20%--30% of the responses was manipulated under the multi-unidimensional pairwise…

Purpose: The purpose of this paper is to present computational algorithms as potential bearers of biases and also tools for reflection, and to advance strategies for engaging with them in education. Design/methodology/approach: Three example games (Dwarf Fortress, RimWorld, FreeCiv) are provided for introducing algorithms as meaningful and…

This methodological paper examines current conceptions of reliability in chemistry education research (CER) and provides recommendations for moving beyond the current reliance on reporting coefficient alpha (a) as reliability evidence without regard to its appropriateness for the research context. To help foster a better understanding of…

In many prekindergarten classes, children begin the day by singing a song as part of their opening routine. In reflecting on opening routines in public prekindergarten classrooms across Michigan, the authors have been struck by how often small changes in teachers' routines or materials could enrich the mathematical engagement of children. The goal…

Design-based methods have recently been developed as a way to analyze randomized controlled trial (RCT) data for designs with a single treatment and control group. This article builds on this framework to develop design-based estimators for evaluations with multiple research groups. Results are provided for a wide range of designs used in…

The aim of this article is to provide an overview of the opportunities for developing computational thinking in young learners. It includes a review of empirical studies on the educational technologies used to develop computational thinking in young learners, and analyses and descriptions of a selection of commercially available technologies for…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…

In the core of computational thinking (CT) practices is problem-solving. However, there is little research on connecting CT with problem solving processes. We developed a computer-based assessment on CT that can log students' problem-solving processes and administered it to a group of fifth graders as a pre- and post- measure of a robotics…

In Huggins-Manley & Han (2017), it was shown that WLSMV global model fit indices used in structural equating modeling practice are sensitive to person parameter estimate RMSE and item difficulty parameter estimate RMSE that results from local dependence in 2-PL IRT models, particularly when conditioning on number of test items and sample size.…

"Where Mathematics Comes From" (Lakoff & Núñez 2000) proposed that mathematical concepts such as arithmetic and counting are constructed cognitively from embodied metaphors of actions on physical objects, and four actions, or 'grounding metaphors' in particular: collecting, stepping, constructing and measuring. This article argues…

This paper presents a game-design workshop built around a digital art installation featuring video games displayed over a real-world skyscraper to stimulate students' interest in computer science and a study testing its short-term effects on improving middle school students' computational thinking (CT) skills and attitudes towards computing.…

Student attendance is both a critical input and intermediate output of the education production function. However, the malleable classroom-level determinants of student attendance are poorly understood. We estimate the causal effect of class size, class composition, and observable teacher qualifications on student attendance by leveraging the…

There has been increasing interest in exploring heterogeneous treatment effects using machine learning (ML) methods such as causal forests, Bayesian additive regression trees, and targeted maximum likelihood estimation. However, there is little work on applying these methods to estimate treatment effects in latent classes defined by…

Despite the importance of retirement savings, many individuals retire with lack of adequate retirement savings. While calculating retirement savings needs was found to enhance retirement savings, little is known about what underlies this enhancement. Applying the theory of planned behavior (TPB), we developed a model in which psychological factors…