Data-based decision-making has been a frequently used policy and practice intervention used in schools to help inform the decision-making processes of educational practitioners, with the aim of improving student outcomes. Interim benchmark assessments are designed by commercial test developers to support educators in this framework. In fact, the…

Data are fundamental to Learning Analytics (LA) research and practice. However, the ethical use of data, particularly in terms of respecting learners' privacy rights, is a potential barrier that could hinder the widespread adoption of LA in the education industry. Despite the policies and guidelines of privacy protection being available worldwide,…

It is meaningful to create a comprehensive score to extract information from mass continuous data when they measure the same latent concept. Therefore, this study adopts the logic of psychometrics to conduct scales on continuous data under the Rasch models. This study also explores the effect of different data discretization methods on scale…

This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

Higher education is awash with data that, when refined, facilitates data-informed decisions. Such decision-making is much more prevalent in support of undergraduate education given the much larger number of undergraduates pursuing higher education in contrast to the much smaller proportion of graduate students. A simple extension of current…

This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…

Measurement systems give colleges a structure for collecting, sharing, and acting on data. The guidebook and tools presented here help faculty, staff, college leadership, and policymakers understand and use measurement systems--and specifically use data to improve completion rates, close institutional performance gaps, and facilitate economic…

Purpose: The main objective of the paper is to develop an investment model using data envelopment analysis (DEA) that provides a decision-making framework to allocate resources efficiently, such that the relative efficiency is improved within an available investment budget. Design/methodology/approach: Firstly, DEA models are used to evaluate the…

Qualitative comparative analysis (QCA) is an empirical research method that has gained some popularity in the social sciences. At the same time, the literature has long been convinced that QCA is prone to committing causal fallacies when confronted with non-causal data. More specifically, beyond a certain case-to-factor ratio, the method is…

Background: Peer assessment has played an important role in large-scale online learning, as it helps promote the effectiveness of learners' online learning. However, with the emergence of numerical grades and textual feedback generated by peers, it is necessary to detect the reliability of the large amount of peer assessment data, and then develop…

Due to the unprecedented growth in available data collected by e-learning platforms, including platforms used by massive open online course (MOOC) providers, important opportunities arise to structurally use these data for decision making and improvement of the educational offering. Student retention is a strategic task that can be supported by…

It is of critical importance to be aware of the historical discrimination embedded in the data and to consider a fairness measure to reduce bias throughout the predictive modeling pipeline. Given various notions of fairness defined in the literature, investigating the correlation and interaction among metrics is vital for addressing unfairness.…

Assessing sensitivity to unmeasured confounding is an important step in observational studies, which typically estimate effects under the assumption that all confounders are measured. In this paper, we develop a sensitivity analysis framework for balancing weights estimators, an increasingly popular approach that solves an optimization problem to…

As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

Schools are increasingly turning towards restorative practices as a pathway to building schools with stronger relationships, justice, and equity. While effectiveness studies are increasing, too little attention is focused on evaluating implementation. This resources is for audiences who evaluate implementation of whole school restorative practices…