There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

Information and communication technology (ICT)-enhanced research methods such as educational data mining (EDM) have allowed researchers to effectively model a broad range of constructs pertaining to the student, moving from traditional assessments of knowledge to assessment of engagement, meta-cognition, strategy and affect. The automated…

The field of learning analytics is rapidly developing techniques for using data captured during online learning. In this article, we develop an additional application: the use of analytics for improving implementation fidelity in a randomized controlled efficacy trial. In an efficacy trial, the goal is to determine whether an innovation has a…