This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

The recent commentary by Beaujean and Farmer (2020) on the original paper by Dixon et al. (2019) serves a cautionary tale of selective p-values, the law of small N sizes, and the type-II error. We believe these authors have crafted a somewhat questionable argument in which only 57% of the original Dixon et al. data were re-analyzed, based on a…

This article conceptualizes the notion of magic(al)ing in relation to post-pandemic ways of thinking about data production and analyses. Revisiting old data produced pre-COVID-19 and engaging with new data produced during COVID-19, we consider the possibilities and potential of magic(al)ing as a theoretical concept. We think with several ideas…

Meta-analysis and structural equation modeling (SEM) are 2 of the most prominent statistical techniques employed in the behavioral, medical, and social sciences. They each have their own well-established research communities, terminologies, statistical models, software packages, and journals ("Research Synthesis Methods" and…

Keynotes fulfill a particular function in the planning and compiling of a conference program, and these individuals are invited for a number of reasons -- to lend political and/or scholarly gravitas to the event, to stimulate and enlighten, and/or to provoke. Keynotes are also often outsiders to a particular field, and an invitation to deliver a…

James J. Cochran is Professor of Applied Statistics, Rogers-Spivey Faculty Fellow, and Associate Dean for Research in the Culverhouse College of Commerce at the University of Alabama. He is a Fellow of the American Statistical Association and of Institute for Operations Research and Management Sciences. He is also a recipient of the INFORMS Prize…

Randomized controlled trials are a special case of designs using an unbiased instrument to take care of confounders even if they are unmeasured or unknown. Another example of studies using instrumental variables is the Mendelian experiment and Directed Acyclic Graphs show the power of such designs to enhance the internal validity. It is argued…

In "Funes the Memorius," Jorge Luis Borges tells the tale of an Argentinian man who falls off a horse, becomes paralyzed, and acquires the strange gift of infinite memory (Borges, 1993). Funes remembers everything, which is to say he forgets nothing. The author will use Borges's story as the backdrop for his response to Professor…

This editorial introduces a special section of the "Journal of Learning Analytics," for which Neil Selwyn's keynote address to LAK '18 has been written up as an article, "What's the problem with learning analytics?" His claims and arguments are engaged in commentaries from Alfred Essa, Rebecca Ferguson, Paul Prinsloo, and…

The development of a student's ability to make data-driven decisions has become a focus in higher education (Schield 1999; Stephenson and Caravello 2007). Data literacy, the ability to understand and use data to effectively inform decisions, is a fundamental component of information competence (Mandinach and Gummer 2013; Stephenson and Caravello,…

In this policy forum commentary, we call for improved national and state-level data collection and access relevant to the principal pipeline. We focus specifically on how access to quality data can inform, has informed, and is critical to policy and practice across three segments of the principal pipeline--principal preparation, licensure, and…

This commentary elaborates on the role of "grounding" as a focal theoretical concept and aims to contextualize the claims formulated by Schneider and Pea (2015, this issue) in previous CSCL discussions. It provides fingerposts for enriching and refining the concept of grounding from a pedagogical point of view. It also suggests using the…

Without peer reviewers, the entire scholarly publishing system as we currently know it would collapse. However, as it currently stands, publishing is an extremely exploitative system, relative to other business models, in which trained and specialized labor is exploited, in the form of editors and peer reviewers, primarily by for-profit…

The importance of data analysis software in graduate programs in education and post-graduate educational research is self-evident. However the role of this software in facilitating supererogated statistical practice versus "cookbookery" is unclear. The need to rigorously document the role of data analysis software in students' graduate…

Learning analytics is a relatively new field of inquiry and its precise meaning is both contested and fluid (Johnson, Smith, Willis, Levine & Haywood, 2011; LAK, n.d.). Ferguson (2012) suggests that the best working definition is that offered by the first Learning Analytics and Knowledge (LAK) conference: "the measurement, collection,…