Conceptual replications have received increased coverage in the educational research agenda. This article argues for clarity in, and justification of, the definition, scope, and boundaries of a conceptual replication and what it can and cannot do. It argues for clear justifications when changing components from those of the original study. The…

Virtual learning environments (VLEs) are increasingly used at-scale in educational contexts to facilitate teaching and promote learning, and the data they produce can be used for educational research purposes. Meanwhile, the U.S. Department of Education's Office of Educational Technology has repeatedly emphasized the importance of using evidence…

Virtual learning environments (VLE) are increasingly used at-scale in educational contexts to facilitate teaching and promote learning, and the data they produce can be used for educational research purposes. Meanwhile, the U.S. Department of Education's Office of Educational Technology has repeatedly emphasized the importance of using evidence to…

Background: For decades, education researchers have relied on the work of Campbell, Cook, and Shadish to help guide their thinking about valid impact estimates in the social sciences (Campbell & Stanley, 1963; Shadish et al., 2002). The foundation of this work is the "validity typology" and its associated "threats to…

This dissertation is composed of projects on three aspects of gathering and learning from data in the social sciences: drawing representative samples, taking valid measurement, and making warranted inductive inferences. Chapter one studies the challenge of drawing representative human samples. It is well documented that most samples used by…

Generative artificial intelligence (GenAI) has profoundly reshaped how graduate students conceptualise, design and conduct academic research in higher education. While current metrics predominantly focus on technology acceptance and usage patterns, they often neglect the diverse cognitive engagements in graduate students' integration of GenAI…

Researchers, theorists, and practitioners have expressed a renewed interest in the longitudinal dynamics of personality characteristics in adulthood, including organic life span trajectories and their amenability to volitional change. However, this research has apparently not yet expanded to include the Dark Triad (psychopathy, narcissism,…

Background: Schools are increasingly measuring school climate and social emotional learning, yet few measures conduct invariance testing by race, gender, or language despite known differences in perceptions of these constructs based on these identities. Objective: This study reports on the validation process of a school climate and social…

The need to find ways of ameliorating a number of what seemed to be gross abuses of 'science', logic, and authority in relation to educational policy emerged as a priority whilst revisiting writings on early childhood and elementary education. In the current paper, it is argued that many of these abuses stem from the uncritical acceptance of…

The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and…

The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and…

American Educational Research Association (AERA) standards stipulate that researchers show evidence of the internal structure of instruments. Confirmatory factor analysis (CFA) is one structural equation modeling procedure designed to assess construct validity of assessments that has broad applicability for counselors interested in instrument…

Context is an important aspect of educational research and the technological pedagogical content knowledge (TPACK) framework, but is often missing from TPACK research, or its specific meaning is not clear. To provide a systematic and comprehensive view of the extent to which context is included in such research, and to understand the meaning of…

The authors of this article use data produced in a collaborative community arts group in BC Canada as a way to think about validation in arts-based educational research (ABER). As Lather attempted to find middle ground between "rampant subjectivity" and "pointless precision" in research, she (1986) suggested that studies with…

In 2011, the International Association for K-12 Online Learning released the second iteration of the "National Standards for Quality Online Courses." These standards have been used by numerous institutions and states around the country to help design and create K-12 online courses. However, there has been no reported research on the…