Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

While many instructors are aware of the "Literary Digest" 1936 poll as an example of biased sampling methods, this article details potential further explorations for the "Digest's" 1924-1936 quadrennial U.S. presidential election polls. Potential activities range from lessons in data acquisition, cleaning, and validation, to…

This study focuses on Grounded Theory, which is one of the qualitative research designs. Glaser and Strauss developed the Grounded Theory; it has been revised by other scientists, resulting in three distinct Grounded Theory approaches: the systematic design (Corbin and Strauss approach), the classical design (Glaser approach), and the…

Those asked to make valid decisions with data don't have the technical knowledge to understand nuance around data quality, assessment aims, and statistical limitations that influence how they should interpret the data. This reality is what Greg Thompson, Leslie Rutkowski, and David Rutkowski call the validity paradox. Educators can surmount this…

Background: Gaining insight into sleep-wake patterns of persons with intellectual disabilities is commonly done using wrist actigraphy. For some people, contactless alternatives are needed. This study compares a contactless bed sensor with wrist actigraphy to monitor sleep-wake patterns of people with moderate to profound intellectual…

The designs of many student-facing learning analytics (SFLA) dashboards are insufficiently informed by educational research and lack rigorous evaluation in authentic learning contexts, including during remote laboratory practical work. In this article, we present and evaluate an SFLA dashboard designed using the principles of formative assessment…

I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

Generative AI tools (GenAI) are increasingly used for academic tasks, including qualitative data analysis for the Scholarship of Teaching and Learning (SoTL). In our practice as academic developers, we are frequently asked for advice on whether this use for GenAI is reliable, valid, and ethical. Since this is a new field, we have not been able to…

To ensure validity in survey research, it is imperative that we properly educate doctoral students on best practices in data quality procedures. A 14-year analysis of 679 studies in the AIS "Basket of 8" journals noted undercommunication in the most pertinent procedures, consistent across journals and time. Given recent calls for…

This paper scrutinizes the increasing trend of using international large-scale assessment (ILSA) data for causal inferences in educational research, arguing that such inferences are often tenuous. We explore the complexities of causality within ILSAs, highlighting the methodological constraints that challenge the validity of causal claims derived…

A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is…

Moving Beyond the Ordinal Methodological Controversy: A Systematic Review (Manuscript 1): Ordinal outcome data is a common byproduct of education research. Yet more than seventy-five years after the development of Stevens' original measurement framework, the permissibility of select analytic techniques to ordinal outcome data remains a topic of…

Focusing on systematic observation, one of the most potent methods of studying teaching quality, represents one of the numerous contributions of Daryl Siedentop to the profession. While he had a clear focus on issues of validity and reliability concerning systematic observation, over the past decades, attention to such issues appears to have…

Most disability research is conducted in high-income countries, despite much of the world's population living in low- and middle-income countries. Given the flexible nature of qualitative research, studies using this methodology have the potential to provide important insights into how disability is perceived across the globe. The aim of the…

This work aims to elaborate a governance composite index for research laboratories in public university. This index is composed by an indicator of responsible liberalism associating effectiveness and ethics, to which are added an organizational management indicator and a strategic management indicator. To achieve the above aim, several methods are…