Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

While many instructors are aware of the "Literary Digest" 1936 poll as an example of biased sampling methods, this article details potential further explorations for the "Digest's" 1924-1936 quadrennial U.S. presidential election polls. Potential activities range from lessons in data acquisition, cleaning, and validation, to…

This study focuses on Grounded Theory, which is one of the qualitative research designs. Glaser and Strauss developed the Grounded Theory; it has been revised by other scientists, resulting in three distinct Grounded Theory approaches: the systematic design (Corbin and Strauss approach), the classical design (Glaser approach), and the…

Background: Gaining insight into sleep-wake patterns of persons with intellectual disabilities is commonly done using wrist actigraphy. For some people, contactless alternatives are needed. This study compares a contactless bed sensor with wrist actigraphy to monitor sleep-wake patterns of people with moderate to profound intellectual…

The designs of many student-facing learning analytics (SFLA) dashboards are insufficiently informed by educational research and lack rigorous evaluation in authentic learning contexts, including during remote laboratory practical work. In this article, we present and evaluate an SFLA dashboard designed using the principles of formative assessment…

I propose two practical advances to the argument-based approach to validity: developing a living document and incorporating preregistration. First, I present a potential structure for the living document that includes an up-to-date summary of the validity argument. As the validation process may span across multiple studies, the living document…

To ensure validity in survey research, it is imperative that we properly educate doctoral students on best practices in data quality procedures. A 14-year analysis of 679 studies in the AIS "Basket of 8" journals noted undercommunication in the most pertinent procedures, consistent across journals and time. Given recent calls for…

A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is…

Focusing on systematic observation, one of the most potent methods of studying teaching quality, represents one of the numerous contributions of Daryl Siedentop to the profession. While he had a clear focus on issues of validity and reliability concerning systematic observation, over the past decades, attention to such issues appears to have…

Online surveys are an efficient and relatively affordable way to collect data. However, there are issues associated with it, including potential fraudulent data due to accidental or deliberate duplicate entries. In this brief we describe a case study of deliberate duplicate entries in an ongoing study of community college students. Students from…

Critical thinking (CT) consists of a deliberate and reflective process that can lead to informed decisions. It involves scrutinizing the trustworthiness and consistency of underlying assumptions, the sources of data, and the validity of other information. CT embodies deliberate, self-regulated judgment incorporating cognitive abilities such as…

It is seen that the number of studies dealing with the values in children's literary products has been increased. Although there are many reviews on the studies concerning with value education, these reviews do not provide some significant details about these studies. This study has provided a content analysis of the studies on the values in…

Background: Traditional survey efforts to gather outcome data at scale have significant limitations, including cost, time, and respondent burden. This pilot study explored new and innovative large-scale methods of collecting and validating data from publicly available sources. Taking advantage of emerging data science techniques, we leverage…

The purpose of this study is to examine the abstracts in 6th International Preschool Education Congress abstract book in terms of research subject, method, model, sample type, data collection tools, data analysis techniques, validity and reliability. This study is a qualitative study and was conducted using document analysis, which is one of the…

Validity refers to the extent to which a given study reflects the dominant values of a research community regarding what constitutes "good" research. Methodological texts on qualitative research provide a wide range of criteria and strategies to help qualitative researchers validate their studies. Given the importance of these strategies…