As the international large-scale assessments (ILSAs) become more popular, policy makers and education practitioners are interested in collecting as much student background information as possible to better understand the learning context of their students. To collect such abundant information, administrators need to develop a lot of questions.…

In educational sciences, 90s were the scene of the paradigmatic wars, as the researchers of quantitative or qualitative research only defended the ideas of the type of research they used and they constantly criticized the counter-paradigm. While this struggle is going on, mixed method research has emerged, a pragmatist approach that believes both…

Many ethical concerns in online big data research stem from a pervasive assumption that data are disembodied and place-less. While some scholars have begun addressing the ethical dilemmas of big data, few offer approaches or tools that fully grapple with the situatedness of online data and its ethical implications. We draw on feminist new…

This paper presents a model for developing research questions that are aligned to research aims for research design in e-learning. The model is proposed as a solution to the on-going problem of heterogeneity of research problems. The model is based on Burrell and Morgan's four social paradigms, and integrates four research aims, namely, explore,…

Academic advising is one of the key practices in U.S. higher education institutions for supporting students' success. However, the complexity of academic advising program structures, the difficulties in identifying appropriate outcome measures, and the lack of inclusion of multiple stakeholders' perspectives continue to challenge scholars to…

Background: The COVID-19 pandemic and the subsequent public health response led to an unprecedented disruption in educational instruction in the U.S. and around the world. Many schools quickly moved to virtual learning for the bulk of the 2020 spring term and many states cancelled annual assessments of student learning. The 2020-21 school year…

This article describes a nexus analysis of the lengthy, complex process of negotiating access to schools for a research project surveying 1,002 children (aged 9-12 years) about their digital and language practices. The analysis distinguished layers of adult-centered gatekeeping, each of which needed to be tackled in sequence. Bottlenecks…

As a research field geared toward understanding and improving learning, Learning Analytics (LA) must be able to provide empirical support for causal claims. However, as a highly applied field, tightly controlled randomized experiments are not always feasible nor desirable. Instead, researchers often rely on observational data, based on which they…

Contrary to its typical presentation in scientific publications as a certain and linear process, in reality, the experimental method, not least the design aspect of it, requires a great deal of trial-and-error and ad hoc decision-making on the part of the researchers. This uncertain and contingent aspect of research, although little known outside…

Factorial surveys use a population of vignettes to elicit respondents' attitudes or beliefs about different hypothetical scenarios. However, the vignette population is frequently too large to be assessed by each respondent. Experimental designs such as randomized block confounded factorial (RBCF) designs, D-optimal designs, or random sampling…

Planned missing data designs allow researchers to have highly-powered studies by testing only a fraction of the traditional sample size. In two-method measurement planned missingness designs, researchers assess only part of the sample on a high-quality expensive measure, while the entire sample is given a more inexpensive, but biased measure. The…

This paper contrasts mixed methods design with strategic research design. Mixed methods research both advocates for itself as always better than singular research methods, while also seemingly allowing a wide variety of researchers to count their work under the very large umbrella of mixed methods. We argue for strategic research design as a set…

We explored the possibility of publication bias in the sleep and explicit motor sequence learning literature by applying precision effect test (PET) and precision effect test with standard errors (PEESE) weighted regression analyses to the 88 effect sizes from a recent comprehensive literature review (Pan & Rickard, 2015). Basic PET analysis…

Collecting data for cross-cultural research is time consuming and expensive. We report on techniques for efficient and effective cross-cultural data collection, drawn from 18 cross-cultural studies we conducted in 22 countries. We discuss research design, site selection and collaboration building, ethical review, cross-site protocol design, data…

The aim of this paper is to introduce a software that is appropriate for the generalizability theory for not only balanced but also unbalanced data sets. Because it is possible to have unbalanced data sets while conducting a study, the researchers have devised an easy solution, other than deleting data, to balance the design to cope with this…