Research on spatial navigation is essential to understanding how mobile species adapt to their environments. Such research increasingly uses virtual environments (VEs) because, although VE has drawbacks, it allows for standardization of procedures, precision in measuring behaviors, ease in introducing variation, and cross-investigator…

By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

Students often believe that statistical significance is the only determinant of whether a quantitative result is "important." In this paper, I review traditional null hypothesis statistical testing to identify what questions inferential statistics can and cannot answer, including statistical significance, effect size and direction,…

This article develops a set-theoretic approach to Bayes's theorem and Bayesian process tracing. In the approach, hypothesis testing is the procedure whereby one updates beliefs by narrowing the range of states of the world that are regarded as possible, thus diminishing the domain in which the actual world can reside. By explicitly connecting…

This paper explores how to apply the principles of accommodations and universal design (UD) in research methods involved in quantitative research (e.g. questionnaires). In particular, we focus on how to make research more accessible for individuals with Learning Disabilities (LD), while also providing suggestions for potential participants of…

Daniel Koretz is the Henry Lee Shattuck Professor of Education at the Harvard Graduate School of Education. His research focuses on educational assessment and policy, particularly the effects of high-stakes testing on educational practice and the validity of score gains. He is the author of "Measuring Up: What Educational Testing Really Tells…

Reproducibility crises have arisen in psychology and other behavioral sciences, spurring efforts to ensure research findings are credible and replicable. Although reforms are occurring at professional levels in terms of new publication parameters and open science initiatives, the credibility and reproducibility of undergraduate research deserves…

Integral to most undergraduate psychology degree programs are research methods courses. Students learn about theory, study design and hypothesis testing, and gain knowledge that is assessed by laboratory reports. We describe a problem-based learning approach with an emphasis on acquisition of study design skills. Working in small groups, students…

For decades, instructional communication scholars have relied predominantly on cross-sectional survey methods to generate empirical associations between effective teaching and student learning. These studies typically correlate students' perceptions of their instructor's teaching behaviors with subjective self-report assessments of their own…

To begin statistical analysis, Bayesians quantify their confidence in modeling hypotheses with priors. A prior describes the probability of a certain modeling hypothesis apart from the data. Bayesians should be able to defend their choice of prior to a skeptical audience. Collaboration between evaluators and stakeholders could make their choices…

Most research in psycholinguistics relies on online measures such as reading time to inform and test theories of language comprehension. However, the value of offline measures such as question-answering performance is sometimes overlooked in sentence processing work. Consequently, psycholinguists do not yet understand how the tasks and measures…

A bottleneck in gathering big data about learning is instrumentation designed to record data about processes students use to learn and information on which those processes operate. The software system nStudy fills this gap. nStudy is an extension to the Chrome web browser plus a server side database for logged trace data plus peripheral modules…

Areal data have been used to good effect in a wide range of sociological research. One of the most persistent problems associated with this type of data, however, is the need to combine data sets with incongruous boundaries. To help address this problem, we introduce a new method for identifying common geographies. We show that identifying common…

Current practices in study design and data analysis have led to low reproducibility and replicability of findings in fields such as psychology, medicine, biology, and economics. Because gifted education research relies on the same underlying statistical and sociological paradigms, it is likely that it too suffers from these problems. This article…

Single case studies can provide vital contributions to theory-testing in social science studies. Particularly, by applying the process-tracing method, case studies can test theoretical frameworks through a rigorous research design that ensures substantial empirical leverage. While most scholarly contributions on process-tracing focus on either…