Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…

Model-Implied Instrumental Variable Two-Stage Least Squares (MIIV-2SLS) is a limited information, equation-by-equation, noniterative estimator for latent variable models. Associated with this estimator are equation-specific tests of model misspecification. One issue with equation-specific tests is that they lack specificity, in that they indicate…

Randomized response techniques (RRTs) are useful survey tools for estimating the prevalence of sensitive issues, such as the prevalence of doping in elite sports. One type of RRT, the unrelated question model (UQM), has become widely used because of its psychological acceptability for study participants and its favorable statistical properties.…

Purpose: Course evaluations are formative and are used to evaluate learnings of the students for a course. Anomalies in the evaluation process can lead to a faulty educational outcome. Learning analytics and educational data mining provide a set of techniques that can be conveniently applied to extensive data collected as part of the evaluation…

Audit correspondence studies are field experiments that test for discriminatory behavior in active markets. Researchers measure discrimination by comparing how responsive individuals ("audited units") are to correspondences from different types of people. This article elaborates on the tradeoffs researchers face between sending audited…

This study examined caregivers' longitudinal reports of adolescent multiracial categorization across the ages of 9.5, 10.5, and 14 years, and adolescents' reports of their own multiracial categorization at the age of 14 years. A portion of caregivers' reports of adolescent multiracial status were inconsistent across the years of the study; some…

In order to assess the status of retraction notices for publications involving research misconduct, we collected and analyzed information from the Office of Research Integrity website. This site lists confirmed instances of misconduct in research supported by the National Institutes of Health. Over a 10-year period, 200 publications derived from…

In this paper, we investigate two purported problems with Bayesian Knowledge Tracing (BKT), a popular statistical model of student learning: "identifiability" and "semantic model degeneracy." In 2007, Beck and Chang stated that BKT is susceptible to an "identifiability problem"--various models with different…

In this paper, we investigate two purported problems with Bayesian Knowledge Tracing (BKT), a popular statistical model of student learning: "identifiability" and "semantic model degeneracy." In 2007, Beck and Chang stated that BKT is susceptible to an "identifiability problem"--various models with different…

Age-period-cohort (APC) models are designed to estimate the independent effects of age, time periods, and cohort membership. However, APC models suffer from an identification problem: There are no unique estimates of the independent effects that fit the data best because of the exact linear dependency among age, period, and cohort. Among methods…

Card and Giuliano's National Bureau of Economic Research (NBER) working paper on universal screening is discussed. This commentary provides a brief summary and critique of the article, proposes an explanation of the results in light of the author's research on the role of nominations or screening tests in the gifted identification process, and…

In this commentary of "Evaluating the Gifted Program of an Urban School District Using a Modified Regression Discontinuity Design" by Davis, Engberg, Epple, Sieg, and Zimmer, we examine the background of the study, critique the methods used, and discuss the results and implications. The study used a fuzzy regression discontinuity design…

For the 2014 study, "A Randomized Trial Examining the Effects of Aerobic Physical Activity on Attention-Deficit/Hyperactivity Disorder Symptoms in Young Children", researchers examined the effect of a daily before-school physical activity program on behavioral outcomes of students in grades K-2. The study sample included 202 students who…

The purpose of this study is to reveal the factors that affect the identification of research problems in educational administration studies. The study was designed using the case study method. Criterion sampling was used to determine the work group; the criterion used to select the participants was that of having a study in the field of…

When data are collected via anonymous Internet surveys, particularly under conditions of obligatory participation (such as with student samples), data quality can be a concern. However, little guidance exists in the published literature regarding techniques for detecting careless responses. Previously several potential approaches have been…