This study adapted an effect size measure used for studying differential item functioning (DIF) in unidimensional tests and extended the measure to multidimensional tests. Two effect size measures were considered in a multidimensional item response theory model: signed weighted P-difference and unsigned weighted P-difference. The performance of…

We estimate school-choice preferences revealed by the rank-ordered lists submitted by more than 22,000 applicants to a citywide lottery for more than 200 traditional and charter public schools in Washington, DC. The results confirm previously reported findings that commuting distance, school demographics, and academic indicators play important…

The primary purpose of this quantitative study was to examine if simulation training correlated with the decision-making abilities of firefighters from two departments (one in a mountain state and one in a southwest state). The other purposes were to determine if firefighter demographics were correlated with the completion of the simulation…

To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

High-fidelity simulation (HFS) use in nursing education has been a frequent research topic in recent years. Previous research included studies on the use of HFS with nursing students, focusing on their feelings of self-confidence and anxiety. However, research focused specifically on the debriefing portion of HFS was limited. This quantitative,…

We surveyed researchers in the health and exercise sciences to explore different areas and magnitudes of bias in researchers' decision making. Participants were presented with scenarios (testing a central hypothesis with p = 0.06 or p = 0.04) in a random order and surveyed about what they would do in each scenario. Participants showed significant…

This study is an evaluation of the behavior of the Liu-Agresti estimator of the cumulative common odds ratio when identifying differential item functioning (DIF) with polytomously scored test items using small samples. The Liu-Agresti estimator has been proposed by Penfield and Algina as a promising approach for the study of polytomous DIF but no…

Researchers conducting studies involving individuals with exceptionalities are often prevented from involving large numbers of participants in their study samples. When this is the case, some say significant correlations are likely to replicate because the relation between two variables must be robust enough to be detected even with low…

Debriefing has been identified as an essential element of experiential learning in high-fidelity human patient simulation (HPS); however, identification of best practices in conducting debriefing sessions is lacking in the literature (Dreifuerst, 2009, 2012; Issenberg & Scalese, 2008; Jeffries, 2005). Nonetheless, it has been proposed that…

This study examined the relationship between human patient simulation (HPS), critical thinking skills, and knowledge acquisition after HPS was integrated across the curriculum of an associate degree nursing program to determine if differences existed in critical thinking and knowledge of students based on the fidelity of HPS used and amount of…

This article familiarizes readers with how to analyze personnel selection decisions in employment discrimination litigation. First, the authors outline some of the basic legal principles that serve as the basis for analyses related to claims of discriminatory employment practices. Second, they describe how to conduct a scientific investigation of…

A common mistake in analysis of cluster randomized trials is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects. This…

The procedures yielding confidence intervals for maximized alpha coefficients of Joe and Woodward are reviewed. Confidence interval procedures of Whalen and Masson are next reviewed. Results are then presented of a Monte Carlo investigation of the procedures. (Author/CTM)

The negative bias of biserial correlations in the presence of guessing is demonstrated by Monte Carlo studies, and another estimator is described that is free of such bias. The usual biserial-correlation assumptions and assumptions about guessing are discussed. Brogden's coefficient of selective efficiency and the triserial correlation are…

Whether one should use null hypothesis testing, confidence intervals, and/or effect sizes is a source of continuing controversy in educational research. An alternative to testing for statistical significance, known as equivalence testing, is little used in educational research. Equivalence testing is useful in situations where the researcher…