The mixed treatment comparison (MTC) method has been proposed to combine results across trials comparing several treatments. MTC allows coherent judgments on which of the treatments is the most effective. It produces estimates of the relative effects of each treatment compared with every other treatment by pooling direct and indirect evidence. In…

This dissertation consists of three manuscripts. The manuscripts contribute to a budding "methodological reform" currently taking place in quantitative second-language (L2) research. In the first manuscript, the researcher describes an empirical investigation on the application of two well-known effect size estimators, eta-squared (eta…

The 1961 Copyright Office study on renewals, authored by Barbara Ringer, has cast an outsized influence on discussions of the U.S. 1923-1963 public domain. As more concrete data emerge from initiatives such as the large-scale determination process in the Copyright Review Management System (CRMS) project, questions are raised about the reliability…

Bayesian statistical approaches to mixed treatment comparisons (MTCs) are becoming more popular because of their flexibility and interpretability. Many randomized clinical trials report multiple outcomes with possible inherent correlations. Moreover, MTC data are typically sparse (although richer than standard meta-analysis, comparing only two…

Applied researchers often find themselves making statistical inferences in settings that would seem to require multiple comparisons adjustments. We challenge the Type I error paradigm that underlies these corrections. Moreover we posit that the problem of multiple comparisons can disappear entirely when viewed from a hierarchical Bayesian…

This study replicates and extends a 2004 content analysis of three major higher education journals. The original study examined the methodological characteristics of all published research in these journals from 1996 to 2000, recommending that higher education programs adjust their graduate training to better match the heavily quantitative and…

Since its release in 1976, LOGIST has been the most widely used computer program for estimating the parameters of the three-parameter logistic item response model developed by A. Birnbaum. An alternative program, BILOG, developed by R. J. Mislevy and R. D. Bock (1983), has recently become available. This paper compares the approaches taken by the…

This document contains summaries of six courses presented at the Second Annual Presessions of the American Educational Research Association: (1) Bayesian statistical analysis, (2) curriculum research and evaluation, (3) design and analysis of comparative experiments in education, (4) educational research management procedures, (5) multivariate…

Several regression methods were examined within the framework of weighted structural regression (WSR), comparing their regression weight stability and score estimation accuracy in the presence of outlier contamination. The methods compared are: (1) ordinary least squares; (2) WSR ridge regression; (3) minimum risk regression; (4) minimum risk 2;…

Three and one-half years of research on computerized ability testing are summarized. The original objectives of the research were: (1) to develop and implement the stratified computer-based ability test; (2) to compare, on psychometric criteria, the various approaches to computer-based ability testing, including the stratified computerized test,…