Psychometrics has recently undergone extensive criticism within the medical education literature. The use of quantitative measurement using psychometric instruments such as response scales is thought to emphasize a narrow range of relevant learner skills and competencies. Recent reviews and commentaries suggest that a paradigm shift might be…

The purpose of this review is to provide an overview of the evolution of social presence research in the field of distance education and identified problems in investigating this construct. The researchers took an integrative review on existing social presence studies to answer three questions: (a) How definitions of social presence evolved since…

Recent meta-analyses of drug-court studies recognized the poor methodological quality of the evaluations, with only a few being randomized. This article critiques the design of the randomized studies from a statistical perspective. Learning points are identified for future drug-court studies and are applicable to evaluations both of other…

Recommends that when repeated-measures Latin-square designs are used to counterbalance treatments across a procedural variable or to reduce the number of treatment combinations given to each participant, effects be analyzed statistically, and that in all uses, researchers consider alternative interpretations of the variance associated with the…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

Develops random-effects probit model for case in which outcome of interest is series of correlated binary responses, obtained as product of longitudinal response process where individual is repeatedly classified on binary outcome variable or in multilevel or clustered problems in which individuals within groups are considered to share…

Discusses quantitative and qualitative approaches in research on peer effects on student attainment, using two texts to argue that the definition of "effect" cannot be restricted to "statistical effect," and that institutional properties are not the sum of individual properties. Asserts that quantitative investigators have…

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

This paper acknowledges that research on school dropouts presents problems in the definitions and computation of dropout indices. It considers a variety of methods for computing dropout rates, using dropout rates which are real and which were available at the end of the 1986-1987 school year. Fall enrollment, average daily membership, and total…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

The study under review is the second-year evaluation report of the Milwaukee Parental Choice Program (MPCP), a publicly funded voucher program that allows low-income students in Milwaukee to attend secular and religious private schools in that city. Its primary finding is that there were no overall statistically significant differences in…

In 1990, Milwaukee (Wisconsin) became the site of the first publicly funded school-choice program providing low-income parents with vouchers that could be used to send their children to secular, private schools. An evaluation of Milwaukee's school-choice experiment was conducted by a team of researchers, headed by John Witte at the University of…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…