Elliot et al. (2010) reported multiple experimental findings that the color red modified women's ratings of attractiveness, sexual desirability, and status of a photographed man. An analysis of the reported statistics of these studies indicates that the experiments lack sufficient power to support these claims. Given the power of the experiments,…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

Debate is occurring about which result interpretation aides focused on examining the experimental effect should be used in single-subject experimental research. In this study, we examined seven nonoverlap methods and compared results using each method to judgments of two visual analysts. The data sources for the present study were 36 studies…

Methodological problems of experimental control, statistical analysis, and appropriateness of experimental design are discussed. Related article is EA 500 731. (KJ)

This guide presents many new experimental designs for data analysis and reviews certain standard procedures. It is hoped that the treatment of the material will stimulate new applications since the emphasis of the guide is on the problems encountered in running experiments rather than on an elaboration of mathematical models. Discussed are:…

Some methodological issues in the study of levels of knowledge are reviewed, and needs for further research are explored, drawing on an analysis of 12 studies reported since the late 1970s. In the 12 studies, 16 quantitative experiments were conducted. These were assessed for internal and external validity. Analysis revealed some shortcomings in…

An integrating framework to explain the research process was presented in the first edition of this book. This edition, which brings the material up to date, is designed to serve the Master s level student better while still meeting the needs of doctoral students of educational research. The nature of research, methods for qualitative and…

This overview of the research process for the novice information retrieval (IR) researcher provides guidance on selecting a research question, choosing the type of test, defining variables, developing or using databases, finding and processing queries, assigning treatments to experimental units, collecting and analyzing the data, and presenting…