An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

Reviews the role of statistical hypothesis testing in research, discusses the problems with multiple t tests, indicates when they are a problem, and suggests a compromise solution. (one reference) (JL)

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

Discusses a serious problem that has existed for years in language research with regard to the use of the inferential statistic known as the t test. (12 references) (JL)

Statistical significance tests (SSTs) have been the object of much controversy among social scientists. Proponents have hailed SSTs as an objective means for minimizing the likelihood that chance factors have contributed to research results. Critics have both questioned the logic underlying SSTs and bemoaned the widespread misapplication and…

A study of school district uses of evaluation and test data is used to illustrate the variety of ambiguities that can appear in qualitative data. Rules of evidence to distinguish valid and potentially nonvalid testimony are proposed. Uses of testimony in evaluation are discussed. (BS)

Methodological considerations in conducting research on the Minnesota Multiphasic Personality Inventory-2 (MMPI-2), the most widely used clinical personality instrument, are reviewed, with reference to the original MMPI and the version for adolescents (MMPI-A). Potential pitfalls in personality testing and personality assessment research are…

Noting that the attention of the speech communication discipline to listening skills does not mirror the apparent importance of such skills, this paper examines five listening assessment tests--focusing on the strengths, weaknesses, procedural problems, and conceptualizations of each--that potential users should be aware of before selecting any…

Reviews relationship of IQ scores to race and gender. Explores the logic that supports the use of intelligence testing to discriminate and to exclude. Argues that default assumptions allow researchers to remain unaware of the subtle adverse impact of their research. Includes recommendations to encourage a broader understanding of intelligence.…

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

A project conducted in Tennessee from 1984 through 1989, Student Teacher Achievement Ratio (Project STAR), serves as a context for a discussion of educational research. The decisions required in major research projects and the problems in carrying out research are seldom discussed in conferences that present research results as completed efforts.…

A quality control review of Connecticut's Sustained Effects studies was undertaken by the Chapter 1 Evaluation Technical Assistance Center (TAC) operated by RMC Research Corporation. Nineteen Connecticut school districts had selected from among four basic evaluation designs in implementing the Chapter 1 Sustained Effects requirement during 1982 to…

The question of how standardized tests can be better developed to improve educational program evaluation is probed in this paper. After the first section's brief introduction, section 2 explores the thesis that tests developed in terms of selection and inference may not serve current social functions of educational testing. To clarify this thesis,…

Dissertations are an important component of the effort to generate knowledge. Thus, dissertation quality may be seen by accreditation and coordinating-board reviewers as a noteworthy reflection on the quality of doctoral programs themselves. The present study reviews methodological errors within Ph.D. dissertations. The illustrative errors are…