An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

The research literature provides important guidance to counselors working to keep abreast of the latest thinking regarding best practices and recently developed counseling tools. The purpose of this digest is to highlight a few errors that seem to recur within the literature, and to provide some helpful references that further explore these…

The development of procedures by which test publishers can screen individual purchasers to minimize the possibility of test misuse is described. The Test User Qualifications Working Group (TUQWoG), an outgrowth of the Joint Committee on Testing Practices, was formed to address the prevention of test misuse through improved methods of screening…

A study of school district uses of evaluation and test data is used to illustrate the variety of ambiguities that can appear in qualitative data. Rules of evidence to distinguish valid and potentially nonvalid testimony are proposed. Uses of testimony in evaluation are discussed. (BS)

It has been proposed that the federal government's General Aptitude Test Battery (GATB) might be used to provide private employers with the same kind of useful information the federal government and college counselors receive about job applicants. The U.S. Department of Labor asked the National Research Council (NRC) to review the issues related…

Methodological considerations in conducting research on the Minnesota Multiphasic Personality Inventory-2 (MMPI-2), the most widely used clinical personality instrument, are reviewed, with reference to the original MMPI and the version for adolescents (MMPI-A). Potential pitfalls in personality testing and personality assessment research are…

Based on a review of the literature, this paper examines criticisms leveled against the communication audit developed by the International Communication Association (ICA) and then offers a modified version of the audit designed to meet those criticisms. Following a brief introduction, the first section of the paper reviews criticisms of the audit,…

This collection is based on the fact that employment, housing, and consumer rights and opportunities are often inextricably linked and mutually dependent. The papers explore aspects of creating a national report card on discrimination, assessing the role that testing and other social science methodologies might play in its formulation. The papers…

Microcomputer versions of three commonly used cognitive style measurement instruments are described and demonstrated: the Leveling-Sharpening House Test (LSHT) (Santostefano, 1964); Lowenfeld's Successive Impressions Test I (SIT-I) (1945); and the Group Embedded Figures Test (GEFT) (Witkin, Oltman, Ruskin, and Karp, 1971). At present, many…

Too few researchers understand what statistical significance testing does and does not do, and consequently their results are misinterpreted. This Digest explains the concept of statistical significance testing and discusses the meaning of probabilities, the concept of statistical significance, arguments against significance testing,…

A project conducted in Tennessee from 1984 through 1989, Student Teacher Achievement Ratio (Project STAR), serves as a context for a discussion of educational research. The decisions required in major research projects and the problems in carrying out research are seldom discussed in conferences that present research results as completed efforts.…

Arguing that educational testing has not grown with the theory and knowledge base of the reading field, this paper cites the current configuration of testing as a major contributor to the instructional stagnation, methodological back-to-basics movement, and general lack of excitement and true innovation found in classrooms and schools today. The…

At one of a series of hearings on H.R. 6, the Elementary and Secondary Education Amendments of 1993, several experts discussed issues related to national assessment, assessment in Chapter 1, and state efforts to develop new forms of assessment. Eleanor Chelimsky, Assistant Comptroller General for Program Evaluation and Methodology of the General…

This research, conducted for California State Department of Education, is one component of a feasibility study focusing on ways to make the testing process more efficient by application of multi-purpose tests (MPT). MPT are designed, administered and scored to serve more than one purpose and to consolidate and unify testing programs as a partial…

Dissertations are an important component of the effort to generate knowledge. Thus, dissertation quality may be seen by accreditation and coordinating-board reviewers as a noteworthy reflection on the quality of doctoral programs themselves. The present study reviews methodological errors within Ph.D. dissertations. The illustrative errors are…