By design, randomized experiments (XPs) rule out bias from confounded selection of participants into conditions. Quasi-experiments (QEs) are often considered second-best because they do not share this benefit. However, when results from XPs are used to generalize causal impacts, the benefit from unconfounded selection into conditions may be offset…

An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two…

Although statistical significance testing as the sole basis for result interpretation is a flawed practice, significance tests can be useful as one of three criteria that must be demonstrated to establish a position empirically. Statistical significance testing provides evidence that an event did not happen by chance but gives no evidence of the…

Outlines concerns that must be addressed by those who advocate replacing statistical hypothesis-testing with alternative data-analysis strategies. Suggests that commonly recommended alternatives are not perfect and that various hypothesis-testing modifications can be implemented to make the process and its conclusions more credible. Hypothesis…

Offers a framework for remedying some of the problems associated with the use of statistical significance tests through modifying journal editorial policies. Reviews examples from some journals that have established guidelines for reporting results of statistical significance tests. (SLD)

The National Assessment Governing Board and the National Center for Education Statistics sponsored a Joint Conference on Standard Setting for Large-Scale Assessments to provide a forum for technical and policy issues relevant to setting standards at local, state, and national levels. This executive summary conveys the essence of the conference by…

Microcomputer versions of three commonly used cognitive style measurement instruments are described and demonstrated: the Leveling-Sharpening House Test (LSHT) (Santostefano, 1964); Lowenfeld's Successive Impressions Test I (SIT-I) (1945); and the Group Embedded Figures Test (GEFT) (Witkin, Oltman, Ruskin, and Karp, 1971). At present, many…

With the many layoffs and downsizing of companies during the 1990s, many displaced workers have turned to temporary employment to earn a living while looking for permanent employment. Others have adopted "temping" as a more long-term work style. Although it may not be possible to predict whether an individual will find satisfaction or…

Researchers investigated the effects of frequent classroom testing on students, examining studies on adjunct questions and on mastery testing. Meta-analysis of 40 studies indicated students who took at least 1 test over 15 weeks scored one-half of a standard deviation higher on criterion examinations than did students who took no tests. (SM)

Illustrates how teacher action research can be the ammunition for teacher advocacy and the cornerstone of empowerment through the example of the New York City Accountability Project. The goal of the project is to support teachers' efforts to introduce better assessment strategies that support instruction. (SLD)

Some of the major research in the area of assessment, concentrating on distance learning, is reviewed, and a strategy that can be used as a guideline for assessment of distance learning, and particularly World Wide Web-based courses, is introduced. A review of assessment strategies confirms that a balance between knowledge acquisition and…

This guide to the National Assessment of Educational Progress (NAEP) describes its purpose, contents, uses, and research methodology by presenting 21 questions about the NAEP program. The NAEP is mandated by Congress to survey the educational accomplishments of U.S. students and to monitor changes in these accomplishments. It tracks the…