Comparison studies conducted to determine which instructional interventions are most efficient for teaching discrete behaviors to individuals with disabilities are potentially valuable, although some threats to internal validity may be more likely in these studies. Studies included in this review typically met common internal validity standards,…

Numerous ways to meta-analyze single-case data have been proposed in the literature, however, consensus on the most appropriate method has not been reached. One method that has been proposed involves multilevel modeling. This study used Monte Carlo methods to examine the appropriateness of Van den Noortgate and Onghena's (2008) raw data multilevel…

Instrumental variable estimators hold the promise of enabling researchers to estimate the effects of educational treatments that are not (or cannot be) randomly assigned but that may be affected by randomly assigned interventions. Examples of the use of instrumental variables in such cases are increasingly common in educational and social science…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

Statistical reform in school psychology research is discussed in terms of research designs, measurement issues, statistical modeling and analysis procedures, interpretation and reporting of statistical results, and finally statistics education.

A process for judging the alignment between curriculum standards and assessments developed by the author is presented. This process produces information on the relationship of standards and assessments on four alignment criteria: Categorical Concurrence, Depth of Knowledge Consistency, Range of Knowledge Correspondence, and Balance of…

This study examined the impact of rater agreement on decisions concerning the alignment between the "Golden State Examination in High School Mathematics" (California Department of Education, 2001a) and the University of California (UC) "Statement on Competencies in Mathematics Expected of Entering College Students" (Academic…

Addresses generalizability theory (GT), which offers a flexible framework for assessing dependability of measurement. GT allows for consideration of multiple sources of error, allowing investigators to assess the overall impact of measurement error. Illustrative analyses demonstrate the special advantages of GT for planning studies in which…

This document answers the question, "What has been learned about evaluation methodology from the decade of compensatory education"? Ten issues dealing with the evaluation of Title I were identified within a general theoretical framework of evaluation. For each issue it was the aim of this document to do the following: 1)to clarify the…

There is a need for clarity regarding different research strategies in order to assess the relative contribution of each. Using the framework of the Facet Design Technique (FDT) for problem structuring, eight general research strategies are identified as they relate to measurement fidelity, representativeness of units, and treatment…

Self-help groups provide help and support for members in dealing with their problems and improving their psychological function and effectiveness. This paper focuses on the multitude of technical issues surrounding the evaluation of the effectiveness or outcome of self-help groups, especially what, when, and whom to measure. (Author/JEL)

This article is the first of a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information decision makers can use with confidence to identify current practices that merit continuation and to create or…

Social studies research has told us very little in the past 30 years. There are several reasons for this state of affairs in social studies. First, inferential statistics has become much too prominent in research thinking and practice. Replication should be used by researchers to build a useful body of knowledge. A second reason for lack of…

This article focuses on the research and scholarship dealing with the assessment of the experiential approach in both its computer-based and human-based forms. It covers two forms of assessment. First it covers explicit attempts to assess the validity of experiential learning, and second it focuses on measuring the effectiveness of the…