Introduction: Interrupted Time Series (ITS) studies may be used to assess the impact of an interruption, such as an intervention or exposure. The data from such studies are particularly amenable to visual display and, when clearly depicted, can readily show the short- and long-term impact of an interruption. Further, well-constructed graphs allow…

Missing data result in less precise and possibly biased effect estimates in single studies. Bias arising from studies with incomplete outcome data is naturally propagated in a meta-analysis. Conventional analysis using only individuals with available data is adequate when the meta-analyst can be confident that the data are missing at random (MAR)…

Descriptive analyses of socially important or theoretically interesting phenomena and trends are a vital component of research in the behavioral, social, economic, and health sciences. Such analyses yield reliable results when using representative individual participant data (IPD) from studies with complex survey designs, including educational…

Launching biomedical innovations based on clinical demands instead of translating basic research findings to practice reduces the risk that the results will not fit the clinical routine. To realize this type of innovation, a meta-analysis of the body of research is necessary to reveal demand-matching concepts. However, both the data deluge and the…

There are both quantitative and methodological techniques that foster the development and maintenance of a cumulative knowledge base within the psychological sciences. Most noteworthy of these techniques is meta-analysis, which allows for the synthesis of summary statistics drawn from multiple studies when the original data are not available.…

The authors have over the years tried to revise meta-analysis because it's basic premise is to add apples and oranges together and analyze. In other words, various data on the same subject are chosen using different samples, research strategies, and number properties. The findings are then homogenized and a statistical analysis is used (Snell, J.…

There is general agreement that meta-analysis is an important tool for synthesizing study results in quantitative educational research. Yet, a shared feature of many meta-analyses is a failure to report sufficient information for readers to fully judge the reported findings, such as the populations to which generalizations are to be made,…

Four types of analysis are commonly applied to data from structured Rater [times] Ratee designs. These types are characterized by the unit of analysis, which is either raters or ratees, and by the design used, which is either between-units or within-unit design. The 4 types of analysis are quite different, and therefore they give rise to effect…

Over the years, methodologists have been recommending that researchers use magnitude of effect estimates in result interpretation to highlight the distinction between statistical and practical significance (cf. R. Kirk, 1996). A magnitude of effect statistic (i.e., effect size) tells to what degree the dependent variable can be controlled,…

Researchers consistently fail to report reliability estimates for data used in their studies. This lack of reporting hinders appropriate evaluation and interpretation of data and may lead to inappropriate conclusions. Because reliability is inured to scores obtained from a test, and not the test itself, it is important to report score reliability…

This paper presents a meta-analysis of theory and research about writing and writing pedagogy, identifying six discourses--configurations of beliefs and practices in relation to the teaching of writing. It introduces and explains a framework for the analysis of educational data about writing pedagogy in which the connections are drawn across views…

Guidelines are offered that make it more likely that high-quality information will be extracted and coded from primary research reports in meta-analyses. It is also noted that the methodology of meta-analysis results in pressure to change the type of information that appears in primary research reports. (SLD)

This report summarizes the findings of an analysis of a series of action research projects conducted by Goshen Community Schools at the elementary, middle, and high school levels. During the 2008-2009 school year, 40 teachers participated in independent action research studies regarding the extent to which a six step approach to direct vocabulary…

Ten years of instrument development are summarized and placed within a framework for assessing the impact of technology in education. Seven well-validated instruments spanning the areas of attitudes, beliefs, skills, competencies, and technology integration proficiencies are presented, along with data analysis examples. These instruments are…

This review paper identifies and captures the major themes from the ACER 2005 Research Conference, distilling ideas and information from the conference papers and also from conversations that took place during the conference. The paper also looks at what are claimed to be effective ways of using data to improve student learning in schools. How…