A new approach to researching school effects on higher education participation is proposed here, which combines insights from the school effectiveness field of research with sociological theories and concepts of schooling. In doing so, it draws attention to some of the problems with the dominant approach often taken in this area and attempts to…

The purpose of this review is to provide an overview of the evolution of social presence research in the field of distance education and identified problems in investigating this construct. The researchers took an integrative review on existing social presence studies to answer three questions: (a) How definitions of social presence evolved since…

Systematic review methodology can be distinguished from narrative reviews of the literature through its emphasis on transparent, structured and comprehensive approaches to searching the literature and its requirement for formal synthesis of research findings. There appears to be relatively little use of the systematic review methodology within the…

For better or for worse, the assessment of research quality is one of the primary drivers of the behaviour of the academic community with all sorts of potential for distorting that behaviour. So, if you are going to assess research quality, how do you do it? This article explores some of the problems and possibilities, with particular reference to…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

The purpose of this article is to extend the discussion of issues currently being debated on the need for more rigorous program evaluation in educational and other sectors of research, to the field of international development evaluation, reviewing the different approaches which can be adopted to rigorous evaluation methodology and their…

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Discusses quantitative and qualitative approaches in research on peer effects on student attainment, using two texts to argue that the definition of "effect" cannot be restricted to "statistical effect," and that institutional properties are not the sum of individual properties. Asserts that quantitative investigators have…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

Some aspects of fourth generation evaluation procedures that have been advocated by E. G. Guba and Y. S. Lincoln were examined empirically, with emphasis on areas where there have been discrepancies between theory and field-based experience. In fourth generation evaluation, the product of an evaluation is not a set of conclusions, recommendations,…

Unintended effects of evaluation are discussed, with reference to the Hawthorne Effect, where unintended effects overshadow the manipulations controlled by researchers. Unintended effects are categorized as (1) affective reactions; (2) political dimensions; (3) importance of individual differences; and (4) expectations concerning evaluation.…