This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

Current scientometric indexes do not encourage the linguistic diversity of sources cited in academic texts and researchers are not motivated to cite texts written in smaller languages. This diminishes the cultural diversity of the sources cited and limits the representation of small and indigenous cultures. This text proposes a scientometric…

This article first makes a case for the need to establish evaluation reporting standards, support for which is rooted in the growing demand for professionalization, in the growing meta evaluation literature, and in growing efforts to develop reporting standards for inquiry efforts. Then, a case is made for a particular set of such standards…

The calls for accountability in higher education have made outcome-based assessment a key accreditation component. Accreditation remains a well-regarded seal of approval on college quality, and requires the programme to set clear, appropriate, and measurable goals and courses to attain them. Furthermore, programmes must demonstrate that…

A college degree is essential in our society, especially for students who historically have been left out of our higher education system. But with the current higher education information systems in place, it's difficult, if not impossible, for students and families to get the data they need to make an informed decision about the best institution…

Despite recommendations from the "Publication Manual of the American Psychological Association" (6th ed.) to include information on statistical power when publishing quantitative results, authors seldom include analysis or discussion of statistical power. The rationale for discussing statistical power is addressed, approaches to using "G*Power" to…

The paper proposes a contingent, learner-centred usability evaluation method and a prototype tool of such systems. This is a new usability evaluation method for web-based learning systems using a set of empirically-supported usability factors and can be done effectively with limited resources. During the evaluation process, the method allows for…

There are ongoing debates as to the merits of mastery and performance (or competitive) approaches to school and student learning. Mastery approaches are focused on factors and processes such as effort, skill development, learning, and understanding. Performance approaches are focused more on competition, demonstrating relative ability, social…

In 1997, American Evaluation Association member George Grob, now retired from the U.S. Department of Health and Human Services (HHS) and currently President of the Center for Public Program Evaluation, made a testimony on Medicare home health care fraud and abuse before the U.S. Senate Special Committee on Aging. The occasion was to announce the…

This paper emerges from a case study of the system of statutory reviews in older people's care homes in the UK. Informed by a review of selected literature on gaining access, this paper provides a critical account of the process of negotiating access with gatekeepers (chiefly, care home managers). The negotiations were time-consuming and largely…

Experimental research involves comparing two or more conditions. One of those conditions in single subject research is often the baseline. Adequate description of the baseline conditions is necessary for evaluating the effects of independent variables, drawing generalizations from studies, and providing information for subsequent replication…

Makes the case for, and demonstrates the use of, poetic transcription as a form of presenting evaluation findings. Taking language from focus group interviews, the evaluator constructed a poem intended to provoke readers into a process of reflection meaning making about the program being evaluated, the method by which the representation was…

Career development practitioners understand that the value of career and employment services extends beyond attachment to the labor market. However, "soft" outcomes such as increased self-efficacy and improved ability to manage transitions are difficult to measure. Convincing funders and policy makers of the significance of such outcomes…

Describes how Geographic Information Systems (GIS) can be used to help evaluators convey complex information simply through a spatial representation. Demonstrates how GIS can be used to plot change over time, including impact and outcome data gathered by primary data collection. (SLD)

The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…