The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

The value of a program can be understood as referring not only to outcomes, but also to how those outcomes compare to the types and amounts of resources expended to produce the outcomes. Major potential mistakes and biases in assessing the worth of resources consumed, as well as the value of outcomes produced, are explored. Most of these occur…

A primary difficulty with music performance assessment is managing its subjective nature. To help improve objectivity, rubrics can be used to develop a set of guidelines for clearly assessing student performance. Moreover, rubrics serve as documentation for student achievement that provides music teachers with a written form of accountability.…

Mandated teacher evaluations are of little use to educators for a variety of reasons, including lack of reliability and validity of evaluation instruments and methods, failure of evaluation systems to adhere to the Personnel Evaluation Standards (Joint Committee, 2008), and the inherent bias in using classroom observations as a method of…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Current economic conditions and the increasing competition for government funding are leading to an increased focus on the impact of research. Measuring the impact of research is difficult because not all impacts are direct and some can be negative or result from the identification of problems that require a non-research response. The time between…

In this study we explored faculty and student experiences of accelerated learning. We conducted interviews with faculty members who had delivered the same course in 12 and 6-week timeframes, and we analysed a student survey. Students reported overall positive experiences in the accelerated courses, particularly in the social aspects of learning,…

P. R. Killeen's (2005a) probability of replication ("p[subscript rep]") of an experimental result is the fiducial Bayesian predictive probability of finding a same-sign effect in a replication of an experiment. "p[subscript rep]" is now routinely reported in "Psychological Science" and has also begun to appear in…

The intent of large-scale assessment systems is to promote student achievement toward specific standards by holding schools accountable for the performance of all students. However, it is difficult to know whether large-scale assessment systems are having this intended effect as they are currently implemented. In this article, the authors examine…

Some students are less accurately measured by typical reading tests than other students. By asking teachers to identify students whose performance on state reading tests would likely underestimate their reading skills, this study sought to learn about characteristics of less accurately measured students while also evaluating how well teachers can…

This support document accompanies the NCVER report, "A Review of Indigenous Employment Programs," hereafter the "Report" [ED499667]. It contains explanatory notes on evaluation methodology, plus additional details on developments in labor market assistance and reviews of the literature relating to the evaluation of such…

Authentic assessment is a growing alternative to conventional testing. This research-to-practice article describes a framework for implementing authentic assessment. The R-E-A-L framework shows how roles, equipment, assessment tools, and location can be incorporated into early childhood practices.

Examines arguments for and against evaluation advocacy in terms of the American Evaluation Association's "Guiding Principles for Evaluators" and other statements on advocacy and neutrality. Suggests revision of the "Guiding Principles." (Author/SLD)

Admissions committees and researchers around the globe have used diligence and imagination to develop and implement various screening measures with the ultimate goal of predicting future clinical and professional performance. What works for predicting future job performance in the human resources world and in most of the academic world may not,…

Social Service agencies have been reluctant to focus on alcoholism as an issue in treating client and family problems, although there are 48 million alcoholics in the U.S., and 7 million of them are under age 18. Reasons for the reluctance to focus on alcoholism include lack of knowledge, poor prognosis, nihilism, denial, social workers' fears of…