Attention to evaluation quality is commonplace, even if sometimes implicit. Drawing on her 2010 Presidential Address to the American Evaluation Association, Leslie Cooksy suggests that evaluation quality depends, at least in part, on the intersection of three factors: (a) evaluator competency, (b) aspects of the evaluation environment or context,…

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally…

Compared to traditional test theory, where person measures are typically referenced to the distribution of a population, item response theory allows for a much more meaningful interpretation of measures as they can be directly compared to item locations. However, Stephen Humphry shows that the crucial role of the unit of measurement has been…

This study is part of a larger research project originally funded by the Write Now CETL looking at assessment, marking and feedback from the lecturers' perspective. Earlier findings have suggested that with new lecturers at least, there are some discipline differences in how able they feel they can put into practice what they have learned about…

Systematic reviews are used to inform practice, and develop guidelines and protocols. A questionnaire to quantify the risk of bias in systematic reviews, the review paper assessment (RPA) tool, was developed and tested. A search of electronic databases provided a data set of review articles that were then independently reviewed by two assessors…

In their article Ruscio et al. (Ruscio, Seaman, D'Oriano, Stremlo, & Mahalchik, this issue) present a comparative study of some of the different variants of the "h" index. The study evaluates a total of 22 metrics, including the "h" index and "h"-type indices, as well as other conventional measures. The novelty of their work is to a large extent…

There is perhaps no subject more contentious in schools than assessment and yet, often, at classroom, school and national level, inferences and decisions are made without much reference to research in this area. In fact, teachers often accept or interpret assessment requirements without question, feeling that assessment has to be approached in a…

Background/Context: Two key uses of international assessments of achievement have been (a) comparing country performances for identifying the countries with the best education systems and (2) generating insights about effective policy and practice strategies that are associated with higher learning outcomes. Do country rankings really reflect the…

A primary difficulty with music performance assessment is managing its subjective nature. To help improve objectivity, rubrics can be used to develop a set of guidelines for clearly assessing student performance. Moreover, rubrics serve as documentation for student achievement that provides music teachers with a written form of accountability.…

Within a transnational educational programme, students residing in the Czech Republic obtain baccalaureate degrees from an accredited American college. The college has a distinctive approach towards learning, co-creation of knowledge and the use of mentors. Part of the degree assessment is an undergraduate dissertation, which serves as a capstone…

The commentaries on my article contain a number of points with which I disagree but also several with which I agree. For example, I continue to believe that the existence of many cases in which between-person variability does not increase with age indicates that greater variance with increased age is not inevitable among healthy individuals up to…

This paper is meant to highlight the occurrence of Simpson's Paradox when using aggregated data obtained from two IEA studies in Israel, while ignoring the effect of a powerful intervening variable in the local context--the ethnicity factor. It will demonstrate faulty conclusions regarding either the absence of relationships between a contextual…

Humphry (this issue) deserves credit for drawing attention to the long-neglected fact that differences in item discrimination parameters are often due to empirical factors and not the product of random error components. In doing so, Humphry offers a psychometrically elegant, coherent, and practically important new model that is more flexible while…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

A fundamental aspect of work integrated learning (WIL) is the development of professional competence, the ability of students to perform in the workplace. Alignment theory therefore suggests that the assessment of WIL should include an assessment of students' demonstration of professional competence in the workplace. The assessment of professional…