The Programme for International Student Assessment (PISA) was designed by the Organization for Economic Cooperation and Development (OECD) to evaluate the quality, equity, and efficiency of school systems around the world. Specifically, the PISA has assessed 15-year-old students' reading, mathematics, and science literacy on a 3-year cycle, since…

Systematic review methodology can be distinguished from narrative reviews of the literature through its emphasis on transparent, structured and comprehensive approaches to searching the literature and its requirement for formal synthesis of research findings. There appears to be relatively little use of the systematic review methodology within the…

Attention to evaluation quality is commonplace, even if sometimes implicit. Drawing on her 2010 Presidential Address to the American Evaluation Association, Leslie Cooksy suggests that evaluation quality depends, at least in part, on the intersection of three factors: (a) evaluator competency, (b) aspects of the evaluation environment or context,…

Student evaluation of teaching is commonplace in many universities and may be the predominant input into the performance evaluation of staff and organisational units. This article used publicly available student evaluation of teaching data to present examples of where institutional responses to evaluation processes appeared to be educationally…

Preschool education is increasingly being recognized as an integral part of efforts to ensure that all children enter school ready to learn and as a way to help close the achievement gaps that exist at the time children enter kindergarten. Such efforts are growing across the country. According to the most recent data, 54 different preschool…

The author of an indicator that tests evaluation system compliance with good governance principles addresses the UNDP's response to his article by offering an empirical test of the UNDP's commitment to reform. While the UNDP Evaluations Office claims to be working on reforms, the test exposes the unwillingness of the UNDP Evaluations Office to…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

Using computers to evaluate teachers based on student test scores is more difficult than it seems. Value-added modeling is a genuinely serious attempt to grapple with the difficulties. Value-added modeling carries the promise of measuring teacher quality automatically and objectively, and improving school systems at minimal cost. The essence of…

Digital video is used to capture and assess a wide range of everyday classroom teaching practices. Generally, these applications are informal in nature and considered either risk-free or risk-neutral by teachers. Increasingly, however, captured video can be scrutinized and assessed by "others" to determine the presence and/or quality of specific…

Internationalization is possible, but the objectives need careful consideration. It is noted that the majority of countries do not have any form of test quality procedure and that only a small number have reviews, registration, certification, or some combination of these approaches. Internationalization could provide benefits at the least by…

Early education has been a growing priority for the Obama administration, and its competitive funding is spurring innovation in this field around the country. In 2013, early education journalist Paul Nyhan, author of this report, conducted case studies of four competitive grant programs that are triggering changes in early education: "Race to…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Standardized testing for higher education has been much in the news in the US over the last few years. In the wake of the Spellings Commission, the clear intent of the Department of Education's (USDOE) position in negotiated rulemaking in 2007 was to mandate its use in accreditation. Standardized testing is also a central feature of the Voluntary…

Although priding itself on high rates of literacy achievement, New Zealand's track record in the last two decades has noticeably declined. Successive New Zealand governments have invested heavily in trying to redress this decline with limited success. Demographic changes in population due to immigration provide a partial explanation, but arguably,…

Within the (Computer-Supported) Collaborative Learning (CS)CL research community, there has been an extensive dialogue on theories and perspectives on learning from collaboration, approaches to scaffold (script) the collaborative process, and most recently research methodology. In contrast, the issue of assessment of collaborative learning has…