In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

In this commentary, the authors discuss some of the issues regarding the use of diagnostic classification models that practitioners should keep in mind. In the authors experience, these issues are not as well known as they should be. The authors then provide recommendations on diagnostic scoring.

The state of teacher evaluation is a significantly and frequently neglected problem in public education, an enterprise that spends $400 billion annually on salaries and benefits. Because teacher evaluation is at the center of the quality of teaching in the nation's classrooms, it has the potential to be a powerful lever of teacher and school…

The Individuals with Disabilities Education Improvement Act of 2004 allows schools to use a child's response to research-based intervention (RTI) as a part of procedures to identify students with learning disabilities. This paper considers whether RTI-based assessment models meet ethical and legal standards for acceptable assessment practices.…

Purpose: This paper aims to explore how teaching and assessing reflective learning skills can support postgraduate practitioners studying organisational change and explores the challenges for tutors in assessing these journals. Design/methodology/approach: Assessment criteria were developed from the literature on reflective practice and…

Although experiments are viewed as the gold standard for evaluation, some of their benefits may be lost when, as is common, outcomes are not defined for some sample members. In evaluations of marriage interventions, for example, a key outcome--relationship quality--is undefined when a couple splits up. This article shows how treatment-control…

This paper forms part of an exploration of assessment on one part-time higher education (HE) course: an in-service, professional qualification for teachers and trainers in the learning and skills sector which is delivered on a franchise basis across a network of further education colleges in the north of England. This paper proposes that the…

This article reflects on key methodological issues emerging from children and young people's involvement in data analysis processes. We outline a pragmatic framework illustrating different approaches to engaging children, using two case studies of children's experiences of participating in data analysis. The article highlights methods of…

This paper describes the process of designing and administering a sufficiently valid and reliable assessment instrument to measure the progress in attainment of adult learners studying numeracy, and discusses some of the inherent difficulties that were involved. The fieldwork took place during 2003-2005 and involved a sample of 34 teachers and 412…

The intent of large-scale assessment systems is to promote student achievement toward specific standards by holding schools accountable for the performance of all students. However, it is difficult to know whether large-scale assessment systems are having this intended effect as they are currently implemented. In this article, the authors examine…

Recent decades have witnessed a remarkable rise in the regulation of public services and servants, education being a case in point. External evaluation and inspection has been an important element of this trend. Increasingly, however as the limitations of external surveillance systems have become clear the concept of internal or self-evaluation…

Career development practitioners understand that the value of career and employment services extends beyond attachment to the labor market. However, "soft" outcomes such as increased self-efficacy and improved ability to manage transitions are difficult to measure. Convincing funders and policy makers of the significance of such outcomes…

This article reviews issues involved with using norm-referenced measures within an intervention validity model. Methodological examination of intervention validity has become more important as intervention methodologies have become part of federal legislation. However, current practice and federal guidelines often implicitly portray a dichotomy…

This paper describes three multigrade school reforms in Latin America: (1) Colombia's "Escuela Nueva", (2) Guatemala's "Nueva Escuela Unitaria", and (3) Chile's MECE-Rural. Each reform endowed primary teachers and students with special training and instructional materials, and encouraged new kinds of instruction in rural…

What is the nature of latent predictors that facilitate diagnostic classification? Rupp and Templin (this issue) suggest that these predictors should be multidimensional, categorical variables that can be combined in various ways. Diagnostic Classification Models (DCM) typically use multiple categorical predictors to classify respondents into…