Ruscio, Seaman, D'Oriano, Stremlo, and Mahalchik (this issue) evaluate 22 bibliometric indicators, including conventional measures, like the number of publications, the "h" index, and many "h" index variants. To assess the quality of the indicators, their well-justified criteria encompass conceptual, empirical, and practical…

This paper forms part of an exploration of assessment on one part-time higher education (HE) course: an in-service, professional qualification for teachers and trainers in the learning and skills sector which is delivered on a franchise basis across a network of further education colleges in the north of England. This paper proposes that the…

Reviews evidence regarding the content, standards, and use validity of the International Adult Literacy Survey's performance scales and self-assessment scales. Concludes that there are serious questions about the performance scales and that self-assessment data may help identify adults who believe they have poor literacy skills. Suggests that…

A year-long case study of the effects of an educational and vocational rehabilitation program in a youth training center was discussed in terms of fourteen issues which might threaten the validity of an evaluation or research project. This correctional institution housed women aged 14 to 21 who were long-term wards of the state, held on remand, or…

Focuses on Subject-Pair Analysis, a technique for comparing examinations in different subjects, to demonstrate that reliance on statistical comparisons of standards between subjects is misplaced. Explicates the fundamental assumptions underlying the Subject-Pair Analysis. Argues that this and related analyses are inappropriate for dealing with the…

Describes as example a parents' center in London to examine impact of evaluation exercises on people and services being evaluated. Questions whether evaluators are measuring the right things, whether evidence is valid, and what effects an evaluation may have on services. Identifies features of research and evaluation that are most likely to…

Examines the use of portfolio assessment in a distance education program for research information skills at the University of South Africa. Discusses the assessment of information literacy and online searching skills; portfolio assessment criteria; student attitudes; validity and reliability of portfolio assessment; and problems. (LRW)

Considers the competing demands placed on evaluators in relation to the service (characteristics of the intervention), the sample (people participating), and methodology or research design. Explores compromises that may be required between scientific ideals and real-world limitations, and assesses implications for obtaining meaningful results in…

Reviews the Standard Assessment Tasks used to evaluate pupil performance relative to the National Curriculum in England and Wales. Asserts that the system of assigning students to one of 10 levels of attainment is criterion-referenced, whereas the test is norm-referenced. (CFR)