ERIC Number: EJ1208320
Record Type: Journal
Publication Date: 2019-Jan
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0958-2029
EISSN: N/A
Available Date: N/A
Referees or Sponsors? The Role of Evaluators in the Promotion of Research Scientists in a Public Research Organization
Glennie, Miriam; O'Donnell, Michael; Brown, Michelle; Benson, John
Research Evaluation, v28 n1 p63-72 Jan 2019
Evaluators play a central role in assessments of researchers' performance for reward, but the nature of their role and influence is not well understood. Ongoing reliance on evaluator judgement is typically justified as a need for referees in contests for reward, because quantitative performance measures alone can be subject to distortion. Yet, if evaluators are able to privately establish or interpret the performance standards utilized in evaluation, it may inhibit equality of opportunity, limit applicant pools, and reinforce existing inequalities. This article untangles the different roles played by evaluators through the development of a typology of systems of performance evaluation from existing literature. The typology is then applied to one type of evaluation system--promotion in a public research organization (PRO)--to investigate how and why particular evaluator roles emerge, and what contextual factors influence their implementation. Data are drawn from a mixed-method case study of a large Australian PRO, which includes data from one focus group, 22 in-depth interviews and 803 survey responses. The case study finds that evaluators' role can extend to sponsorship of researchers through the promotion system when diversity in research specializations inhibits the establishment of uniform performance standards. It also demonstrates that reporting lines and evaluator workload impact how and to whom sponsoring support is given.
Descriptors: Research Universities, Role, Evaluators, Focus Groups, Decision Making, Performance Based Assessment, Institutional Evaluation, Classification, State Universities, Context Effect, Case Studies, Researchers, Specialization, College Faculty, Standards, Foreign Countries
Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Australia
Grant or Contract Numbers: N/A
Author Affiliations: N/A