ERIC Number: EJ1452544
Record Type: Journal
Publication Date: 2024
Pages: N/A
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0958-2029
EISSN: EISSN-1471-5449
Available Date: N/A
Perceptions of Grant Peer Reviewers: A Mixed Methods Study
Karen B. Schmaling; Gabriel R. Evenson; Blake K. Marble; Stephen A. Gallo
Research Evaluation, v33 Article rvae050 2024
Peer review is integral to the evaluation of grant proposals. Reviewer perceptions and characteristics have received limited study, especially their associations with reviewers' evaluations. This mixed methods study analyzed the unstructured comments of 270 experienced peer reviewers after they scored proposals based on mock overall evaluations written by the primary reviewer. Comments were coded for topical content and emotional valence blind to participants' characteristics. The most frequent comments were about their experiences with peer review with negative valence. Additional themes were identified within the content codes, including concerns about favoritism and inappropriate behavior observed in other reviewers. Reviewers who made negative comments gave poorer scores than reviewers who did not. Reviewer mindsets are understudied: negative moods and cognitions may affect reviewers' overall evaluative severity. Future studies should further investigate these associations.
Descriptors: Peer Evaluation, Grants, Evaluation Research, Program Proposals, Ethics, Scores, Evaluators
Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A