The transformative turn in research and innovation (R&I) policy calls for new approaches to monitoring and evaluation, yet most evaluands are still rooted in previous policy paradigms. For evaluators tasked with conducting ex-post evaluations, this situation creates multiple challenges that have received little attention to date. In this…

It is well known that research quality notions vary across research fields. Despite this, humanities quality notions are often portrayed as deviant or particularly hard to grasp. To some extent, this has a historical explanation, as notions from within the humanities have not been the standards used in the development of research evaluation tools.…

Studies on research quality criteria and their application have largely not defined the concept of 'research quality'. This reluctance to define and theoretically position the concept of research quality consigns empirical research to remain descriptive and makes methodological decisions more difficult. This paper aims to propose a theoretical…

The monitoring and evaluation of R&I policies relies on quantitative and qualitative methods with important methodological shortcomings. Quantitative assessments rely on standardized indicators that do not capture context-specific challenges, while qualitative approaches lack comparability. Both approaches are complementary but not always…

The economic significance of open research data is widely acknowledged, yet its quantification remains challenging. This paper presents an effective valuation instrument to help stakeholders understand and evaluate the economic benefits of open research data. By conducting a scoping review and prioritizing user engagement, this study introduces a…

The work of professionals practicing in the community provides a pathway for knowledge advances to reach practice. Yet outside of medicine, little attention has been paid to this phenomenon. Similarly, professions are defined by bodies of knowledge yet studies of professions do not attend to the dynamic relationship between professionals and the…

Research practice partnerships (RPPs) are an increasingly popular approach for bringing together research and practice in ways that can improve and transform education. To date, however, evaluators have lacked measures to evaluate such partnerships. This paper describes a project to develop validity evidence for a survey to evaluate the…

In this paper we investigate the practices and capacities that define successful societal interaction of research groups with stakeholders in mutually beneficial processes. We studied the Finnish Strategic Research Council's (SRC) first funded projects through a dynamic governance lens. The aim of the paper is to explore how the societal…

Data Envelopment Analysis (DEA) is a widely adopted non-parametric technique for evaluating R&D performance. However, traditional DEA models often struggle to provide reliable solutions in the presence of data uncertainty. To address this limitation, this study develops a novel robust super-efficiency DEA approach to evaluate R&D…