Critiquing journal articles can be intimidating, especially for new scholars. Many new graduate students focus on the findings and discussion rather than the quality of the research. This methodology review guide is our tool to help scholars identify and evaluate a research article, particularly focusing on the methodology. Although there are some…

Generative AI (GenAI) challenges assessment validity by enabling students to complete tasks without demonstrating genuine capability. In response to this challenge, institutions have developed and implemented various approaches that aim to communicate permissible AI use to students. Familiar examples include the 'traffic light' approach now…

The interaction between teacher and student in an architecture design studio is an important part of the teaching/learning process because it generates a kind of conversation that solidates the 'learning by doing' of teaching. This paper attempts to closely examine the jury system during the design assessment session. By monitoring the jury…

Participatory research can be promoted by scientific intermediary units, such as Science Shops. The overarching goal of these initiatives is thereby to foster a process of co-creation of the research questions to address societal needs that are relevant to scientific research and society at large. The InSPIRES project was a Horizon Europe…

This paper presents a framework for utilizing Student Evaluations of Teaching (SET) in faculty evaluations. Recognizing the ongoing debate about the validity of SET as a measure of teaching effectiveness, the authors agree with scholars who propose viewing SET as a tool for gauging 'student perceptions of learning'. They present a method that…

Information technology advancements have facilitated the widespread adoption of online education, providing learners with more flexible and convenient means of accessing educational resources and completing learning tasks. To improve the quality of online education and promote collaborative learning, online assessment is crucial in this…

In web surveys, no interviewer is present to clarify question comprehension problems, which can be particularly prevalent among respondents with low literacy skills. Although plain language is used in various contexts to improve text comprehensibility, its use in social science questionnaires has not been investigated to date. Using a…

For over 30 years, the notion of authentic assessment in higher education has been adopted in academic practice, but it has managed to escape substantial critique. Although there have been multiple definitions and operationalisations of authentic assessment, current practice tends to foreground mimicking of work tasks. Authenticity cannot be…

Changing health-care climates mean evaluators need to provide findings within shorter time frames, but challenges remain in the creation of rapid research designs capable of delivering quality data to inform decision-making processes. We conducted a review of articles to grapple with these challenges and explore the ways in which rapid evaluations…

Since 2007, two taxonomies have been proposed to identify the components of evaluation practice that may be specified in an evaluation policy. Little is known, however, about how these taxonomies align with evaluation policies developed by philanthropic foundations. Through thematic analysis, this article first compares 12 foundation evaluation…

High-quality assessments are crucial to many aspects of the educational process. They can help policymakers monitor long-term educational trends, assist state educational agencies (SEAs) and local educational agencies (LEAs) in allocating resources and professional development opportunities, provide insights to teachers about how well students…

This study examines the views of assessment of programme directors at a Portuguese public university (n = 60). Data were collected through a questionnaire which included closed and open-ended questions. The participants hold different professional categories and come from medical and health sciences, exact sciences, engineering and technology,…

Does the choice of observation instrument make a difference in the feedback and ratings that teachers receive? This study explores how lessons are rated differentially across various observation instruments. To investigate this question, ten randomly selected mathematics lessons were rated using six different observation instruments. Overall…

Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…