As environmental challenges increase in scope and scale, new conceptualizations for environmental literacy are needed. Specifically, notions of environmental literacy must move from those at the individual level to those at the group, or community, level. However, the concept of community level environmental literacy is underdeveloped. In this…

Anxiety is a multifaceted force that can negatively impact the ability of evaluators to succeed in practice. In the evaluation literature, discussions concerning anxiety have primarily been limited to strategies to reduce stakeholder anxiety to encourage positive and productive working relationships with evaluators. This study was among the first…

The consensus-based assessment has long been a prevalent methodology employed in "panel crit" settings in design education and professional design awards. Acknowledging the subjective nature of design evaluation and its importance to the design development process, we report two studies investigating the effect of three levels of design…

In this article we attempt to reconstruct the tacit and implicit notions of quality in the humanities. This reconstruction is based on a series of semi-structured qualitative interviews with 33 humanities scholars. Applying Max Weber's theory of authority, we argue the quality notions have two different sources--external and internal. External…

The purposes of this research were to assess the educational sustainability of an educational project based on phases-based assessment and to assess the results of the educational project. The participants were stakeholders of the educational project and experts, who were acquired by purposive sampling. The instruments were the assessment forms of…

Feedback provided by peer reviewers plays a pivotal role in any journal peer-review model. Peer-review feedback helps authors reconsider their manuscripts in a new light and improve their work before it is published. While there is a wealth of knowledge and empirical evidence focusing on effective feedback practices in educational settings, there…

Validation is needed for any newly developed model or framework because it requires several real-life applications. The investment made into e-learning in medical education is daunting, as is the expectation for a positive return on investment. The medical education domain requires data-wise implementation of e-learning as the debate continues…

This paper explores how the charter school sector evaluates the success of specialized education programs in order that the Nature School can learn from these best practices and develop its own framework. The researcher conducted in-depth interviews with five evaluation experts and eight diverse charter school authorizers overseeing a significant…

Scoring mathematics exam papers accurately is vital for fostering students' engagement and interest in the subject. Incorrect scoring practices can erode motivation and lead to the development of false self-confidence. Therefore, the implementation of appropriate scoring methods is essential for the success of mathematics education. This study…

For decades, student ratings of university faculty have been used by administrators in high stakes faculty employment decisions such as tenure, promotion, contract renewal and reappointment, and merit pay. However, virtually no attention has been paid to the ethical questions of using ratings in employment decisions. Instead, the ratings…

This article presents a brief overview of the state-of-the-art in large language models (LLMs) like ChatGPT and discusses the difficulties that these technologies create for educators with regard to assessment. Making use of the 'arms race' metaphor, this article argues that there are no simple solutions to the 'AI problem'. Rather, this author…

This study examined how students utilized metacognition while solving physics problems. A case study design was implemented, involving 30 11th-grade students. Data were collected by using open-ended physics problems, with a think-aloud strategy applied during the process. Both quantitative and qualitative analyses were conducted using the…

The European Research Council (ERC) receives many high-quality applications, but funds only a few. We analyze how members of ERC review panels assess applications in the first, highly competitive step of evaluations for ERC Starting and Consolidator Grants. Drawing on interviews with ERC panel members in different fields, we show that they adopt a…

While states are increasingly adopting and implementing the Next Generation Science Standards (NGSS) as goalposts for student learning, there is less clear consensus around the science instruction needed in classrooms to realize this vision. In this study, I investigate the visions of expertise in science instruction that three science teacher…

In crowdsourcing ideation websites, companies can easily collect large amount of ideas. Screening through such volume of ideas is very costly and challenging, necessitating automatic approaches. It would be particularly useful to automatically evaluate idea novelty since companies commonly seek novel ideas. Four computational approaches were…