In this Reflection on Practice I argue the case for using the principles of scholarship of teaching and learning (SoTL) to serve as a framework for evaluating and designing peer observation programmes in higher education contexts. I suggest that for peer observation to be an activity worthy of SoTL, it should be systematic, collaborative,…

Aguirre-Urreta, Rönkkö, and Marakas' (2016) paper in "Measurement: Interdisciplinary Research and Perspectives" (hereafter referred to as ARM2016) is an important and timely piece of scholarship, in that it provides strong analytic support to the growing theoretical literature that questions the underlying ideas behind causal and…

The topic and purpose of this paper is to explore within the literature the theoretical foundations and applications of rubrics in the process of evaluation of retained learning and mastery of knowledge within the educational environment. The first step of the research was to assemble a definition of the term rubric from a historical perspective.…

Local food system stakeholders are confronted with challenges when attempting to ascertain the economic impacts of food system investments. The U.S. Department of Agriculture Agricultural Marketing Service commissioned a team of economists to develop a resource to provide support to stakeholders interested in understanding the economic impacts of…

These next two lectures succinctly discuss the necessary preparation and methods for observation. Using the naturalist Fabre as an example of scientific training of the faculties for sharp observation, Montessori compares the observer to a researcher and gives many suggestions for conducting thorough yet unobtrusive observation. Self-awareness of…

The purpose of this ITEMS module is to provide an introduction to differential item functioning (DIF) analysis using mixture item response models. The mixture item response models for DIF analysis involve comparing item profiles across latent groups, instead of manifest groups. First, an overview of DIF analysis based on latent groups, called…

In educational contexts where many domains subject to improvement are interdependent and causal evidence is frequently lacking it is difficult, if not impossible, for policymakers and educational practitioners to decide which domain should be invested in. This paper proposes a new method that uses Conditional Mean Independent Correlations (CMIC)…

This paper seeks to understand the contextual influences that were considered important for shaping teachers' use of Assessment for Learning (AfL). Using the micro, meso and macro-level contextual framework, the content analysis of teachers' propositions drawn from semi-structured interviews and three group discussions unveiled both internal and…

In 2020, because of the COVID-19 pandemic the higher education sector, in the United Kingdom and internationally, transitioned to online assessment, at a speed and scale which might have been unimaginable under normal circumstances. The priority in the sector was to ensure that fundamental principles of assessment, including integrity, were…

Machines have a long-demonstrated ability to find statistical relationships between qualities of texts and surface-level linguistic indicators of writing. More recently, unlocked by artificial intelligence, the potential of using machines to identify content-related writing trait criteria has been uncovered. This development is significant,…

In this investigation we propose new machine learning methods for automated scoring models that predict the vocabulary acquisition in science and social studies of second grade English language learners, based upon free-form spoken responses. We evaluate performance on an existing dataset and use transfer learning from a large pre-trained language…

Classroom observations have been increasingly used for teacher evaluations, and it is important to examine the measurement quality and the use of observation ratings. When a teacher is observed in multiple classrooms, his or her observation ratings may vary across classrooms. In that case, using ratings from one classroom per teacher may not be…

As chemists, we understand that science is more than a set of disconnected facts. It is a way of investigating and understanding our natural world that involves things like asking questions, analyzing data, identifying patterns, constructing explanations, developing and using models, and applying core concepts to other situations. This paper uses…

Purpose: The purpose of this paper is to highlight both the need for measurement of graduate capabilities post-degree completion and the challenges posed by such a task. Higher education institutions provide an important site of learning that can equip future professionals with capabilities to manage and respond to complex sustainability…

This study investigates the role of speech evaluation training in a) creating speech evaluation fidelity between instructor scores and student self-evaluation scores and b) facilitating the type and quality of written feedback on speeches by both students and instructors. The results suggest that students who undergo speech evaluation training…