This study aimed to examine pre-service physical education teachers' (PPETs) subjective theories of assessment as they formed prior to the professional training of assessment during PETE. Using a phenomenological approach, 11 PPETs were interviewed. Data were analyzed in Nvivo 12. Findings revealed that (a) PPETs understood assessment as data…

Generative Artificial Intelligence (GenAI) is transforming education, with assessment design emerging as a crucial area of innovation, particularly in computer science (CS) education. Effective assessment is critical for evaluating student competencies and guiding learning processes, yet traditional practices face significant challenges in CS…

Student evaluations of teaching (SETs) are a ubiquitous feature of higher education. However, scholars have presented numerous challenges to the accuracy, validity, reliability and objectivity of SETs as a measure of teaching effectiveness. Given the potential for bias, the use of SETs in professional review may constitute a form of institutional…

With the aim to provide teachers with more specific, frequent, and actionable feedback about their teaching, we explore how Large Language Models (LLMs) can be used to estimate "Instructional Support" domain scores of the CLassroom Assessment Scoring System (CLASS), a widely used observation protocol. We design a machine learning…

Collecting treatment integrity data is critical for (a) strengthening internal validity within a research study, (b) determining the impact of an intervention on student outcomes, and (c) assessing the need for implementation supports. Although researchers have noted the increased inclusion of treatment integrity data in published articles, there…

Evaluations that include stakeholders aim to understand their perspectives and to ensure that their views are represented. This article offers a new approach to gaining stakeholder perspectives through crowdsourcing. We recruited a sample of individuals with chronic low back pain through a crowdsourcing site. This sample coded textual data…

In many countries, assessment and curriculum reforms came into being in recent decades. In Iran, an important educational assessment reform took place called Descriptive Assessment (DA). In this reform, the focus of student assessment was moved from a more summative approach of providing grades and deciding about promotion to the next grade to a…

Evaluators can work with brief units of text-based data, such as open-ended survey responses, text messages, and social media postings. Online crowdsourcing is a promising method for quantifying large amounts of text-based data by engaging hundreds of people to categorize the data. To further develop and test this method, individuals were…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

This article describes the development of an application for the grading and provision of feedback on educational processes. The too, named "EduZinc," enables instructors to go through the complete process of creating and evaluating the activities and materials of a course. The application enables for the simultaneous management of two…

Electronic portfolios (E-portfolios) are crucial means for workplace-based assessment and feedback. Although E-portfolios provide a useful approach to view each learner's progress, so far options for personalized feedback and potential data about a learner's performances at the workplace often remain unexploited. This paper advocates that…

Student rating instruments are recognised to be valid indicators of effective instruction, providing a valuable tool to improve teaching. However, free-form text comments obtained from the open-ended question component of such surveys are only infrequently analysed comprehensively. We employed an innovative, systematic approach to the analysis of…

The use of rubrics for grading and feedback in higher education has increased in response to requirements for consistency and transparency across a diverse range of assessment tasks. There is a growing evidence base demonstrating the reliability of rubrics across different markers and instances. The number of studies describing the impact of…

The book examines the shift needed to our systems and society to enable lifelong, experiential, interconnected learning journeys. The book outlines the vision for a learning ecosystem that spans technology, learning science, policy, and organizational factors. "Modernizing Learning" is the outcome of a multi-year study recently completed…

Data use is becoming a prominent strategy for educational innovation and improvement across countries. However, the fragmentation of data collection often hinders the capacity of policymakers, researchers and practitioners to access and analyse the wealth of data routinely generated in educational institutions. A critical step towards realising…