Written assignments for large classes pose a far more significant challenge in the age of the GenAI revolution. Suggestions such as oral exams and formative assessments are not always feasible with many students in a class. Therefore, we conducted a study in South Africa and involved 280 Honors students to explore the usefulness of Turnitin's AI…

The integration of Generative Artificial Intelligence (GenAI) in education has introduced innovative approaches to assessment. One such approach is AI chatbot-based assessment, which utilizes large language models to provide students with timely and consistent feedback. However, the effectiveness of AI chatbots in generating assessments comparable…

Certainty-based marking (CBM) requires students to indicate their certainty levels alongside their answers. CBM has been shown to enhance self-assessment and metacognitive awareness. This study aimed to explore the implementation of CBM in multiple-choice assessments in physiology. The CBM assessment tool was developed with an artificial…

Background/purpose: Generative artificial intelligence (GenAI) is often promoted as a transformative tool for assessment, yet evidence of its validity compared to human raters remains limited. This study examined whether an AI-based rater could be used interchangeably with trained faculty in scoring complex coursework. Materials/methods:…

Online teaching has gained more momentum since the outbreak of the COVID-19 pandemic. While this mode offers many benefits, one major concern is maintaining academic integrity, as online instruction can provide more opportunities for cheating. This study aimed to explore students' attitudes toward cheating in online assessments (OAs) and any…

Globally, higher education institutions were forced to use online assessments during the COVID-19 pandemic. Given the fast-paced transition to online assessments at the time, the authors saw a unique opportunity to explore accounting educators' experiences and perceptions of assessments conducted in accounting courses in South Africa during this…

Formative assessment is a valuable tool in medical education as it allows students to reflect on their own learning and make necessary corrections. The use of innovative techniques in formative assessment can make it more engaging and effective for students, particularly utilizing electronic tools. A word cloud is a visual representation of data…

This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on…

Comparative studies on paper and pencil--and computer-based tests principally focus on statistical analysis of students' performances. In educational assessment, comparing students' performance (in terms of right or wrong results) does not imply a comparison of problem-solving processes followed by students. In this paper, we present a theoretical…

It is demonstrated that the fully automatic generation of isomorphic questions allows for both repeat assessment, and for this assessment to be individualized. While this does require a substantial up-front effort, once prepared assessments can be reproduced with relative ease and with a near-zero probability of students receiving the same…

Access to high-quality education at scale is limited by the difficulty of providing student feedback on open-ended assignments in structured domains like programming, graphics, and short response questions. This problem has proven to be exceptionally difficult: for humans, it requires large amounts of manual work, and for computers, until…

As classroom diversity increases across educational domains, additional stress is placed on instructors to provide effective and personalised learning experiences. Formative assessments can inform instructors of learning differences between student cohorts and individual students, allowing adaptation of learning experiences to individual student…

This paper reports findings from a research study at The Open University, UK into the quality of distance learners' online exam experience and the differences in experience between online (pandemic) and in-person (pre-pandemic) modes of examination. Our research responds to the ongoing need for greater insight into the exam experience and…

Acid-base chemistry, and in particular the Lewis acid-base model, is foundational to understanding mechanistic ideas. This is due to the similarity in language chemists use to describe Lewis acid-base reactions and nucleophile-electrophile interactions. The development of artificial intelligence and machine learning technologies has led to the…

Purpose: Based on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in…