Assessing students' answers and in particular natural language answers is a crucial challenge in the field of education. Advances in transformer-based models such as Large Language Models (LLMs), have led to significant progress in various natural language tasks. Nevertheless, amidst the growing trend of evaluating LLMs across diverse tasks,…

The current educational system relies heavily on manual grading, posing challenges such as delayed feedback and grading inaccuracies. Automated grading tools (AGTs) offer solutions but come with limitations. To address this, "GRAD-AI" is introduced, an advanced AGT that combines automation with teacher involvement for precise grading,…

This paper proposes to evaluate learning efficiency by implementing the flipped classroom and automatic source code evaluation based on the Kirkpatrick evaluation model in students of CS1 programming course. The experimentation was conducted with 82 students from two CS1 courses; an experimental group (EG = 56) and a control group (CG = 26). Each…

Background and Context: Auto-graders are praised by novice students learning to program, as they provide them with automatic feedback about their problem-solving process. However, some students often make random changes when they have errors in their code, without engaging in deliberate thinking about the cause of the error. Objective: To…

Most existing autograders used for grading programming assignments are based on unit testing, which is tedious to implement for programs with graphical output and does not allow testing for other code aspects, such as programming style or structure. We present a novel autograding approach based on machine learning that can successfully check the…

Generative Artificial Intelligence (GenAI) is transforming education, with assessment design emerging as a crucial area of innovation, particularly in computer science (CS) education. Effective assessment is critical for evaluating student competencies and guiding learning processes, yet traditional practices face significant challenges in CS…

Access to high-quality education at scale is limited by the difficulty of providing student feedback on open-ended assignments in structured domains like programming, graphics, and short response questions. This problem has proven to be exceptionally difficult: for humans, it requires large amounts of manual work, and for computers, until…

Making accurate judgements and interpretations about student growth and progress in mathematics can be problematic when using open-ended assessments. This study reports on the development of a class-based assessment instrument and marking key designed to assess Year 2 students' mathematics competence to reflect their learning of mathematics…

Recently, massive open online courses (MOOCs) have been offering a new online approach in the field of distance learning and online education. A typical MOOC course consists of video lectures, reading material and easily accessible tests for students. For a computer programming course, it is important to provide interactive, dynamic, online coding…

There does not appear to be consensus on how to optimally match students during the peer feedback process: with same-ability peers (homogeneously) or different-ability peers (heterogeneously). In fact, there appears to be no empirical evidence that either homogeneous or heterogeneous student matching has any direct effect on writing performance.…

The purpose of this study was to understand students' perspectives on the role of homework. Middle school students (N = 506) volunteered to complete open-ended surveys describing their perceptions regarding the effectiveness of homework. Qualitative analysis revealed that students identified several instructional and noninstructional reasons for…

This article explores the suitability of static analysis techniques based on the abstract syntax tree (AST) for the automated assessment of early/mid degree level programming. Focus is on fairness, timeliness and consistency of grades and feedback. Following investigation into manual marking practises, including a survey of markers, the assessment…

A multi-disciplinary academic unit at a Canadian university completed an evaluation of course syllabi used in its undergraduate programmes over the previous five years. This paper examines the reasons for the evaluation, the processes employed to collect and analyse the data, and how the results will be incorporated into the next steps of the…

Variations of the question, "How are you doing in school?" are among those most frequently posed by adults to students (Reeves, 2004). Grades represent the primary source of that information; indeed, Olson (1995) called grades "one of the most sacred traditions in American education" (p. 24). There is so much trust in the…

This study explores the experience of becoming an elementary teacher in an educational climate where standardization and accountability increasingly affect what happens in classrooms across the country by following two beginning teachers. Specifically, this longitudinal study in which two first-year teachers' stories are analyzed and restoried…