Programming demands a variety of cognitive skills, and mastering these competencies is essential for success in computer science education. The importance of formative feedback is well acknowledged in programming education, and thus, a diverse range of techniques has been proposed to generate and enhance formative feedback for programming…

ChatGPT and other large language models (LLMs) have the potential to significantly disrupt common educational practices and assessments, given their capability to quickly generate human-like text in response to user prompts. LLMs GPT-3.5 and GPT-4 have been tested against many standardized and high-stakes assessment materials (e.g. SAT, Uniform…

This activity prompts students to go beyond the often reductionist responses to new technologies (e.g. technological determinism) by creating a media literacy-focused infographic about the role, uses, ethical concerns, and/or impact of generative AI (e.g. ChatGPT). Sample topics have included the role of AI in specific industries (e.g. film,…

Providing consistent, individualized feedback to teachers is essential for improving instruction but can be prohibitively resource-intensive in most educational contexts. We develop M-Powering Teachers, an automated tool based on natural language processing to give teachers feedback on their uptake of student contributions, a high-leverage…

In this study, we introduce a framework designed to help educators assess the effectiveness of popular generative artificial intelligence (AI) tools in solving authentic assessments. We employed Bloom's taxonomy as a guiding principle to create authentic assessments that evaluate the capabilities of generative AI tools. We applied this framework…

In postsecondary education institutions, where innovative technologies continually reshape research and pedagogical approaches, the integration of generative artificial intelligence (GenAI) tools presents promising avenues for enhancing student learning experiences. This study assesses the efficacy of integrating GenAI tools, specifically…

Various studies empirically proved the value of highly informative feedback for enhancing learner success. However, digital educational technology has yet to catch up as automated feedback is often provided shallowly. This paper presents a case study on implementing a pipeline that provides German-speaking university students enrolled in an…

This study explored the effectiveness of scaffolding in students' reflection writing process. We compared two sections of an introductory computer programming course (N=188). In Section 1, students did not receive any scaffolding while generating reflections, whereas in Section 2, students were scaffolded during the reflection writing process.…

Generative large language models (LLMs) like ChatGPT can quickly produce informative essays on various topics. However, the information generated cannot be fully trusted, as artificial intelligence (AI) can make factual mistakes. This poses challenges for using such tools in college classrooms. To address this, an adaptable assignment called the…

[This paper is part of the Focused Collection in Investigating and Improving Quantum Education through Research.] The modern physics course is a crucial gateway for physics majors as it provides an introduction to concepts beyond the scope of the K-12 education. This study collected 167 modern physics syllabi from 127 U.S. research-intensive…

Large language models (LLMs), such as Codex, hold great promise in enhancing programming education by automatically generating feedback for students. We investigate using LLMs to generate feedback for fixing syntax errors in Python programs, a key scenario in introductory programming. More concretely, given a student's buggy program, our goal is…

This exploratory study focuses on the use of ChatGPT, a generative artificial intelligence (GAI) tool, by undergraduate engineering students in lab report writing in the major. Literature addressing the impact of ChatGPT and AI on student writing suggests that such technologies can both support and limit students' composing and learning processes.…

Online education, while not a new phenomenon, underwent a monumental shift during the COVID-19 pandemic, pushing educators and students alike into the uncharted waters of full-time digital learning. With this shift came renewed concerns about the integrity of online assessments. Amidst a landscape rapidly being reshaped by online exam/homework…

The emergence of AI-powered Large Language Models (LLMs), such as ChatGPT and Google Gemini, presents both opportunities and challenges for higher education, particularly regarding academic integrity in writing instruction. This exploratory study examines a novel pedagogical approach that integrates LLMs as required feedback tools in a…

Massive pretrained language models have garnered attention and controversy due to their ability to generate humanlike responses: Attention due to their frequent indistinguishability from human-generated phraseology and narratives and controversy due to the fact that their convincingly presented arguments and facts are frequently simply false. Just…