This study compared the problem-solving abilities of ChatGPT and 58 pre-service teachers (PSTs) in solving a mathematical word problem using various strategies. PSTs were asked to solve a problem individually. Data was collected from PSTs' submitted assignments, and their problem-solving strategies were analyzed. ChatGPT was also given the same…

The rapid advancement of artificial intelligence (AI) has given rise to sophisticated language models that excel in understanding and generating human-like text. With the capacity to process vast amounts of information, these models effectively tackle problems across diverse domains. In this paper, we present a comparative analysis of prominent AI…

This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

Generative AI has recently gained the ability to generate computer code. This development is bound to affect how computer programming is taught in higher education. We used past programming assignments and solutions for textbook exercises in our introductory programming class to analyze how accurately one of the leading models, ChatGPT, generates…

In massive open online course (MOOC) environments, computer-based analysis of course reviews enables instructors and course designers to develop intervention strategies and improve instruction to support learners' learning. This study aimed to automatically and effectively identify learners' concerned topics within their written reviews. First, we…

The use of technologies in mathematics education at all levels has been discussed extensively for a number of years. It is one of the few themes that was the object of two ICMI studies, the most recent being published in 2010. Two new approaches, emerging lately in the teaching and learning of Mathematics at all levels, will be discussed:…

The rapid development of large language models (LLMs) presented opportunities for the transformation of science and STEM education. Research on LLMs was in the exploratory phase, characterized by discussions and observations rather than empirical investigations. This study presented a framework for incorporating LLMs into Science and Engineering…

Large language models (LLMs) offer an opportunity to make large-scale changes to educational content that would otherwise be too costly to implement. The work here highlights how LLMs (in particular GPT-4) can be prompted to revise educational math content ready for large scale deployment in real-world learning environments. We tested the ability…

Educators have recognized the importance of providing a realistic learning environment which helps learners to not only comprehend learning content, but also to link the content to practical problems. Such an environment can hence foster problem-solving skills in nursing training. However, when learners interact in a virtual environment with rich…

While commercially available mixed-reality (MR) head-mounted devices are also increasingly used in education the impact of MR learning environments is mostly being evaluated with respect to learning outcomes and learning gains alongside a number of affective variables. Here we aim at a deeper understanding of the influence of MR on experimental…

Large language models (LLMs) offer an opportunity to make large-scale changes to educational content that would otherwise be too costly to implement. The work here highlights how LLMs (in particular GPT-4) can be prompted to revise educational math content ready for large scale deployment in real-world learning environments. We tested the ability…

Purpose: Personas are lifelike characters that are driven by potential or real users' personal goals and experiences when interacting with a product. Personas support user-centered design by focusing on real users' needs. However, the use of personas in educational research and design requires certain adjustments from its original use in…

Machine translation is currently undergoing a paradigm shift from statistical to neural network models. Neural machine translation (NMT) is difficult to conceptualise for translation students, especially without context. This article describes a short in-class evaluation exercise to compare statistical and neural MT, including details of student…

The order of problems presented to students is an important variable that affects learning effectiveness. Previous studies have shown that solving problems in a blocked order, in which all problems of one type are completed before the student is switched to the next problem type, results in less effective performance than does solving the problems…