We presented two empirical studies to assess the efficacy of two Deep Reinforcement Learning (DRL) frameworks on two distinct Intelligent Tutoring Systems (ITSs) to exploring the impact of Worked Example (WE) and Problem Solving (PS) on student learning. The first study was conducted on a probability tutor where we applied a classic DRL to induce…

A key challenge in e-learning environments like Intelligent Tutoring Systems (ITSs) is to induce effective pedagogical policies efficiently. While Deep Reinforcement Learning (DRL) often suffers from "sample inefficiency" and "reward function" design difficulty, Apprenticeship Learning (AL) algorithms can overcome them.…

In interactive e-learning environments such as Intelligent Tutoring Systems, pedagogical decisions can be made at different levels of granularity. In this work, we focus on making decisions at "two levels": whole problems vs. single steps and explore three types of granularity: "problem-level only" ("Prob-Only"),…

In interactive e-learning environments such as Intelligent Tutoring Systems, there are pedagogical decisions to make at two main levels of granularity: whole problems and single steps. Here, we focus on making the problem-level decisions of worked example (WE) vs. problem solving (PS) and the step-level decisions of elicit vs. tell. More…

Background: Computer-based scaffolding has been intensively used to facilitate students' self-regulated learning (SRL). However, most previous studies investigated how computer-based scaffoldings affected the cognitive aspect of SRL, such as knowledge gains and understanding levels. In contrast, more evidence is needed to examine the effects of…

Students learn when they connect new information to existing understanding or when they modify existing understanding to accept new information. Most current teaching methods focus on trying to get students to solve problems in a manner identical to that of an expert. This study investigates the effectiveness of assessing student understanding…

Online planning of good teaching sequences has the potential to provide a truly personalized teaching experience with a huge impact on the motivation and learning of students. In this work we compare two main approaches to achieve such a goal, POMDPs that can find an optimal long-term path, and Multi-armed bandits that optimize policies locally…

An important goal in the design and development of Intelligent Tutoring Systems (ITSs) is to have a system that adaptively reacts to students' behavior in the short term and effectively improves their learning performance in the long term. Inducing effective pedagogical strategies that accomplish this goal is an essential challenge. To address…

In learning systems and environment research, intelligent tutoring and personalisation are considered the two most important factors. An Intelligent Tutoring System can serve as an effective tool to improve problem-solving skills by simulating a human tutor's actions in implementing one-to-one adaptive and personalised teaching. Thus, in this…

In this study, we applied decision trees (DT) to extract a compact set of pedagogical decision-making rules from an original "full" set of 3,702 Reinforcement Learning (RL)- induced rules, referred to as the DT-RL rules and Full-RL rules respectively. We then evaluated the effectiveness of the two rule sets against a baseline Random…

Recent years have seen a growing interest in intelligent game-based learning environments featuring virtual agents. A key challenge posed by incorporating virtual agents in game-based learning environments is dynamically determining the dialogue moves they should make in order to best support students' problem solving. This paper presents a…

Detecting the student internal state during learning is a key construct in educational environment and particularly in Intelligent Tutoring Systems (ITS). Students' uncertainty is of primary interest as it is deeply rooted in the process of knowledge construction. In this paper we propose a new sensor-based multimodal approach to model…

In building intelligent tutoring systems, it is critical to be able to understand and diagnose student responses in interactive problem solving. However, building this understanding into a computer-based intelligent tutor is a time-intensive process usually conducted by subject experts. Much of this time is spent in building production rules that…

This edited volume provides an overview of the latest advancements in adaptive training technology. Intelligent tutoring has been deployed for well-defined and relatively static educational domains such as algebra and geometry. However, this adaptive approach to computer-based training has yet to come into wider usage for domains that are less…

The 9th International Conference on Educational Data Mining (EDM 2016) is held under the auspices of the International Educational Data Mining Society at the Sheraton Raleigh Hotel, in downtown Raleigh, North Carolina, in the USA. The conference, held June 29-July 2, 2016, follows the eight previous editions (Madrid 2015, London 2014, Memphis…