Background: Learning analytics (LA) research often aggregates learning process data to extract measurements indicating constructs of interest. However, the warranty that such aggregation will produce reliable measurements has not been explicitly examined. The reliability evidence of aggregate measurements has rarely been reported, leaving an…

Studies examining students' learning behavior predominantly employed rich video data as their main source of information due to the limited knowledge of computer vision and deep learning algorithms. However, one of the challenges faced during such observation is the strenuous task of coding large amounts of video data through repeated viewings. In…

Pair programming (PP), as a mode of collaborative problem solving (CPS) in computer programming education, asks two students work in a pair to co-construct knowledge and solve problems. Considering the complex multimodality of pair programming caused by students' discourses, behaviors, and socio-emotions, it is of critical importance to examine…

Aim/Purpose: This article proposes a framework based on a sequential explanatory mixed-methods design in the learning analytics domain to enhance the models used to support the success of the learning process and the learner. The framework consists of three main phases: (1) quantitative data analysis; (2) qualitative data analysis; and (3)…

In an Intelligent Tutoring System (ITS), problem (or question) difficulty is one of the most critical parameters, directly impacting problem design, test paper organization, result analysis, and even the fairness guarantee. However, it is very difficult to evaluate the problem difficulty by organized pre-tests or by expertise, because these…

As students learn how to program, both their programming code and their understanding of it evolves over time. In this work, we present a general data-driven approach, named "Temporal-ASTNN" for modeling student learning progression in open-ended programming domains. Temporal-ASTNN combines a novel neural network model based on abstract…

Aim/Purpose: Although many computer science measures have been proposed, visualizing individual students' capabilities is difficult, as those measures often rely on specific tools and methods or are not graded. To solve these problems, we propose a rubric for measuring and visualizing the effects of learning computer programming for elementary…

In recent years, learning process data have become increasingly easy to collect through computer-based learning environments. This has led to increased interest in the field of "learning analytics," which is concerned with leveraging learning process data in order to better understand, and ultimately to improve, teaching and learning. In…