Objectives: Java is a popular programming language for use in computing education, but it is difficult to get a wide picture of the issues that it presents for novices; most studies look only at the types or frequency of errors. In this observational study, we aim to learn how novices use different features of the Java language. Participants:…

This paper describes a method to collect data of which section of pages learners were browsing in digital textbooks without eye-tracking technologies. In previous researches on digital textbook systems, it was difficult to collect such data without using eye-tackers. However, eye-trackers cost a massive budget. Our proposed system automatically…

Item harvesters who memorize, record and share test items can jeopardize the validity and fairness of credentialing tests. Item harvesting behaviors are difficult to detect by the existing statistical modeling approaches due to the absence of operational definitions and the idiosyncratic nature of human behaviors. Motivated to detect the…

Within classrooms, psychologists and teachers use direct behavior observation methods, systematic behavior observations (SBOs) and direct behavior ratings (DBRs), to gather information about students' behaviors for the purposes of making decisions related to diagnosis and classroom management or behavioral feedback respectively. Observers use SBOs…

We present an empirical study on the use of keystroke analytics to capture and understand how writers manage their time and make inferences on how they allocate their cognitive resources during essay writing. The results suggest three distinct longitudinal patterns of writing process that describe how writers approach an essay task in a writing…

Learning analytics (LA) is a significant field of study to examine and identify difficulties the novice programmers face while learning how to program. Despite producing notable research by the community in the specified area, rare work is observed to synthesize these research efforts and discover the dimensions that guide the future research of…

The increased adoption of online learning environments has resulted in the availability of vast amounts of educational log data, which raises questions that could be answered by a thorough and accurate examination of students' online learning behaviours. Event logs describe something that occurred on a platform and provide multiple dimensions that…

Interactive tasks designed to elicit real-life problem-solving behavior are rapidly becoming more widely used in educational assessment. Incorrect responses to such tasks can occur for a variety of different reasons such as low proficiency levels, low metacognitive strategies, or motivational issues. We demonstrate how behavioral patterns…

As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

Academic department chairs are key in helping universities achieve student success. To succeed in their decisions and furthering their university's educational mission, department chairs can use institutional data to inform their decision-making. In many cases, however, there are gaps, misalignments, and inefficiencies between department chairs…

Process mining methodologies are designed to uncover underlying business processes, deviations from them, and in general, usage patterns. One of the key limitations of these methodologies is that they struggle in cases in which there is no structured process, or when a process can be performed in many ways. Learning Management Systems are a…

Arguably one of the most valuable tools for investigating pupil behaviour in an educational environment is systematic classroom observation. Classroom observation is often cited as having the potential to enable research of the learning process in action. Low inference classroom observation instruments are designed to record a sequence of data…

The research on using event logs and item response time to study test-taking processes is rapidly growing in the field of educational measurement. In this study, we analyzed the keystroke logs collected from 761 middle school students in the United States as they completed a persuasive writing task. Seven variables were extracted from the…

The last two decades have witnessed a quick shift from pen-and-paper writing to computer keyboard writing. Corresponding to this shift in the writing medium are vigorous research efforts to understand new features of writing in computer keyboard settings. Using Inputlog7.0, this study investigated the writing process of 60 Chinese English as a…

As online learning platforms and computerized testing become more common, an increasing amount of data are collected about users. These data include, but are not limited to, response time, keystroke logs, and raw text. The desire to observe these features of the response process reflect an underlying interest in the cognitive processes and…