This study presents several multivariate Generalizability theory designs for analyzing automatic item-generated (AIG) based test forms. The study used real data to illustrate the analysis procedure and discuss practical considerations. We collected the data from two groups of students, each group receiving a different form generated by AIG. A…

Generative artificial intelligence (GenAI) has opened new possibilities for designing learning analytics (LA) tools, gaining new insights about student learning processes and their environment, and supporting teachers in assessing and monitoring students. This systematic literature review maps the empirical research of 41 papers utilizing GenAI…

The Powerful Learning with Computational Thinking report explains how the Digital Promise team works with districts, schools, and teachers to make computational thinking ideas more concrete to practitioners for teaching, design, and assessment. We describe three powerful ways of using computers that integrate well with academic subject matter and…

Background: Traditional survey efforts to gather outcome data at scale have significant limitations, including cost, time, and respondent burden. This pilot study explored new and innovative large-scale methods of collecting and validating data from publicly available sources. Taking advantage of emerging data science techniques, we leverage…

The world of work is being impacted by a fourth industrial revolution, transformed by artificial intelligence and other emerging technologies. With forecasts suggesting large shares of workers, displaced by automation, in need of upskilling/reskilling, the design of active skills policies is necessary. Conventional methods used to anticipate…

The world of work is being impacted by a fourth industrial revolution, transformed by artificial intelligence and other emerging technologies. With forecasts suggesting large shares of workers, displaced by automation, in need of upskilling/reskilling, the design of active skills policies is necessary. Conventional methods used to anticipate…

The world of work is being impacted by a fourth industrial revolution, transformed by artificial intelligence and other emerging technologies. With forecasts suggesting large shares of workers, displaced by automation, in need of upskilling/reskilling, the design of active skills policies is necessary. Conventional methods used to anticipate…

When used effectively, reflective writing tasks can deepen learners' understanding of key concepts, help them critically appraise their developing professional identity, and build qualities for lifelong learning. As such, reflective writing is attracting substantial interest from universities concerned with experiential learning, reflective…

Orchestrating collaborative learning in the classroom involves tasks such as forming learning groups with heterogeneous knowledge and making learners aware of the knowledge differences. However, gathering information on which the formation of appropriate groups and the creation of graphical knowledge representations can be based is very effortful…

Effective mining of data from online submission systems offers the potential to improve educational outcomes by identifying student habits and behaviours and their relationship with levels of achievement. In particular, it may assist in identifying students at risk of performing poorly, allowing for early intervention. In this paper we investigate…

This commentary reflects on the contributions to learning analytics and theory by a paper that describes how multiple theoretical frameworks were woven together to inform the creation of a new, automated discourse analysis tool. The commentary highlights the contributions of the original paper, provides some alternative approaches, and touches on…

This paper describes theory-led design as a way of developing novel tools for learning analytics (LA). It focuses upon the domain of automated discourse analysis (ADA) of group learning activities to help an instructor to orchestrate online groups in real-time. The paper outlines the literature on the development of LA tools within the domain of…

The "2015 NMC Technology Outlook for Brazilian Universities" is a collaborative research effort between the New Media Consortium and Saraiva to inform Brazilian higher education leaders and decision-makers about important developments in technologies supporting teaching, learning, and creative inquiry in higher education across the…

New high-frequency, automated data collection and analysis algorithms could offer new insights into complex learning processes, especially for tasks in which students have opportunities to generate unique open-ended artifacts such as computer programs. These approaches should be particularly useful because the need for scalable project-based and…

The "2014 NMC Technology Outlook for Brazilian Universities: A Horizon Project Regional Report" reflects a collaborative research effort between the New Media Consortium (NMC) and Saraiva to help inform education leaders in Brazil about significant developments in technologies supporting teaching, learning, and creative inquiry in higher…