Accurate data extraction is a key component of evidence synthesis and critical to valid results. The advent of publicly available large language models (LLMs) has generated interest in these tools for evidence synthesis and created uncertainty about the choice of LLM. We compare the performance of two widely available LLMs (Claude 2 and GPT-4) for…

This article provides an account of the making of KBLab, the data lab at the National Library of Sweden (KB). The first part discusses the work involved in establishing a lab as both a physical and a digital site for researchers to use digital collections at previously unimaginable scales. The second part explains how the lab has deployed the…

Ithaka S+R's Research Support Services program's most recent project, "Supporting Big Data Research," focused specifically on the rapidly emerging use of big data in research across disciplines and fields. As part of this study, they partnered with librarians from more than 20 colleges and universities, who then conducted over 200…

Increasingly learning analytics (LA) has begun utilising staff- and student-facing dashboards capturing visualisations to present data to support student success and improve learning and teaching. The use of LA is complex, multifaceted and raises many issues for consideration, including ethical and legal challenges, competing stakeholder views and…

In this paper, we propose the Social Semantic Server (SSS) as a service-based infrastructure for workplace and professional learning analytics (LA). The design and development of the SSS have evolved over eight years, starting with an analysis of workplace learning inspired by knowledge creation theories and their application in different…

Research into self-regulated learning has traditionally relied upon self-reported data. While there is a rich body of literature that has extracted invaluable information from such sources, it suffers from a number of shortcomings. For instance, it has been shown that surveys often provide insight into students' perceptions about learning rather…

The basic idea of the research was to take advantage of IT and establish a direct contact between businesses (employers) and universities in order to exchange relevant data on the knowledge, skills and competencies of students who got their first job in the economy. We used the best practices from previous papers that dealt with designing web…

This article describes the crossroads between learning analytics and learner engagement. The authors do this by describing specific challenges of using analytics to support student engagement from three distinct perspectives: pedagogical considerations, technological issues, and interface design concerns. While engaging online learners presents a…