Background: Process data captured by computer-based assessments provide valuable insight into respondents' cognitive processes during problem-solving tasks. Although previous studies have utilized process data to analyse behavioural patterns or strategies in problem-solving tasks, the connection between latent cognitive states and their…

The Survey of Adult Skills is a product of the Programme for the International Assessment of Adult Competencies (PIAAC) led by the Organisation for Economic Cooperation and Development (OECD). The Survey of Adult Skills aims to measure the skills needed by adults to participate in society and for economies to prosper. The 2023 survey assessed…

Recent economic diversifications of Kazakhstan from over-reliance on the extraction of natural resources are mainly based on increasing the quality of human capital by building a knowledge-based economy as an instrument for long-term sustainable development. In this regard, the paper explores the level of cognitive skills of the adult population…

The action sequences of respondents in problem-solving tasks reflect rich and detailed information about their performance, including differences in problem-solving ability, even if item scores are equal. It is therefore not sufficient to infer individual problem-solving skills based solely on item scores. This study is a preliminary attempt to…

Interactive tasks designed to elicit real-life problem-solving behavior are rapidly becoming more widely used in educational assessment. Incorrect responses to such tasks can occur for a variety of different reasons such as low proficiency levels, low metacognitive strategies, or motivational issues. We demonstrate how behavioral patterns…

This study investigated how one's problem-solving style impacts his/her problem-solving performance in technology-rich environments. Drawing upon experiential learning theory, we extracted two behavioral indicators (i.e., planning duration for problem solving and human-computer interaction frequency) to model problem-solving styles in…

This study analysed two internationally recognised measurements of professional skills: the Programme for the International Assessment of Adult Competencies (PIAAC) and the Digital Competence Framework for Citizens (DigComp 2.2). This analysis aimed to establish a baseline and reference point for a comprehensive understanding of these two scales…

To be able to solve complex information problems in a digital environment is a key 21st century skill. Technology users usually expect to achieve their goals in a fast and accurate way. However, the actual relationship between time-on-task and task outcome is currently not well understood. We analyzed data from a large-scale international study in…

The knowledge-based economy and the information society highlights the importance of developing new competencies for personal, professional and social integration. Problem-solving in technologically rich environments (PS-TREs) is one of these competencies. This research examines the relationships between higher education and the PS-TREs…

The Program for International Assessment of Adult Competencies, better known as PIAAC, developed a numeracy assessment framework that was used internationally to assess adults' numeracy skills. The assessment gauged adults' (aged 16-65 years) numeracy skills across a full range, from adults with very low levels of numeracy to college level math…

This study aims to evaluate the level of Turkish higher education graduates' problem-solving skills (PSSs) in technology-rich environments (TREs) at work and daily life as information and communication technologies are increasingly used in economic and social structure. It also investigates the effects of socio-demographic factors including…

The benefits of incorporating process information in a large-scale assessment with the complex micro-level evidence from the examinees (i.e., process log data) are well documented in the research across large-scale assessments and learning analytics. This study introduces a deep-learning-based approach to predictive modeling of the examinee's…

Problem-solving skills in a digital environment are a prerequisite to a better future for all citizens in the Fourth Industrial Revolution era. To investigate the relationship between age, gender, computer use, and adult learners' problem-solving skills in a digital environment, this study analyzed the 4,540 Korean participants' problem-solving…

The response process of problem-solving items contains rich information about respondents' behaviours and cognitive process in the digital tasks, while the information extraction is a big challenge. The aim of the study is to use a data-driven approach to explore the latent states and state transitions underlying problem-solving process to reflect…

The OECD's Programme for the International Assessment of Adult Competencies (PIAAC) represents a comprehensive international comparative assessment of the information processing skills of adults vital for the full participation in social and economic life in the 21st century. PIAAC is now in its second cycle and continues a series of international…