Most studies suggest that students develop computational thinking (CT) through learning programming. However, when the target of CT is decoupled from programming, emerging evidence challenges the assertion of CT transferability from programming. In this study, CT was operationalized in everyday problem-solving contexts in a learning experiment (n…

Given the ongoing development of computer-based tasks, there has been increasing interest in modelling students' behaviour indicators from log file data with contextual variables collected via questionnaires. In this work, we apply a latent regression model to analyse the relationship between latent constructs (i.e., performance, speed, and…

Collaboration is a complex skill, comprised of multiple subskills, that is of growing interest to policy makers, educators and researchers. Several definitions and frameworks have been described in the literature to support assessment of collaboration; however, the inherent structure of the construct still needs better definition. In 2015, the…

In the digital era, traditional communication has undergone a drastic transformation into computer-mediated communication (CMC), which can be classified into synchronous CMC (SCMC) and asynchronous CMC (ASCMC). This study compared the effects of extracurricular CMC among students about schoolwork on students' digital reading achievement between…

This paper uses data from the OECD's 2015 PISA and an endogenous treatment effects model to investigate the impact of different intensities of digital device use for academic purposes on science learning outcomes. When we do not differentiate the location of device use, we find that greater use can help students improve their science scores in…

Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is…

Examining the testing processes, as well as the scores, is needed for a complete understanding of validity and fairness of computer-based assessments. Examinees' rapid-guessing and insufficient familiarity with computers have been found to be major issues that weaken the validity arguments of scores. This study has three goals: (a) improving…

The analyses presented in this report indicate that in several Member States (MS) 15-year-old students in vocational-oriented programmes (VET) perform better in digital reading than in print reading in PISA 2012. When differentiated by programme of study--VET versus general education programmes--VET students perform better in digital than in print…

Abstract The 2015 Programme for International Student Assessment (PISA) has drawn a substantial amount of attention from science educators and educational policymakers because it marked the first time that PISA assessed students' ability to evaluate and design scientific inquiry using computer-based simulations. We undertook a secondary analysis…

The Programme for International Student Assessment (PISA) is an important cross-national study of 15-year-olds' academic knowledge and skills. Educationalists and public policymakers eagerly await the tri-annual results, with particular interest in whether their country has moved up or slid down the international rankings, as compared to earlier…

The Programme for International Assessment (PISA) is an important cross-national study of 15-year olds academic achievement. Although it has traditionally been conducted using paper-and-pencil tests, the vast majority of countries will use computer-based assessment from 2015. In this paper, we consider how cross-country comparisons of children's…

Test results from the Program for International Student Assessment (PISA) reveal that Shanghai students performed less well in solving interactive problems (those that require uncovering necessary information) than in solving analytical problems (those having all information disclosed at the outset). Accordingly, this study investigates…

Complex Problem Solving (CPS) is seen as a cross-curricular 21st century skill that has attracted interest in large-scale-assessments. In the Programme for International Student Assessment (PISA) 2012, CPS was assessed all over the world to gain information on students' skills to acquire and apply knowledge while dealing with nontransparent…

Program for International Student Assessment results indicate that while reading comprehension needs to be promoted, teachers are struggling to find ways to motivate students to do reading comprehension activities and although technology-enhanced learning approaches are entering the classroom, researchers are still experimenting with them to…

This study tested the effects of the modality of reading formats (electronic vs. print), online reading habits (engagement in different online reading activities), use of cognitive strategies, metacognitive knowledge, and navigation skills on printed and electronic reading literacy across regions. Participants were 31,784 fifteen-year-old students…