Missing data are common with large scale assessments (LSAs). A typical approach to handling missing data with LSAs is the use of listwise deletion, despite decades of research showing that approach can be a suboptimal strategy resulting in biased estimates. In order to help researchers account for missing data, we provide a tutorial using R and…

Recognising the importance of developing creativity in education, the Programme for International Student Assessment (PISA) included an assessment of creative thinking for the first time in its 2022 cycle -- with the results summarised in the PISA 2022 Results (Volume III) report. While that report focused on comparing countries' performance on…

This study examines potential assessment bias based on students' primary language status in PISA 2018. Specifically, multilingual (MLs) and nonmultilingual (non-MLs) students in the United States are compared with regard to their response time as well as scored responses across three cognitive domains (reading, mathematics, and science).…

Mathematical word problem solving is influenced by various characteristics of the task and the person solving it. Yet, previous research has rarely related these characteristics to holistically answer which word problem requires which set of individual cognitive skills. In the present study, we conducted a secondary data analysis on a dataset of N…

Collaborative problem-solving competence (CPSC) is a core skill in the twenty-first century. As an innovative literacy, CPSC was assessed for the first time in the Program for International Student Assessment (PISA) 2015. Our study aims to identify the effects of student's perceptions toward interpersonal relationships on CPSC in PISA 2015.…

Cross-national comparisons of educational achievement rely upon each participating country collecting nationally representative data. While obtaining high response rates is a key part of reaching this goal, other potentially important factors may also be at play. This paper focuses on one such issue--exclusion rates--which has received relatively…

While methodologies are often presented as standardised procedures which, under specified conditions, should lead to the same conclusions, this case study presents the complex and deeply personal process of research (Addey and Piattoeva 2022). We analyse our application of network ethnography -- an approach presented by Ball (2016) -- to the study…

PISA aims to serve as a "global yardstick" for educational success, as measured by student performance. For comparisons to be meaningful across countries or over time, PISA samples must be representative of the population of 15-year-old students in each country. Exclusions and non-response can undermine this representativeness and…

This colloquium brings information about a second cycle of OECD's International Early Learning and Well-being Study (IELS) to the early childhood community, and offers a further critique of the approach to comparative research that the IELS embodies.

The Survey of Adult Skills is a product of the Programme for the International Assessment of Adult Competencies (PIAAC) led by the Organisation for Economic Cooperation and Development (OECD). The Survey of Adult Skills aims to measure the skills needed by adults to participate in society and for economies to prosper. The 2023 survey assessed…

The advancement of technology has led to a growing interest in assessing scientific inquiry within digital platforms. This shift towards dynamic and interactive inquiry assessments enables researchers to investigate not only the accuracy of student responses ("product data") but also their steps and actions leading to those responses…

International large-scale assessments provide cross-national data on students' cognitive and non-cognitive characteristics. A critical methodological issue that often arises in comparing data from cross-national studies is ensuring measurement invariance, indicating that the construct under investigation is the same across the compared groups.…

The Programme for the International Assessment of Adult Competencies (PIAAC) of the Organisation for Economic Co-operation and Development (OECD) has transformed international research and policy debates on the assessment of adult skills. Although research using PIAAC data is accumulating, little is known about how these data are used and what…

The use of multistage adaptive testing (MST) has gradually increased in large-scale testing programs as MST achieves a balanced compromise between linear test design and item-level adaptive testing. MST works on the premise that each examinee gives their best effort when attempting the items, and their responses truly reflect what they know or can…

Questionnaires in educational research assessing students' attitudes and beliefs are low-stakes for the students. As a consequence, students might not always consistently respond to a questionnaire scale but instead provide more random response patterns with no clear link to items' contents. We study inter-individual differences in students'…