This study examines potential assessment bias based on students' primary language status in PISA 2018. Specifically, multilingual (MLs) and nonmultilingual (non-MLs) students in the United States are compared with regard to their response time as well as scored responses across three cognitive domains (reading, mathematics, and science).…

Mathematical word problem solving is influenced by various characteristics of the task and the person solving it. Yet, previous research has rarely related these characteristics to holistically answer which word problem requires which set of individual cognitive skills. In the present study, we conducted a secondary data analysis on a dataset of N…

Collaborative problem-solving competence (CPSC) is a core skill in the twenty-first century. As an innovative literacy, CPSC was assessed for the first time in the Program for International Student Assessment (PISA) 2015. Our study aims to identify the effects of student's perceptions toward interpersonal relationships on CPSC in PISA 2015.…

Cross-national comparisons of educational achievement rely upon each participating country collecting nationally representative data. While obtaining high response rates is a key part of reaching this goal, other potentially important factors may also be at play. This paper focuses on one such issue--exclusion rates--which has received relatively…

PISA aims to serve as a "global yardstick" for educational success, as measured by student performance. For comparisons to be meaningful across countries or over time, PISA samples must be representative of the population of 15-year-old students in each country. Exclusions and non-response can undermine this representativeness and…

The teaching guides that complement textbooks have key importance in the assessment of competence in problem solving, because these materials contain the assessment tools that teachers frequently use to quantify the achievements of their students. In this paper, we set two aims: to analyze which curriculum contents are given priority in the…

This colloquium brings information about a second cycle of OECD's International Early Learning and Well-being Study (IELS) to the early childhood community, and offers a further critique of the approach to comparative research that the IELS embodies.

The Survey of Adult Skills is a product of the Programme for the International Assessment of Adult Competencies (PIAAC) led by the Organisation for Economic Cooperation and Development (OECD). The Survey of Adult Skills aims to measure the skills needed by adults to participate in society and for economies to prosper. The 2023 survey assessed…

International large-scale assessments provide cross-national data on students' cognitive and non-cognitive characteristics. A critical methodological issue that often arises in comparing data from cross-national studies is ensuring measurement invariance, indicating that the construct under investigation is the same across the compared groups.…

The Programme for the International Assessment of Adult Competencies (PIAAC) of the Organisation for Economic Co-operation and Development (OECD) has transformed international research and policy debates on the assessment of adult skills. Although research using PIAAC data is accumulating, little is known about how these data are used and what…

The use of multistage adaptive testing (MST) has gradually increased in large-scale testing programs as MST achieves a balanced compromise between linear test design and item-level adaptive testing. MST works on the premise that each examinee gives their best effort when attempting the items, and their responses truly reflect what they know or can…

Questionnaires in educational research assessing students' attitudes and beliefs are low-stakes for the students. As a consequence, students might not always consistently respond to a questionnaire scale but instead provide more random response patterns with no clear link to items' contents. We study inter-individual differences in students'…

In international large-scale assessments, students may not be compelled to answer every test item: a student can decide to skip a seemingly difficult item or may drop out before the end of the test is reached. The way these missing responses are treated will affect the estimation of the item difficulty and student ability, and ultimately affect…

This research aims to describe students' level of algebraic reasoning based on the adversity quotient types of climber, camper, and quitter in solving PISA model mathematics problems. This research is descriptive research with a qualitative approach. The research began by administering a questionnaire to determine the student's adversity quotient…

Nowadays, individuals are expected to be literate in different areas. Mathematical literacy and financial literacy are among them. Mathematical literacy has been evaluated in PISA since 2000 while financial literacy has been included in PISA since 2012. Based on the idea that there is a close relationship between these literacies, in this study…