International large-scale assessments provide cross-national data on students' cognitive and non-cognitive characteristics. A critical methodological issue that often arises in comparing data from cross-national studies is ensuring measurement invariance, indicating that the construct under investigation is the same across the compared groups.…

The accuracy of learning results relies on the evaluation and assessment. The learning goals, including problem solving ability must be aligned with the valid standardized measurement tools. The study on exploring the nature of problem-solving, framework, and assessment in the Indonesian context will make contributions to problem solving…

This study aims to describe: (1) The validity and reliability of the PISA model mathematical problems on the change and relationship content developed; (2) The practicality of PISA mathematical problem models on the developed change and relationship content; (3) Students' mathematical problem-solving abilities on mathematical problems in the PISA…

Since 2000, the PISA test implemented by OECD has become the prime benchmark for international comparisons in education. The 2015 PISA edition introduced methodological changes that altered the nature of its results. PISA made no longer valid non-reached items of the final part of the test, assuming that those unanswered questions were more a…

With rising importance of collaborative problem-solving skills (CLPS) for the new information age, the PISA 2015 assessed students' CLPS skills on a large scale. This new attempt to measure CLPS raises an issue of validity. The purpose of this research is to examine evidence for convergent validity of CLPS through investigating the relationships…

This study aims to develop a math problem type PISA to familiarize students using problems with PISA standard and produces a valid, practical, PISA context of Bangka (Tanjung Kalian Lighthouse) type and see the Basic Math Skills (BMS) seen from the context of Tanjung Kalian lighthouse. The research method used is design research with the type of…

PISA [Programme for International Student Assessment] will be in the news again this year. The 2018 results are due to be released at the end of 2019 and they usually generate media interest. This Rangahau Whakarapopoto is a research brief which outlines things to watch out for as you think about what the results might mean.

In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

Open-ended (OE) items are widely used to gather data on student performance in international achievement studies. However, several factors may threaten validity when using such items. This study examined Finnish coders' opinions about threats to validity when coding responses to OE items in the PISA 2012 problem-solving test. A total of 6…

Purpose: This policy brief, the third in the AERI-NEPC eBrief series "Understanding validity issues around the world", discusses validity issues surrounding International Large Scale Assessment (ILSA) programs. ILSA programs, such as the well-known Programme of International Student Assessment (PISA) and the Trends in International…

Scholastic tests regard cognitive abilities to be domain-specific competences. However, high correlations between competences indicate either high task similarity or a dependence on common factors. The present rating study examined the validity of 12 Programme for International Student Assessment (PISA) and Third or Trends in International…

The results of large-scale international assessments such as Programme for International Student Assessment (PISA) have attracted a considerable attention worldwide and are often used by policy-makers to support educational policies. To ensure that the published results represent the actual population, these surveys go through a thorough scrutiny…

Those who work in second- and foreign-language testing often find Koretz's concern for validity inferences under high-stakes (VIHS) conditions both welcome and familiar. While the focus of the article is more narrowly on the potential for two instructional responses to test-based accountability, "reallocation" and "coaching,"…

The Organization for Economic Cooperation and Development [OECD] is a global policy organization that includes the United States and about half of the Western Europe countries. It administers international comparison tests, called Programme for International Student Assessment (PISA), for 15 year-old students in Mathematics and other subjects. I…

Quantitative literacy has been recognized as an important skill in the higher education and workforce communities, focusing on problem solving, reasoning, and real-world application. As a result, there is a need by various stakeholders in higher education and workforce communities to evaluate whether college students receive sufficient training on…