This paper examines policy responses across Canada to international student assessment programs such as the program for international student assessment, trends in international mathematics and science study, and progress in international reading and literacy study. Literature reviewed included refereed and non-refereed journal articles,…

Background: While illustrations are widely used in international test comparisons, very scant research has been conducted on their design and on their influence on student performance. It is not clear how the features of illustration act in combination supporting students' access to the content of items or increasing their interpretation demands.…

Recent policy suggestions from the European Community underlined the importance of "efficiency" and "equity" in the provision of education while, at the same time, the European countries are required to provide their educational services by minimizing the amount of public money devoted to them. In this article, an empirical…

Massive population shift is a current global reality--especially given some of the latest development on European shores; some are calling it a humanitarian crisis. Although the United States (US) receives a large number of immigrants (documented and not) and about 70,000 refugees each year, it is certainly not the only nation to do so.…

PISA claims that it can extend its reach from its current core subjects of Reading, Science, Maths and problem-solving. Yet given the requirement for high levels of reliability for PISA, especially in the light of its current high stakes character, proposed widening of its subject coverage cannot embrace some important aspects of the social and…

Trying to understand PISA is analogous to the parable of the blind men and the elephant. There are many facets of the PISA program, and thus many ways to both applaud and critique this ambitious international program of assessment that has gained enormous importance in the crafting of contemporary educational policy. One of the facets discussed in…

Results from international large-scale assessments (ILSAs) garner considerable attention in the media, academia, and among policy makers. Although there is widespread recognition that ILSAs can provide useful information, there is debate about what types of comparisons are the most meaningful and what could be done to assure more sound…

One major issue with large-scale assessments is that the respondents might give no responses to many items, resulting in less accurate estimations of both assessed abilities and item parameters. This report studies how the types of items affect the item-level nonresponse rates and how different methods of treating item-level nonresponses have an…

International comparative testing, such as the OECD Programme for International Student Assessment (PISA), has considerable impact on policy-makers, the media and the general public. A central assumption underlying PISA is that global variation in students' academic performance is attributable to national educational structures and policies. The…

Traditional estimators of item response theory scale scores ignore uncertainty carried over from the item calibration process, which can lead to incorrect estimates of the standard errors of measurement (SEMs). Here, the authors review a variety of approaches that have been applied to this problem and compare them on the basis of their statistical…

In this study, we use decomposition methods on PISA 2006 data to compare student academic performance across OECD countries. We first establish an empirical model to explain the variation in academic performance across individuals, and then use the Oaxaca-Blinder decomposition method to decompose the achievement gap between each of the OECD…

Reports of international large-scale assessments tend to evaluate and compare education system performance based on absolute scores. And policymakers refer to high-performing and economically prosperous education systems to enhance their own systemic features. But socioeconomic differences between systems compromise the plausibility of those…

Very little Canadian research has examined the academic achievement of private school students. Data from The Programme for International Student Assessment (PISA) 2003 were used to examine the achievement of private school students. The study found that private school students outperformed their public school peers. In addition, the students'…

Pundits and bureaucrats use the results from international tests, particularly the PISA, to make claims about the quality of the public education system in the United States and make policy recommendations. In this article I argue, with evidence, that the scores and rankings from PISA are not important and that they cannot give policy makers or…

Secretary of Education Duncan (2010) lamented the state of U.S. education in 2010 after the release of the results from the 2009 Programme for International Student Assessment (PISA). He wrote: "Unfortunately, the 2009 PISA results show that American students are poorly prepared to compete in today's knowledge economy. President Obama has…