With the growing attention on large-scale educational testing and assessment, the ability to process substantial volumes of response data becomes crucial. Current estimation methods within item response theory (IRT), despite their high precision, often pose considerable computational burdens with large-scale data, leading to reduced computational…

State education agencies are sitting on rich repositories of quantitative and qualitative assessment data. This document is designed to provide a conceptual framework and implementation guidance that can help agency leadership leverage and interrogate student performance data in systematic ways for reporting, outreach, and planning purposes. The…

In February 2018, the IIEP-UNESCO Office in Dakar, with the support of Agence Française de Développement, launched a programme to support the monitoring of education quality in sub-Saharan Africa. The programme's primary objective is to assist education authorities in diagnosing and regulating their practices across all levels, contributing to the…

IES is the primary research, evaluation, and statistics arm of the U.S. Department of Education. Established through the Education Sciences Reform Act of 2002 (ESRA), the Institute's mission is to expand fundamental knowledge and understanding of education and to provide education leaders and practitioners, parents and students, researchers, and…

This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

This article considers the role played by policy makers, government organisations, and research institutes (sometimes labelled "think tanks") in the analysis, use and reporting of PISA data for the purposes of policy advice and advocacy. It draws on the ideas of Rizvi and Lingard (Globalizing Education Policy, 2010), Bogdandy and…

Monitoring Trends in Educational Growth (MTEG) offers a flexible, collaborative approach to developing and implementing an assessment of learning outcomes that yields high-quality, nationally relevant data. MTEG is a service that involves ACER staff working closely with each country to develop an assessment program that meets the country's…

Massive population shift is a current global reality--especially given some of the latest development on European shores; some are calling it a humanitarian crisis. Although the United States (US) receives a large number of immigrants (documented and not) and about 70,000 refugees each year, it is certainly not the only nation to do so.…

This paper provides evidence on the sources of differences in inequality in educational scores and their evolution over time in four European countries. Using Programme for International Student Assessment data from the 2000 and the 2006 waves, the paper shows that inequality decreased in Germany and Spain (two "decentralised" schooling…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

Results from international large-scale assessments (ILSAs) garner considerable attention in the media, academia, and among policy makers. Although there is widespread recognition that ILSAs can provide useful information, there is debate about what types of comparisons are the most meaningful and what could be done to assure more sound…

One major issue with large-scale assessments is that the respondents might give no responses to many items, resulting in less accurate estimations of both assessed abilities and item parameters. This report studies how the types of items affect the item-level nonresponse rates and how different methods of treating item-level nonresponses have an…

International comparative testing, such as the OECD Programme for International Student Assessment (PISA), has considerable impact on policy-makers, the media and the general public. A central assumption underlying PISA is that global variation in students' academic performance is attributable to national educational structures and policies. The…

Reports of international large-scale assessments tend to evaluate and compare education system performance based on absolute scores. And policymakers refer to high-performing and economically prosperous education systems to enhance their own systemic features. But socioeconomic differences between systems compromise the plausibility of those…

Secretary of Education Duncan (2010) lamented the state of U.S. education in 2010 after the release of the results from the 2009 Programme for International Student Assessment (PISA). He wrote: "Unfortunately, the 2009 PISA results show that American students are poorly prepared to compete in today's knowledge economy. President Obama has…