The use of multistage adaptive testing (MST) has gradually increased in large-scale testing programs as MST achieves a balanced compromise between linear test design and item-level adaptive testing. MST works on the premise that each examinee gives their best effort when attempting the items, and their responses truly reflect what they know or can…

The Programme for International Student Assessment (PISA) introduced creative thinking as an innovative domain in 2022. This paper examines the unique methodological issues in international assessments and the implications of measuring creative thinking within PISA's framework, including stratified sampling, rotated form designs, and a distinct…

Multiple group modeling is one of the methods to address the measurement noninvariance issue. Traditional studies on multiple group modeling have mainly focused on item responses. In computer-based assessments, joint modeling of response times and action counts with item responses helps estimate the latent speed and action levels in addition to…

The process of quantification is a powerful development shaping many domains of life today. In the area of education, for example, performance measurement, testing and ranking have become common tools of governance. Quantification is not a neutral way of describing society, but a process of valorisation. It has three sociologically relevant…

South Australia's PISA performance has been in constant decline since 2003 with the proportion of PISA participants meeting the Australian national proficient standard dropping from 73% (in 2003) to 50% (in 2018). In contrast, Singapore is a consistently strong performer. To better understand student readiness in answering PISA questions, this…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

Collaboration is a complex skill, comprised of multiple subskills, that is of growing interest to policy makers, educators and researchers. Several definitions and frameworks have been described in the literature to support assessment of collaboration; however, the inherent structure of the construct still needs better definition. In 2015, the…

Large-scale assessment programs such as the National Assessment of Educational Progress (NAEP), Trends in International Mathematics and Science Study (TIMSS), and Programme for International Student Assessment (PISA) use a sophisticated assessment administration design called matrix sampling that minimizes the testing burden on individual…

The Organisation for Economic Cooperation and Development (OECD) has developed impressive machinery to produce international comparative data across more than 70 systems of education and these data have come to be used extensively in policy circles around the world. In many countries, national and international comparative data are used as the…

Purpose: This paper presents a moderated discussion on popular misconceptions, benefits and limitations of International Large-Scale Assessment (ILSA) programs, clarifying how ILSA results could be more appropriately interpreted and used in public policy contexts in the USA and elsewhere in the world. Design/methodology/approach: To bring key…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…

The Australian Council for Educational Research (ACER) is one of the world's leading educational research centres. ACER's mission is to create and promote research-based knowledge, products and services that can be used to improve learning across the life span. This annual report describes ACER's milestones and accomplishments for the 2015-2016…

Not much is known about the ways in which assessment data have actually been used in education policy to date. Understanding the role of assessments in informing system-level decision-making is a first step towards helping stakeholders improve the design and usefulness of assessments. Moreover, this understanding can help to further discussions…

The general thesis of this paper is that the motives of the currently dominant global educational governance are rooted in a specific cultural milieu in the time of the Cold War, more precisely in the late 1950s, heading to a harmonious world. The more specific thesis is that a series of failures in the achievement of this harmonized globe led to…

The Australian Council for Educational Research (ACER) is one of the world's leading educational research centres. ACER's mission is to create and promote research-based knowledge, products and services that can be used to improve learning across the life span. This annual report describes ACER's milestones and accomplishments for the 2016-2017…