This article examines whether the way that PISA models item outcomes in mathematics affects the validity of its country rankings. As an alternative to PISA methodology, a two-parameter logistic model is applied to PISA mathematics item data from Italy and Spain for the year 2009. In the estimation procedure, item difficulty and dispersion…

In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

Purpose: The purpose of this paper is to develop a framework for reconceptualising research on school autonomy to redress the limitations of traditional research, strengthen the conceptual links between school autonomy and learning outcomes and offer a range of new strategies for studying the interplay of school autonomy, leadership and learning.…

Bui, Craig, and Imberman assessed the impact of gifted and talented programs on student achievement using regression discontinuity and random assignment to gifted magnet schools. In both analyses, they found minimal impact of the gifted and talented programs on student achievement. This commentary addresses two concerns associated with the study.…

Survey research in education is a popular quantitative research design and is used to determine opinions, attitudes, behavior, habits, and perceptions on a wide variety of topics. While many people are familiar with survey methods, it is often used in a 'quick and dirty' way to get information. This case aims to describe some of the challenges of…

The results of large-scale international assessments such as Programme for International Student Assessment (PISA) have attracted a considerable attention worldwide and are often used by policy-makers to support educational policies. To ensure that the published results represent the actual population, these surveys go through a thorough scrutiny…

There is no doubt that a lesson plan is a necessary product of Lesson Study. However, the collaborative work among teachers that goes into creating that lesson plan is largely under-appreciated by non-Japanese adopters of Lesson Study, possibly because the effort involved is invisible to outsiders, with our attention going to its most visible…

The aim of this study is to evaluate the reasoning skills in geometry-related subjects of six 8th Grade students. The study data were obtained at the end of the 2011-2012 spring period in a public elementary school. The study uses a case study with qualitative research techniques to investigate how students use reasoning skills. In this study, six…

This research aims to produce mathematics problems based on PISA level with valid and practical content of change and relationships and has potential effect for Junior High School students. A development research method developed by Akker, Gravemeijer, McKenney and Nieveen is used this research. This development research consists of three stages;…

Background/Context: Two key uses of international assessments of achievement have been (a) comparing country performances for identifying the countries with the best education systems and (2) generating insights about effective policy and practice strategies that are associated with higher learning outcomes. Do country rankings really reflect the…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

Discusses the need for awareness of real and potential problems in educational evaluation approaches, kinds of problems there are with true experimental designs and with quasi-experimental designs, and the criteria applied by the Joint Dissemination Review Panel to its review of educational programs. (MF)

The definition of test bias--the inventory of the ways in which the term is used--has many widely disparate aspects frequently stemming from entirely different universes of discourse. This article attempts a review of the status of each of these. (Author)

The increasing use of educational performance or outcome measurements for a range of policy purposes points to new procedures for adjusting data for population composition. The purposes include: program formulation, budget resource allocation, grant-in-aid designs, performance incentive payments, consumer information for school selection, and…

Abstracts are presented of the major conference papers and thematic discussions delivered at the 1978 Measurement and Methodology Conference. The titles of the presentations are: Policy-Responsive Evaluation (Wiley); When Educators Set Standards (Glass); Comments on Wiley and Glass (Schutz); Key Standard-Setting Considerations for Minimal…