This paper contributes to a growing body of research on the increasing datafication of schooling, which has become a salient topic in comparative education and education policy research. Specifically, we address the rising scholarly concern about the meaning of (comparing) contexts as bounded localities facing an increasingly fluid and generative…

International Large-Scale Assessments (ILSAs) have been used to draw comparisons among countries on a variety of topics in education and, more broadly, for example, in adolescent development. These assessments can inform the public about influential factors on the micro and macro levels, foster interdisciplinary and international collaboration,…

Not much is known about the ways in which assessment data have actually been used in education policy to date. Understanding the role of assessments in informing system-level decision-making is a first step towards helping stakeholders improve the design and usefulness of assessments. Moreover, this understanding can help to further discussions…

Randomization tests have been suggested as a method for analyzing the data from single-case designs. This paper explores three concerns which have arisen: the nonresponsive nature of randomization tests, the appropriateness of specific test statistics and the power of these tests. An example is given to illustrate how partial control can be given…

The National Assessment of Educational Progress (NAEP) is an enormous and enormously ambitious project. It generates data of a richness and complexity beyond any simple survey. The broad utilization of the information it provides can be aided through the use of more evocative data displays. In this report, the uses to which data tables are put is…

Focuses on Subject-Pair Analysis, a technique for comparing examinations in different subjects, to demonstrate that reliance on statistical comparisons of standards between subjects is misplaced. Explicates the fundamental assumptions underlying the Subject-Pair Analysis. Argues that this and related analyses are inappropriate for dealing with the…

During the past 6 years, under a contract from the National Center for Education Statistics, a Technical Review Panel has overseen and conducted a series of research studies addressing a range of validity questions relevant to the various uses and interpretations of the National Assessment of Educational Progress (NAEP). Study topics included: (1)…

Since July 1978, RMC Research Corporation has been conducting a study concerned with several aspects of the Title I Evaluation and Reporting System (TIERS). Phases I and II included examination of technical and procedural issues, development of system materials, and assessment of state evaluation reports. Phase III was intended to be an…

The Title I Evaluation and Reporting System (TIERS) under Title I of the Elementary and Secondary Education Act first required project participation and achievement data from the states for the 1979-80 school year. Chapter 1 of the Education Consolidation and Improvement Act of 1981 (ECIA) repealed the requirements for use of federally mandated…

A quality control review of Connecticut's Sustained Effects studies was undertaken by the Chapter 1 Evaluation Technical Assistance Center (TAC) operated by RMC Research Corporation. Nineteen Connecticut school districts had selected from among four basic evaluation designs in implementing the Chapter 1 Sustained Effects requirement during 1982 to…

This is the final report of the National Academy of Education's Panel on the Evaluation of the National Assessment of Education (NAEP) Progress Trial State Assessment. In this report, the Panel considers philosophical, technical, and policy issues concerning the NAEP in the immediate future and in the long term. The high technical quality of the…

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…

In 2003 the first nationally-comparable science assessment was designed, developed and carried out under the auspices of the national council of education ministers, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA). In 2006 a second science assessment was conducted and, for the first time nationally, the…

Data from the Canadian Test of English for Scholars and Trainees (CanTEST) are compared to data from the Test of English as a Foreign Language (TOEFL) to establish CanTEST as a valid admissions tool for English-as-a-Second Language college applicants. Data are taken from four groups of examinees who took both tests. (eight references) (LR)

In July 2001, the Ministerial Council on Education, Employment, Training and Youth Affairs (MCEETYA) agreed to the development of assessment instruments and key performance measures for reporting on student skills, knowledge and understandings in primary science. It directed the newly established Performance Measurement and Reporting Taskforce…