Data harmonization is an emerging approach to strategically combining data from multiple independent studies, enabling addressing new research questions that are not answerable by a single contributing study. A fundamental psychometric challenge for data harmonization is to create commensurate measures for the constructs of interest across…

The article outlines a methodology for systematically observing collective violence (and public order policing in relation to it). Specific attention is given to matters of sampling and measurement and to the way in which observational challenges have been met in comparison with participant observational studies of demonstrations and football…

This article presents findings on the consequences of matrix sampling of context questionnaires for the generation of plausible values in large-scale assessments. Three studies are conducted. Study 1 uses data from PISA 2012 to examine several different forms of missing data imputation within the chained equations framework: predictive mean…

Existing data sets can be an efficient, powerful, and readily available resource for addressing questions about developmental science. Many of the available databases contain hundreds of variables of interest to developmental psychologists, track participants longitudinally, and have representative samples. In this article, the authors discuss the…

Background: In the context of international large scale assessments, it is often not feasible to implement a complete survey of all relevant populations. For example, the OECD Program for International Student Assessment surveys both students and schools, but does not obtain information from teachers. In contrast the OECD Teaching and Learning…

Ramsay-curve item response theory (RC-IRT) is a nonparametric procedure that estimates the latent trait using splines, and no distributional assumption about the latent trait is required. For item parameters of the two-parameter logistic (2-PL), three-parameter logistic (3-PL), and polytomous IRT models, RC-IRT can provide more accurate estimates…

This article describes the principles, applications and performances of methods to measure gas-phase air pollutants that either utilise passive or active sampling with subsequent laboratory analysis or involve automated "in situ" sampling and analysis. It focuses on air pollutants that have adverse impacts on human health (nitrogen…

The vertical scales of large-scale achievement tests created by using item response theory (IRT) models are mostly based on cluster (or correlated) educational data in which students usually are clustered in certain groups or settings (classrooms or schools). While such application directly violated assumption of independent sample of person in…

Reporting methods used in large-scale assessments such as the National Assessment of Educational Progress (NAEP) rely on latent regression models. To fit the latent regression model using the maximum likelihood estimation technique, multivariate integrals must be evaluated. In the computer program MGROUP used by the Educational Testing Service for…

The purpose of the present study was to determine whether a "natural" four-alternative multiple choice item represents the same psychological task as a five-choice item rescored as a four-choice item. (Author)

To complement traditional learning activities in a masters-level research methodology course, social work students worked on a formal research project which involved: designing the study, constructing measures, selecting a sampling strategy, collecting data, reducing and analyzing data, and finally interpreting and communicating the results. The…

This document answers the question, "What has been learned about evaluation methodology from the decade of compensatory education"? Ten issues dealing with the evaluation of Title I were identified within a general theoretical framework of evaluation. For each issue it was the aim of this document to do the following: 1)to clarify the…

The National Food and Agriculture Council of the Philippines regularly requires rapid feedback data for analysis, which will assist in monitoring programs to improve and increase the production of selected crops by small scale farmers. Since many other development programs in various subject matter areas also require similar statistical…

This training text is designed to introduce program evaluation concepts and terminology to beginning program evaluators for state-federal vocational rehabilitation programs. Taking a research approach, the text covers the principles underlying program evaluation, and is geared to give the reader a basic understanding of how these principles can be…

Finding ways to improve the design of large-scale tests is a timely issue. Recent changes in Federal legislation (including the No Child Left Behind Act of 2001) have placed greater emphasis on accountability via large-scale tests. Students who have previously been exempted from large-scale assessments, including students with disabilities and…