Impact is an increasingly significant part of academia internationally, both in centralised assessment processes (for example, UK) and funder drives towards knowledge mobilisation (for example, Canada). However, narrowly focused measurement-centric approaches can encourage short-termism, and assessment paradigms can overlook the scale of effort…

This article describes issues in measuring school contexts with an eye toward understanding students' experiences and outcomes. I begin with an overview of the conceptual underpinnings related to measuring contexts, briefly describe the initiatives at the National Center for Education Statistics to measure school contexts, and identify possible…

We offer an introduction to the five papers that make up this special section. These papers deal with a range of the methodological challenges that face researchers analyzing fMRI data--the spatial, multilevel, and longitudinal nature of the data, the sources of noise, and so on. The papers all provide analyses of data collected by a multi-site…

The use of "radar charts" is an increasingly popular way to present spatial data in a visually interesting format. Some authors recommend using "filled radar charts" to compare the performance of observational units. Filled radar charts are not appropriate for such comparisons because the size of the area within the polygon is not invariant to the…

Unlike in elementary schools, high school teacher effects may be confounded with unobserved track-level treatments (such as the AVID program) that are correlated with individual teachers. I present a strategy that exploits detailed course-taking information to credibly estimate the effects of 9th grade Algebra and English teachers on test scores.…

This chapter summarizes ten selected issues and common problems that arise in most assessment research projects. These include: (1) the uses of grades in assessment; (2) institutional review boards; (3) research design as a compromise; (4) standardized testing; (5) self-reported measures; (6) missing data; (7) weighting data; (8) conditional…

Using "error bars" on graphs is a good way to help students see that, within the inherent uncertainty of the measurements due to the instruments used for measurement, the data points do, in fact, lie along the line that represents the linear relationship. In this article, the author explains why connecting the dots on graphs of collected data is…

A process for judging the alignment between curriculum standards and assessments developed by the author is presented. This process produces information on the relationship of standards and assessments on four alignment criteria: Categorical Concurrence, Depth of Knowledge Consistency, Range of Knowledge Correspondence, and Balance of…

This article examines methodological issues confronting the study of qualitative and quantitative differences in ways that separated parents share time with their children. Measurement issues explored include disentangling dimensions of contact, identifying economic implications of contact, and measuring quality of contact. Sampling issues relate…

This article reassesses large-scale uncitedness, the proportion of articles that do not receive a single citation within five years of publication. Examines the problem of disaggregation in the measurement of uncitedness; reviews reactions of the popular press and scholars; provides a case study of uncitedness in "College & Research…

States that the efficiency of computer-supported learning cannot be substantiated without difficulty. Explores basic problems of the measurement of school achievement from a theory of (1) measurement and (2) the psychology of learning. Examines the form of "achievement" as a construct of measurement and the consequences of developing a design of…

Stevens postulated that we can use the responses of a participant in a ratio scaling experiment directly to construct a psychophysical function representing the participant's sensations. Although Stevens' methods of constructing measurement scales are widely used in the behavioral sciences, the problem of which scale type is appropriate to…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

This article is the first of a research methods series dedicated to getting good results from survey research. In this series, "good results" is a stenographic term used to define surveys that yield accurate and meaningful information decision makers can use with confidence to identify current practices that merit continuation and to create or…