This special issue's editors invited discussion of three broad questions. Slightly rephrased, they are: How well do self-report data represent theoretical constructs? How should analyses of data be conditioned by properties of self report data? In what ways do interpretations of self-report data shape interpretations of a study's findings? To…

The goal of this special issue is to examine the use of self-report measures in the study of motivation and strategy use. This commentary reviews the articles contained in this special issue to address the primary objective of determining if and when self-report measures contribute to understanding these major constructs involved in self-regulated…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

In this commentary, we offer a set of visual tools that can assist education researchers, especially those in the field of mathematics, in developing cohesiveness from a mixed methods perspective, commencing at a study's research questions and literature review, through its data collection and analysis, and finally to its results. This expounds…

"Game-Based Assessments: A Promising Way to Create Idiographic Perspectives" (Adrienne Walker and George Englehard) comments on: "How Task Features Impact Evidence from Assessments Embedded in Simulations and Games" by Russell G. Almond, Yoon Jeon Kim, Gertrudes Velasquez, and Valerie J. Shute. Here, Walker and Englehard write…

This article is a commentary of a paper by Derek C. Briggs and Frederick A. Peck, "Using Learning Progressions to Design Vertical Scales That Support Coherent Inferences about Student Growth," which describes an elegant potential framework for at least beginning to address three priorities in large-scale assessment that have not been…

The REL Mid-Atlantic Webinar discussed the elements in a positive school climate and shared different methods for assessing school data, including the Comprehensive School Climate Inventory. The Q&A presented in this document address the questions participants had for Dr. Cohen following the webinar. The webinar recording and PowerPoint…

In this rejoinder, the authors provide their thoughts on each of the commentaries of the seven respondents to their article. They find that the response of Kyngdon differs markedly from the others in questioning some basic elements of the methods of analysis that they propose for the construction of a "road map." The authors emphasize that they…

Humphry (this issue) deserves credit for drawing attention to the long-neglected fact that differences in item discrimination parameters are often due to empirical factors and not the product of random error components. In doing so, Humphry offers a psychometrically elegant, coherent, and practically important new model that is more flexible while…

Ruscio et al. (Ruscio, Seaman, D'Oriano, Stremlo, & Mahalchik, this issue) write of a thing with which scientists and scholars are all too familiar, the assessment of published research and of its authors. The author was startled to discover how little the agenda of the paper seems to engage with factors one relies on for salary and promotion…

Presents and discusses implications of a set of measures of information. Definitions of relevant terms, including fact, data, representation, information, and knowledge, are given; four levels of processing data are explained (i.e., data transfer, data selection, data analysis, and data reduction); and relationships between information and…

This paper is based on the premise that relatively little is known about how to improve validity in qualitative research and less is known about how to estimate validity in studies conducted by others. The purpose of the study was to describe the conceptualization of validity in qualitative inquiry to determine how it was used by the author of a…

Discusses several issues that pertain to analysis of data from repeated measurements designs. Notes that necessity for assumption concerning uniformity of correlations can be avoided by calculating linear and/or nonlinear trend scores. Discusses advantages of separately calculated trend scores. Proposes conservative criterion for use of one-sided…

The American Educational Research Association (AERA) 2007 Call for Proposals points out the need for researchers in education to look beyond their usual sources to other fields that have extensive experience in relevant theories and methods. In transitioning from a response to AERA's Call for Proposals to the text of these articles on Assessing…

School climate is an elusive but powerful concept that has captured the attention of both researchers and practitioners, but choosing an instrument to assess climate can be very complicated. This monograph accordingly discusses four basic issues that should be considered prior to selecting an instrument to measure school climate: purpose, choice…