This article describes a study, from a Canadian technical institute's upgrading mathematics course, where students played a role in developing the final closed-book exam that they sat. The study involved a process where students developed practice exams and solutions keys, students sat each other's practice exams, students evaluated classmates'…

In this article, the authors provide their critique on a set of papers that investigated Mathematics Knowledge for Teachers (MKT) assessment and the underlying theory and characteristics of the validity enterprise. Three types of assumptions and inferences--elemental, structural, and ecological--are discussed in these papers. These assumptions…

In this issue of Measurement: Interdisciplinary Research and Perspectives, Schilling et al. are explicit about the centrality of assessment design and development and psychometric analysis in validation. Schilling and colleagues, Kane (2004, 2006), other contemporary validity theorists and practitioners, and their predecessors typically discuss…

Schilling et al. (this issue) have done a commendable job in illustrating a comprehensive process of validating assessments of teacher knowledge (and, more broadly, other types of tests as well). On one hand, the concrete illustration of a process that often remains murky and incomplete is profoundly heartening, as it provides a rigorous model for…

The Unified Science and Mathematics for Elementary Schools (USMES) Program was designed to teach students complex problem-solving skills. This paper reports the effects of USMES on basic skills, explains the effects, comments on difficulties in data collection, and recommends data-gathering that should complement or replace standard basic skills…

In this journal issue, the authors of the focus articles have provided a suite of very stimulating and thoughtful articles. The overarching purpose of this research is to explore the application of principles derived from the view of validity proposed by Kane (2004) to their research on issues related to the measurement of mathematical knowledge…

The authors of this volume's stimulus papers have taken on the challenge of developing measures of teachers' mathematical knowledge for teaching (MKT). This task involves multiple decisions and considerations, including: (1) How does one specify the body of knowledge being assessed? What warrants are offered for those choices?; (2) How does one…

Teacher knowledge has been of theoretical and empirical interest for over two decades, and development of measures is overdue. The researchers represented in this volume have been breaking new ground by developing a measure of mathematical knowledge for teaching (MKT) without guiding precedents, and in the face of differing perspectives on teacher…

Operating from multiple literature bases in cognitive psychology, mathematics education, and theoretical and applied psychometrics, Schilling, Hill and their colleagues provide a systemic approach to studying the validity of scores of mathematical knowledge for teaching. This system encompasses an array of task formats and methodologies. The…

The author offers some thoughts on commentator's reactions to the substance of the measures, particularly those about measuring teacher learning and change, based on the major uses of the measures, and because this is a significant challenge facing test development as an enterprise. If teacher learning results in more integrated knowledge or…

In this article, the author echoes his co-author's and colleague's pleasure (Hill, this issue) at the thoughtfulness and far-ranging nature of the comments to their initial attempts at test validation for the mathematical knowledge for teaching (MKT) measures using the validity argument approach. Because of the large number of commentaries they…

Basic rules of test construction are detailed to provide teachers with ways to improve the validity and reliability of teacher-made tests and worksheets. Designing the test, writing the items, and scoring the test are each discussed. The critical need for good instruments is promoted. (MP)

The 1961 meeting of the Western Regional Conference on Testing Problems dealt with changes in education and measurement since Sputnik. The following papers were presented: (1) "Who's Testing Whom and for What?" by Daniel D. Feder; (2) "Recent Development and Problems in the Teaching of English" by Alfred H. Grommon; (3) "The New Foreign Language…

Differential item performance (DIP) is discussed as a concept that does not necessarily imply item bias or unfairness to subgroups of examinees. With curriculum-based achievement tests, DIP is presented as a valid reflection of group differences in requisite skills and instruction. Using data from a national testing of the ACT Assessment, this…

This study examined the curricular validity of the New Jersey Basic Skills test, a minimum competency test administered to all public school students in grades 3, 6, 9, and 11 to measure basic skills in reading and mathematics. Based on examinations of a Modified Caution Index, there were differences in the usual response patterns for both reading…