In this study we explored the effect of notations that undergraduates produce on their reasoning abilities. Participants solved four analytical reasoning problems, making notes to solve two problems and solving two without notations. Most participants produced notes when given the opportunity. The production of higher quality notes did not aid…

The context in which higher education admissions tests are used, both intended, validated uses and misuses, are examined. Possible legal problems of misuse are discussed in light of a recent court decision, Sharif v. New York State Education Department. Focus is on three tests: the Scholastic Assessment Test, Graduate Record Examinations, and the…

Issues concerning the cost and feasibility of using Formulating Hypotheses (FH) test item types for the Graduate Record Examinations have slowed research into their use. This project focused on two major issues that need to be addressed in considering FH items for operational use: the costs of scoring and the assignment of scores along a range of…

This study examined the relationship between the need for cognition, defined as the tendency to engage in effortful cognitive activity, and metacognition which is one's thinking about thinking and how these variables relate to intellectual task performance. Participants completed measures of need for cognition, metacognition, and problem-solved…

The nature of percentile ranks scores is explored using concrete heuristic examples. It is explained why arithmetic operations require measurement on equal-interval scales, and that percentile ranks are not measured on equal-interval scales and therefore may not be added or averaged. The consequences of inappropriately adding percentile ranks are…

This exploratory study applied two new cognitively sensitive measurement models to constructed-response quantitative data. The models, intended to produce qualitative characteristics of examinee performance, were fitted to algebra word problem solutions produced by 285 examinees taking the Graduate Record Examinations (GRE) General Test. The two…

This report describes the development of a new tool for assessment research in graduate education. The tool, the Algebra Assessment System, is based on GIDE, a pre-existing program that diagnostically analyzes complex constructed responses to algebra word problems. The project had three goals. The first goal was to build a generically usable…