The past [approximately]15 years have seen increasing interest in defining disciplinary core concepts. Within the field of physiology, Michael, McFarland, Modell, and colleagues have published studies that defined physiology core concepts and have elaborated many of these as detailed conceptual frameworks. With such helpful definitions now in…

Geography educators have been, and continue to be, interested in spatial thinking, especially since they have been convinced of its importance in their students' ability to learn and do geography. As they developed strategies to improve students' spatial thinking, they searched for assessment instruments to evaluate their interventions' effects.…

Standardized assessments are widely used to determine access to educational resources with important consequences for later economic outcomes in life. However, many design features of the tests themselves may lead to psychological reactions influencing performance. In particular, the level of difficulty of the earlier questions in a test may…

We examine the effects of computer-based versus paper-based assessment of critical thinking skills, adapted from English (in the U.S.) to Chinese. Using data collected based on a random assignment between the two modes in multiple Chinese colleges, we investigate mode effects from multiple perspectives: mean scores, measurement precision, item…

Writing multiple-choice test items to measure student learning in higher education is a challenge. Based on extensive scholarly research and experience, the author describes various item formats, offers guidelines for creating these items, and provides many examples of both good and bad test items. He also suggests some shortcuts for developing…

We make a distinction between two types of test changes: inevitable deviations from specifications versus planned modifications of specifications. We describe how score equity assessment (SEA) can be used as a tool to assess a critical aspect of construct continuity, the equivalence of scores, whenever planned changes are introduced to testing…

This article considers the design process for new formative history assessments. Over the course of 3 years, my colleagues from the Stanford History Education Group and I designed, piloted, and revised dozens of "History Assessments of Thinking" (HATs). As we created HATs, we sought to gather information about their cognitive validity,…

The purpose of this research is to automatically construct multiple equivalent test forms that have equivalent qualities indicated by test information functions based on item response theory. There has been a trade-off in previous studies between the computational costs and the equivalent qualities of test forms. To alleviate this problem, we…

The use of computers to deliver course-related materials is rapidly expanding in most universities. Yet the effects of computer vs. printed delivery modes on students' performance and motivation are not yet fully known. We compared the impacts of Web vs. paper to deliver practice quizzes that require information search in lecture notes. Hundred…

Studies the effect of item order on test scores and completion time. Students scored slightly higher when test items were grouped sequentially (relating to text and lectures) than on tests when test items were grouped by text chapter but ordered randomly, or when test items were ordered randomly. Found no differences in completion time. (Author/LS)

Describes the process of developing an essay topic for large group scoring. Proposes guidelines for test development committees, and emphasizes the importance of accessibility and reader perspective in the formation of test questions. (MM)

This article outlines the advantages and disadvantages of various question types in tests for library classes, including selected-response, constructed-response and alternative-response test items. It examines a test case in which students in a for-credit library course were given a take home quiz with search story problems. Sample "search story"…

Explores the history of testing, motivations for testing, testing procedures, and the inevitable limitations of testing. Argues that writing program faculty and administrators must clarify and profess their values, decide what they want students to know and what sort of thinkers they should be, and develop tests reflecting those needs. (SR)

This paper discusses the design and pedagogy underpinning the use of online quiz items in which students are presented with a range of questions designed to enhance understanding of complex linguistic constructions. It explores the design of different types of quiz questions from the perspective of pedagogy and cognitive demand. The particular…

This article describes the development of an English spelling measure designed to assess the progress made by Spanish-English bilingual children from Grade 2 to Grade 5. Different stages of developing the measure are described, such as selecting the focus features, the prepilot and pilot phases, and the operational version. Two underlying…