Objective: Our master's program in biostatistics requires a qualifying examination (QE). A curriculum review led us to question whether to replace a closed-book format with an open-book one. Our goal was to improve the QE. Methods: This is a case study and commentary, where we describe the evolution of the QE, both in its goals and its content.…

Retrospective pretests ask respondents to report after an intervention on their aptitudes, knowledge, or beliefs before the intervention. A primary reason to administer a retrospective pretest is that in some situations, program participants may over the course of an intervention revise or recalibrate their prior understanding of program content,…

College and university admissions officers are the gatekeepers who decide which individuals may join the "country club" of higher education. As such, the decisions they make have a significant impact on the lives of individuals, especially those who are willing to travel across the globe and risk living in an unfamiliar country in order…

In their reactions to my paper, the four authors provide comments that are illuminating and helpful for continuing discussions of the nature and utility of quantitative, comparative, international studies of educational achievement. In this response, I comment further on the issues of test characteristics, sample design, culture and causation.

In May 2008, the National Assessment Program--Literary and Numeracy (NAPLAN) conducted nation-wide tests for reading, writing, language conventions, and numeracy. A national assessment program of this kind should provide the stimulus for macro-level (systemic) analytical studies and micro-level (individual school and/or class) analytical studies…

One purpose of a college education is to create active and engaged citizens and future leaders. If everyone wants students who have the potential to become such people, it is necessary to keep in mind the skills involved in good citizenship and positive leadership when evaluating applicants. Many of the leaders who have gotten the world into its…

Discusses state testing, various types of tests, and whether the increased attention to assessment is contributing to improved student learning. Describes uses of standardized multiple-choice, open-ended constructed response, essay, performance event, and portfolio methods. (JOW)

In this article we consider the extent to which the Document-Based Question (DBQ) on the New York State Global History and Geography exam represents an authentic task. The DBQ seems like a significant step toward authenticity, especially when compared with traditional forced-choice assessments. Drawing on the characteristics of authentic tasks as…

This article responds to points raised in the article "The paired format in the Cambridge Speaking Tests" by Julie Norton in the 59/4 issue of this Journal on the potential drawbacks of a paired format in oral testing, based on observations about the nature of the discourse produced in this context. This article argues that, although the author…

Numerous short forms of the Minnesota Multiphasic Personality Inventory have been proposed in the last 15 years. In each case, the initial enthusiasm has been replaced by the questions about the clinical utility of the abbreviated version. Argues that the statistical properties of the test and reduced reliability due to shortening the scales…

Argues that the School Leaders Licensure Assessment required for administrator certification in several states promotes a narrow, mainstream concept of instructional leadership. (PKP)

Discusses answer justification, a technique that allows students to convert multiple-choice items perceived to be "tricky" into short-answer essay questions. Convincing justifications earn students credit for missed items. The procedure is reported to be easy to administer and very popular among students. (Author/GEA)

Personal construct psychologists have suggested various psychological functions explain differences in the stability of constructs. Among these functions are constellatory and loose construction. This paper argues that measurement error is a more parsimonious explanation of the differences in construct stability reported in these studies. (Author)

The purpose of this paper is to highlight some psychometric cautions that should be observed when seeking to develop short form versions of tests. Several points are made: (1) score reliability is impacted directly by the characteristics of the sample and testing conditions; (2) sampling error has a direct influence on reliability and factor…

Discusses, for the benefit of research workers and other test users, the ongoing controversy concerning the relative merits of conventional test theory and Rasch scaling in the construction of reading tests. Concludes that a great deal of further research is required to see whether these approaches are educationally valid. (JD)