Two item-writing rules were tested: phrasing stems as questions versus partial sentences; and using the "none-of-the-above" option instead of a specific content option. Results with 228 college students do not support the use of either stem type and provide limited evidence to caution against the "none-of-the-above" option.…

Discusses a concurrent validity study of an indirect measure of English-as-a-Second-Language writing based on information processing: anagram solving, word reordering, paragraph assembly tests, etc. The criterion measure was a direct, holistic measure of writing. Analysis revealed that the indirect measure did not exhibit concurrent validity for…

A "successful intelligence" intervention improved school achievement for a group of 225 ethnically diverse third-graders, both on performance assessments measuring analytical, creative, and practical achievements and on conventional multiple-choice memory assessments. Teaching for triarchic thinking facilitates factual recall, because learning…

A Rasch-type analysis is presented for multiple-choice items in which one parameter is assigned to each distractor. Results of a small simulation study show that the parameter recovery of the distractor model is very satisfactory. Analysis of a real dataset shows that some items fit the Rasch model rather than the distractor model. (SLD)

Multiple-choice and true-false versions of Palmore's first Facts on Aging Quiz were completed by 501 college students. Multiple choice reduced the chances of guessing and had less measurement error for average and above-average respondents. (Author/SK)

Multiple choice questions are a common method of assessing student understanding. In this article, the authors discuss and evaluate a student-focused collaborative learning strategy for working with such questions that results in greater student learning and allows instructors to better understand student thinking and ultimately to write better…

Four item response theory linking methods (2 moment methods and 2 characteristic curve methods) were compared to concurrent (CO) calibration with the focus on the degree of robustness to format effects (FEs) when applying the methods to multidimensional data that reflected the FEs associated with mixed-format tests. Based on the quantification of…

In this article we describe the development, analysis, and interpretation of a novel item format we call Ordered Multiple-Choice (OMC). A unique feature of OMC items is that they are linked to a model of student cognitive development for the construct being measured. Each of the possible answer choices in an OMC item is linked to developmental…

Purpose: To provide educationalists with an understanding of the key quality issues relating to multiple-choice tests, and a set of guidelines for the quality assurance of such tests. Design/methodology/approach: The discussion of quality issues is structured to reflect the order in which those issues naturally arise. It covers the design of…

Students (N=153) in three equivalent sections of an undergraduate human development course compared pairs of related concepts via either written or oral discussion at the beginning of most class sessions. A writing-for-random-credit section achieved significantly higher ratings on the writing activities than did a writing-for-no-credit section.…

We conducted correlational and performance discrepancy analyses on exam and achievement data taken from students in three psychology courses. Across courses, the same findings emerged. First, only a small fraction of students consistently performed more strongly on one type of assessment (e.g., multiple-choice) than on another (e.g., short…

Background: Recent changes in higher education in the UK have led to much discussion about the performance of men and women students with different methods of assessment. Aim: To see whether or not there were differences between the marks awarded to men and women final-year psychology students as a function of the modes of assessment used. Method:…

At the beginning of a Java computer programming course, nine students in an undergraduate class and nine students in a graduate class completed a web-based programmed instruction tutoring system that taught a simple computer program. All students exited the tutor with an identical level of skill, at least as determined by the tutor's required…

While today's curriculum is largely driven by standards, many teachers find the lack of specificity in the standards to be confounding and even intimidating. Now this practical book provides middle and high school teachers with explicit guidance on designing specific objectives and developing appropriate formative and summative assessments to…

This digest presents a list of recommendations for writing multiple-choice test items, based on psychometrics statistics are typically provided by a measurement, or test scoring, service, where tests are machine-scored or by testing software packages. Test makers can capitalize on the fact that "bad" items can be differentiated from…