The subject of the research is to build methodologies to evaluate the student knowledge by testing. The author points to the importance of feedback about the mastering level in the learning process. Testing is considered as a tool. The object of the study is to create the test system models for defence practice problems. Special attention is paid…

We demonstrate that student engagement with PeerWise, an online tool that allows students to author and answer multiple-choice questions (MCQs), is associated with enhanced academic performance across diverse assessment types on a second year Genetics course. Benefits were consistent over three course deliveries, with differential benefits…

It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent's ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood…

Assessment is central to any educational process. Number Right (NR) scoring method is a conventional scoring method for multiple choice items, where students need to pick one option as the correct answer. One point is awarded for the correct response and zero for any other responses. However, it has been heavily criticized for guessing and failure…

Most experts in the testing community have presumed that the $350 million promised by the U.S. Department of Education to support common assessments would promote those that made greater use of open-ended items capable of measuring higher-order critical-thinking skills. But as measurement experts consider the multitude of possibilities for an…

Multiple-choice tests are generally scored using a conventional number right scoring method. While this method is easy to use, it has several weaknesses. These weaknesses include decreased validity due to guessing and failure to credit partial knowledge. In an attempt to address these weaknesses, psychometricians have developed various scoring…

Discusses multiple choice questions and presents a statistical approach to post-test correction for guessing that can be used in spreadsheets to automate the correction and generate a grade. Topics include the relationship between the learning objectives and multiple-choice assessments; and guessing correction by negative marking. (LRW)

Examiners seeking guidance on multiple-choice and true/false tests are likely to encounter various faulty or questionable ideas. Twelve of these are discussed in detail, having to do mainly with the effects on test reliability of test length, guessing and scoring method (i.e. number-right scoring or negative marking). Some misunderstandings could…

Discusses and demonstrates combining scores from multiple-choice (MC) and constructed-response (CR) items to create a common scale using Item Response Theory methodology. Provides empirical results using a set of tests in reading, language, mathematics, and science in three grades. (SLD)

Describes a "gradebook program" capable of recording, editing, recoding, weighting, and scaling multiple choice test scores. (SK)

The testing of grammar is one of the mainstays of language testing, since it can be argued that a basic knowledge of grammar underlies the ability to use language to express meaning. The most common way of testing grammatical knowledge is the multiple-choice test, and the most common multiple-choice item is one in which the student selects a word…

This paper provides a historical review of the changes and improvements made in estimating numerical cutpoints for the National Assessment of Educational Progress (NAEP). While reviewing the various methodologies used for collecting judgment data, the paper discusses: (1) the incorporation of Item Response Theory for setting standards; (2)…

This handbook describes the procedures used to develop, administer, and analyze the results of the 1978-79 art assessment of 9-year-olds, and 17-year-olds by the National Assessment of Educational Progress (NAEP). The primary purpose of the handbook is to provide detailed procedural information for people interested in replicating the assessment…

Describes an in-class exercise using students' discussion of their answers on a multiple choice test to demonstrate the powerful effects and pervasiveness of social influence. After a brief multiple choice test, students discuss their answers with their neighbors and then answer again. Similar response patterns emerge among the participants. (MJP)

This proof-of-concept investigation describes a computer-based approach for deriving the knowledge structure of individuals and of groups from their written essays, and considers the convergent criterion-related validity of the computer-based scores relative to human rater essay scores and multiple-choice test scores. After completing a…