Background: Multiple-choice item (MCI) assessments are burdensome for instructors to develop. Artificial intelligence (AI, e.g., ChatGPT) can streamline the process without sacrificing quality. The quality of AI-generated MCIs and human experts is comparable. However, whether the quality of AI-generated MCIs is equally good across various domain-…

This study investigates meaning-making processes in language and literacy assessments. Using a social semiotic perspective, it examines how adult second language learners with emerging literacy self-articulate their understanding of multimodal elements and components utilized in low-stakes assessments, and the strategies they use to make meaning…

Providing two or more versions of multiple-choice exams has long been a popular strategy for reducing the opportunity for students to engage in academic dishonesty. While the results of studies comparing exam scores under different question-order conditions have been inconclusive, the potential importance of contextual cues to aid student recall…

A comprehensive review is given of evidence, with a bearing on the recommendation to avoid use of complex multiple choice (CMC) items. Avoiding Type K items (four primary responses and five secondary choices) seems warranted, but evidence against CMC in general is less clear. (SLD)

Gibb (1964) defined test-wiseness (TW) as the ability to respond advantageously to item clues in a multiple-choice setting and therefore to obtain credit without knowledge of the subject matter being tested. This study investigated TW in a sample of 6th grade pupils. A test instrument was developed utilizing fictitious material similar to the…

Three groups of students were tested on the same material in three different forms of examination. They performed better in multiple-choice and in cued essay questions than in uncued essay questions. (Author/LBH)

This study confirmed the practical benefits of three-choice items. (Author)

Three item-construction principles for multiple-choice tests were studied to determine how they affected test results for high school students: (1) use of incomplete sentence stem; (2) location of blank in the stem; and (3) presence of noncueing material. Differences in item construction had a slight effect on test results. (Authors/CJ)

The cognitive approach to education and instruction is discussed, with a focus upon achievement test question processing. A model of multiple-choice processing is discussed and used to develop a proposed model of recall processing. Each model is tested by the means of investigating the use of retrieval cues in processing each type of question. The…

The quality of mathematics multiple choice items and their susceptibility to test wiseness were examined. Test wiseness was defined as "a subject's capacity to utilize the characteristics and formats of the test and/or test taking situation to receive a high score." The study used results of the Graduate Record Examinations Aptitude Test (GRE) and…

Results of a study involving pathology students suggest that there is significant cluing in multiple-true-false test questions that use secondary responses to represent combinations of the primary response (e.g., "Mark B if only 1 and 3 are correct"). Thus test scores are artificially inflated and test reliability is lowered. (JMD)

Guidelines for test item-writing have traditionally recommended making the correct answer of a multiple-choice item grammatically consistent with its stem. To investigate the effects of adhering to this practice, certain item formats were designed to determine whether the practice of providing relevant grammatical clues, in itself, created cue…