It has long been debated whether the Open-Book-Open-Web exam was useful and efficient as the traditional closed book exams. Some scholars and practitioners have doubted the efficiency and the possibility of cheating in the OBOW as it is not directly monitored. This paper tends to investigate the effectiveness of OBOW exams by comparing them with…

Mokken scale analysis (MSA) is a probabilistic-nonparametric approach to item response theory (IRT) that can be used to evaluate fundamental measurement properties with less strict assumptions than parametric IRT models. This instructional module provides an introduction to MSA as a probabilistic-nonparametric framework in which to explore…

Whether or not the scores for multiple-choice questions (MCQs) and written questions (WQs) in formative assessments are the same, has been a subject of intense scrutiny. However, the evidence for their similarity at different levels of cognitive ability in applied courses has not been sufficiently documented. This study analysed the comparability…

In large scale multiple-choice (MC) tests alternate forms of a test may be developed to prevent cheating by changing the order of items or by changing the position of the response options. The assumption is that since the content of the test forms are the same the order of items or the positions of the response options do not have any effect on…

The rise of computer-based testing has brought with it the capability to measure more aspects of a test event than simply the answers selected or constructed by the test taker. One behavior that has drawn much research interest is the time test takers spend responding to individual multiple-choice items. In particular, very short response…

This study examines the relationships between the environmental attitudes and environmental knowledge of school children within the framework of an environmental intervention. We employed questions from the 2-MEV model to monitor students' environmental attitudes in terms of the model factors Preservation and Utilisation while concurrently…

Copying adjacent answer sheets on the oft-used multiple-choice exams can be prevented if exam material is scrambled. The latter mode has been a requirement for all exams of this type at McGill University for 26 years. Cheating by copying has been reduced to nearly zero in this time. The experiment carried out used permissive seating and a single…

Misconceptions are the "the old, the bad, and the ugly" prior knowledge, ideas or conceptions that the learners have that hinder their further learning in science. Several types of misconceptions that undergraduate students hold about reaction coordinate diagrams (from here on we use the term "reaction coordinate diagrams" and…

Feedback is an important aspect of the learning process. The immediate feedback assessment technique (IF-AT®) form allows students to receive feedback on their answers during a testing event. Studies with introductory psychology students supported both perceived and real student learning gains when this form was used with testing. Knowing that…

This article examines the test-taking strategies of high- and low-scoring Chinese-speaking participants when they answer English multiple-choice reading comprehension questions. Thirty-two participants took a TOEIC reading test, provided think-aloud protocols, and joined a post-task interview. The data come primarily from qualitative analysis and…

Multiple-choice questions (MCQs) play a key role in standardised testing and in-class assessment. Research into the influence of within-item response order on MCQ characteristics has been mixed. While some researchers have shown preferential selection of response options presented earlier in the answer list, others have failed to replicate these…

This paper presents item-analysis data to illustrate how to identify a set of internally consistent test items that differentiate or discriminate among examinees who are highly proficient and nonproficient on the construct of interest. Suggestions for analyzing the quality of test items are offered as well as a pedagogical approach to augment the…

Assessment is often used to hold schools and teachers accountable for student learning. Assessment instruments are used as tools to guide curriculum choices and lesson plans, from districts to individual students. In any discipline, knowing what students know and what they have learned following a lesson is important on multiple levels. This is…

Background: Erroneous answers in multiple-answer problems not only make the correct answer harder to determine but also indicate why the correct choice is suitable and the erroneous one a mistake when compared to the correct answer. However, it is insufficient to simply create erroneous answers for this purpose: explanations of these answers are…

A novel instrument, the Features of Excellent Arguments task (FEXA), was developed to elicit adolescents' judgments about argumentative essays displaying to varying degrees features characteristic of strong persuasive writing: academic language, rich evidence, multiple perspectives, and rhetorical appeal. We collected students' categorical choices…