With the already widespread nature of multiple-choice assessments and the increasing popularity of answer-until-correct, it is important to have methods available for exploring the validity of these types of assessments as they are developed. This work analyzes a 20-question multiple choice assessment covering introductory undergraduate chemistry…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…

Assessing students' (mis)conceptions is a challenging task for teachers as well as for researchers. While individual assessment, for example through interviews, can provide deep insights into students' thinking, this is very time-consuming and therefore not feasible for whole classes or even larger settings. For those settings, automatically…

Language assessment is increasingly computermediated. This development presents opportunities with new task formats and equally a need for renewed scrutiny of established conventions. Recent recommendations to increase integrated skills assessment in lecture comprehension tests is premised on empirical research that demonstrates enhanced construct…

This research is a developmental research aiming at developing a good mathematical test instrument using polytomous responses based on classical and modern theories. This research design uses the Plomp model, which consists of five stages, (1) preliminary investigation, (2) design, (3) realization/construction, (4) revision, and (5) implementation…

Optics is a core field in the curricula of secondary physics education. In this study, we present the development and validation of a test instrument in the field of optics, the ray optics in converging lenses concept inventory (ROC-CI). It was developed for and validated with middle school students, but can also be adapted for the use in higher…

The purpose of this study was to develop the Critical Thinking Disposition Test in Biology as an alternative instrument in looking at the extent of one's disposition to critical thinking, especially in Biology University. Critical Thinking Disposition Tests in Biology are tests in the form of multiple choice based on biological cases. This…

This study focused on the development and validation of a three-tier multiple-choice diagnostic instrument about the ecological footprint. Each question in the three-tier test comprised by; (a) the content tier, assessing content knowledge; (b) the reason tier, assessing explanatory knowledge; and (c) the confidence tier that differentiates lack…

The purpose of this paper is to assess the validity of multiple-choice questions in measuring fourth grade students' ability to interpret graphs related to physical science topics such as motion and temperature. We administered a test including 6 multiple-choice questions to 28 fourth grade students. Students were asked to explain their thinking…

Integrating Google Street View into a three-dimensional virtual environment in which users control personal avatars provides these said users with access to an innovative, interactive, and real-world context for communication and culture learning. We have selected London, a city famous for its rich historical, architectural, and artistic heritage,…

Learning or performance gains are often measured in improvements of test scores over time. However, learners may also answer questions incorrectly which they appeared to master previously, making claims about overall learning gains problematic. Using data from 1,211 grade 6 learners in the Umgungundlovu district in KwaZulu-Natal, we interrogated…

Physics educators around the world often need reliable diagnostic materials to measure students' understanding of physics concept in high school. The purpose of this study is to evaluate a new diagnostic tool on High School Optics concept. Test of Conceptual Understanding on High School Optics (TOCUSO) consists of 25 conceptual items that measures…

A methodology for developing multiple-choice critical thinking tests is described, which attempts to overcome certain problems of validity and fairness associated with such tests. It is concluded that direct evidence on test validity should be gathered using verbal reports of students' thinking on trial items. (TJH)

This paper reflects on the ongoing debate surrounding the usefulness (or otherwise) of multiple-choice questions (MCQ) as an assessment instrument. The context is a graduate school of business in Australia where an experiment was conducted to investigate the use of assertion-reason questions (ARQ), a sophisticated form of MCQ that aims to…

Multiple-choice items were used to measure knowledge of drug abuse among four distinct groups of college students in the Los Angeles area. No difference in knowledge was found about five aspects of drug abuse measured by subscales of the instrument. These findings suggest that knowledge about drugs is remarkably uniform, although the students…