Do multiple choice unit tests reflect what students have learned during the unit? The day before the administration of a county-mandated multiple choice test, two classes were shown a topic they had not previously seen, and told it would be on the test. One class was shown the same material and told it was not important, and two classes were not…

Concept inventory tests are one method to evaluate conceptual understanding and identify possible misconceptions. The multiple-choice question format, offering a choice between a correct selection and common misconceptions, can provide an assessment of students' conceptual understanding in various dimensions. Misconceptions of some engineering…

Item development is a time- and resource-intensive process. Automatic item generation integrates cognitive modeling with computer technology to systematically generate test items. To date, however, items generated using cognitive modeling procedures have received limited use in operational testing situations. As a result, the psychometric…

Energy is one of the most central and richly connected ideas across all science disciplines. The purpose of this study was to develop a measurement instrument for assessing students' understanding of the energy concept within and across different science disciplines. To achieve this goal, the Inter-Disciplinary Energy concept Assessment (IDEA) was…

Researchers have widely adopted measures of teachers' mathematical knowledge for teaching (MKT). This paper investigates why teachers select "I'm not sure" as a suggested solution in MKT items. In this study, in-service teachers responded to multiple-choice MKT items, they submitted written responses to open-ended questions, and they…

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

There are various types of instructional media related to Valence Shell Electron Pair Repulsion (VSEPR) but there is a lack of diversity of resources devoted to assessment. This research presents an assessment and comparison of students' understanding of VSEPR theory before and after tuition involving the use of the foam molecule model (FMM) and…

Large classes are a reality in many tertiary programmes in the South African context and this involves several challenges. One of these is the assessment process, including the provision of meaningful feedback and implementing strategies to support struggling students. Due to large student numbers, multiple-choice questions (MCQs) are often used…

Statistical literacy refers to understanding fundamental statistical concepts. Assessment of statistical literacy can take the forms of tasks that require students to identify, translate, compute, read, and interpret data. In addition, statistical instruction can take many forms encompassing course delivery format such as face-to-face, hybrid,…

In decades Peer Instruction (PI) has been confirmed that it can improve students' conceptual understanding. Anyway the main problem for using PI is an audience responding system which is required for gathering students' answer, to enhance the learning process of PI instead of using Clickers which cost about 40 USD per item. In this work we decided…

High stakes assessments are commonly used at the end of secondary school to select students for higher education. However, growing concerns about the preparedness of new undergraduates for university study have led to an increased focus on the form of assessments used at upper secondary level. This study compared the structure and format of…

Testing strategies can either have a very positive or negative effect on the learning process. The aim of this study was to examine the degree of consistency in evaluating the practicality and logic of questions from a medical school pathophysiology test, between students and family medicine doctors. The study engaged 77 family medicine doctors…

Free-response research-based assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple choice. To increase…

The authors assessed the effects of using "none of the above" as an option in a 40-item, general-knowledge multiple-choice test administered to undergraduate students. Examinees who selected "none of the above" were given an incentive to write the correct answer to the question posed. Using "none of the above" as the…

In this paper, we introduce a mathematical model for collaborative learning and the answering process for multiple-choice questions. The collaborative learning model is inspired by the Ising spin model and the model for answering multiple-choice questions is based on their difficulty level. An intensive simulation study predicts the possibility of…