Multiple choice tests are unlikely to disappear from formal education, partly due to the ease of large-scale administration and grading and their similarity to licensing exams in various fields (e.g., nursing). Despite post-secondary instructors' best intentions in giving students adequate time to complete multiple choice assessments, it can be…

This study assesses the performance of ChatGPT in comparison with that of undergraduate students in 60 multiple-choice questions (MCQs) of Corporate Finance exams that sought to measure students' abilities to solve different types of questions (descriptive and numerical) and of varying difficulty levels (basic and intermediate). Our results…

At a conference on educational physics, someone described a series of multiple-choice problems to test students' ideas about various mechanical phenomena. One of the problems questioned students' conceptions about the shape of the Earth's orbit in the solar system. The question was as follows: "Which of the following schematic illustrations…

At present, research on computational thinking in universities is gaining interest, and more attention is being paid to the cultivation and teaching of computational thinking. However, there is a lack of computational thinking assessment tools for college students, which makes it difficult to understand the current status and development of their…

This article is concerned with the statistical detection of copying on multiple-choice exams. As an alternative to existing permutation- and model-based copy-detection approaches, a simple randomization p-value (RP) test is proposed. The RP test, which is based on an intuitive match-score statistic, makes no assumptions about the distribution of…

The current study examined whether the learning benefits of pretesting--like those produced by posttesting--generalize to classroom settings, and whether such benefits transfer to non-pretested related information. Before some lectures but not others, undergraduate students enrolled in a large research methods class were given a brief competitive…

Two-stage testing (TST) involves individual testing followed by taking the same test in teams. Previously, Vogler and Robinson ("The Journal of Experimental Education," 84(4), 787-803, 2016) found that TST facilitated individual performance. The present study addressed methodological limitations in the Vogler and Robinson study in two…

We discuss the development and validation of the long version of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws-Long suitable for introductory physics courses. This version of the survey instrument is a longer version of the original shorter version developed and validated…

The testlet design is very popular in educational and psychological assessments. This article proposes a new cognitive diagnosis model, the multiple-choice cognitive diagnostic testlet (MC-CDT) model for tests using testlets consisting of MC items. The MC-CDT model uses the original examinees' responses to MC items instead of dichotomously scored…

Emotional intelligence (EI) has a positive correlation with the academic performance of medical students. However, why there is a positive correlation needs further exploration. We hypothesized that the capability of answering higher-order knowledge questions (HOQs) is higher in students with higher EI. Hence, we assessed the correlation between…

Multiple-response questions are a common feature of survey-based research, as its advantages of information collection are well known. Statistical analysis of the responses, however, tends to be either one or two-dimensional, with the restrictions that this entails. This paper presents a multidimensional analysis protocol that provides the…

In tertiary mathematics courses, students often have difficulties acquiring an understanding of the mathematical concepts covered. One approach to address this problem is to implement so-called Concept-Tests. These are multiple-choice questions whose distractors represent common problems and misconceptions related to the concepts. While there…

The study used phenomenology to examine teacher candidates' metaphorical perceptions for measurement and evaluation practices in distance education. 210 teacher candidates at a foundation university in Istanbul were included in the study group. Researchers collected data using a three-part form. The first part gathered demographic information, the…

Despite extensive studies on large language models and their capability to respond to questions from various licensed exams, there has been limited focus on employing chatbots for specific subjects within the medical curriculum, specifically medical neuroscience. This research compared the performances of Claude 3.5 Sonnet (Anthropic), GPT-3.5 and…

Digital administration of assessments allows for the collection of process data indices, such as response time, which can serve as indicators of rapid-guessing and examinee test-taking effort. Setting a time threshold is essential to distinguish effortful from effortless behavior using item response times. Threshold identification methods may…