Multiple-choice quizzes (MCQs) are a popular form of assessment. A rapid shift to online assessment during the COVID-19 pandemic in 2020, drove the uptake of MCQs, yet limited invigilation and wide access to material on the internet allow students to solve the questions via internet search. ChatGPT, an artificial intelligence (AI) agent trained on…

Digital games have been used in various disciplines to enhance students' learning interest and effectiveness through the gaming contexts. However, most of the digital educational games use multiple-choice questions to confirm students' learning status, implying the challenge of understanding the actual learning status of students. Also, the gaming…

Eye-tracking technology can create a record of the location and duration of visual fixations as a test-taker reads test questions. Although the cognitive process the test-taker is using cannot be directly observed, eye-tracking data can support inferences about these unobserved cognitive processes. This type of information has the potential to…

Comprehending a text involves constructing a coherent mental representation of it and deep comprehension of a text in its entirety is a critical skill in academic contexts. Interpretations on test takers' ability to comprehend texts are made on the basis of performance in test tasks but the extent to which test tasks are effective in directing…

This article reports a validity study of History Assessments of Thinking (HATs), which are short, constructed-response assessments of historical thinking. In particular, this study focuses on aspects of cognitive validity, which is an examination of whether assessments tap the intended constructs. Think-aloud interviews with 26 high school…

This article describes the results of Action Research conducted in an ESP classroom of Dhofar University located in Oman. Following the call of Oman Vision 2040 to emphasize educational practices that promote the development of higher-order cognitive processes, this study raises the following question: Can an online multiple choice question (MCQ)…

Learning standards across the United States have increasingly called for history students to engage in aspects of "historical thinking," a term used to describe the complex disciplinary processes that historians use to make sense of the past. Although students are expected to learn these complex processes, little is known about how to…

The reading framework for the 2015 National Assessment of Educational Progress (NAEP) presents the assessment's conceptual base and discusses its content. The framework describes the types of texts and questions that should be included in the assessment, as well as how the questions should be designed and scored. This report provides highlights of…

Concept inventories hold tremendous promise for promoting the rigorous evaluation of teaching methods that might remedy common student misconceptions and promote deep learning. The measurements from concept inventories can be trusted only if the concept inventories are evaluated both by expert feedback and statistical scrutiny (psychometric…

As the ongoing national indicator of what American students know and can do, the National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through The Nation's Report Card, the NAEP Reading Assessment reports how well students perform in…

The current paper discusses ambiguities in critical thinking assessment. The paper first reviews the components of critical thinking. It then discusses the features and issues of commonly used critical thinking tests and to what extend they are made compatible to the conceptualization of critical thinking. The paper argues that critical thinking…

As the ongoing national indicator of what American students know and can do, the National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through The Nation's Report Card, the NAEP Reading Assessment reports how well students perform in…

Fifth graders completed multiple choice exams and measures of cognitive style to determine whether changing answers was more frequent and productive for field independent or field dependent, reflective or impulsive, students. Impulsive students changed more answers and gained more points. Field dependence/field independence did not relate to…

Investigated the test-taking processes of English-as-a-Foreign-Language (EFL) testees taking a multiple choice listening-comprehension test, evaluating the effectiveness of immediate retrospection for accessing such processes. Linguistic and non-linguistic knowledge was activated in a parallel manner for all subjects with input of various…

Performance by medical school sophomores (N=106) on higher-order questions in a second year introductory medicine course did not correlate with perceived performance in subsequent clerkships any better than did performance on fact-recall items. The use of multiple clinical simulations may emerge as the only satisfactory controlled assay of…