Given the widespread presence of competition in educational settings and its complex impact on science learning, how students complete tasks in competitive environments has attracted a wide range of attention. The purpose of this study is to compare students' performance on physics conceptual questions in noncompetitive and competitive…

The intricate relationship between representational competence and content knowledge in organic chemistry has been widely debated, and the ways in which representations contribute to task difficulty, particularly in assessment, remain unclear. This paper presents a multiple-choice test instrument for assessing individuals' knowledge of fundamental…

Prior research has emphasized that two-tier tests are an effective approach to guiding students through game tasks; furthermore, self-efficacy, which is potentially related to students' surroundings and academic performance, has a positive impact on students' cognitive outcomes in games. This implies the significance of conducting a study to probe…

Answering the call for response process-based validation, this study shows how researchers can evaluate validity evidence of test scores based on the mental "processes" test-takers use, rather than based on correlations with other "outcome" measures. The proposed methods for process-based validation studies are demonstrated…

Digital games have been used in various disciplines to enhance students' learning interest and effectiveness through the gaming contexts. However, most of the digital educational games use multiple-choice questions to confirm students' learning status, implying the challenge of understanding the actual learning status of students. Also, the gaming…

The development and evaluation of valid assessments of scientific reasoning are an integral part of research in science education. In the present study, we used the linear logistic test model (LLTM) to analyze how item features related to text complexity and the presence of visual representations influence the overall item difficulty of an…

The use of concurrent data elicitation procedures (e.g. think-alouds, eye-tracking, response time) to investigate learners' cognitive processing and processes is becoming more prominent in research designs as researchers seek to acquire a better understanding of how second language (L2) learners process L2 data (e.g. Martin et al., 2019; Rogers,…

Distractors might display discriminatory power with respect to the construct of interest (e.g., intelligence), which was shown in recent applications of nested logit models to the short-form of Raven's progressive matrices and other reasoning tests. In this vein, a simulation study was carried out to examine two effect size measures (i.e., a…

Comprehending a text involves constructing a coherent mental representation of it and deep comprehension of a text in its entirety is a critical skill in academic contexts. Interpretations on test takers' ability to comprehend texts are made on the basis of performance in test tasks but the extent to which test tasks are effective in directing…

Although an accurate measure of vocabulary size is integral to understanding the proficiency of language learners, the validity of multiple-choice (M/C) vocabulary tests to determine this has been questioned due to users guessing correct answers which inflates scores. In this paper the nature of guessing and partial knowledge used when taking the…

This article describes the results of Action Research conducted in an ESP classroom of Dhofar University located in Oman. Following the call of Oman Vision 2040 to emphasize educational practices that promote the development of higher-order cognitive processes, this study raises the following question: Can an online multiple choice question (MCQ)…

Although listening is key to communication, it remains the least studied skill compared to other skills, both at the national and international levels, among learners of English as a foreign language (EFL). There is also often a lack of awareness among scholars and teachers of how listening takes place, how it is best taught, and how it can be…

This study aims to scrutinise the cognitive and metacognitive strategies of the 6th-grade students while answering multiple-choice questions on "Human Body Systems" within the domain of their Biology course. In determining these strategies, the characteristics of multiple-choice questions (figures, graphs, explanations, etc.) were also…

The aim of the study was to determine whether there is a relationship between students' answers to geography questions framed according to the factual and conceptual levels of the knowledge dimension of the Revised Bloom's Taxonomy. The study used a correlational survey design. The data were gleaned from the answers that 52 students studying…

In this study, we describe the methodology used to identify and validate a set of expert-defined fraction subtraction related attributes. These attributes are expected to be mastered by 6th grade students toward proficiency in fraction subtraction. This research argues and demonstrates that state standards guiding subject instruction plays an…