In this study, we investigated whether the use of smartphone games while reading a text reduces learning performance or reading speed. We also examined whether this is affected by push notifications. Ninety-three students were randomly assigned to three learning conditions. In the gaming group (G), participants played a game app for 20 s at 2-min…

The emergency transition to online learning due to COVID-19 has forced many sectors to respond quickly. The readiness of educational institutes to attend to the abrupt crisis and shift to teach remotely is practiced at different levels. Online assessment is one of them. Rapid advances in technology and software applications are changing the…

We developed a Quantum Mechanics Conceptual Understanding Survey (QMCUS) in this study. The survey was conducted using a quantitative methodology. A multiple-choice survey of 35 questions was administered to 338 undergraduate students. Three experienced quantum mechanics instructors examined the validity of the survey. The reliability of our…

The Conceptual Survey of Electricity and Magnetism (CSEM) is a multiple-choice survey that contains a variety of electricity and magnetism concepts from Coulomb's law to Faraday's law at the level of introductory physics used to help inform instructors of student mastery of those concepts. Prior studies suggest that many concepts on the survey are…

Item response theory (IRT) is a popular method to infer student abilities and item difficulties from observed test responses. However, IRT struggles with two challenges: How to map items to skills if multiple skills are present? And how to infer the ability of new students that have not been part of the training data? Inspired by recent advances…

Background: In countries that endorse science, technology, engineering, and mathematics (STEM) education as an educational movement, design-based learning is deemed a pedagogical approach. Purpose: Because the integration of the engineering design process and scientific investigation has been an issue in science education, this study examined the…

A new teaching format, the LecturePlus, was formulated as a lecture followed by small-group learning activities. This study assessed the effectiveness of LecturePlus in medical education. An interventional study was conducted among final-year medical students, with 74 students in the experimental group and 96 students in the control group. Each…

Readers often struggle to identify the main ideas in expository texts. Existing research and instruction provide some guidance on how to encourage readers to identify main ideas. However, there is substantial variability in how main ideas are operationalized and how readers are prompted to identify main ideas. This variability hinders…

Whether visual information belongs in second language (L2) listening tests has long been a subject for scholarly debate, with L2 learners' performance on and perceptions of video-based tests being the primary sources of evidence. The research into L2 teachers' perceptions, however, is scarce, as is the research into stakeholders' views of content…

The New York State Education Department (NYSED) has a partnership with NWEA for the development of the 2024 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2024 Grades 6 and 7 English Language…

Educational videos are becoming more prevalent within a higher education context and the use of videos is now taken for granted. However, the full impact videos have on learning is under researched and not fully known. This study was conducted to investigate the effectiveness of quiz questions embedded throughout a video. Students from different…

This article presents a novel experimental methodology in which groups of students were offered the option to choose between two equivalent scoring rules to assess a multiple-choice test. The effect of choosing the scoring rule on marks is tested. Two major contributions arise from this research. First, it contributes to the literature on the…

Due to their test economy and objective evaluability, multiple-choice items are used much more frequently to test knowledge than constructed-response questions. However, studies point out that dependencies may exist between the individual test result and the test format (multiple-choice or constructed-response). Studies testing economic knowledge…

One of the most important goals in E-learning is to guarantee that participants reach the learning objectives. We have observed that having the knowledge of the subject is not sufficient for reaching learning objectives. The participants must also develop understanding that they know the subject, which we have named confidence. In this work, we…

Assessment plays an important role in learning and Multiple Choice Questions (MCQs) are quite popular in large-scale evaluations. Technology-enabled learning necessitates a smart assessment. Therefore, automatic MCQ generation became increasingly popular in the last two decades. Despite a large amount of research effort, system generated MCQs are…