The use of computerized adaptive testing algorithms for ranking items (e.g., college preferences, career choices) involves two major challenges: unacceptably high computation times (selecting from a large item pool with many dimensions) and biased results (enhanced preferences or intensified examinee responses because of repeated statements across…

The purpose of this study was to compare the quality of multiple choice questions (MCQs) developed using automated item generation (AIG) versus traditional methods, as judged by a panel of experts. The quality of MCQs developed using two methods (i.e., AIG or traditional) was evaluated by a panel of content experts in a blinded study. Participants…

The purpose of this study is to reduce ethics violations such as tricking and cheating that may occur in the offline assessment of undergraduate level Physics-II (Electricity) course subjects. The study is significant for the reliable and ethical evaluation of the Internet and computer-based educational process. Thirty-eight pre-service teachers…

This study aimed to reveal the differences in individuals' abilities, their standard errors, and the psychometric properties of the test according to the two methods of applying the test (electronic and paper). The descriptive approach was used to achieve the study's objectives. The study sample consisted of 74 male and female students at the…

Purpose: The present study assessed the test-retest reliability of the American Sign Language (ASL) version of the Computerized Revised Token Test (CRTT-ASL) and compared the differences and similarities between ASL and English reading by Deaf and hearing users of ASL. Method: Creation of the CRTT-ASL involved filming, editing, and validating CRTT…

Purpose: This study evaluated the feasibility of the "Start to Move" (S2M) digital assessment of children's fundamental movement skills being implemented by primary school teachers within PE lessons. Methods: Nine primary school teachers in the United Kingdom trialed S2M weekly over a 6-week period. Posttrial surveys and interviews were…

This research explored the effect of incentives to complete online quizzes during a course. When a 1% weighting incentive per quiz was removed, student engagement dropped dramatically. There is also evidence that students who continued to complete quizzes did so with less vigour, spending less time on each quiz, starting them later in the week and…

In this study, we applied natural language processing (NLP) techniques, within an educational environment, to evaluate their usefulness for automated assessment of students' conceptual understanding from their short answer responses. Assessing understanding provides insight into and feedback on students' conceptual understanding, which is often…

With the effect of the pandemic, higher education is maintained all over the world with the help of online education methods. How to make online exams, which are an important part of distance education processes, in a way to prevent cheating and illegal behavior is an important issue that brings with it discussions. This research, in which the…

Purpose: The purpose of this case study is to share the authors' involvement and observation in adopting online exam as an evaluation tool, in the hope that others may too be able to adapt and circumvent this lockdown period while bringing a more reliable methodological approach in an online exam. Design/methodology/approach: This is a case study…

The COVID-19 shutdown of in-person university classrooms in Spring 2020 brought the question of how to conduct online examinations into urgent focus. Although, online education has been around since 1984 and online exams have been routinely built into online course syllabi, the mid-semester transition to online teaching confronted many instructors…

Machine learning (ML) has been increasingly employed in science assessment to facilitate automatic scoring efforts, although with varying degrees of success (i.e., magnitudes of machine-human score agreements [MHAs]). Little work has empirically examined the factors that impact MHA disparities in this growing field, thus constraining the…

An essential question when computing test--retest and alternate forms reliability coefficients is how many days there should be between tests. This article uses data from reading and math computerized adaptive tests to explore how the number of days between tests impacts alternate forms reliability coefficients. Results suggest that the highest…

In automated essay scoring (AES), scores are automatically assigned to essays as an alternative to grading by humans. Traditional AES typically relies on handcrafted features, whereas recent studies have proposed AES models based on deep neural networks to obviate the need for feature engineering. Those AES models generally require training on a…

In modern times, the importance of education cannot be overstated. Beyond the acquisition of knowledge, perhaps the most important aim of education may be the development of character in individuals, including vitality, courage, sensitiveness, and intelligence, from which our society may experience increased prosperity, peace, and freedom. In this…