This qualitative study explores the levels of technology acceptance of students and teachers in higher education regarding the use of artificial intelligence (AI) in summative assessment. Twelve students and eight teachers of a university expressed their views on a series of hypothetical scenarios. Stimulated recall interviews, using hypothetical…

In today's digital age, tests are increasingly being delivered on computers. Many of these computer-based tests (CBTs) have been adapted from paper-based tests (PBTs). However, this change in mode of test administration has the potential to introduce construct-irrelevant variance, affecting the validity of score interpretations. Because of this,…

As a form of assessment, examinations are designed to determine whether students have met learning outcomes. However, students with disabilities report avoiding examinations, selecting units of study where the assessments align with their strengths. To ensure examinations do not contribute to the systematic exclusion of students with disabilities,…

Automated writing evaluation (AWE) systems are developed based on interdisciplinary research and technological advances such as natural language processing, computer sciences, and latent semantic analysis. Despite a steady increase in research publications in this area, the results of AWE investigations are often mixed, and their validity may be…

Objectives: The purpose of this study is to determine university students' views on online exams during the pandemic. The study was carried out with the participation of 15 undergraduate students studying at an engineering university in Azerbaijan. Methods: Interpretive phenomenology guided the study. Data were collected through semi-structured…

Free text answers to short questions can reflect students' mastery of concepts and their relationships relevant to learning objectives. However, automating the assessment of free text answers has been challenging due to the complexity of natural language. Existing studies often predict the scores of free text answers in a "black box"…

Online tests offer many advantages but they still belong to assessment, which may make learners have anxiety. Thus, students may experience certain emotion. Academic emotion is a branch of emotion and has great effects on student learning. Such effects can be associated with individual differences, especially prior knowledge. To this end, this…

Background: Over the last 20 years, educational large-scale assessments have undergone dramatic changes moving away from simple paper-pencil assessments to innovative, technology-based assessments. This comprehensive switch has led to some rather technical improvements such as identifying early guessing or improving standardization. Objectives: At…

E-assessments are becoming increasingly common and progressively more complex. Consequently, how these longer, more complex questions are designed and marked is imperative. This article uses the NUMBAS e-assessment tool to investigate the best practice for creating longer questions and their mark schemes on surveying modules taken by engineering…

We conducted a collective case study investigating two college algebra students' graph reasoning and selection on an online assessment. Students completed the assessment during individual, semi-structured interviews, as part of a broader validation study. The assessment contained six items; students selected Cartesian graphs to represent…

With the increased restrictions on physical distancing due to the COVID-19 pandemic, remote proctoring has emerged as an alternative to traditional onsite proctoring to ensure the continuity of essential assessments, such as computer-based medical licensing exams. Recent literature has highlighted the significant impact of different proctoring…

Within the scope of this study, it was aimed to determine the factors that should be considered regarding the usability and security of online test applications used as an assessment and evaluation tool during the COVID-19 pandemic. In this context, the case study method was used to obtain the opinions of field experts. Furthermore, in this study,…

Assessments are a way for stakeholders in education to understand what students know and can do. They can take many forms, including but not limited to paper and pencil or computer-adaptive formats. However, assessments do not have to be tests in the traditional sense at all; rather, they can be carried out through teacher observations of students…

For many years, question choice has been used in some UK public examinations, with students free to choose which questions they answer from a selection (within certain parameters). There has been little published research on choice of exam questions in recent years in the UK. In this article we distinguish different scenarios in which choice…

Computer Adaptive Multistage Testing (ca-MST), which take the advantage of computer technology and adaptive test form, are widely used, and are now a popular issue of assessment and evaluation. This study aims at analyzing the effect of different panel designs, module lengths, and different sequence of a parameter value across stages and change in…