With the advances of technologies, possessing digital and information literacy is crucial for the selection of candidates by employers in this digital AI era. For most students, receiving and outputting electronic text has become the norm, and thus examinations with writing components done by hand may not accurately reflect their abilities. It…

COVID-19 has disrupted higher education globally, and there is scarce information about the "learning loss" in university students throughout this crisis. The goal of the study was to compare scores in a large-scale knowledge diagnostic exam applied to students admitted to the university, before and during the pandemic. Research design…

The current investigation reflects on the insufficient performance of students in virtual exams in the era of transformation of the physical mode of education to digital one due to the passive adaptation to the technical drive of the virtual environment, the tenuous command of platform's technical language, especially in mathematics and physics…

One perceived advantage of computer-based testing is that accessibility tools can be embedded within the testing format, allowing students with disabilities to use them when necessary to remove unique barriers within testing. However, an important assumption is that students activate and use the tools when needed. Initial data from large-scale…

Edmentum offers a personalized learning platform called Exact Path. This quasi-experimental study, designed to meet ESSA Tier 2 evidence and What Works Clearinghouse standards with reservations, aimed to assess the efficacy of Exact Path in a district from the Midwestern United States. The goal was to provide specific recommendations to educators…

Remote proctoring, or monitoring test takers through internet-based, video-recording software, has become critical for maintaining test security on high-stakes assessments. The main role of remote proctors is to make judgments about test takers' behaviors and decide whether these behaviors constitute rule violations. Variability in proctor…

Questionnaires are by far the most common tool for measuring noncognitive constructs in psychology and educational sciences. Response bias may pose an additional source of variation between respondents that threatens validity of conclusions drawn from questionnaire data. We present a mixture modeling approach that leverages response time data from…

With the recent and rapid transition to online teaching and learning in higher education, this explanatory study investigated the key design considerations used by business educators designing assessments suitable for online delivery. From a comprehensive literature review, we identified five key design considerations for online assessments: they…

As a result of the COVID-19 pandemic, online assessment has become pivotal to allow evaluation of the knowledge and competences of teachers-to-be. In this context, this study explored language teacher educators' conceptions and practices of online assessment and the implications of this type of assessment for language teacher education. Forty-six…

"Tests of Aptitude for Language Learning" (TALL) is an openly accessible internet-based battery to measure the multifaceted construct of foreign language aptitude, using language domain-specific instruments and L1-sensitive instructions and stimuli. This brief report introduces the components of this theory-informed battery and…

There has been widespread media commentary about the potential impact of generative Artificial Intelligence (AI) such as ChatGPT on the Education field, but little examination at scale of how educators believe teaching and assessment should change as a result of generative AI. This mixed methods study examines the views of educators (n = 318) from…

This study examines the proficiency of Chat GPT, an AI language model, in answering questions on the Situational Judgement Test (SJT), a widely used assessment tool for evaluating the fundamental competencies of medical graduates in the UK. A total of 252 SJT questions from the "Oxford Assess and Progress: Situational Judgement" Test…

The aim of this study was to investigate whether secondary science teachers had different styles of technology adoption for technology-based assessments (TBAs), and whether teachers with different adoption styles showed different patterns of beliefs, attitudes and intentions regarding TBAs. By combining the variable-centered and person-centered…

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection…

This paper describes methods and findings from student cognitive labs, teacher cognitive labs, and test administration observations as evidence evaluated in a validity argument for a computer-based alternate assessment for students with significant cognitive disabilities. Validity of score interpretations and uses for alternate assessments based…