Automated assessment is well-established within computer science courses but largely absent from human--computer interaction courses. Automating the assessment of human--computer interaction (HCI) is challenging because the coursework tends not to be computational but rather highly creative, such as designing and implementing interactive…

Background: Remote assessment through telehealth offers potential benefits for people with aphasia (PWA), particularly where in-person services are limited. However, its diagnostic validity in developing countries remains underexplored due to differences in infrastructure and digital literacy. Aims: To compare in-person and remote administration…

Formative assessment is a type of low-stakes assessment that can help reduce student anxiety and encourage students to engage in the course regularly. Formative assessment can also help instructors identify knowledge gaps. Students who had completed the first semester of a two-semester sophomore-level anatomy and physiology sequence were surveyed…

"A Practical Guide to Language Assessment" helps educators at every level redefine their approach to language assessment. Grounded in extensive research and aligned with the latest advances in language education, this comprehensive guide introduces foundational concepts and explores key principles in test development and item writing.…

The purpose of this study was to generate an item bank for assessing faculty members' assessment literacy and to examine the applicability and feasibility of a Computerized Adaptive Test (CAT) approach to monitor assessment literacy among faculty members. In developing this assessment using a sequential mixed-methods research design, our goal was…

Previous research has shown that phonological awareness is one of the most important prerequisites for early reading. Monitoring its development requires reliable, easy-to-use instruments especially in the last years of kindergarten. The present study aims to explore the potential for assessing phonological awareness and some of its subskills…

In automated essay scoring (AES) systems, similarity techniques are used to compute the score for student answers. Several methods to compute similarity have emerged over the years. However, only a few of them have been widely used in the AES domain. This work shows the findings of a ten-year review on similarity techniques applied in AES systems…

Although many educational and psychological tests are labeled as computerized adaptive test (CAT), not all tests show the same level of adaptivity -- some tests might not have much adaptation because of various constraints imposed by test developers. Researchers have proposed some indices to measure the amount of adaption for an adaptive test.…

There has been a growing interest in approaches based on machine learning (ML) for detecting test collusion as an alternative to the traditional methods. Clustering analysis under an unsupervised learning technique appears especially promising to detect group collusion. In this study, the effectiveness of hierarchical agglomerative clustering…

Computerized adaptive testing (CAT) offers an efficient and highly accurate method for estimating examinees' abilities. In this article, the free version of Concerto Software for CAT was reviewed, dividing our evaluation into three sections: software implementation, the Item Response Theory (IRT) features of CAT, and user experience. Overall,…

This research synthesizes studies that used a Digitalized Interactive Component (DIC) to assess K-12 student performance during Computer-based-Assessments (CBAs) in mathematics. A systematic search identified ten studies, including four that provided language assistance and six that provided response-construction support. We reported on the one…

Despite the fact that the digital administration format of Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V) was published in 2016, no research to date has examined its factor structure using all 10 of the primary subtests to measure intellectual ability. The purpose of this study, therefore, was to use exploratory and confirmatory…

Background: For peer assessment, reliability (i.e., consistency in ratings across peers) and validity (i.e., consistency of peer ratings with instructors or experts) are frequently examined in the research literature to address a central concern of instructors and students. Although the average levels are generally promising, both reliability and…

The issues of academic integrity across online and in-person assessments were addressed by analyzing student total, conceptual, and numerical performance scores in the three modes of assessment: (1) In-person assessment with proctoring; (2) Online unproctored assessment; and (3) Respondus assessment online with proctoring. It was identified that…

In this three-study investigation, we applied various approaches to score drawings created in response to both Form A and Form B of the Torrance Tests of Creative Thinking-Figural (broadly TTCT-F) as well as the Multi-Trial Creative Ideation task (MTCI). We focused on TTCT-F in Study 1, and utilizing a random forest classifier, we achieved 79% and…