Traditional item analyses such as classical test theory (CTT) use exam-taker responses to assessment items to approximate their difficulty and discrimination. The increased adoption by educational institutions of electronic assessment platforms (EAPs) provides new avenues for assessment analytics by capturing detailed logs of an exam-taker's…

Traditionally, researchers employ human raters for scoring responses to creative thinking tasks. Apart from the associated costs this approach entails two potential risks. First, human raters can be subjective in their scoring behavior (inter-rater-variance). Second, individual raters are prone to inconsistent scoring patterns…

The purpose of this study was to compare calibration and linking methods for placing pretest item parameter estimates on the item pool scale in a 1-3 computerized multistage adaptive testing design in terms of item parameter recovery. Two models were used: embedded-section, in which pretest items were administered within a separate module, and…

Online calibration is a key technology for item calibration in computerized adaptive testing (CAT) and has been widely used in various forms of CAT, including unidimensional CAT, multidimensional CAT (MCAT), CAT with polytomously scored items, and cognitive diagnostic CAT. However, as multidimensional and polytomous assessment data become more…

Computer-based testing (CBT) is becoming an increasingly popular format of assessment in educational settings. If students face a digital divide in terms of access to computers at school and at home, CBT may exacerbate measured student achievement gaps. In this paper, we use the rollout of CBT in South Carolina starting in 2015 to investigate its…

To improve the calibration accuracy and calibration efficiency of cognitive diagnostic computerized adaptive testing (CD-CAT) for new items and, ultimately, contribute to the widespread application of CD-CAT in practice, the current article proposed a Gini-based online calibration method that can simultaneously calibrate the Q-matrix and item…

As universities moved to remotely taught courses during the COVID-19 pandemic, the importance of maintaining academic integrity in online environments intensified. In response, this study explores instructors' perceptions about the role of online proctoring as a tool for their courses with the intent of enhancing the understanding of online…

The replacement of existing technology or the introduction of novel technology into the day-to-day routines of higher education institutions is not a trivial task. Currently, many higher education institutions are faced with the challenge of replacing existing procedures for administering written exams with e-exams. To guide this process, this…

Prior research highlights the benefits of multimode surveys and best practices for item-by-item (IBI) and matrix-type survey items. Some researchers have explored whether mode differences for online and paper surveys persist for these survey item types. However, no studies discuss measurement invariance when both item types and online modes are…

The purpose of this study was to examine any differences in test scores between three different online versions of the Mental Cutting Test (MCT). The MCT was developed to quantify a rotational and proportion construct of spatial ability and has been used extensively to assess spatial ability. This test was developed in 1938 as a paper-and-pencil…

Research on formative assessment in accounting education examines the learning outcomes stemming from e-assessment or formative assessment within a stand-alone subject, but few studies examine the benefits and implications of continuous formative assessment or the perceptions of students who undertake formative assessment. The findings of…

A tree model for diagnostic educational testing is described along with Monte Carlo simulations designed to evaluate measurement accuracy based on the model. The model is implemented in an assessment of inferential reading comprehension, the Multiple-Choice Online Causal Comprehension Assessment (MOCCA), through a sequential, multidimensional,…

The purpose of this quantitative study was to examine the relationship between the use of online proctoring software and technostress, age, and years' experience utilizing educational technology among nurse educators' using online proctoring software for the first time during the COVID-19 pandemic. A total of 131 surveys were returned via…

Integrity and quality of assessments on the online platform should be upheld to ensure that it supports student learning as well as the efficacy of teaching because in the end it measures the reputation of an institution. How institutions have traversed such domains remains a grey area. This paper provides anecdotal insights into how staff from a…

The turn to online learning and training programs as a response to challenging times (i.e., the COVID-19 crisis) necessitated the need for internet-based testing solutions. Researchers generally have found that Unproctored Internet Testing (UIT) for high-stakes cognitive ability assessments results in higher scores than proctored assessments. Live…