This article introduces the Quality of Item Pool (QIP) Index, a novel approach to quantifying the adequacy of an item pool of a computerized adaptive test for a given set of test specifications and examinee population. This index ranges from 0 to 1, with values close to 1 indicating the item pool presents optimum items to examinees throughout the…

Computer adaptive testing is an important research field in educational measurement, and simulation studies play a critically important role in CAT development and evaluation. Both Monte Carlo and Post Hoc simulations are frequently used in CAT studies in order to investigate the effects of different factors on test efficiency and to compare…

Scoring of teachers' noticing responses is typically burdened with rater bias and reliance upon interrater consensus. The authors sought to make the scoring process more objective, equitable, and generalizable. The development process began with a description of response characteristics for each professional noticing component disconnected from…

Intelligence Tutoring Systems (ITSs) focus on promoting knowledge acquisition, while providing relevant feedback during students' practice. Self-explanation practice is an effective method used to help students understand complex texts by leveraging comprehension. Our aim is to introduce a deep learning neural model for automatically scoring…

This paper presents improvements made to a computerized adaptive testing (CAT)-based version of the FCI (FCI-CAT) in regards to test security and test efficiency. First, we will discuss measures to enhance test security by controlling for item overexposure, decreasing the risk that respondents may (i) memorize the content of a pretest for use on…

How can one construct a test that provides accurate measurements across the range of performance levels while providing adequate coverage of all of the critical areas of the domain, yet that is not unmanageably long? This paper discusses the approach taken in a linear test of academic English language, and how the transition to a computer-based…

Children have traditionally been viewed as less reliable witnesses than are adults. More recently, a concept known as developmental reversals, has brought this view into question. Developmental reversals have demonstrated that in certain contexts, children produce fewer false memories than adults. The primary paradigm used to demonstrate…

Implementing a randomized controlled trial design, the present study investigated the effects of two types of accommodations, linguistic modification and a glossary, for English learners (ELs) taking a computer-based mathematics assessment. Process data including response time and clicks on glossary words were also examined to better interpret…

COVID-19 pandemic lockdown is an emergency period in education where assessment of teaching and learning became inevitable to determine effectiveness of the digital processes used. The objectives of this research are to; (a) investigate the types of assessment used during the COVID-19 pandemic in Nigeria; (b) establish the effectiveness of the…

This study examines relationships between digital SAT scores and other relevant educational measures, such as high school grade point average (HSGPA), PSAT/NMSQT Total score, and Average AP Exam score, and compares those relationships to current paper and pencil SAT score relationships with the same measures. This information can provide…

In Automated Essay Scoring (AES) systems, many previous works have studied group fairness using the demographic features of essay writers. However, individual fairness also plays an important role in fair evaluation and has not been yet explored. Initialized by Dwork et al., the fundamental concept of individual fairness is "similar people…

Can a single adjective immediately influence message-building during sentence processing? We presented participants with 168 sentence contexts, such as "His skin was red from spending the day at the …" Sentences ended with either the most expected word ("beach") or a low cloze probability completion ("pool"). Nouns…

It has been extensively researched how satisfied students are with the vast majority of goods and services offered by educational institutions of higher learning. However, there appears to be a paucity of research on students' satisfaction with the facilities and services of computer-based assessment (CBA) centers in higher education institutions,…

The idea of data-based decision-making (DBDM) at the classroom level is that teachers use assessment data to adapt their instruction to students' individual needs and thus improve students' learning progress. In this study, we first investigate this theoretically assumed DBDM process, and second, we evaluate the effectiveness of teacher support on…

The COVID-19 pandemic has been a strong driver for moving more teaching and learning activities online. Border restrictions have had a severe impact on international students either hoping to enroll in courses offered in Australia or continue with such courses if they are already enrolled. The online learning experience is likely different between…