Using item-response theory to model rater effects provides an alternative solution for rater monitoring and diagnosis, compared to using standard performance metrics. In order to fit such models, the ratings data must be sufficiently connected in order to estimate rater effects. Due to popular rating designs used in large-scale testing scenarios,…

This study aims to see the effect of student perceptions on web-based character assessment on the results of student character assessment. The population in this study was a junior high school in Batanghari Regency with a sample of 322 students using the purposive sampling technique. Quantitative methods are used in this study with descriptive and…

In mixed methods approaches, statistical models are used to identify "nested" cases for intensive, small-n investigation for a range of purposes, including notably the examination of causal mechanisms. This article shows that under a commonsense interpretation of causal effects, large-n models allow no reliable conclusions about effect…

We introduce a short answer scoring engine made up of an ensemble of deep neural networks and a Latent Semantic Analysis-based model to score short constructed responses for a large suite of questions from a national assessment program. We evaluate the performance of the engine and show that the engine achieves above-human-level performance on a…

To detect differential item functioning (DIF), Rasch trees search for optimal split-points in covariates and identify subgroups of respondents in a data-driven way. To determine whether and in which covariate a split should be performed, Rasch trees use statistical significance tests. Consequently, Rasch trees are more likely to label small DIF…

Background: Massive Open Online Courses (MOOCs) have touted the idea of democratizing education, but soon enough, this utopian idea collided with the reality of finding sustainable business models. In addition, the promise of harnessing interactive and social web technologies to promote meaningful learning was only partially successful. And…

This study presents the results of a sequential explanatory mixed-method approach to investigate the Iranian English language non-gainers of a computerized dynamic reading comprehension test (CDRT) by utilizing a learning style survey. Using an interventionist approach, the researchers used the CDRT software to explore English learners' perceptual…

Multidimensional scoring evaluates each constructed-response answer from more than one rating dimension and/or trait such as lexicon, organization, and supporting ideas instead of only one holistic score, to help students distinguish between various dimensions of writing quality. In this work, we present a bilevel learning model for combining two…

The challenges of teaching during the COVID-19 pandemic were multiple and accompanied by dramatic changes in the experiences of students, faculty, and administration. However, this year also offered us an opportunity to be creative and generate new ideas to solve problems we knew about but often did not have enough of a reason to make significant…

Practice testing is a powerful tool to consolidate long-term retention of studied information, facilitate subsequent learning of new information, and foster knowledge transfer. However, practitioners frequently express the concern that tests are anxiety-inducing and that their employment in the classroom should be minimized. The current review…

The purpose of this meta-analysis was to examine the effects of Gamified-Assessment Tools (GAT) used in formal educational settings on student academic achievement. We used PRISMA systematic procedures to screen the articles across Web of Science, ERIC, Scopus, Pubmed, and PsycArticles databases. We identified 23 independent results from 17…

Academic dishonesty is a major issue in education. Perhaps more so in the online environment where may times students are on their honor to complete exams without the use of the Internet, notes, or other prohibited materials. The age range of 18-24 encompasses the traditional aged student body. The non-traditional students are over the age of 25…

Despite the widespread use of examples in survey questions, very few studies have examined their impact on survey responses, and the evidence is mainly based on data collected in the United States using questionnaires in English. This study builds on previous research by examining the effects of providing examples using data from a cross-national…

The National Assessment of Educational Progress (NAEP) is an integral measure of academic progress over time. It is the largest nationally representative and continuing assessment of what our nation's students know and can do in various subjects such as mathematics, reading, and science. The program also provides valuable insights into students'…

School psychologists often administer evidence-based academic interventions such as Explicit Timing in order to increase math fact fluency. However, little is known about the efficacy of adapting Explicit Timing interventions to be used in a virtual format. This dissertation examines the use of virtually delivered Explicit Timing interventions as…