The literature showing that subscores fail to add value is vast; yet despite their typical redundancy and the frequent presence of substantial statistical errors, many stakeholders remain convinced of their necessity. This article describes a method for identifying and reporting unexpectedly high or low subscores by comparing each examinee's…

Bayesian knowledge tracing model (BKT) is a typical student knowledge assessment method. It is widely used in intelligent tutoring systems. In the standard BKT model, all knowledge and skills are independent of each other. However, in the process of student learning, they have a very close relation. A student may understand knowledge B better when…

Producers and consumers of test scores are increasingly concerned about fraudulent behavior before and during the test. There exist several statistical or psychometric methods for detecting fraudulent behavior on tests. This paper provides a review of the Bayesian approaches among them. Four hitherto-unpublished real data examples are provided to…

Producers and consumers of test scores are increasingly concerned about fraudulent behavior before and during the test. There exist several statistical or psychometric methods for detecting fraudulent behavior on tests. This paper provides a review of the Bayesian approaches among them. Four hitherto-unpublished real data examples are provided to…

In May 2019, College Board published the first national operational SAT® validity study on the new SAT introduced in 2016. Based on data from more than 221,000 students across 169 four-year colleges and universities, the study showed that the SAT was essentially as effective as high school grades in predicting students' college performance and…

The question of whether humans represent grammatical knowledge as a binary condition on membership in a set of well-formed sentences, or as a probabilistic property has been the subject of debate among linguists, psychologists, and cognitive scientists for many decades. Acceptability judgments present a serious problem for both classical binary…

Curriculum Associates' i-Ready is an adaptive diagnostic and individualized instructional tool that has been used in M-DCPS in the last few years. In addition, Curriculum Associates provides the District with results of their predictive model, which uses the students' outcomes on the Fall and Winter i-Ready diagnostic testing as well as the…

Bayesian Knowledge Tracing (BKT) is a commonly used approach for student modeling, and Long Short Term Memory (LSTM) is a versatile model that can be applied to a wide range of tasks, such as language translation. In this work, we directly compared three models: BKT, its variant Intervention-BKT (IBKT), and LSTM, on two types of student modeling…

A central issue in nonexperimental studies is identifying comparable individuals to remove selection bias. One common way to address this selection bias is through propensity score (PS) matching. PS methods use a model of the treatment assignment to reduce the dimensionality of the covariate space and identify comparable individuals. parallel to…

When is the right moment to transition an English learner student from part-time participation in English language development classes into full-time participation in mainstream English-only classes? English learner students should be moved into full-time mainstream English-only classes when they are sufficiently fluent in English to be able to…

Curriculum Associates' i-Ready is an adaptive diagnostic and individualized instructional tool that has been used in M-DCPS in the last few years. In addition, in 2016-2017, Curriculum Associates provided the District with results of their predictive model, which used the outcomes of the Fall and Winter i-Ready diagnostic testing to estimate the…

Two very reliable influences on eye fixation durations in reading are word frequency, as measured by corpus counts, and word predictability, as measured by cloze norming. Several studies have reported strictly additive effects of these 2 variables. Predictability also reliably influences the amplitude of the N400 component in event-related…

This paper introduces a dataset and associated analysis of the scores of National Football League (NFL) games over the 2012, 2013, and first five weeks of the 2014 season. In the face of current media attention to "lopsided" scores in Thursday night games in the early part of the 2014 season, t-test results indicate no statistically…

Repeating an item in a list benefits recall performance, and this benefit increases when the repetitions are spaced apart (Madigan, 1969; Melton, 1970). Retrieved context theory incorporates 2 mechanisms that account for these effects: contextual variability and study-phase retrieval. Specifically, if an item presented at position "i" is…

Little is known about individual differences in integrating numeric base-rates and qualitative text in making probability judgments. Fuzzy-Trace Theory predicts a preference for fuzzy processing. We conducted six studies to develop the FPPI, a reliable and valid instrument assessing individual differences in this fuzzy processing preference. It…