This article critically reviews how diagnostic models have been conceptualized and how they compare to other approaches used in educational measurement. In particular, certain assumptions that have been taken for granted and used as defining characteristics of diagnostic models are reviewed and it is questioned whether these assumptions are the…

We present two empirical studies with 241 and 211 pre-service teachers that evaluate the explanatory power of word order matching and static comparison as models for the reversal error. We used tasks consisting of generating an algebraic equation representing a comparison given in a verbal statement. We introduce the types of magnitude involved in…

Simulation studies are extremely common in the item response theory (IRT) research literature. This article presents a didactic discussion of "truth" and "error" in IRT-based simulation studies. We ultimately recommend that future research focus less on the simple recovery of parameters from a convenient generating IRT model,…

The automatic evaluation of text-based assessment items, such as short answers or essays, is an open and important research challenge. In this paper, we compare several features for the classification of short open-ended responses to questions related to a large first-year health sciences course. These features include a) traditional n-gram…

When conducting biological investigations, experts constantly integrate their conceptual and quantitative understanding of variation with the design and analysis of the investigation. This process is difficult for students, because curricula often treat these concepts as separate components. This study describes the effect of a curricular…

We analyze a natural experiment in which policymakers in Pennsylvania first implemented, and later removed, reimbursements to districts for students exiting to brick and mortar and cyber charter schools. Generalized difference-in-difference models show that larger shares of students enrolling in charter schools predict decrements in spending,…

Reading development involves several changes in orthographic processing. A key question is, "how does the coding of letters develops in children learning to read?" Masked priming effects of transposition and substitution primes have been taken to index the importance of letter position and identity coding. Somewhat contradicting results…

The Hartung-Knapp method for random-effects meta-analysis, that was also independently proposed by Sidik and Jonkman, is becoming advocated for general use. This method has previously been justified by taking all estimated variances as known and using a different pivotal quantity to the more conventional one when making inferences about the…

Project prioritization is often an arduous task for any organization. This is particularly evident in large, complex organizations with matrixed management structures, such as the VA Cooperative Studies Program (CSP). CSP is responsible for the planning and conduct of large multicenter clinical trials and epidemiological studies in the Department…

Scores estimated from multidimensional item response theory (IRT) models are not necessarily comparable across dimensions. In this article, the concept of aligned dimensions is formalized in the context of Rasch models, and two methods are described--delta dimensional alignment (DDA) and logistic regression alignment (LRA)--to transform estimated…

"Wheel spinning" is the phenomenon in which a student fails to master a Knowledge Component (KC), despite significant practice. Ideally, an intelligent tutoring system would detect this phenomenon early, so that the system or a teacher could try alternative instructional strategies. Prior work has put forward several criteria for wheel…

Foreign accents can vary considerably in the degree to which they deviate from the listener's native accent, but little is known about how the relationship between a speaker's accent and a listener's native language phonology mediates adaptation. Using an artificial accent methodology, we addressed this issue by constructing a set of three…

This study shows that residual variation can cause problems related to scaling in exponential random graph models (ERGM). Residual variation is likely to exist when there are unmeasured variables in a model--even those uncorrelated with other predictors--or when the logistic form of the model is inappropriate. As a consequence, coefficients cannot…

This study investigates whether there are different first-language-second-language (L1-L2) dependency resolutions by focusing on less-studied crosslinguistic variances in L2 acquisition of Chinese, a null-subject language, by speakers of English, a non-null-subject language. The overt subject pronoun of a Chinese main clause has free orientation…

Extensive research has been done to identify the conceptual components of intercultural competence (IC), which resulted in a plethora of models and a wide array of differently defined constructs that are in use today to develop and assess IC. However, the majority of IC research comes from relatively similar contexts that are westernised, high on…