Researchers addressing posttreatment complications in randomized trials often turn to principal stratification to define relevant assumptions and quantities of interest. One approach for the subsequent estimation of causal effects in this framework is to use methods based on the "principal score," the conditional probability of belonging…

Drawing parallels to classical test theory, this article clarifies the difference between rater accuracy and reliability and demonstrates how category marginal frequencies affect rater agreement and Cohen's kappa. Category assignment paradigms are developed: comparing raters to a standard (index) versus comparing two raters to one another…

The impact of automatic promotion practice on students dropping out of Uganda's primary education was assessed using propensity score in difference in differences analysis technique. The analysis strategy was instrumental in addressing the selection bias problem, as well as biases arising from common trends over time, and permanent latent…

Stimuli that capture the central tendency of presented exemplars are often preferred--a phenomenon also known as the classic beauty-in-averageness effect. However, recent studies have shown that this effect can reverse under certain conditions. We propose that a key variable for such ugliness-in-averageness effects is the category structure of the…

This study analyzed the debt profile of low-income households before and after the Great Recession using the 2007, 2010, and 2013 Survey of Consumer Finances (SCF). We used Heckman selection models to investigate three debt characteristics: (a) the amount of debt, (b) debt-to-income ratio, and (c) debt delinquency. Before and after the Great…

In this paper, we investigate two purported problems with Bayesian Knowledge Tracing (BKT), a popular statistical model of student learning: "identifiability" and "semantic model degeneracy." In 2007, Beck and Chang stated that BKT is susceptible to an "identifiability problem"--various models with different…

The purpose of this paper is to provide guidance in choice of analytic bias reduction methods for educational studies in which the goal is to estimate a treatment effect in the presence of selection bias into treatment. In addition, issues of dimensionality, collinearity, omitted confounders, missing outcomes, and non-independence may be factors…

This paper argues that assortative matching may explain over-education. Education determines individuals' income and, due to the presence of assortative matching, the quality of partners in personal, social and working life. Thus, an individual acquires education to improve the expected partners' quality. However, since every individual of the…

We propose a method of generating teaching policies for use in intelligent tutoring systems (ITS) for concept learning tasks [1], e.g., teaching students the meanings of words by showing images that exemplify their meanings à la Rosetta Stone [2] and Duo Lingo [3]. The approach is grounded in control theory and capitalizes on recent work by [4],…

Many important high-stakes decisions--college admission, academic performance evaluation, and even job promotion--depend on accurate and reliable scores from valid large-scale assessments. However, examinees sometimes cheat by copying answers from other test-takers or practicing with test items ahead of time, which can undermine the effectiveness…

The two-high-threshold (2HT) model of recognition memory assumes that people make memory errors because they fail to retrieve information from memory and make a guess, whereas the continuous unequal-variance (UV) model and the low-threshold (LT) model assume that people make memory errors because they retrieve misleading information from memory.…

It is commonly assumed that belief-based reasoning is fast and automatic, whereas rule-based reasoning is slower and more effortful. Dual-Process theories of reasoning rely on this speed-asymmetry explanation to account for a number of reasoning phenomena, such as base-rate neglect and belief-bias. The goal of the current study was to test this…

Any attempt to influence behavior by sharing a research finding that makes a probabilistic statement (e.g., a p value) should necessarily entail consideration of how consumers of the information might interpret this information. Such consideration can be informed, at least in part, by applying phenomenological principles of inquiry. This does not…

In 2015, the Australian Government's Excellence in Research for Australia (ERA) assessment of research quality declined to rate 1.5 per cent of submissions from universities. The public debate focused on practices of gaming or "coding errors" within university submissions as the reason for this outcome. The issue was about the…

Since school voucher funds are public, policymakers fiercely debate how those funds should be spent. A goal of many decision-makers is to ensure that every private school option is "high-quality" through program accountability regulations. Private schools, however, decide whether to participate in a private school choice program and…