The reliability of a test score is usually underestimated and the deflation may be profound, 0.40 - 0.60 units of reliability or 46 - 71%. Eight root sources of the deflation are discussed and quantified by a simulation with 1,440 real-world datasets: (1) errors in the measurement modelling, (2) inefficiency in the estimator of reliability within…

Although Goodman-Kruskal gamma (G) is used relatively rarely it has promising potential as a coefficient of association in educational settings. Characteristics of G are studied in three sub-studies related to educational measurement settings. G appears to be unexpectedly appealing as an estimator of association between an item and a score because…

This article investigates the association between cultural capital and the likelihood of attending an elite university within the Chinese socio-educational context. Drawing on data from the Beijing College Students Panel Survey, we show that: (1) objectified cultural capital is negatively correlated with the likelihood of attending an elite…

This paper describes the development and efficacy of an online tool for assessing the numeracy of undergraduate students. The tool was designed to be easy to administer, provide immediate feedback to students on whether they had the required level of numeracy, and to be consistent with other measures of adult numeracy. When used with students…

Reflective thinking, problem solving and probabilistic thinking are important processes in mathematics education and considered to what extent those processes can be carried out by elementary school students is essential. The study is conducted with 188 eighth grade students. As a result, no significant difference is observed in reflective…

Establishing causal links when experiments are not feasible is an important challenge for psychology researchers. The question of whether parents' spanking causes children's externalizing behavior problems poses such a challenge because randomized experiments of spanking are unethical, and correlational studies cannot rule out potential selection…

One argument for keeping the physics Graduate Record Exam (GRE) is that it can help applicants who might otherwise be missed in the admissions process stand out. In this work, we evaluate whether this claim is supported by physics graduate school admissions decisions. We used admissions data from five Ph.D.-granting physics departments over a…

The purpose of this study was to determine if the 1- and 2-term retention rates for students with the same ACT mathematics subsection scores were different between students who took a regular section of Probability and Statistics and students who took a learning support section of the same course. The subjects of this study were 2,714 students…

This paper presents the results of a national validity study examining relationships between new SAT Essay scores and first semester grades in English and writing courses, as well as first-year grade point average (FYGPA) in college. The sample includes more than 180,000 first-year students across 171 four-year institutions. Results show that…

In May 2019, College Board published the first national operational SAT® validity study on the new SAT introduced in 2016. Based on data from more than 221,000 students across 169 four-year colleges and universities, the study showed that the SAT was essentially as effective as high school grades in predicting students' college performance and…

This study investigates the relationship between early maternal employment history and children's vocabulary and inductive reasoning ability at age 5, drawing on longitudinal information on 2,200 children from the Growing Up in Scotland data. Prior research rarely addresses dynamics in maternal employment and the methodological ramifications of…

This paper analyzes the impact of students' proactivity on academic performance based on a sample from students enrolled in an introductory course of Political Economy at the University of Seville (Spain) in three consecutive courses (2014-2015, 2015-2016 and 2016-2017). Proactivity is measured by several indicators, such as class attendance,…

To increase opportunities for students to take more advanced math courses in high school, many school districts enroll grade 8 students in Algebra I, a gateway course for advanced math. But students who take Algebra I in grade 8 and skip other math courses, such as grade 8 general math, might miss opportunities to develop the foundational…

In this article, we propose using the Bayes factors (BF) to evaluate person fit in item response theory models under the framework of Bayesian evaluation of an informative diagnostic hypothesis. We first discuss the theoretical foundation for this application and how to analyze person fit using BF. To demonstrate the feasibility of this approach,…

The question of whether humans represent grammatical knowledge as a binary condition on membership in a set of well-formed sentences, or as a probabilistic property has been the subject of debate among linguists, psychologists, and cognitive scientists for many decades. Acceptability judgments present a serious problem for both classical binary…