Random forests are a nonparametric machine learning method, which is currently gaining popularity in the behavioral sciences. Despite random forests' potential advantages over more conventional statistical methods, a remaining question is how reliably informative predictor variables can be identified by means of random forests. The present study…

Colleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models. We address this lack of transparency by systematically comparing two…

Background and Aims: The fastest growing group of students with disabilities are those with Autism Spectrum Disorder (ASD). States annually report on post-high school outcomes (PSO) of exited students. This study sought to fill two gaps in the literature related to PSO for exited high-school students with ASD and the use of state data and…

Listening comprehension involves the ability to understand and extract meaning from spoken sentences, stories, and instruction. This skill is vital for young children and has long-term effects on school achievement, employability, income, and participation in society. There is a lack of measures of young children's listening comprehension skills.…

Methods for identifying dyslexia in adults vary widely between studies. Researchers have to decide how many tests to use, which tests are considered to be the most reliable, and how to determine cut-off scores. The aim of this study was to develop an objective and powerful method for diagnosing dyslexia. We took various methodological measures,…

This study documents the reliability and validity of a new infant-toddler authentic assessment, the Learning Through Relating Child Assets Record (LTR-CAR), and its feasibility of use by infant-toddler caregivers in an Early Head Start program. In a sample of 136 children, results indicated a strong internal structure of the LTR-CAR as evidenced…

P. R. Killeen's (2005a) probability of replication ("p[subscript rep]") of an experimental result is the fiducial Bayesian predictive probability of finding a same-sign effect in a replication of an experiment. "p[subscript rep]" is now routinely reported in "Psychological Science" and has also begun to appear in…

The purpose of the recently proposed "p[subscript rep]" statistic is to estimate the probability of concurrence, that is, the probability that a replicate experiment yields an effect of the same sign (Killeen, 2005a). The influential journal "Psychological Science" endorses "p[subscript rep]" and recommends its use…

In this technical report, we provide reliability and validity evidence for the easyCBM[R] Reading measures for grade 2 (word and passage reading fluency and multiple choice reading comprehension). Evidence for reliability includes internal consistency and item invariance. Evidence for validity includes concurrent, predictive, and construct…

Examines the kind of analysis performed for material on the job prospects in the Occupational Outlook Handbook and evaluates the accuracy of previous projections. Discusses why projections of job outlook are made, methods used in their development, and their accuracy. (JOW)

This technical manual discusses some of the recent developments in the science of graphology and their implications for the science. The manual contains the following sections: (1) Graphology: An Introduction; (2) "CHAPS": Computerized Handwriting Analysis Profiling Systems; (3) HRC Profiles; (4) Reliability; (5) Validity; (6) Historical…

The Mean Cost Rating, P(A) from Signal Detection Theory, Kendall's rank correlation coefficient tau, and Goodman and Kruskal's gamma measures of predictive power are compared and shown to be different transformations of the statistic S. Gamma is generally preferred for hypothesis testing. Measures of association for ordered contingency tables are…

Changes, like single scores, are demonstrated to be valid and reliable and potentially predictable by independent variables. Change and growth measures determined from individual examinees' test scores indicated excellent predictive value. (Author/PN)

Statistical significance is often misinterpreted to mean replicability or generalizability of results, although a statistically significant difference does not equal a reliable difference. Sample splitting procedures may be a more accurate way of estimating research result generalizability. This type of cross-validation involves randomly dividing…

Three studies investigated comfortable loudness levels with particular reference to their application to hearing aid gain prescriptions. The studies, involving 33 normal hearing adults and 77 adults with hearing impairments, suggest that comfortable loudness levels for continuous speech bands can be estimated rather accurately, quickly, and with…