In this study we examined procedures for assessing model-data fit of item response theory (IRT) models for mixed format data. The model fit indices used in this study include PARSCALE's G[superscript 2], Orlando and Thissen's S-X[superscript 2] and S-G[superscript 2], and Stone's chi[superscript 2*] and G[superscript 2*]. To investigate the…

Monte Carlo methods can be used in data analytic situations (e.g., validity studies) to make decisions about sample size and to estimate power. The purpose of using Monte Carlo methods in a validity study is to improve the methodological approach within a study where the primary focus is on construct validity issues and not on advancing…

Whenever one uses a composite scale score from item responses, one is tacitly assuming that the scale is dominantly unidimensional. Investigating the unidimensionality of item response data is an essential component of construct validity. Yet, there is no universally accepted technique or set of rules to determine the number of factors to retain…

This article reviews several decades of the author's meta-analytic and experimental research on the conditions under which nonrandomized experiments can approximate the results from randomized experiments (REs). Several studies make clear that we can expect accurate effect estimates from the regression discontinuity design, though its statistical…

The distance between nonparametric and parametric item characteristic curves has been proposed as an index of goodness of fit in item response theory in the form of a root integrated squared error index. This article proposes to use the posterior distribution of the latent trait as the nonparametric model and compares the performance of an index…

Learning disabled youth in the Child and Young Adult samples of the NLSY79 are "more" likely to graduate from high school than peers with the same measured cognitive ability, a difference that cannot be explained by differences in noncognitive skills, families, or school resources. Instead, I find that learning disabled students graduate…

Despite the recent increase of structural equation modeling (SEM) in language testing and learning research and Kunnan's (1998) call for the proper use of SEM to produce useful findings, there seem to be no reviews about how SEM is applied in these areas or about the extent to which the current application accords with appropriate practices. To…

Steinberg and Monahan's (2011) reanalysis of the Teen Media longitudinal survey of adolescents does not meet prevailing standards for propensity score analysis and therefore does not undermine the original conclusions of the Brown, L'Engle, Pardun, Guo, Kenneavy, and Jackson (2006) analysis. The media do matter in the sexual socialization of…

This paper aims at investigating the causal effects of social behaviors on subsequent reading growth in elementary school, using the "Early Childhood Longitudinal Study-Kindergarten" ("ECLS-K") data. The sample was 8,869 subjects who provided longitudinal measures of reading IRT scores from kindergarten (1998-1999) to fifth…

This three-volume report describes the "SAM (School Administration Manager) process," an approach that about 700 schools around the nation are using to direct more of principals' time and effort to improve teaching and learning in classrooms. Research has shown that a principal's instructional leadership is second only to teaching among…

This paper summarizes research associated with the development of the "Public Opinion Survey of Human Attributes-Stuttering" ("POSHA-S"), a survey instrument designed to provide a worldwide standard measure of public attitudes toward stuttering. Pilot studies with early experimental prototypes of the "POSHA-S" are summarized that relate to…

Purpose: The purpose of this study was to identify the most appropriate item response theory (IRT) measurement model for aphasia tests requiring 2-choice responses and to determine whether small samples are adequate for estimating such models. Method: Pyramids and Palm Trees (Howard & Patterson, 1992) test data that had been collected from…

Childhood obesity trends have increased dramatically over the past three decade's. The purpose of this quantitative systematic review is to provide an update of the evidence, illustrating the efficacy of childhood obesity treatment, considering whether treatment fidelity has been measured and/or reported and whether this related to the treatment…

The t-test is one of the most commonly used significance tests to assess whether the means of two groups are statistically significantly different from each other. The use of t-test has become a natural choice, and rarely practitioners question its appropriateness. This article reviews and discusses t-test's value in providing a rough comparison…

Recommendations made by major educational and psychological organizations (American Educational Research Association, 2006; American Psychological Association, 2001) call for researchers to regularly report confidence intervals. The purpose of the present paper is to provide support for the use of confidence intervals. To contextualize this…