Short scales are time-efficient for participants and cost-effective in research. However, researchers often mistakenly expect short scales to have the same reliability as long ones without considering the effect of scale length. We argue that applying a universal benchmark for alpha is problematic as the impact of low-quality items is greater on…

Convenience sampling dominates social science research. But there is a paucity of studies comparing the impact of sample source type based on composite-based theoretical model relationships. This study empirically tests four different sample sources (e.g. student, crowdsourced, professional panel, and respondent driven social network) to assess…

The aim of this study was to compare, by simulation, the accuracy of mapping a cut-score from one test to another by expert judgement (using the Angoff method) versus the accuracy with a small-sample equating method (chained linear equating). As expected, the standard-setting method resulted in more accurate equating when we assumed a higher level…

The standard error of equating quantifies the variability in the estimation of an equating function. Because common items for deriving equated scores are treated as fixed, the only source of variability typically considered arises from the estimation of common-item parameters from responses of samples of examinees. Use of alternative, equally…

In this article, we consider estimation of parameters of random effects models from samples collected via complex multistage designs. Incorporation of sampling weights is one way to reduce estimation bias due to unequal probabilities of selection. Several weighting methods have been proposed in the literature for estimating the parameters of…

On the 2009 AP[c] Statistics Exam, students were asked to create a statistic to measure skewness in a distribution. This paper explores several of the most popular student responses and evaluates which statistic performs best when sampling from various skewed populations. (Contains 8 figures, 3 tables, and 4 footnotes.)

Reporting methods used in large-scale assessments such as the National Assessment of Educational Progress (NAEP) rely on latent regression models. To fit the latent regression model using the maximum likelihood estimation technique, multivariate integrals must be evaluated. In the computer program MGROUP used by the Educational Testing Service for…

This article examines methodological issues confronting the study of qualitative and quantitative differences in ways that separated parents share time with their children. Measurement issues explored include disentangling dimensions of contact, identifying economic implications of contact, and measuring quality of contact. Sampling issues relate…

This paper outlines procedures used to derive variables from data in the National Survey of Postsecondary Faculty; these variables were then used to create measures not expressly included as items in that survey. The derived variables were used to examine faculty satisfaction in two contexts: first, the complexity of satisfaction, and second, the…