ERIC Number: ED601000
Record Type: Non-Journal
Publication Date: 2019-Sep
Pages: 39
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-
EISSN: N/A
Available Date: N/A
Using Pooled Heteroskedastic Ordered Probit Models to Improve Small-Sample Estimates of Latent Test Score Distributions. CEPA Working Paper No. 19-05
Shear, Benjamin R.; Reardon, Sean F.
Stanford Center for Education Policy Analysis
This paper describes a method for pooling grouped, ordered-categorical data across multiple waves to improve small-sample heteroskedastic ordered probit (HETOP) estimates of latent distributional parameters. We illustrate the method with aggregate proficiency data reporting the number of students in schools or districts scoring in each of a small number of ordered "proficiency" levels. HETOP models can be used to estimate means and standard deviations of the underlying (latent) test score distributions, but may yield biased or very imprecise estimates when group sample sizes are small. A simulation study demonstrates that pooled HETOP models can reduce the bias and sampling error of standard deviation estimates when group sample sizes are small. An analysis of real test score data suggests the pooled models are likely to improve estimates in applied contexts.
Descriptors: Computation, Scores, Statistical Distributions, Sample Size, Data Analysis, Statistical Bias, Error of Measurement, Models, Statistical Analysis, Achievement Tests
Stanford Center for Education Policy Analysis. 520 Galvez Mall, CERAS Building, 5th Floor, Stanford, CA 94305. Tel: 650-736-1258; Fax: 650-723-9931; e-mail: contactcepa@stanford.edu; Web site: http://cepa.stanford.edu
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Spencer Foundation; Russell Sage Foundation; Bill and Melinda Gates Foundation; Overdeck Family Foundation; William T. Grant Foundation
Authoring Institution: Stanford Center for Education Policy Analysis (CEPA)
IES Funded: Yes
Grant or Contract Numbers: R305D110018
Author Affiliations: N/A