Topic models are mathematical and statistical models used to analyze textual data. The objective of topic models is to gain information about the latent semantic space of a set of related textual data. The semantic space of a set of textual data contains the relationship between documents and words and how they are used. Topic models are becoming…

This National Council on Measurement in Education (NCME) instructional module compares classical test theory and item response theory and describes their applications in test development. Related concepts, models, and methods are explored; and advantages and disadvantages of each framework are reviewed. (SLD)

An overview is given of the available statistical theory and software for analyzing hierarchically nested data. Programs are evaluated, and general techniques are proposed to analyze data from several domains. This research is part of a larger project to evaluate elementary education in the Netherlands. The models discussed are the random…

Multiple matrix sampling (MMS) theory indicates how data may be gathered to most efficiently convey information about levels of attainment in a population, but standard analyses of these data require random sampling of items from a fixed pool of items. This assumption proscribes the retirement of flawed or obsolete items from the pool as well as…

Two models are presented to compare trainee and expert assessment strategies. The use of these procedures in assessment training programs is illustrated in a study of 5 postgraduate students in an environmental education course who were required to rate the work of 20 students. (SLD)

The effectiveness of alternative procedures to correct for rater leniency/stringency effects was studied when true scores were known. Ordinary least squares, weighted least squares, and imputation of the missing data consistently outperformed averaging the observed ratings; and the imputation technique was superior to the least squares methods.…

The role that measurement error plays in the regression effect is discussed with particular reference to the RMC models for evaluating the effects of Elementary Secondary Education Act Title I programs. The norm referenced evaluation model assumes a theory of growth where the relative ranking of students remains the same from pretest to posttest…

Two approaches--Harnisch/Linn and Rasch-based--to comparing district-level student performance to system-level student performance were examined, using results for 3,607 students on a curriculum-referenced mathematics test. Both approaches addressed relative mean performance on categories of common items. A modification of one approach and an…

This paper is the second report on the purpose, methodology, and results of a large-scale statistical analysis of standardized test scores from Chicago public elementary schools for 1988 and 1989. Major purposes were to develop methods for measuring student improvement (change) at the individual and school levels, to find ways of identifying…

Having low literacy skills could impact everything from reading a newspaper and balancing a checkbook to wise consumer decisions and job advancement. This study estimates adult literacy measures for Cuyahoga County, Ohio and its municipalities. It is also important to have a sense of how many children are at risk for developing literacy problems…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…