This invited response to the paper by D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow (CKS), and the responses by the investigative teams of the studies criticized by them, addresses specific errors of logic and interpretation by CKS, and integrates comments made by the study investigators. CKS provide a flawed analysis of the literature on the…

This study provides information about the total and component scores of the Test of English as a Foreign Language (TOEFL). First, the study provides comparative global and component estimates of test-retest, alternate-form, and internal-consistency reliability, controlling for sources of measurement error inherent in the examinees and the testing…

Over the last 15 years or so, research into measurement error has begun to consider not just whether the test items fit, but whether the people who answer the items fit. Attempts to systematically identify people who do not fit the typical pattern have led to several "person-fit statistics." This digest describes the need for such…

In response to the federal goal to connect all of the nation's school classrooms, libraries, hospitals, and law enforcement agencies to the information superhighway, the Department of Education commissioned a survey to obtain baseline data on the status of advanced telecommunications in public elementary and secondary schools. Data was gathered…

Although the standard-setting method of W. H. Angoff (1971) has broad-based support in the research literature, inconsistencies in the resulting standards do occur. Sources of these inconsistencies are examined in a study of judges, competencies (items), rounds (replications), and the interactions among them. A modified Angoff approach was used to…

A study was conducted to assess the reliability of the College-Level Academic Skills Test (CLAST) for the major ethnic groups in Florida; and to develop a standard error of measurement for the critical group that fell close to the cut score on each test. The October 1983 and March 1984 administrations of the CLAST were analyzed to determine…

The Bureau of Labor Statistics (BLS) publishes the official unemployment rate on the first Friday of each month based on a sample survey of 59,500 households called the Current Population Survey. Unemployment data for states and local areas are published monthly by the BLS in cooperation with the state employment security agencies. The primary…

Confirmatory factor analysis (LISREL VI) is the method best suited to the comparison of measurement models when those models are based on a priori assumptions. Traditionally, positive and negative item stems were mixed on affective scales to reduce response set bias since the item pairs were considered to be parallel. Recent studies indicate that…

This paper isolates and examines separately three distinct sources of error in essay scores: lack of agreement between raters; inconsistencies in performance within mode of discourse, and inconsistencies in performance between modes of discourse. Essay prompts in the Iowa Tests of Basic Skills (ITBS) Writing Supplement were designed to assess…

The efficacy of employing subsets of items from a calibrated item pool to estimate the Rasch model person parameters was investigated. Specifically, the degree of invariance of Rasch model ability-parameter estimates was examined across differing collections of simulated items. The ability-parameter estimates were obtained from a simulation of…

It is suggested that bias--when associated with a predictor, a test, or a statistical estimator--is not always bad, in spite of the immediate negative response evoked by the word, bias. Four settings are described to illustrate situations in which a procedure should not be summarily rejected due to bias: (1) educational researchers rejected the…

Three methods of item selection were used to select sets of 38 items from a 50-item verbal analogies test and the resulting item sets were compared for internal consistency, standard errors of measurement, item difficulty, biserial item-test correlations, and relative efficiency. Three groups of 1,500 cases each were used for item selection. First…

Outlines the simple exercise of measuring the length of an object as a concrete paradigm of the entire process of making chemical measurements and treating the resulting data. Discusses the procedure, significant figures, measurement error, spurious data, rejection of results, precision and accuracy, and student responses. (TW)

This document discusses in depth the theoretical background of the Lexile Framework, which is based on the assumption that reading comprehension is the best predictor of success in higher education and job performance, and that it is the most tested construct in education. The first section defines measurement and differentiates between specific…

Effects of altering test difficulty on examinee ability measures and test length in a computer adaptive test were studied for 225 medical technology students in 3 test difficulty conditions. Results suggest that, with an item pool of sufficient depth and breadth, acceptable targeting to test difficulty is possible. (SLD)