Twenty-eight studies of grades, over a century, were reviewed using the argument-based approach to validity suggested by Kane as a theoretical framework. The review draws conclusions about the meaning of graded achievement, its relation to tested achievement, and changes in the construct of graded achievement over time. "Graded…

The 2003 National Assessment of Adult Literacy (NAAL) assessed the English literacy skills of a nationally representative sample of more than 19,000 U.S. adults (age 16 and older) residing in households and correctional institutions. NAAL is the first national assessment of adult literacy since the 1992 National Adult Literacy Survey (NALS). The…

Omitted items cannot properly be treated as wrong when estimating ability and item parameters. A convenient method for utilizing the information provided by omissions is presented. Some theoretical and considerable empirical justification is adduced for the estimates obtained by both old and new methods. (Author)

Factor loadings, used directly or as the basis of binary values, are not appropriate as weights to produce component scores from a rotated solution. A series of examples showing the results of an incorrect measurement of components is given. Several correlation matrices were taken from books on factor analysis and multivariate analysis. Each…

A comparison was made between four different scoring procedures for the 45-item Reading Comprehension subtest, Level I, of the Comprehensive Test of Basic Skills, Form S, for a sample of 1,000 third grade students. These students were selected to have been among those who omitted from 3 to 22 of the 45 items. Another representative sample of 1,300…

The one parameter latent trait theory of Georg Rasch has two assumptions: that student abilities can be measured on an equal interval scale, and that the success of a student with a given item is a function of student achievement and item difficulty. The grade four Michigan Educational Assessment Program reading test was designed to measure…

Differential achievement growth patterns between comparison groups is a problem associated with data analysis in compensatory education programs. Children in greatest need of additional assistance, are usually assigned to the program rather than to an alternative treatment so that the comparison groups may vary in several ways, in addition to the…

An investigation was conducted to determine the effects of response-category weighting and item weighting on reliability and predictive validity. Response-category weighting refers to scoring in which, for each category (including omit and "not read"), a weight is assigned that is proportional to the mean criterion score of examinees selecting…

A specially designed answer format was used for three tests in a college level agriculture class of 19 students to record responses to three things about each item: (1) the student's choice of the best answer; (2) the degree of certainty with which the answer was chosen; and (3) all the answer choices which the student was certain were incorrect.…

A simulation study was designed to assess the severity of regression effects when a set of selection scores is also used as pretest scores as this pertains to RMC Model A of the Elementary and Secondary Education Act Title I evaluation and reporting system. Data sets were created with various characteristics (varying data reliability and…

The concept of testing for partial knowledge is considered with the concept of tailored testing. Following the special usage of latent trait theory, the word valdity is used to mean the correlation of a test with the construct the test measures. The concept of a method factor in the test is also considered as a part of the validity. The possible…

The educational significance of wrong answers on multiple choice tests was investigated in over 4,000 subjects, aged 7 to 20. Gorham's Proverbs Test--which requires the interpretation of a proverb sentence--was administered and repeated five months later. Four questions were addressed: (1) what can the pattern of answer choice, across age, using…

Estimates for the variance of empirically determined scoring weights are given. It is shown that test item writers should write distractors that discriminate on the criterion variable when this type of scoring is used. (Author)

The second section of a four-part technical report of Florida's statewide program for assessing reading-related skills in grades 2 and 4 provides statistical and scoring information. Item and student sampling, a test re-scoring study, reporting statewide assessment data (percentage of achievement, types of tables used), and standard error…

Census data were used to predict average district scores on standardized achievement tests for grades one, two, three, six, and twelve, in 716 California school districts. The following census variables were used: education, income, college, poverty (families); poverty (children); professional occupations; housing; Spanish surnames; and Black.…