The purpose of this study was to investigate the ways in which universities use the "GRE"® General Test scores to award merit-based fellowships to first-year graduate students in doctoral programs. While GRE use in fellowship award decisions is a common practice, there is very little validity evidence to support its use in this context.…

Lissitz and Samuelsen (2007) have proposed an operational definition of "validity" that shifts many of the questions traditionally considered under validity to a separate category associated with the utility of test use. Operational definitions support inferences about how well people perform some kind of task or how they respond to some kind of…

Discusses the problem of assigning subjects to one of several treatments based on their test scores. The success of each treatment is measured by different criterion. (RB)

The relationship between Children's Depression Inventory (CDI) scores and major depression, conduct disorder, and anxiety disorders was studied for 107 psychiatric inpatients aged 12 to 18 years. Findings support total CDI score, rather than factor scores, as the most practical measure for classifying participants as depressed or not. (SLD)

This paper presents a method for estimating the accuracy and consistency of classifications based on test scores. The scores can be produced by any scoring method, including the formation of a weighted composite. The estimates use data from a single form. The reliability of the score is used to estimate its effective test length in terms of…

Methods of adjusting group differences in assessment and test scores are described, classified, and evaluated. Investigation of the relationship between intended use of test scores and the appropriate meaning of scores is essential for fair treatment in assessment. (SLD)

Scores from 324 Louisiana schools on the Louisiana Graduation Exit Examination and a within-school split sample of 255 schools indicate that a single subject or grade provides a less consistent and more narrow perspective on school effectiveness than a subcomposite made up of 2 subject areas. (SLD)

Although the primary use of the speaking section of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT Speaking test) is to inform admissions decisions at English medium universities, it may also be useful as an initial screening measure for international teaching assistants (ITAs). This study provides criterion-related…

As high-stakes use of tests increases, it becomes vital that test developers and test users communicate clearly about the accuracy and limitations of the scores generated by a test after it is assembled and used. A procedure is described for portraying the accuracy of test scores. It can be used in setting accuracy targets during form construction…

Differences between traditional linear regression and a Bayesian approach to classification are discussed. Classification consists of assigning subjects to one of several available treatments on the basis of their test scores when the success of each treatment is measured by a different criterion. Formulating this problem as an empirical Bayes…

The validity of using proficiency test scores to make specific educational decisions is addressed. Ninth grade mathematics proficiency test scores were analyzed in both continuous and categorized form. The nature of the decisions to be made was examined as a factor in determining the categorization technique. (Author/PN)

The relationship between scores on the cognitive domain of the Battelle Developmental Inventory (BDI) and scores on the Stanford-Binet Intelligence Test (SBIT), Fourth Edition, was studied for 32 urban, low socioeconomic status (SES), African American children (22 males and 10 females) aged 3 to 5 years. The BDI is a developmental inventory…