The State of Washington requires school districts to file court petitions on students with excessive unexcused absences. The "Washington Assessment of Risks and Needs of Students" (WARNS), a self-report screening instrument developed for use by high school and juvenile court personnel in such situations, purports to measure six facets of…

The University of Reading Learning Gain project is a three-year longitudinal project to test and evaluate a range of available methodologies and to draw conclusions on what might be the right combination of instruments for the measurement of Learning Gain in higher education. This paper analyses the validity of a measure of critical thinking…

The "Motor-Free Visual Perception Test-fourth edition" (MVPT-4) is a revised version of the "Motor-Free Visual Perception Test-third edition." The MVPT-4 is used to assess the visual-perceptual ability of individuals aged 4.0 through 80+ years via a series of visual-perceptual tasks that do not require a motor response. Test…

Controlled assessment (CA) was introduced as a valid and reliable replacement for coursework in GCSE English and English Literature assessments in 2009. I argue that CA lacks clear definition, typically mimics externally-assessed public examinations and, when interrogated through the Crooks eight-link chain model, is undermined by several threats…

Literature shows that most researchers are unaware of some of the characteristics of reliability. This paper clarifies some misconceptions by describing the procedures, benefits, and limitations of reliability generalization while using it to illustrate the nature of score reliability. Reliability generalization (RG) is a meta-analytic method…

This article shows that measurement invariance (defined in terms of an invariant measurement model in different groups) is generally inconsistent with selection invariance (defined in terms of equal sensitivity and specificity across groups). In particular, when a unidimensional measurement instrument is used and group differences are present in…

Use of internal correlation for statistical analysis--as proposed by G. W. Joe and J. L. Mendoza (1989)--is discussed. Use of the bootstrap technique to deal with the distributional problem is questioned. Joe and Mendoza attempt the interpretation of the two linear composites that produce the largest internal correlation. (TJH)

The use of internal correlation for statistical analysis, as proposed by G. W. Joe and J. L. Mendoza (1989), is discussed. The suggestion of using bootstrapping is received well. Applications to collinearity are suggested. (TJH)

The Center for Epidemiologic Studies-Depression (CES-D) Scale is among the most commonly used measures of depressive symptomatology. Despite this, a paucity of research has been undertaken to examine the psychometric properties of responses to this scale. This meta-analytic study examined previously published studies of caregiving to identify…

The CAGE is a commonly used alcohol screening instrument. Although considerable work has been done on the validity of CAGE scores, relatively little information is available on their reliability. Reliability induction and generalization studies were performed for the CAGE. Of the 259 studies available for analysis, only 19 (7.3%) contained…

The internal correlation--a measure of dependency in a set of variables--is discussed and generalized. Applications of the internal correlation coefficient and its generalizations are given for several data-analytic situations. The internal correlation is illustrated and the concept is expanded to a series of additional indices. (TJH)

Use of internal correlation for statistical analysis--proposed by G. W. Joe and J. L. Mendoza (1989)--is discussed. Focus is on the "content" question (what this application can do with the information that statistics contain) and the "eloquence" question (the advantages of this means of encoding information over other means). (TJH)

This paper describes major concepts related to item analysis for criterion-referenced tests including validity, reliability, item difficulty, and item discrimination, particularly in relation to criterion-referenced tests. The paper discussed how these concepts can be used to revise and improve items and listed suggestions regarding general…

This study focused on the validation of Generalizable Reasoning Skills assessment instruments with students with disabilities in secondary vocational programs. Results indicated that student self-ratings, teacher ratings, and a performance test were internally consistent and precise measures of reasoning skills for some uses but that most…

Issues pertaining to the quality of performance assessments, including reliability and validity, are discussed. The relatively limited generalizability of performance across tasks is indicative of the care needed to evaluate performance assessments. Quality control is an empirical matter when measurement is intended to inform public policy. (SLD)