Registered examinees for the GRE® General Test answered open-ended sentence-completion items. For half of the items, participants received immediate feedback on the correctness of their answers and up to two opportunities to revise their answers. A significant feedback-and-revision effect was found. Participants were able to correct many of their…

A recent series of papers has renewed interest in the question of whether consumption data are superior to income data for poverty measurement. Although the Census Bureau has provided researchers with an experimental series of variables that can produce a comprehensive income measure, this resource has not been fully exploited in previous…

An alternative derivation of Tryon's basic formula for the coefficient of domain validity or the coefficient of generalizability developed by Cronbach, Rajaratnam, and Glaser is provided. This derivation, which is also the generalized Kuder-Richardson coefficient, requires a relatively minimal number of assumptions compared with that in previously…

A technique for assessing the agreement between the Q-sorts of two or more groups of subjects is presented which relies on the relationship between the Kendall coefficient of concordance (W) and the Spearman rank order correlation (rho). The proposed statistical treatment of Q-sort data involves the use of a number of intercorrelations rather than…

The Goodenough technique for determining scale error is compared to the Guttman technique and demonstrated to be more conservative than the Guttman technique. Implications with regard to Guttman's evaluative rule of thumb for evaluating a reproducibility are noted. (Author)

Since fixed and random facets may exist in objects of study as well as in conditions of observation, various modifications of the generalizability theory estimation formulas are required for different types of measurement designs. Various design modifications are proposed to improve reliability by reducing error variance. (Author/BW)

An approximate statistical test of the equality of two intraclass reliability coefficients based on the same sample of people is derived. Such a test is needed when a researcher wishes to compare the reliability of two measurement procedures, and both procedures can be applied to results from the same group. (SLD)

Previous visual analysis research reported that the overall agreement between visual analysis and statistical analysis was poor. In response, some researchers suggested the use of celeration lines to improve the accuracy and reliability of visual analysis. However, subsequent research reported little or no improvement in accuracy with such lines.…

The conventional approach for testing the equality of two normal mean vectors is to test first the equality of covariance matrices, and if the equality assumption is tenable, then use the two-sample Hotelling T[superscript 2] test. Otherwise one can use one of the approximate tests for the multivariate Behrens-Fisher problem. In this article, we…

The major purpose of the study was to determine the construct validity of the Spanish version of the Emotional Skills Assessment Process (ESAP) in a targeted population of agriculture college students in Mexico. The ESAP is a self assessment approach that helps students to identify and understand emotional intelligence skills relevant for…

A large number of seemingly diverse coefficients have been proposed as indices of dependability, or reliability, for domain-referenced and/or mastery tests. In this paper, it is shown that most of these indices are special cases of two generalized indices of agreement: one that is corrected for chance, and one that is not. The special cases of…

To adhere to the principle of "exercise specificity" exercise testing should be completed using the same physical activity that is performed during exercise training. The present study was designed to assess whether aerobic step exercisers have a greater maximal oxygen consumption (max VO sub 2) when tested using an activity specific, maximal step…

Introduction: The Accreditation Council for Continuing Medical Education (ACCME) provides guidelines for continuing medical education (CME) materials to mitigate problems in the independence or validity of content in certified activities; however, the process of peer review of materials appears largely unstudied and the reproducibility of…

Longitudinal studies of test wiseness (TW) were conducted to determine: (1) the relationship between TW and grade level, (2) the relationship between TW and sex, and (3) the stability of TW. Aspects of TW observed included stem cue and specific determiner identification and usage and the elimination of similar and absurd options. Subjects were…

A discussion of selected applications of new tests developed within the context of a large-scale curriculum for educable mentally retarded (EMR) children, the Social Learning Curriculum (SLC), is presented in this paper which investigates three types of reliability that need to be demonstrated in order to provide a basis of these applications. The…