One of the major claims of the report of University of California's Task Force on Standardized Testing is that SAT and ACT scores are superior to high-school grades in predicting how students will perform at UC. This finding has been widely reported in the news media and cited in several editorials favoring UC's continued use of SAT/ACT scores in…

Critically examining common statistical approaches and their strengths and weaknesses is an important step in advancing recreation and leisure sciences. To continue this critical examination and to inform methodological decision making, this study compared three approaches to determine how alternative approaches may result in contradictory…

Many have elaborated on the potential of virtual reality (VR) in learning. This article attempts at organizing the literature in this issue in order to better identify indicators that can account for future valid trends, and seeks to bring to attention how authors who wrote about the future of VR in education confused futures' terms and produced…

Studies reporting sociometric assessments based on nominations have been characterized by important methodological inconsistencies when conducted in the middle school context. The purpose of this study was to examine (1) the possibility of a response bias when participants are provided with a long roster sorted alphabetically, (2) the impact of…

R. D. Howell, E. Breivik, and J. B. Wilcox (2007) have argued that causal (formative) indicators are inherently subject to interpretational confounding. That is, they have argued that using causal (formative) indicators leads the empirical meaning of a latent variable to be other than that assigned to it by a researcher. Their critique of causal…

In most selection validation research, only the upper and lower tails of the criterion distribution are used, often yielding misleading or incorrect results. Provides formulas and tables which enable the researcher to account more accurately for the distribution of criterion within the middle range of population. (Author/RW)

Three computer simulations were conducted to show that very high aggregate predictive validity coefficients can occur when the across-case variability in absolute score stability occurring in both the predictor and criterion matrices is quite small. In light of the increase in internal consistency reliability achieved by the method of aggregation…

Surveys current methodologies and problems in enrollment forecasting at the State and institutional level. (Author/MLF)

To determine if the observed correlation between two variables can be "explained" by a third variable, a significance test on the partial correlation coefficient is often used. This can be misleading when the third variable is measured with error. This article shows how the problem can be partially overcome. (Author/BW)

In their article, "Disconfirmation of the Predictive Validity of the Self-Appraisal Questionnaire in a Sample of High-Risk Drug Offenders," criminologists Mitchell and MacKenzie (2006) purported to evaluate psychometric properties of the Self-Appraisal Questionnaire (SAQ), the first self-report risk/need measure estimating violent and nonviolent…

Patients were classified into categories using Spitzer and Endicott's computer program for diagnosis. Analyses of variance using single and grouped scales and discriminant analyses predicting category membership suggested that narrow band categorization is better predicted by the Minnesota Multiphasic Personality Inventory than is broad band…

Concludes that there is no evidence for differential validity in the Minnesota Multiphasic Personality Inventory (MMPI) between racial subgroups and that black norms for the MMPI are premature. Criticism of these findings is also presented. (Author/BEF)

Prediction of success in a special program often guides program participant selection and treatment. If the statistical analysis used to develop such predictions is based on the special selectivity built into the program, the predictions can be misleading and the validation tests uninformative. Federal district court pretrial release data is used…

By focusing on "appropriateness" and "adequacy" of inference and action, unified validity may be misused in rejecting valid test outcomes. The notion of levels of validity is challenged, the necessity of assumption is argued, and experience is proposed as the basis of validity. "Consequential validity" is interpreted as an optional predictive…