The situational specificity hypothesis predicts that, if the setting does not vary, validity will not vary. Using data from a large-sample validity study numerous small-sample studies were generated for which the setting was held constant. Results indicate variability across studies in observed validity coefficients, significance levels, and conclusions produced by traditional data-analytic procedures. (Author/BL)