The purpose of this paper is to introduce the process and value of Random Qualitative Validation (RQV) in the development and interpretation of survey data. RQV is a method of gathering clarifying qualitative data that improves the validity of the quantitative analysis. This paper is concerned with validity in relation to the participants' understanding of the survey author's intent, and the ability to accurately interpret the quantitative response on forced-choice scales. A campus study of rigor in general education courses conducted in 2006/07 provides examples and will be used to demonstrate the benefits and challenges of the RQV approach. A sample survey page is appended. (Contains 1 table.)