Research practice partnerships (RPPs) are an increasingly popular approach for bringing together research and practice in ways that can improve and transform education. To date, however, evaluators have lacked measures to evaluate such partnerships. This paper describes a project to develop validity evidence for a survey to evaluate the effectiveness of RPPs in education. The survey is intended to be used in conjunction with interview, observation, and other evidence to draw inferences about the effectiveness of projects within RPPs and support partnership improvement. The measurement effort followed an evidence-centered design approach to developing and evaluating the validity of the survey measure for its intended uses, collecting and analyzing data from sixty-five different RPPs. Results indicate the scales were reliable overall, but that measurement was not entirely consistent for educators and researchers. Implications for appropriate use of these measures in the context of evaluating RPPs are discussed.