The research shared in this conference paper report illustrates how an iterative process to item development that involves expert review and cognitive lab interviews with students can be used to collect evidence of validity for assessment items. Analysis of students' reasoning was also used to expand a model for identifying conceptions and misconceptions about probability. Participants at the conference will discuss the model and how several items can be used to diagnose students' probabilistic reasoning.