Since computer science education is a key to preparing students for a technologically-oriented future, it makes sense to have high quality resources for conducting summative and formative evaluation of those programs. This paper describes the results of a critical analysis of the resources for evaluating K-12 computer science education projects. After conducting a comprehensive literature search for evaluation resources geared towards the evaluation of K-12 computer science education programs, the resources that met the criteria for inclusion were rated, quantitatively and qualitatively, by two raters. The ratings were based on a framework of feasibility, utility, accuracy, and propriety. Evaluators of K-12 computer science education programs can use the findings of this paper to determine which evaluation resources they may want to use.