This article discusses the difficulties Kutztown University's Rohrbach Library- and many libraries- face when evaluating eBook collections, and the process used to overcome some of the obstacles to making meaningful comparisons. Two multidisciplinary eBook subscription packages, EBSCO and ProQuest, are the focus of this study. Data collected from COUNTER reports and the integrated library system were input into Excel to examine the data. The authors show a comparison of the two collections while including the tremendous challenges and limitations involved in the process. This article emphasizes the need for COUNTER standardization, more consistent data reporting, and collection quality evaluation methods.