This study evaluated a scholarship support program, "Mathematics as a Common Language in Science," that was funded by the National Science Foundation (NSF). Running from 2015 to 2020, the scholarship support program assisted 31 students to major in chemistry, physics, or mathematics with the intent of supporting these students to enter graduate school and careers in the physical sciences. In this study, student outcome metrics and survey data were collected to investigate the impact of the program elements on the participants' academic success. Additional program elements, such as access to tutoring support, outreach opportunities, and undergraduate research, were emphasized to support students in their designated major. A 1-credit-hour course, taught first semester for the freshman cohort of students, emphasized study skills and university resources, and engaged students to consider the overarching applicability of math concepts to the science curriculum. The findings of this study offer insight into program elements that supported student success with consideration of aspects that did not function as planned. The authors hope that sharing these insights will aid other programs to structure effective programming for students.