This research study investigates the impact of the COVID-19 pandemic, course delivery modality, and student engagement on student performance in data collected from business statistics courses at a medium-sized southeastern public university. Our data analysis suggests student engagement and disruptions caused by the COVID-19 pandemic are the strongest predictors of overall student performance. While course delivery modality did not seem to have a significant impact on student performance in and of itself, statistical analysis suggests there is a significant impact on the performance of students enrolled in online courses during the Spring 2020 semester despite the fact there were no emergency changes to the delivery modality of their class. An important takeaway for distance learning administrators is "other factors" outside of the time spent engaged in completing course requirements seem to have had a significant, negative impact on student outcomes in the Spring 2020 semester. Further research is needed to better understand the interaction between general societal disruptions caused by COVID-19 restrictions and student outcomes for the online course delivery modality.