Research has shown a link between the acquisition of numerical concepts and language, but exactly how linguistic input matters for numerical development remains unclear. Here, we examine both symbolic (number word knowledge) and non-symbolic (numerical discrimination) numerical abilities in a population in which access to language is limited early in development--oral deaf and hard of hearing (DHH) preschoolers born to hearing parents who do not know a sign language. The oral DHH children demonstrated lower numerical discrimination skills, verbal number knowledge, conceptual understanding of the word "more", and vocabulary relative to their hearing peers. Importantly, however, analyses revealed that group differences in the numerical tasks, but not vocabulary, disappeared when differences in the amount of time children had had auditory access to spoken language input via hearing technology were taken into account. Results offer insights regarding the role language plays in emerging number concepts.