The present study aimed to analyze the direction of the associations between repeating patterning, growing patterning, and numerical ability. Participants were 410 children who were annually assessed on their repeating patterning, growing patterning, and numerical ability, at ages 4, 5, and 6 years (i.e., spring 2017, 2018, and 2019). A cross-lagged panel model identified bidirectional associations between all three abilities from ages 4 to 5 years while taking into account spatial skills. From ages 5 to 6 years, both patterning abilities predicted later numerical ability, but the reverse was no longer true. Associations between performances on both pattern types also disappeared. Results highlight the unique associations between repeating patterning, growing patterning, and numerical ability, above spatial skills.