This article presents a large-scale longitudinal study of hundreds of students across the state of Kentucky that participated in a dual-focus mathematics intervention initiative when they were in the third grade. Rather than an exclusive focus on intervention, this initiative focused on both (i) high quality pull-out intervention and (ii) coherence between pull-out intervention and classroom instruction. The study found that over half of the third grade intervention students that participated in this initiative were classified as "novice" (the lowest possible performance category) on state standardized mathematics assessments at the end of the third grade. However, over the course of the following four years, the novice reduction rate of these students was significantly (p < .01) greater than other novices in Kentucky that did not participate in the initiative. These findings indicate that when implementing intervention initiatives to help students that are struggling with mathematics, it may be important to establish coherence between pull-out intervention and classroom instruction. The long term impact of this approach among traditionally underrepresented minorities suggest that this publication may provide insight into important equity issues where long-term analyses may sometimes be needed to capture the full impact of intervention initiatives.