The expression of autism spectrum disorder (ASD) is highly heterogeneous, owing to the complex interactions between genes, the brain, and behavior throughout development. Here we present a model of ASD that implicates an early and initial failure to develop the specialized functions of one or more of the set of neuroanatomical structures involved in social information processing (i.e., the "social brain"). From this early and primary disruption, abnormal brain development is canalized because the individual with an ASD must develop in a highly social world without the specialized neural systems that would ordinarily allow him or her to partake in the fabric of social life, which is woven from the thread of opportunities for social reciprocity and the tools of social engagement. This brain canalization gives rise to other characteristic behavioral deficits in ASD including deficits in communication, restricted interests, and repetitive behaviors. We propose that focused efforts to explore the brain mechanisms underlying the core, pathognomic deficits in the development of mechanisms for social engagement in ASD will greatly elucidate our understanding and treatment of this complex, devastating family of neurodevelopmental disorders. In particular, developmental studies (i.e., longitudinal studies of young children with and without ASD, as well as infants at increased risk for being identified with ASD) of the neural circuitry supporting key aspects of social information processing are likely to provide important insights into the underlying components of the full-syndrome of ASD. These studies could also contribute to the identification of developmental brain endophenotypes to facilitate genetic studies. The potential for this kind of approach is illustrated via examples of functional neuroimaging research from our own laboratory implicating the posterior superior temporal sulcus (STS) as a key player in the set of neural structures giving rise to ASD.