Externalizing behaviors in individuals with autism spectrum disorder (ASD) are often either reduced or elevated compared to healthy controls (HCs). This study investigated the moderating role of context in ASD by comparing 32 individuals with ASD to 40 HCs during a social and a non-social provocation task. Compared to HCs, individuals with ASD showed similar externalizing behavior in the social context. In the non-social context reactions after provocation were enhanced relative to non-provoking situations. The findings implicate that the context is an important influencing variable when comparing individuals with ASD to HCs after being provoked. Impulsivity, trait aggression and empathy did not predict behavior in the ASD group but were partly related to observed behavior in HCs.