A survey asked autistic and non-autistic people about the driving difficulties they experience and their autistic traits. Principle components analysis was used to identify how reported difficulties clustered together in each group, and regression was used to determine which subscales of the Autism Spectrum Quotient predict these factors. For autistic drivers three factors of driving difficulty emerged: a Driving Executive factor, predicted by Attention Switching; a Driving Understanding factor, predicted by Communication; and a Driving Social Interaction factor, predicted by Attention Switching. For non-autistic drivers only one Driving General factor emerged, predicted by Communication. This suggests autistic people may experience at least three distinct domains of difficulty when driving which may relate to their particular profile of autistic features.