Purpose: Our study addresses three main questions: (a) Do autistics and neurotypicals produce different patterns of disfluencies, depending on the experimenter's direct versus averted gaze? (b) Are these patterns correlated to gender, skin conductance responses, fixations on the experimenter's face, alexithymia, or social anxiety scores? Lastly, (c) can eye-tracking and electrodermal activity data be used in distinguishing listener- versus speaker-oriented disfluencies? Method: Within a live face-to-face paradigm combining a wearable eye-tracker with electrodermal activity sensors, 80 adults (40 autistics, 40 neurotypicals) defined words in front of an experimenter who was either staring at their eyes (direct gaze condition) or looking elsewhere (averted gaze condition). Results: Autistics produce less listener-oriented ("uh," "um") and more speaker-oriented (prolongations, breath) disfluencies than neurotypicals. In both groups, men produce less um than women. Both autistics' and neurotypicals' speech are influenced by whether their interlocutor systematically looks at them in the eyes or not, but their reactions go in opposite directions. Disfluencies seem to primarily be linguistic phenomena as experienced stress, social attention, alexithymia, and social anxiety scores do not influence any of the reported results. Finally, eye-tracking and electrodermal activity data suggest that laughter could be a listener-oriented disfluency. Conclusions: This article studies disfluencies in a fine-grained way in autistic and neurotypical adults while controlling for social attention, experienced stress, and experimental condition (direct vs. averted gaze). It adds to current literature by (a) enlightening our knowledge of speech in autism, (b) opening new perspectives on disfluency patterns as important signals in social interaction, (c) addressing theoretical issues on the dichotomy between listener- and speaker-oriented disfluencies, and (d) considering understudied phenomena as potential disfluencies (e.g., laughter, breath).