Background: Often, people with and without intellectual disabilities do not mingle. Research has mostly focused on how to foster "convivial encounters" for social inclusion, but further thinking is needed on situations in which potential encounters do not take place. Method: Discussion of philosophical and urban sociological literature on social interaction in public. Results: In non-encounters, people give subtle non-verbal cues in situations of physical proximity. This can both lead to hurtful experiences of invisibility and positive experiences of "micro-recognition." In spite of best efforts, people can position others unintendedly as "strange," which leads to "hesitation." Conclusions: This analysis highlights how non-encounters can be both socially inclusive and exclusive. In spite of best intentions, interactions in public spaces also come with tensions. The question of how to transform social culture to encompass difference remains significant.