Diversity and inclusion in the field of physics has been an important area of research in the last two decades. However, such work has scarcely looked at the concerns and barriers faced by LGBT+ physicists, despite numerous indications they face discrimination in wider society. This article presents the first study looking at the climate experiences and persistence of LGBT physicists through an online survey (N = 324) focused on intragroup differences within the LGBT+ community. The results indicated that 36% of all respondents reported considering leaving their institution or workplace with 22% reporting that they experienced exclusionary behavior in the last year (i.e., being shunned, ignored, or harassed). However, this number varied by gender with transgender participants (49%) experiencing the most exclusionary behavior. Overall, respondents who could be out about being LGBT+ were more comfortable at their institutions and workplaces. The results point to the increasing challenges of LGBT+ physicists who are also transgender or persons of color, indicating the need for further research on this topic.