This study investigated physical education (PE) teachers' experiences with remote instruction in the United States during the initial outbreak of COVID-19. PE teachers (n = 4,362) from all 50 states completed a survey identifying their experiences with remote instruction in May, 2020. Survey responses were analyzed by geographic region, district type, and school level. Teachers reported having students submit assignments (51% yes), using video instruction (37% yes), being less effective when instructing remotely (20% yes), and emphasizing student outcomes focused on health-related fitness (32% yes), and physical activity value/enjoyment (43% yes). Access to technology (40% yes) and required student assignments (43% yes) were lowest among teachers from the South. Rural teachers reported the least access to technology (37% yes) and rated themselves as least effective (24% yes). Secondary level teachers reported the highest percentage of required assignments (84% yes). Teachers' responses identify unique challenges to delivering equitable and effective remote PE instruction.