In Swiss high schools, teachers have significant leeway in determining the learning objectives and contents of curricula, including the recommended transversal theme of human rights. Teachers' views on human rights and human rights education (HRE) are, therefore, a determining factor for HRE's successful implementation. This article presents the results of a study conducted with 55 high school teachers, which aimed to establish teachers' views of HRE. The article focuses specifically on perceived challenges to implementation: teachers' views on content and aims of HRE; intended curriculum; and supporting implementation of HRE. It argues that, while we need to address some of these challenges at the level of policy, curriculum, and material development, other obstacles are mainly due to teachers' misconceptions and lack of familiarity with the concept of HRE and can, thus, best be tackled through tailored pre- and in-service training measures.