The philosophers of the Enlightenment formulated a set of new ideas and visions about access to knowledge and education for all citizens. The main discourse of modernity is linked to liberty, democracy and equality, but modernity is also an ambiguous project, characterized by an ongoing conflict between individual freedom and discipline. Modernity has been transformed through different phases and the related crises that have marked the transition between them. In this conflicting history the ideological and socio-political conditions for special education during modernity is also described. The article uses examples from Norwegian special education policy and practice in describing and discussing developments and discourses in the field through different phases of modernity, from the early rise of the field within the frames of the charity institutions to the discourses on integration and inclusion in the latest decades. (Contains 8 notes.)