There is a lack of tests available for assessing sign language proficiency among L2 learners. We have therefore developed a sign repetition test, SignRepL2, with a specific focus on the phonological features of signs. This paper describes the two phases of developing this test. In the first phase, content was developed in the form of 50 items with sentence lengths between one and three signs. Then, when a period of teaching revealed a ceiling effect in the first version, a second version was developed with 40 items varying between one and four signs. Test scores revealed increasing proficiency in Swedish Sign Language during education, and that mouth actions have a lower degree of accuracy than manual parameters.