This study presents the processes of developing and establishing reliability and validity of a reading test by administering an integrative approach as conventional reliability and validity measures superficially reveals the difficulty of a reading test. In this respect, analysing vocabulary frequency of the test is regarded as a more eligible way of measuring validity. A study was conducted at Dokuz Eylu¨l University and C¸anakkale Onsekiz Mart University with three colleagues and 100 undergraduate students to establish validity and reliability along with readability and vocabulary frequency of a 32-item reading test which was developed by the researcher. Such detailed assessment is highly recommended for researchers who are in need of preparing pre and post tests which are different from each other.