The development, formative evaluation, and potential uses of the "Sixteen Quality Indicators" (16 QI) rating scale are described. The scale was developed as a systematic way to rate the quality of Skill Qualifications Tests (SQTs) in the United States Army. An SQT measures a soldier's knowledge of a military occupational specialty. It is a criterion-referenced test that samples the tasks in a specific specialty area. Several hundred SQTs are developed annually. The 16 QI is a list of critical criterion-referenced test characteristics. Scale drafts were reviewed by army job specialists and civilian testing experts to form a five-point scale. The 16 QI are grouped into characteristics of the total test, the task-measuring part of the test, and the item. The 16 QI rating scale has not yet been evaluated thoroughly, but would appear to have potential for monitoring SQT quality and diagnosing what needs to be done to improve the quality of a test. As an organized and systematic procedure, the 16 QI may be useful in other applications to evaluate criterion-referenced tests. Four tables present the elements of the 16 QI and the regulations and policies that support its use. (SLD)