The viewpoint is expressed that adding to test reliability by either selecting a more homogeneous set of items, restricting the range of item difficulty as closely as possible to the most efficient level, or increasing the number of items will not add to test validity and that there is considerable danger that efforts to increase reliability may reduce validity. It is also stated that short tests may have useful validity if the items are well made and carefully selected. More stress should be placed on item quality and less on quantity. It is recommended that occasional well-funded item validity studies be initiated. (BH)