Examination of popular publications that rate and rank collegiate undergraduate education reveals several methodological concerns. The challenges for consumers and researchers are to know what shortcomings exist in these ratings, what impact the shortcomings have on the rankings, and what methodological changes might improve the evaluations.…

The preparation and use of data needed to make objective, useful comparisons in higher education are considered. The needs for comparative data in higher education, including demands for accountability and strategic planning, are reviewed. In addition, data-related problems are considered: problems of narrowness, misrepresentation, sameness,…

The analytical problems faced by gross interstate comparisons of higher education funding are reviewed, the overall usefulness to decision-makers of interstate comparisons, and other approaches to comparative analysis are considered. It is claimed that the usefulness of gross interstate comparisons is limited, since both technical and structural…

It is argued that research testing the reliability and validity of college and university reputational studies should be conducted, a concern not raised by consumers and publishers. Two studies of "America's Best Colleges," published by "U.S. News and World Report," raise questions about the guide's validity and suggest that…

Debate grows over the validity and reliability of college and university rankings, which judge rather than describe institutions, as the public's willingness to accept them increases. While many institutional characteristics can be measured, measurement methods need improvement. One solution is to publish the peer studies that the institutions…