Efforts to develop common higher education data standards are expanding both within and across countries. The institutional research (IR) community plays a critical role in assuring that these efforts capture the diverse manifestations of the postsecondary and tertiary education systems and promote responsible comparisons. This chapter provides…

This article describes a mixed-methods approach to integrating the methodological tools of social network analysis and qualitative research to explore intersectionality as it pertains to faculty experiences in institutional contexts. These research strategies, employed at the individual and aggregate levels, can be useful tools as institutions aim…

The process of identifying and selecting peers for a college or university is one of this volume's definitions for "benchmarking": "a strategic and structured approach whereby an organization compares aspects of its processes and/or outcomes to those of another organization or set of organizations to identify opportunities for…

The sophisticated analytical techniques available to institutional researchers give them an array of procedures to estimate a causal effect using observational data. But as many quantitative researchers have discovered, access to a wider selection of statistical tools does not necessarily ensure construction of a better analytical model. Moreover,…

The purpose of this chapter is to discuss the conceptual, methodological, and statistical challenges in selecting appropriate peer institutions for comparative purposes. The authors' approach embraces a Western scientific tradition that physical things and phenomena can be "reduced into a set of key variables--identifiable parts--that make key…

Multilevel modeling (MLM), also referred to as hierarchical linear modeling (HLM) or mixed models, provides a powerful analytical framework through which to study colleges and universities and their impact on students. Due to the natural hierarchical structure of data obtained from students or faculty in colleges and universities, MLM offers many…

Drawing on the work of several prominent scholars, the author describes the evolution of quantitative critical inquiry and compares this perspective to traditional research paradigms. (Contains 1 table.)

System offices for community college institutional research differ in many ways from campus offices for community college institutional research. The other chapters in this volume describe salient characteristics of system IR offices, but many readers may want to see a direct comparison of system IR offices to campus IR offices in the community…

College student self-reported gains are used frequently in institutional research and in general research on college outcomes (Gonyea, 2005). These self-report measures serve not only to identify experiences and programs associated with student growth but also to draw comparisons across colleges and universities. The vast majority of institutions…

Survey data are widely used in higher education for purposes such as assessment and strategic planning. One of the most common ways of using surveys has been to assess student learning outcomes by means of proxy questions on a survey, assuming that students who engage in specific behaviors (called engagement) have learned more during college than…

Policy analysis in higher education is distinct from but is informed by and can contribute to both institutional research and institutional planning. Policy analysis extends beyond data analysis, using many qualitative research methods and a degree of intuition, and focuses on specific issues, not systems as does planning. (MSE)

Examination of popular publications that rate and rank collegiate undergraduate education reveals several methodological concerns. The challenges for consumers and researchers are to know what shortcomings exist in these ratings, what impact the shortcomings have on the rankings, and what methodological changes might improve the evaluations.…

Comparative alumni research data can be used by individual institutions and entire sectors of higher education to study, improve, and promote themselves. A large multi-institutional alumni study in Pennsylvania provides an example of the methods and benefits of such research. Aggregate findings in 11 key areas and specific key subgroup profiles…

Institutional comparison groups can be selected in several ways, depending on the comparison issue. The method chosen involves both technical and political considerations. (Author/MSE)

It is argued that research testing the reliability and validity of college and university reputational studies should be conducted, a concern not raised by consumers and publishers. Two studies of "America's Best Colleges," published by "U.S. News and World Report," raise questions about the guide's validity and suggest that…