In this chapter, we explore the obligations for individuals and institutions that emerge from the newfound insights that are enabled through learning analytics. While ethical concerns are raised through learning analytics, a misplaced trend is a "do nothing" approach as a way to assure we "do no harm." We suggest that this is a…

As we become increasingly acquainted with the rich opportunities that analytics systems can provide, there is a commensurate need to consider the extent to which analytics tools are effectively integrated, with proper training, into the day-to-day functioning of higher education professionals. This chapter explores the extent to which predictive…

In this chapter, we explore the contexts within which institutional researchers must try to ensure the ethical use of data. We also identify challenges institutional research professionals can face when navigating college culture while trying to ensure the ethical use of data. Finally, we identify potential solutions for improving institutional…

Decades of research in survey methodology and psychology have yielded important insights about how to create effective and valid survey instruments. As Porter (in press) has argued convincingly, college student surveys often fall well short of these standards by placing unrealistic demands on students' memory and by assuming that students readily…

Organizations such as the National Collegiate Athletic Association (NCAA) and the Knight Commission, as well as many members of the press, have debated for years whether intercollegiate athletics departments make money. In 2003, an NCAA study noted that 85 of the then 117 institutions in Division I-A, the highest competitive level of…

The methods and models for categorical data analysis cover considerable ground, ranging from regression-type models for binary and binomial data, count data, to ordered and unordered polytomous variables, as well as regression models that mix qualitative and continuous data. This article focuses on methods for binary or binomial data, which are…

Multilevel modeling (MLM) gives researchers the ability to make inferences about organizations where nesting factors will bias results and the assumption of independence is not tenable. This article provides an overview of the variety of data sources that lend themselves to conducting institutional research (IR). It not only serves as a repository…

In this chapter, the author examines the adequacy and appropriateness of self-report data using the lens of construct validity (Kane, 2006; Messick, 1989). Because construct validity focuses on the appropriateness of data for specific uses or interpretations, he limits his discussion to the use of self-report data in scholarly research. Other…

Assessment research is at its best when it packages research results and data so that they can be digested by multiple audiences. Too many assessment researchers spend all their efforts planning and executing the research project with little attention to closing the loop at the end. If assessment findings are not communicated effectively, the…

This article highlights the utility of disaggregating qualitative research and assessment data on Asian American college students. Given the complexity of and diversity within the Asian American population, scholars have begun to underscore the importance of disaggregating data in the empirical examination of Asian Americans, but most of those…

As a tour de force, data mining is likely to gain wider use in the next few years. To facilitate this transition, we make several recommendations addressed to both institutional research professionals and the Association of Institutional Research.

The author introduces her critical and feminist perspective, elaborates on her critical approach, and discusses how this influenced the development of her research questions, methodology, data analysis, interpretation, and presentation of findings.

Provides information regarding the National Educational Longitudinal Study database that was used for many of the studies in this volume. Provides relevant background and instructions so that others may use this resource from the National Center for Education Statistics. (Author/EV)

A consortium-based, student-oriented interinstitutional research project for educational assessment is described. The College Research Center (CRC) experience suggests that a consortium can be an effective vehicle but that there are difficulties in cultivating interest and long-term commitment. (Author/LBH)

This chapter discusses the theoretical literature on why people choose to respond to a survey and reviews the latest empirical research on how survey administration and the characteristics of a survey affect response rates. (Contains 1 figure.)