Decades of research in survey methodology and psychology have yielded important insights about how to create effective and valid survey instruments. As Porter (in press) has argued convincingly, college student surveys often fall well short of these standards by placing unrealistic demands on students' memory and by assuming that students readily…

In this chapter, the author examines the adequacy and appropriateness of self-report data using the lens of construct validity (Kane, 2006; Messick, 1989). Because construct validity focuses on the appropriateness of data for specific uses or interpretations, he limits his discussion to the use of self-report data in scholarly research. Other…

Most assessment arguments are about measurement. When is it better to use direct versus indirect measures of student learning? Is one standardized test of critical thinking better than another? Is applying rubrics to student work better than using standardized tests? How valid are self-reported measures of learning? Although these arguments are…

Most institutional research (IR) practitioners lack access to direct measures of longitudinal student learning, let alone assessment instruments systematically embedded into the curriculum that yield representative cognitive gain data controlling for student motivation. Typically, measures of student learning growth rest on findings from survey…

In this chapter, the author proposes a model for assessing institutional effectiveness. The Volkwein model for assessing institutional effectiveness consists of five parts that summarize the steps for assessing institutions, programs, faculty, and students. The first step in the model distinguishes the dual purposes of institutional effectiveness:…

Evaluative statements from alumni have legitimacy with both internal and external stakeholders. Thus, alumni studies can provide valuable evidence of institutional effectiveness and lend themselves to both locally designed and commercial survey instruments for data collection. Under ideal conditions, the results of alumni studies equip faculty and…

Despite their apparent popularity among those seeking degrees and credentials, today's colleges and universities face several interrelated public criticisms and concerns. When these competing concerns about student success, productivity, cost, and educational effectiveness all collide at the campus level, they create an array of campus tensions…

A discussion of methods for measuring college faculty workload first reviews course load analysis, the traditional method used to define, measure, and report faculty workload, then suggests some data alternatives and related issues faced by institutional research offices. Suggestions are offered for locating existing workload data, compiling a…

The Total Quality Management approach is used as a framework for a discussion of methodological issues related to diversity in higher education, including classification of race and ethnic information, data aggregation, and use of several key indicators (access to college, persistence, and student progress). (MSE)