When tasked with selecting a Course Management System (CMS), the first step many responsible colleges, universities and consortia take is to name a selection committee of faculty, administration, students and possibly IT staff. They do some Web searching and talk to colleagues, friends and counterparts at other institutions. This same committee…

Studied the nature of barriers to the implementation of external program evaluation through interviews with 18 staff members of a university outreach program. Findings reinforce the importance of a trusting relationship to avoid barriers to evaluation implementation. (SLD)

The most recent attempt by educators to emulate the "sound principles" and methods of business and science is to become data-driven. The leaders in a data-driven school are able to demonstrate how some number, preferably scores on standardized tests, has moved upward as a result of some program they have initiated. Data-driven schools also possess…

The current study examines the views of experts in the science of mental abilities about the primacy and uniqueness of "g" and the social implications of ability testing, and compares their responses to the views of a group of non-expert psychologists. Results indicate expert consensus that "g" is an important, non-trivial determinant (or at least…

Like Dorothy in the Wizard of Oz, faculty members and student affairs educators often believe that the answers they seek about assessment are secrets kept by an all-knowing, powerful person. If they can just find the Wizard of Assessment and be granted the secret assessment formula, all will be well. The student affairs educators at California…

Purpose--The purpose of this research is to examine participants' response rate on dual style training course evaluation forms. These combine structured and open-ended formats. Pencil and paper forms have a long history of use by trainers in business and commerce and more recently in education. Research methods texts tend to have neglected the…

"How New York City's Charter Schools Affect Achievement" estimates the effects on student achievement of attending a New York City charter school rather than a traditional public school and investigates the characteristics of charter schools associated with the most positive effects on achievement. Because the report relies on an…

This paper considers the problem of analysis of correlation coefficients from a multivariate normal population. A unified theorem is derived for the regression model with normally distributed explanatory variables and the general results are employed to provide useful expressions for the distributions of simple, multiple, and partial-multiple…

The American Indian Higher Education Consortium (AIHEC), comprising 34 American Indian tribally controlled colleges and universities, has undertaken a comprehensive effort to develop an "Indigenous Framework for Evaluation" that synthesizes Indigenous ways of knowing and Western evaluation practice. To ground the framework, AIHEC engaged…

A comprehensive review of the literature on the evaluation of learning objects revealed a number of problem areas, including emphasizing technology ahead of learning, an absence of reliability and validity estimates, over-reliance on informal descriptive data, a tendency to embrace general impressions of learning objects rather than focusing on…

While the current debate in the evaluation community has concentrated on examining and explicating implications of the choice of methods for evaluating federal programs, the authors of this paper address the challenges faced by the government in the selection of funding mechanisms for supporting program evaluation efforts. The choice of funding…

The relation of the concept of metapolicy to the evaluation agenda is discussed. Metapolicy is a general rule or policy about how public policies should be made or implemented. Broad shifts in metapolicy create new agenda items for evaluation. If the shift is toward reduced federal involvement in social programs, new evaluation questions are not…

Identifies salient features that distinguish between criticisms perceived by their recipients as "good" from those perceived as "bad." Considers five primary areas for criticism: appearance, skill performance, relationships, general personhood, and decision making, as well as stylistic characteristics of criticism. (NKA)

The problems associated with forms used to evaluate instructional software are described, and a new form is presented. Rating forms for reviewers should address: (1) global characteristics of the courseware; (2) specific characteristics; and (3) specific properties related to instructional design. The two-page Software Evaluation Form is included.…

Explains that Fritz Machlup's four principles of measurement have been widely used to explain all aspects of the postindustrial, information society, but they do not serve to analyze changes in complexity of work, routinization, educational requirements, and increasing worker utilization of information. (SD)