The methods, procedures, and results of an interview survey into reactions of user personnel to the Air Force Instructional System Development (ISD) system are reported. Training evaluation, student measurement, and training manager/instructor personnel were interviewed. All groups regarded the ISD procedures favorably, but some problems…

This document contains the full and short papers on evaluation of learning and systems from ICCE/ICCAI 2000 (International Conference on Computers in Education/International Conference on Computer-Assisted Instruction) covering the following topics: a new method for efficient study of Kanji using mnemonics and software; a study on the relation…

Highlights lessons learned by a national organization, the Council of Chief State School Officers, in building an education indicator system in cooperation with federal and state education agencies. Issues emphasized are (1) the role of consensus; (2) production of indicators through a cooperative data system; and (3) reporting methods. (SLD)

Argues that there is a fundamental gap between the knowledge that the information systems development community values and that which cultural analysis yields. Suggests that developers, rather than trying to explain social behavior and knowledge with rules, should be concerned with the production of contesting rules and what the production tells…

Four articles respond to the Bader and Nyce position that it is unlikely cultural analysis will become a routine tool for information systems developers with these arguments: ethnographic work can aid software development; the problem lies with inappropriate application of social science methods; the problem is technique, not fundamentals; and…

A system designed to assist training managers or evaluators in increasing the effectiveness of military training programs has been developed, tested, and refined. The Training Program Evaluation (TPE) system offers advantages over traditional approaches of assessing program effectiveness. TPE involves the direct observation of training and testing…

The improvement and standardization of quality Title I evaluations at the local, state and federal levels is the intent underlying the development and dissemination of the Elementary and Secondary Education Act Title I Evaluation and Reporting System. Even if the current suggested procedures were technically perfect, implementation of any…

The feasibility of using a centralized data processing facility to sever a large group of secondary schools and the capabilities of two alternative systems were investigated. The population to be served included 100,000 students in grades 9-14 attending 50 schools in an area having a hundred mile radius. Service requirements were defined to…

The development of leadership evaluation procedures has been impeded by the same obstacles that have slowed the development of soft skills systems engineering techniques. Problems include the difficulty of finding a "true expert", the general lack of clarity concerning ultimate criterion measures, and the fact that leadership skills are…

Discusses the management predicaments encountered in decision making for a very small school library and the reasons that procedures recommended in the literature may not be applicable. The process used in planning and implementing an online circulation system in a high school library is described. (Author/CLB)

Oregon's Educational Act for the 21st Century is a remarkably comprehensive and systematic approach to school reform. Relying on a broad partnership of business leaders, parents, teachers, and educational professionals, it calls for a shift in public attitudes, a focus on outcome-based evaluations, and efforts to ensure its compatibility with…

Some steps to identify an initial set of indicators and to develop alternative indicator systems are outlined for educational evaluation and illustrated through the example of a National Science Foundation (NSF) study of mathematics and science education. The first step is to conceptualize potential indicators to specify a comprehensive monitoring…

Field testing, the last step in the developmental cycle for educational products, must ascertain whether the test product, placed in a natural environment, will actually elicit the behavioral changes it was designed to effect. A systems approach to field testing requires that certain basic areas of investigation first be established. Specific…

Research explored methods of providing a coherent framework for the Instructional Systems Development (ISD) model which would promote better system evaluation, internal communications and student testing. Lists of critical tasks for two Air Force specialties were compiled and multidimensional scaling and hierarchical cluster analysis employed to…

The six articles comprising this special section on MELVYL, the University of California automated library system, discuss plans for the future, general recommendations for online catalog design, evaluation methods, evolution of computing resources, impact on the work of librarians, and academic goals and benefits. A chronology of MELVYL…