Discusses design and evaluation concepts and methodologies in the context of comprehensive system design (CSD) and considers the concept of error throughout. Topics addressed include six core concepts of CSD; design processes; evaluation concepts; evaluation processes, including criterion-related validity, construct validity, and systemic…

Describes digital community information systems (CIS) and the need for improvements in system design. Proposes a layered evaluation framework to guide the evaluation of digital CIS from the perspective of information retrieval, following a selective review of digital CIS and evaluation approaches. Contains 59 references. (Author/LRW)

American indicator systems of educational accountability generally focus on student outcomes. The next generation of indicator systems must address wider issues, such as social context and values, curriculum assessment, structure of schooling, and individual student differences. Administrative, technical, political, and financial issues in…

Increasingly, machine learning is entertained as a mechanism for improving the efficiency of planning systems. Research in this area has generated an impressive battery of techniques and a growing body of empirical successes. Unfortunately the formal properties of these systems are not well understood. This is highlighted by a growing corpus of…

The development and evaluation of a potential viewdata-style delivery system for computer assisted learning (CAL) at the Open University are described. First examined are Open University problems with CAL and television delivery systems, which resulted in the consideration of a viewdata approach involving allocation of a small central processor to…

Reports on a project that proposes and tests a comprehensive and systematic model of user evaluation of Web search engines. This article describes the model, including a set of criteria and measures and a method for implementation. A literature review portrays settings for developing the model and places applications of the model in contemporary…

A literature review describes evaluation activities in mental health services in financial, programmatic/clinical, and new constituency areas. Expanding reimbursement for alternative mental health services is offered as a way of developing a formal structure to ensure better utilization of evaluation results. (SLD)

This report examines the feasibility of implementing a student unit record system to replace the student-related components that currently are based on aggregate institution-level data collected as part of the Integrated Postsecondary Education Data System (IPEDS). The feasibility study was initiated by the National Center for Education Statistics…

Reviews recent and current research and development projects in the United Kingdom dealing with online information systems. Main areas of research (systems design, impact on user behavior and organizational structure, ergonomics and bibliographic factors) and research techniques (features analysis, transaction log analysis, surveys and comparative…