The relative worth of any evaluation instrument depends on user needs and the material being evaluated. Potential users of a good computer assisted instruction (CAI) instrument include purchasers, authors, reviewers, and publishers of CAI materials. Although each user has unique needs, a good instrument will serve both to educate and discriminate,…

Describes the variety of types of products produced by instructional designers, discusses the role of the designer, lists the critical instructional design attributes needed by instructors who design and implement loosely structured instructional products, and discusses prototype evaluation methods for less flexible, instructor-centered products.…

Data on the intrinsic characteristics of an educational program are essential in pilot testing new programs in order to determine how successfully design components have achieved their intended purpose. At the outset of an evaluation of such data, it is necessary to define the evaluator's role and determine what intrinsic information will be…

Discusses the importance of involving experts and learners in the formative evaluation of instructional materials. A case study describing the evaluation of a filmstrip/audiotape program is presented, and the importance of gathering feedback from multiple sources before making revision decisions is emphasized. (Author/LRW)

Self-formative evaluation is a unique form of formative evaluation which refers to the involvement of both the producer and the users in the evaluation of newly developed instructional materials; it does not indicate evaluation of themselves. This examination of the feasibility of employing this evaluation technique during the process of…

Provides a framework for understanding the concept of validity and how it applies to simulation research. Extant tests of validity are discussed in terms of this framework, and a general schema for testing validity is proposed. (MBR)

Describes and compares formative evaluation approaches: expert review, developmental testing, three-stage model, learner verification and revision, and general approach to formative evaluation. Discussion of differences among approaches related to duration of try-out/revision cycle and recommendations for effective acquisition of data are…

Steps used in the formative evaluation of a project designed to incorporate self-instructional materials in an introductory zoology course included techniques which: (1) involved colleagues in the material development; (2) assessed relevant student characteristics, expectations, and evaluations; and (3) were used in the examinations. (MBR)

A project developed and tested an Institutional Effectiveness Assessment Guide (IEAG) that incorporated themes and factors identified by Wardlow et al. (1992) as contributing to excellence. An interpretive design was used to enable researchers to gain input and consensus from participants of exemplary institutions regarding the institutional-level…

Describes the collection and analysis of summative data for a slide/tape self-instruction program on an introductory zoology course. Points of concern regarding curricular changes, teaching assistant training, student use, student performance evaluation, development, and revision are discussed from their unique perspectives within the summative…

A system designed to assist training managers or evaluators in increasing the effectiveness of military training programs has been developed, tested, and refined. The Training Program Evaluation (TPE) system offers advantages over traditional approaches of assessing program effectiveness. TPE involves the direct observation of training and testing…

A survey was conducted of expert instructional design practitioners about their use of developmental testing and revision procedures. The degree of correspondence was examined between published recommended practice and actual practice, as reported by 90 respondents to a questionnaire. The surveyed sample were members of the National Society for…