Presents the state-of-the-art of information systems monitoring, addressing historical and current approaches and manual and automated techniques; develops the concept of automated monitoring into a well-defined methodology; formulates methodologies/techniques/theoretical foundations for analyzing monitored data; and discusses computer based…

A step-by-step outline is presented for testing the applicability of Lotka's law of scientific productivity. Steps include the computation of the values of the exponent and constant based on Lotka's method and the test for significance of observed frequency distribution against the estimated theoretical distribution derived from Lotka's formula.…

Discusses the PRECALL, PRR (probability of relevance given retrieval), and EP (expected precision) approaches for dealing with the problem of weak ordering in information retrieval systems. Findings of two experiments comparing evaluation results obtained by PRR and EP are reported. Several mathematical formulas and proofs are included. (20…

Describes the hyperterm system REALIST (Retrieval Aids by Linguistics and Statistics) with emphasis on its semantic component, which generates term relations from free-text input. Experiments with various similarity measures are discussed, and the quality of the associated terms is evaluated using term recall and term precision measures. (22…

Describes work performed under the Spelling Error Detection Correction Project (SPEEDCOP) at Chemical Abstracts Service to devise effective automatic methods of detecting and correcting misspellings in scholarly and scientific text. The trigram analysis technique developed determined sites but not types of errors. Thirteen references are listed.…

Various methods for calculating and presenting results of information retrieval (IR) evaluation research are discussed, with illustrations from recent laboratory results. Highlights include measures for calculating recall and precision, user needs for high or low level of recall, and comparisons of Boolean and ranked output retrieval. (22…

Describes the concept of an integrated environment which allows managers to evaluate and measure the performance of computer based information systems. Both system efficiency evaluation and user interaction evaluation are addressed, and MADAM, a system currently operational at the University of Southwestern Louisiana, is briefly described.…

Describes an investigation of tools, techniques, and methods for the evaluation of interactive library catalogs, with emphasis on diagnostic methods and on use of the catalog in the wider context of user information-seeking behavior. A front-end system (Olive) developed to test various enhancements of traditional transaction lodging as a…

Outlines problems involved in information retrieval evaluation and suggests a more user-centered interpretive approach. A longitudinal study that examines evaluation through the information-seeking behavior of 22 case studies of actual users is described; and relevance judgments, effectiveness ratios, and analysis of document failures are…

Describes a study of medical students that was conducted to evaluate measures of performance on factual searches of INQUIRER, a full-text database in microbiology. Measures relating to recall, precision, search term overlap, and efficiency are discussed; reliability and construct validity are considered; and implications for future research are…