A DETAILED ANALYSIS OF THE RETRIEVAL EVALUATION RESULTS OBTAINED WITH THE AUTOMATIC SMART DOCUMENT RETRIEVAL SYSTEM FOR DOCUMENT COLLECTIONS IN THE FIELDS OF AERODYNAMICS, COMPUTER SCIENCE, AND DOCUMENTATION IS GIVEN IN THIS REPORT. THE VARIOUS COMPONENTS OF FULLY AUTOMATIC DOCUMENT RETRIEVAL SYSTEMS ARE DISCUSSED IN DETAIL, INCLUDING THE FORMS OF INPUT, AUTOMATIC CONTENT ANALYSIS METHODS, AND THE MATCHING PROCEDURES USED TO COMPARE DOCUMENTS AND SEARCH REQUESTS. THE COMPLETE TEST ENVIRONMENT AND THE PARAMETERS WHICH ENTER INTO THE EVALUATION PROCESS ARE ALSO DESCRIBED. CONTENTS--(1) TEST ENVIRONMENT BY E.M. KEEN, (2) EVALUATION PARAMETERS BY E.M. KEEN, (3) SEARCH MATCHING FUNCTIONS BY E.M. KEEN, (4) CORRELATION MEASURES BY K. REITSMA AND J. SAGALYN, (5) DOCUMENT LENGTH BY E.M. KEEN, (6) SUFFIX DICTIONARIES BY E.M. KEEN, (7) THESAURUS, PHRASE AND HIERARCHY DICTIONARIES BY E.M. KEEN, (8) AN EXPERIMENT IN AUTOMATIC THESAURUS CONSTRUCTION BY R.T. DALTOLA AND D.M. MURRAY, (9) WORD-WORD ASSOCIATIONS IN DOCUMENT RETRIEVAL SYSTEMS BY M.E. LESK, AND (10) AN ANALYSIS OF THE DOCUMENTATION REQUESTS BY E.M. KEEN. TWO APPENDICES ARE ALSO INCLUDED--(1) RECALL-PRECISION TABLES AND (2) ORIGINAL AND MODIFIED ADI QUERIES. FOR PREVIOUS REPORT IN THIS SERIES, SEE LI 000 417. THIS DOCUMENT IS AVAILABLE AS PB-177-812 FROM THE CLEARINGHOUSE FOR FEDERAL SCIENTIFIC AND TECHNICAL INFORMATION, SPRINGFIELD, VIRGINIA 22151, $3.00 FOR HARD COPY, $0.65 FOR MICROFICHE, 504 PAGES. (AUTHOR/CM)