This article presents a synopsis of each of seven presentations given at a conference on design and analysis in community trial studies. Papers identify problems with community trials and discuss strengths and weaknesses associated with design and analysis strategies. Areas of consensus are summarized. (SLD)

An original study with a 96 percent questionnaire return rate and four replications with high return rates were compared in terms of populations sampled, implementation, and results. Future use of this procedure, which includes advance mailing, telephone contact, telephone explanations, and followups, is discussed. (SLD)

This paper argues that judgment-based assessment of data from multiply replicated single-subject or small-N studies should replace normative-based (p=less than 0.05) assessment of large-N research in the clinical sciences, and asserts that inferential statistics should be abandoned as a method of evaluating clinical research data. (Author/JDD)

Discussion of user queries in information retrieval highlights the experimental evaluation of an adaptive linear model that constructs improved query vectors from user preference judgments on a sample set of documents. The performance of this method is compared with that of standard relevance feedback techniques. (28 references) (LRW)

Discusses a technique for estimating sample size that does not require an a priori definition of desired precision. Presents five modifications that make the method easier to use and reduce the probability of estimating a larger sample size than necessary. The technique can guide the design of environmental sampling programs. (Contains 31…

This study compared the speech of five children (ages 5 and 6) with Down syndrome across single word samples elicited from tests and connected speech samples elicited during play. Analysis indicated that connected speech samples provided fewer total words and word tokens and sometimes failed to target certain later developing phonemes. Clinical…

A method is described for increasing residual degrees of freedom in a community experiment without substantially increasing cost or difficulty by dividing experimental subunits into batches. Theoretical advantages of batch sampling are described and illustrated with data from the Pawtucket Heart Health Program. (SLD)

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

Procedures for implementing the Pennsylvania Plan (see TM 000 608) are detailed, and the method of achieving representative sampling is described. Functions of school representatives involved in the data collection are listed, and their training is outlined. Procedures for collecting school and teacher information, and administering tests and…

This speech discusses performance contracting as educational research, notes some evaluation problems, and proposes solutions to these problems. The term performance contracting, according to the report, denotes an administrative rather than an instructional innovation. The author observes that the understanding of instruction and learning derived…

Provides comprehensive description of methodology used in national study on competencies of vocational rehabilitation practitioners in major specializations and employment settings, giving special attention to sampling design and instrument development phases. Also gives detailed descriptive information on characteristics of respondents.…

A number of quality assurance educational evaluation methods are illustrated. Evaluation data obtained from the Providence, Rhode Island, school district are used. The methods are: (1) from auditing, internal control; (2) from accounting, double bookkeeping; and (3) from industrial quality control, acceptance sampling and cumulative percentage…

Describes a process for evaluating career education activities. Discusses the selection of the evaluation sample, selection and development of instruments, data reduction and analysis, comparison standards, and preparation of an evaluation handbook. (JOW)

A case study approach taken with three years of data on a hospital's trauma program indicate that, although service user data is important, its political importance far outweighs evaluation value and utility, especially for hard-to-access samples. Implications of this challenge to traditional assumptions for program evaluation are discussed. (SLD)

Combinations of five methods of equating test scores and two methods of selecting samples of students for equating were compared for accuracy, using data from the administration of the Scholastic Aptitude Test to more than 115,000 students. Implications for research and practice are discussed. (SLD)