A prototype revised form of the Test of Spoken English (TSE) was compared with the current version of the same test, comparing interrater reliability, frequency of rater discrepancy at all score levels, component task adequacy, scoring efficacy, and other concurrent and construct validity evidence, including the oral proficiency interview correlations for a subsample of the examinees. The study employed a representative sample of 342 nonnative speakers of English, purposely sampled from two professional domains of prospective university teaching assistants (N=184) and prospective licensed medical professionals (N=158). In an attempt to involve the persons most at risk in the judgment process, 16 naive adult raters (8 first-year university students and 8 nondegreed medical outpatients) were used in addition to the usual group of trained raters. The naive raters provided concurrent judgments of the comprehensibility and communicative effectiveness of a subset of 40 examinations. In general, the evidence appeared to underscore the psychometric quality of the prototype revised TSE and to support conclusions of its adequacy as an instrument to make judgments of oral English language proficiency of nonnative speakers. Some suggestions on scoring are provided. Six appendixes give additional scoring information and include sample tests. (Contains 10 tables and 10 references.) (SLD)