This article presents an analysis of Ordinate Corporation's PhonePass Spoken English Test-10. The company promotes this product as being a useful assessment tool for screening job candidates' ability in spoken English. In the real-life domain of the work environment, one of the primary target language use tasks involves extended production…

As high-stakes use of tests increases, it becomes vital that test developers and test users communicate clearly about the accuracy and limitations of the scores generated by a test after it is assembled and used. A procedure is described for portraying the accuracy of test scores. It can be used in setting accuracy targets during form construction…

A study was conducted to validate the Army's Computerized Adaptive Screening Test (CAST), using data from 2,240 applicants from 60 army recruiting stations across the nation. CAST is a computer-assisted adaptive test used to predict performance on the Armed Forces Qualification Test (AFQT). AFQT scores are computed by adding four subtest scores of…

Supervisory performance appraisals may be of limited utility in the validation of bilingual tests because incumbents are often hired to be the only employee in a unit who possesses the skills necessary to do the job. In an effort to provide criterion-related validity for four equivalent forms of a Spanish/English bilingual test for school district…

An overview is presented of methods of teacher assessment. The most heavily used methods of teacher assessment are standardized paper-and-pencil examinations and on-the-job ratings by supervisors. An alternative to the paper-and-pencil approach is explored, and preliminary evidence is presented in support of this assessment strategy.…

The composite of Armed Services Vocational Aptitude Battery (ASVAB) subtests used to select applicants for entry-level training in Army clerical schools was evaluated by correlating composite scores with training performance scores. Comparisons were made between the multiple R for this optimal set of predictors and that for the composite of…

The purpose of this paper, which is drawn from a larger analytic history of the National Teacher Evaluation (NTE) program, is to investigate issues of validity within the context of the program's 50-year history. Three major findings emerge from historical considerations relating to: (1) the continuity of test content and justification over the…