Discusses the role of the Rasch model IRT in evaluating two subtests of the Occupational English test and argues for its use in exploring test constructs and in considering the implications of the empirical analysis presented for the validity of communicative language tests involving speaking and writing skills. (39 references) (Author/JL)

This study was undertaken, in conjunction with other studies field-testing prototype tasks for a new TOEFL, to evaluate the content validity, perceived authenticity and educational appropriateness of these prototype tasks. We interviewed seven highly experienced instructors of English as a Second Language (ESL) at three universities, asking them…

This article reports on a collaborative study involving ESL teachers in an Australian English Language Centre as they work through some of their concerns about reliability and validity in their assessment practices. The focus of this article is on how teachers work with the Curriculum Standards Framework (CSF) as an assessment tool. The discussion…

This is a construct validation study of a second language speaking assessment that reported a language profile based on analytic rating scales and a composite score. The study addressed three key issues: score dependability, convergent/discriminant validity of analytic rating scales and the weighting of analytic ratings in the composite score.…

Presents the theory of general language proficiency and looks at the construct validation of cloze tests and C-tests. Describes the defects of classical cloze procedures. Gives an example of the C-Test and discusses its empirical validity. Concludes that C-tests are authentic tests of the construct of general language proficiency.

Presents a literature review seeking to answer four questions: (1) What is washback? (2) How does washback work? (3) How can we promote positive washback? and (4) How can we investigate washback? A model is proposed that identifies participants, processes and products which may influence or be influenced by, washback. Strategies for investigating…

The reliability and validity of a cloze procedure used as an English-as-a-second-language (ESL) test in China were improved by applying traditional item analysis and selection techniques. The 'best' test items were chosen on the basis of item facility and discrimination indices, and were administered as a 'tailored cloze.' 29 references listed.…

Examines bias in Australian school examinations as it affects learners of languages other than English from different primary language backgrounds. Argues that the determination of whether tests are biased depends on how the test construct is defined and on whom is defining it. This issue is discussed within the context of a plan to compensate…

Describes current procedures used for testing bilingual teachers in the United States and focuses on one means of assessment used in Arizona. Examinee questionnaire responses, teacher questionnaire responses and test section analysis all contributed evidence for validity. (33 references) (Author/CK)

Utilizing the Test of English Proficiency, developed by Seoul National University (TEPS), examined comparability between the paper-based language test and the computer-based language test based on content and construct validation employing content analyses based on corpus linguistic techniques in addition to such statistical analyses as…

Assessed native Brazilian students' affective reactions to different oral English-as-a-Foreign-Language achievement test formats. A multivariate analysis of variance based on the results of a factor analysis showed no significant difference among student reactions to the different test formats. (Author/CB)

A total of 102 university English majors were administered 4 different language tests to form a General Language Proficiency measure against which the C-test was evaluated. Results confirmed its reliability and validity and also provided data on text difficulty/appropriateness, word structure, content, and different scoring methods. (13…

Discusses the value of content considerations in the design of language tests and the implications of the findings of various investigations of content analysis. The article argues that content analysis can be viewed as the application of a model of test design to a particular measurement instrument, using judgments of trained analysts. (26…

Discusses the reliability and validity of different measures of lexical richness in various language data research and computer simulations, and examines the behavior of these measures in spontaneous speech data of first language and second language children learning Dutch, aged 4 to 7, compared with their lexical abilities as measured by tests.…

This article investigates a group oral test as administered at a university in Japan to find if it is appropriate to use scores for higher stakes decision making. It is one component of an in-house English proficiency test used for placing students, evaluating their progress, and making informed decisions for the development of the English…