Describes several elicitation techniques used for speech act data collection and analysis and discusses their suitability in testing a learner's acquisition of the rules of language use. Argues that the development of testing instruments for communicative competence cannot be divorced from the field of cross-cultural pragmatics. (SED)

Describes a study of multiple-choice and open-ended questions, each presented in the native language and in the second language, on the same second language text. Different methods resulted in different scores. Some methods were found to be more difficult than others and to have a greater effect on students of low-level proficiency. (SED)

Argues that language tests employing methods not fair to all test takers are unethical. Ways of reducing sources of unfairness in language testing is discussed. (15 references) (Author/CK)

Outlines research necessary for determining the validity and reliability of Test of Written English, an essay test that directly measures writing ability and complements Test of English-as-a-Foreign-Language's (TOEFL) indirect assessment of writing skills. Research should cover such aspects as construct, criterion-related, concurrent, content, and…

Classical test theory and correlational techniques such as factor analysis have been unable to deal with many language tests' measurement problems. The Partial Credit Model, a latent trait model for the analysis of data scored in ordered categories, is used to construct and analyze an oral interview test of English as a Second Language. (28…

Analysis of TOEFL (Test of English as a Foreign Language) scores for 32,467 graduate school applicants, all nonnative speakers of English, revealed that students in the two key major-field groups, humanities/social sciences and biological/physical sciences, performed better on reading passages related to their own groups than on other passages.…

Several analyses are presented on the relationships among the Test of Spoken English, Test of Written English, and Test of English as a Foreign Language. The multivariate prediction of each test from the scores on the others is very accurate; variances with two prominent factors may relate to specific cognitive test-taking skills. (eight…

Reports on a project to develop and validate a criterion-referenced performance test of listening summary translation ability. This exam is designed to assess ability to comprehend and summarize in written English recorded conversations spoken in Spanish. The Bachman framework is used to present the test and provide evidence for its validity. (12…

This study examined the multiple true-false (MTF) test format in second language testing by comparing multiple-choice (MCQ) and multiple true-false (MTF) test formats in two language areas of general English: vocabulary and reading. Two counter-balanced experimental designs--one for each language area--were examined in terms of the number of MCQ…

Presents approaches to test development analysis, reliability, and validity based on criterion-referenced measurement principles and compares them with norm-referenced approaches in terms of the types of decisions that result from either approach. This is done by using data from an English-as-a-second-language achievement testing project at the…

Argues that tests have always been used as a means of political and social control. Maintains that test results are unreliable, especially at the extremes, that their predictive power is weak and that language testers need to be skeptical and need to insist on complete information on candidates' backgrounds for selection decision making. (10…

A validation study of the "semi-direct" Chinese Speaking Test (CST) directly compared college students' performance on the test with their performance on the "live" language proficiency interview. CST provided scoring results largely equivalent to those of the live interview, although examinees perceived CST to be more…

Three analysis procedures were used to study the dependability and validity of ESLPE, a criterion-referenced English-as-a-Second-Language placement test developed at the University of California at Los Angeles in 1989. Findings led to the suggestion that some students might have been differently placed if subtest scores were used for placement.(38…

The purpose of this study was to replicate previous research on the construct validity of the paper-based version of the TOEFL and extend it to the computer-based TOEFL. Two samples of Graduate Record Examination (GRE) General Test-takers were used: native speakers of English specially recruited to take the computer-based TOEFL, and ESL…

The present study utilized both the IRT-LR (item response theory likelihood ratio) and a series of CFA (confirmatory factor analysis) multi-sample analyses to systematically examine the relationships between DIF (differential item functioning) and DTF (differential test functioning) with a random sample of 15 000 Korean examinees. Specifically,…