Our nation's bleak economic situation has forced state governments to cut educational funding. While funds are decreasing, accountability for student achievement remains high. The No Child Left Behind Act (NCLB) forces each state to create and implement an accountability system of rewards and sanctions based on standardized test scores. In…

This action research study evaluates a classroom approach incorporating a reflective, metacognitive component within a second language process-oriented writing environment. Inspired by the literature and developed by the first author, this approach seeks to provide English language learners (ELLs) with a command of metalinguistic principles…

The goal of the current study was to examine the validity and topic generality of a writing performance test designed to place international students into appropriate ESL courses at a large mid-western university. Because for each test administration the test randomly rotates three academic topics integrated with listening and reading sources, it…

Using generalizability theory, this study examined both the rating variability and reliability of ESL students' writing in the provincial English examinations in Canada. Three years' data were used in order to complete the analyses and examine the stability of the results. The major research question that guided this study was: Are there any…

This study investigated whether dedicated test preparation classes gave learners an advantage in improving their writing test scores. Score gains following instruction on a measure of academic writing skills--the International English Language Testing System (IELTS) academic writing test--were compared across language courses of three types; all…

Educators often have to choose among different types of rating scales to assess second-language (L2) writing performance. There is little research, however, on how different rating scales affect rater performance. This study employed a mixed-method approach to investigate the effects of two different rating scales on EFL essay scores, rating…

The objective of the present investigation was to examine the comparability of writing prompts for different gender groups in the context of the computer-based Test of English as a Foreign Language[TM] (TOEFL[R]-CBT). A total of 87 prompts administered from July 1998 through March 2000 were analyzed. An extended version of logistic regression for…

Adult English as a second language (ESL) students learning English outside of traditional academic settings are an understudied population of second language learners. The purpose of the research reported here is to contribute to meeting the instructional needs of these students more effectively by investigating the relationships between their…

Possible integrated and independent tasks were pilot tested for the writing section of a new generation of the TOEFL[R] (Test of English as a Foreign Language[TM]). This study examines the impact of various rating designs and of the number of tasks and raters on the reliability of writing scores based on integrated and independent tasks from the…

In this work, prominent authorities review the latest research on all aspects of ELL instruction (K-12) and identify what works for today's students and schools. Provided are best-practice guidelines for targeting reading, writing, oral language, vocabulary, content-domain literacies, and other core skill areas; assessing culturally and…

Providing information to test takers and test score users about the abilities of test takers at different score levels has been a persistent problem in educational and psychological measurement (Carroll, 1993). Since the 1990s Educational Testing Service has been investigating solutions to this problem through the development of proficiency…

This study explored the extent to which the reading-to-write construct is the sum of one's reading and writing abilities or an independent construct. The investigation included an analysis of (a) test tasks, (b) the relationship of test task scores and scores on reading and writing measures, and (c) the effects of proficiency level and educational…

This paper reports the results of generalizability theory (G) analyses done for new writing and speaking tasks for the Test of English as a Foreign Language (TOEFL). For writing, a special focus was placed on evaluating the impact on the reliability of the number of raters (or ratings) per essay (one or two) and the number of tasks (one, two, or…

A long-time detractor of immersion education has been the concern that a substantial proportion of teaching in and about a language other than English might potentially lead to irreparable damage to immersion students' development in English and, hence, their ability to function in an English-dominant society. The assessment in this article,…

Possible integrated and independent tasks were pilot tested for the writing section of a new generation of TOEFL® (Test of English as a Foreign Language™) examination. This study examines the impact of various rating designs as well as the impact of the number of tasks and raters on the reliability of writing scores based on integrated and…