This article provides renewed converging empirical evidence for the hypothesis that asking test-takers to respond to text passages with multiple-choice questions induces response processes that are strikingly different from those that respondents would draw on when reading in non-testing contexts. Moreover, the article shows that the construct of…

This paper provides a summary of the authors' attempts to uncover links between their measures, classroom mathematics instruction, and student learning. This paper also provides evidence regarding one central critique of their measures: that multiple-choice assessments cannot validly represent the knowledge, skills, and judgment involved in actual…

This paper describes the development and evaluation of a blended learning resource in the biosciences, created by combining online learning with formal face-face lectures and supported by formative assessments. In order to improve the effectiveness and efficiency of teaching large classes with mixed student cohorts, teaching was delivered through…

Essay and multiple-choice scores from Advanced Placement (AP) examinations in American History, European History, English Language and Composition, and Biology were matched with freshman grades in a sample of 32 colleges. Multiple-choice scores from the American History and Biology examinations were superior to essays for predicting overall grade…

A study investigated certain mechanisms underlying the acquisition of phrasal verbs in English as a Second Language. Subjects were native Finnish- and Swedish-speaking students in Finland, most aged 16-25 years. The subjects were administered a multiple-choice test with each item containing two correct alternatives, a phrasal verb (preferred by…

This paper contends that much of the time and money devoted to standardized testing in the United States is misspent. Too many tests are poorly constructed, unreliable, and unevenly administered. Multiple-choice tests cannot measure thinking skills or real problem-solving ability. In addition, many examinations are biased racially, culturally,…

This report provides information on student performance at the state, regional, and school system levels on end-of-grade (grades 3-8 reading and mathematics) multiple-choice tests and end-of-course (high school subjects) multiple-choice tests administered in 1997-98 for 117 public school systems and 35 charter schools. Beginning in the 1992-93…

The impact of the Channel One school newscasts on student knowledge of current events and on student attitudes was studied with tenth and eleventh graders in six suburban high schools in the Midwest. Three schools (464 students) received the newscast and the remaining schools (604 subjects) did not. Current events knowledge was assessed with a…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

This study examined scores from 133,906 operationally scored Test of English as a Foreign Language™ (TOEFL®) essays to determine whether the choice of composition medium has any impact on score quality for subgroups of test-takers. Results of analyses demonstrate that (a) scores assigned to word-processed essays are slightly more reliable than…

Use of item response theory (IRT), the delta plot method, and Mantel-Haenszel techniques to assess differential item functioning (DIF) across racial and gender groups associated with the Maryland Test of Citizenship Skills (MTCS) is described. The objective of this research was to determine the: effect of sample size on results from these three…

The provincial results of the English 33 Achievement Test administered June 8, 1982, as part of the Student Achievement Testing Program of Alberta Education are presented in this report. Following a list of the requirements of Part A (written expression), the first section describes the categories used to assess total expression and the scoring…

The process of revising and validating two English language tests used by the United States armed forces in hiring foreign nationals overseas is described. Development of the item banks and classification of items are outlined, and field testing in the United States and overseas is described. The tests were the basic and intermediate level…

An activity was undertaken to develop written criterion-referenced tests for the agricultural production component of Applied Principles of Agribusiness and Natural Resources Occupations. Intended for tenth grade students who have completed Fundamentals of Agribusiness and Natural Resources Occupations, applied principles were designed to consist…

An investigation of biology matriculation tests in Israel was undertaken to assess the use of justifications with multiple-choice items and to compare the effect of three item formats on students' performance. More specifically, the study was designed to determine the: (1) extent to which justifications will differ if the correct answer is made…