I altered the format of an exercise physiology course from traditional lecture to emphasizing daily reading quizzes and group problem-solving activities. I used the SALGains evaluation to compare the two approaches and saw significant improvements in the evaluation ratings of students who were taught using the new format. Narrative responses…

This paper surveys some current developments in second language vocabulary assessment, with particular attention to the ways in which computer corpora can provide better quality information about the frequency of words and how they are used in specific contexts. The relative merits of different word lists are discussed, including the Academic Word…

Multidimensional item response theory (IRT) models have been proposed for better understanding the dimensional structure of data or to define diagnostic profiles of student learning. A compensatory multidimensional two-parameter partial credit model (M-2PPC) for constructed-response items is presented that is a generalization of those proposed to…

Educators in Europe are complaining about mishandled changes in a key English-language test and are demanding that the Educational Testing Service (ETS), which runs the examination, delay plans to introduce its new online format in March 2006 in more than 100 countries. Critics of the planned change in the Test of English as a foreign Language…

The purpose of this study was to determine whether it is both possible and cost-effective to revise middle-difficulty Graduate Record Examinations (GRE) discrete items in order to produce items of higher or lower difficulty. The basic procedure was to select items of a given difficulty and, by revising the distractors, make them easier or more…

A study compared the influence of two forms of discourse completion test (DCT) on the elicitation of rejection of advice. An open questionnaire providing scenarios alone was compared with a classic dialogue completion task in which a conversational turn is provided. The tasks were given to 32 graduate students, 19 native and 13 non-native…

Two studies addressed the effects of failure in reading test performance. In experiment 1, 36 students in 3 intact reading and study skills courses at an upstate New York community college completed a questionnaire, were administered an "unsolvable" reading test, were either given no feedback or "failure feedback," an…

In the early 1970s A. Constantinople wrote a seminal article that led to the development of the construct of psychological androgyny. The Bem Sex-Role Inventory is a popular measure of the construct, but the measure remains controversial. The construct validity of scores from the measure was explored using confirmatory factor analysis on data from…

A study investigated the comparability of second language (L2) listening comprehension tests by examining the effects of varying text type and assessment task on student performance. Student target language experience was an additional variable considered. Subjects were 107 beginning and 64 advanced-intermediate college-level Spanish second…

Often, educational and psychological measurement instruments must be translated from one language to another when they are administered to different cultural groups. The translation process often necessarily introduces measurement inequivalence. Therefore, an examination may be said to exhibit differential functioning if the test provides a…

This manual is designed to assist both special and regular educators with mastering the skills for developing quality teacher-made tests consistent with content-oriented instruction. The manual presents tips for constructing both objective and subjective, supply and select test questions--namely, short answer, essay, fill in the blanks or…

Many testing programs include a section of optional questions in addition to mandatory parts of a test. These optional parts of a test are not often truly parallel to one another, and groups of examinees selecting each optional test section are not equivalent to one another. This paper provides a general method based on missing-data methods for…

This project extended the application of a model for development of semi-direct tests of oral proficiency, originally developed for Chinese, to a diverse set of less commonly taught languages spanning various language families and representing diverse cultural backgrounds. This second, final report covers development of tests for Hebrew, Hausa,…

This Monte Carlo study examined strategies for forming the matching variable for the Mantel-Haenszel (MH) differential item functioning (DIF) procedure. Data were generated using a three-parameter logistic item response theory model, with common guessing parameters. The number of subjects and test length were manipulated, as were the difficulty,…

A correlational analysis was performed to examine the relationship between recognition and recall test formats. A total of 236 college students completed one of four 80-item general knowledge tests; the forms contained 20 items of each of four formats: (1) true; (2) false; (3) multiple-choice; and (4) free response. Ninety-three of the subjects…