The process of revising and validating two English language tests used by the United States armed forces in hiring foreign nationals overseas is described. Development of the item banks and classification of items are outlined, and field testing in the United States and overseas is described. The tests were the basic and intermediate level…

It is asserted in this paper that some standardized tests do not do a good job of what they claim to do, and for some testing purposes nonstandardized tests are more appropriate or efficient. Under present circumstances, group I.Q. tests should be abolished. They provide no useful information that cannot be gained from achievement tests. And what…

In a comparative evaluation of a standard true-false format for personality assessment and a forced-choice format, subjects from college residential units were assigned randomly to respond either to the forced-choice or standard true-false form of the Personality Research Form (PRF). All subjects also rated themselves and the members of their…

Gives examples of major sources of unreliability in multiple choice items in health professions classroom achievement tests (clues to response combinations, mutually exclusive alternatives, implausible distractors) and offers some suggestions for eliminating them when writing such tests. (MF)

This paper traces developments in educational psychology and measurement that led to the Test of English as a Foreign Language (TOEFL) and the test of English for International Communication (TOEIC) and the application of educational measurement terms such as validity and reliability to testing. Use of a table of specifications for planning…

Reliability and validity of multiple-choice examinations as a function of the number of options per item and of student ability were computed for 435 junior class parochial high school students in the tri-county area of Portland (Oregon). The verbal section of the Washington Pre-College Test Battery was used. The least discriminating options were…

The reliability, content validity, and construct validity were compared for two test formats in a public examination used to assess a secondary school geography course. The 11-item geography portion of the Intermediate Certificate Examination (essay examination) was administered in June 1987 to 400 secondary school students in Ireland who also…

A proficiency examination developed for placing non-native English-speakers in appropriate expository writing courses is described. The instrument is a multiple-choice examination containing items that test specific expository writing skills through reading skills. The rationale for including such items for placement in expository writing courses,…

Appropriateness indexes (statistical formulas) for detecting suspiciously high or low scores on aptitude tests were presented, based on a simulation of the Scholastic Aptitude Test (SAT) with 3,000 simulated scores--2,800 normal and 200 suspicious. The traditional index--marginal probability--uses a model for the normal examinee's test-taking…

Discusses the movement toward authentic assessment, also called direct or performance assessment, as an alternative to multiple-choice, standardized, norm-referenced testing. Authentic testing involves assessment tasks that are real instances of extended criterion performances rather than proxies of actual learning goals. Questions use of…

As a result of the dual roles of the National Assessment of Educational Progress (NAEP) to measure trends in academic achievement over time and to measure what students know and can do, a scale anchoring procedure was developed. Although the NAEP provides norm-referenced information about student proficiency, the scale anchoring procedure gives…

Teacher-made mastery tests were administered in a classroom-sized sample to study their decision consistency. Decision-consistency of criterion-referenced tests is usually defined in terms of the proportion of examinees who are classified in the same way after two test administrations. Single-administration estimates of decision consistency were…

This study examines the relationship between an open-ended cloze test and its multiple-choice versions generated from three sources: (1) interlingual learner-generated distractors--distractors selected from one language group and administered to a different language group, (2) intralingual learner-generated distractors--distractors selected from…

This paper questions the purpose of testing in second language instruction. Comments are based on an examination of tests used by the Defense Language Institute for students of English as a second language. Two kinds of tests are used: the English Comprehension Level (ECL), used primarily as a basis for setting exit requirements, and "Book…

The use of videotape tests is presented. Such tests enable the educator to assess student performance more directly than traditional paper and pencil tests. Test 1 was exploratory. Test 2 was designed to measure empathetic understanding. It contains 16 scenes, each about one minute long, which show five individuals in a group situation. The…