This pamphlet reprints three papers and an invited discussion of them, read at a Division 5 Symposium at the 1975 American Psychological Association Convention. The first paper describes a Bayesian tailored testing process and shows how it demonstrates the importance of using test items with high discrimination, low guessing probability, and a…

Among the new testing developments are the use of objectives or goals in instruction, competency based approaches to instruction, criterion referenced testing, and performance oriented testing. These new approaches often emphasize individualized learning; each student's progress is individually monitored by comparison with clear statements of what…

The matching cloze format used in constructing the reading comprehension parts of the Micronesian Achievement Test Series (MATS) is described as a holistic approach which measures skills comparable to those needed by English as a second language students in actual reading situations. Kenneth Goodman's theory about the strategies used by good…

The validity of the multiple-choice Sequential Tests of Educational Progress (STEP) Writing Test (1957) was tested by the University of Chicago Center for the Cooperative Study of Instruction. Seven criteria developed by the center to score essay assignments were used to determine the relationship between STEP and actual writing behavior. Of the…

A student's choice of an answer to a test question is a coarse measure of his knowledge about the subject matter of the question. Much finer measurement might be achieved if the student were asked to estimate, for each possible answer, the probability that it is the correct one. Such a procedure could yield two classes of benefits: (a) students…

The purpose of this study was to develop a test that could be used both to diagnose student writing needs and to evaluate the effects of classroom teaching on the abilities of secondary school-junior college students to write expositorily. Data analysis was organized to indicate the extent to which a carefully designed objective test could validly…

A review of the recent literature has yielded a number of concerns about the validity, reliability, cost, efficiency, generalizability, utility, and cultural sensitivity of performance based assessments. The resulting conclusion was that continuing the performance based assessment initiative should be rethought. Suggested alternatives included…

Scholastic achievement tests and mental ability tests normally consist of a set of multiple choice items, all of which are assumed to measure school-relevant cognitive abilities. The presumption, in a given test situation, is that the answers/solutions to the given tasks represent cognitive capabilities on the part of the examinees. The purpose of…

The development and field testing of a proficiency test in English as a Second Language for non-native speakers teaching on Guam is reported. The resulting instrument measures four language skills (listening, reading, writing, and speaking). The listening measure uses natural language that might be heard by a classroom teacher. The reading measure…

This study hypothesized that items in the one-question-per-passage format would be less easily answered when administered without their associated contexts than conventional reading comprehension items. A total of 256 seventh and eighth grade students were administered both Forms 3A and 3B of the Sequential Tests of Educational Progress (STEP 11).…

The Nevada Department of Education implemented a standard setting study of the Pre-Professional Skills Tests. The tests constitute a secure test battery developed by the Educational Testing Service to assess basic proficiency in reading, writing, and mathematics via three multiple-choice tests and a written essay test. The Nevada study, in the…

The Advanced Placement Program reports grades to students and colleges on a 1 to 5 point scale derived from combining the separate scores on the multiple-choice and free-response sections of Advanced Placement Examinations (ADPEs). In this study, predictions of grades in first-semester college biology courses were made based on students' separate…

The ability to correctly answer reading comprehension test items, without having read the accompanying reading passage, was compared for third grade learning disabled students and their peers from a regular classroom. In the first experiment, fourteen multiple choice items were selected from the Stanford Achievement Test. No reading passages were…

This paper discusses the role of intelligence in language comprehension. In the study reported, an attempt is made to determine how much of the variability in English reading scores of non-native speakers of English can be predicted on the basis of intelligence alone. In the study, three measures of reading comprehension are used: a traditional…

The technology of transforming sentences from prose instruction into test questions was examined by comparing two methods of selecting sentences (keyword vs. rare singleton), two types of question words (nouns vs. adjectives), and two foil construction methods (writer's choice vs. algorithmic). Four item writers created items using each…