This study analyzed the relationship between selecting critical errors (choices that would be dangerous to patients) and conventional test scores on a medical school certifying examination that included three item formats: regular and weighted multiple-choice questions and patient management problems. Data from a Clinical Certifying Examination…

First-, second-, and third-year students enrolled in an introductory educational psychology class at Texas A&M University in College Station were administered either a pencil-and-paper or computerized version of the Strong-Campbell Interest Inventory. The same or other version of the test was administered after 2 weeks. Focus is on equivalence…

This study encompassed the collection of teacher reported (N=326) testing practices and the direct assessment of teacher-made tests (N=175) for item cognitive functioning levels and construction errors. Focus was on assessing the nature and quality of teacher-made tests used in public school classrooms and describing the classroom teachers'…

A solution to reduce the likelihood of one examinee copying another's answers on large scale tests that require all examinees to answer the same set of questions is to use multiple test forms that differ in terms of item ordering. This study was conducted to determine whether varying the sequence in which blocks of items were presented to…

The Research Services of the National Education Association (NEA) conducted a nationwide teacher opinion poll (TOP) based upon a stratified disproportionate two-state cluster sample of classroom teachers. This research study was conducted to test the hypothesis that the order of presentation of items would make no difference in the conclusions…

To meet the needs of visually-impaired candidates, Educational Testing Service (ETS) has traditionally provided tests in three special formats: large-print, Braille, and cassette. Certain ETS programs permit the use of the candidate's reader or the use of amanuensis, that is, someone who records answers for the candidate. The primary goal of…

Two 50-item multiple-choice forms of a grammar test were developed differing only in humor being included in 20 items of one form. One hundred twenty-six (126) eighth graders received the test plus alternate forms of a questionnaire. Humor inclusion did not affect grammar scores on matched humorous/nonhumorous items nor on common post-treatment…

The relationship between metamemorial accuracy and student test performance was assessed in a graduate educational psychology class. Metamemory is defined as information about the content of one's own memory. Adult students in two courses (N=67) were asked to select multiple choice answers in two midterms and a final examination and to rate their…

Approaches to the testing of foreign language proficiency have tended to mirror prevailing philosophies in foreign language teaching, and for many years, no serious effort was made to devise oral proficiency measures. However, after World War II, structural linguistics applied to the classroom produced audiolingualism, which was a method heavily…

This report describes the sequence of activities that took place as the Examination Division of the New Jersey Department of Civil Service introduced a word processing system for a test item bank and for production of camera-ready test copy. The equipment selection, installation and orientation procedures are discussed. Keyboard and CRT terminals,…

The fill-in-test, a modified version of the cloze procedure, is relatively easy to construct, is easier to score than the cloze procedure, and yields a greater number of questions per line of text than the conventional multiple choice comprehension test. The fill-in-test is constructed by inserting blank spaces into a text and providing a number…

The results of a survey questionnaire of all teaching faculty at the National Technical Institute for the Deaf (NTID) were presented. The researchers were concerned with teacher-constructed classroom tests and the problems encountered in developing, administering, and grading them. The survey topics included: instructors' current test development…

The multilevel characteristics of test item data are considered as a method for examining the characteristics of standardized norm-referenced tests. A theoretical rationale for examining multilevel characteristics is presented. It can be used as an aid to understand why program and instructional effects on measures constructed from…

A study was conducted to investigate the effects of symbolic format of test material on short- and long-term recognition. Subjects, 104 undergraduate students, viewed slides of either a black-and-white photograph, a one-sentence verbal description of the photo, a black-and-white drawing based on the verbal description, or a black-and-white line…

The present study was an attempt to alleviate some of the difficulties inherent in multiple-choice items by having examinees respond to multiple-choice items in a probabilistic manner. Using this format, examinees are able to respond to each alternative and to provide indications of any partial knowledge they may possess concerning the item. The…