The purpose of this paper is to highlight some psychometric cautions that should be observed when seeking to develop short form versions of tests. Several points are made: (1) score reliability is impacted directly by the characteristics of the sample and testing conditions; (2) sampling error has a direct influence on reliability and factor…

Illustrates how multidimensional scaling (MDS) and differential item functioning (DIF) procedures can be used to evaluate the equivalence of different language versions of an examination. Presents examples of structural differences and DIF across languages. (SLD)

Discusses ways of designing a review for a test, or a test itself, as a treasure hunt. Offers suggestions for how to set up the game. Presents 10 sample clues for a grammar test and 10 sample clues for a literature test. (RS)

Describes and evaluates a "controlled assessment procedure" as a holistic approach to avoiding problems of administering and evaluating traditional exams. Key characteristics include: the question is known well in advance and is broad and open-ended, students are encouraged to respond in any self-selected written format, and the rationale and…

A multiple-form structure (MFS) is an ordered collection or network of testlets (i.e., sets of items). An examinee's progression through the network of testlets is dictated by the correctness of an examinee's answers, thereby adapting the test to his or her trait level. The collection of paths through the network yields the set of all possible…

The microcomputer version of the Ohio Vocational Interest Survey (OVIS II) differs from the machine-scored version in its ability to incorporate data from the OVIS II:Career Planner in its printed report. It differs from the hand-scored version in its ability to include data from the OVIS II:Work Characteristic Analysis in its printed report.…

This article focuses on common errors associated with true-false, matching, completion, and essay questions as presented in textbook test manuals. Teachers should be able to select and/or adapt test questions which would be applicable to the content of their courses and which meet minimal standards for test construction. (JD)

Suggests methods for developing higher level objective test questions. Taxonomies that define learning outcomes are discussed; and examples for various test types are presented, including multiple correct answers; more complex forms, including classification and multiple true-false; relations and correlates; and interpretive exercises. (LRW)

A set of design patterns for digital item types has been developed in response to challenges identified in various projects by teachers in higher education. The goal of the projects in question was to design and develop formative and summative tests, and to develop interactive learning material in the form of quizzes. The subject domains involved…

In most large-scale assessments of student achievement, several broad content domains are tested. Because more items are needed to cover the content domains than can be presented in the limited testing time to each individual student, multiple test forms or booklets are utilized to distribute the items to the students. The construction of an…

The method for questionnaire construction described in this paper makes it convenient to generate as many different forms for a questionnaire as there are respondents. The method is based on using the computer to produce the questionnaire forms themselves. In this way the items or subgroups of items of the questionnaire may be randomly ordered or…

The format of the final examinations in Conservative Dentistry in the Dental Schools of Great Britain and Ireland was investigated by means of a questionnaire sent to each of the dental schools in each country. Results are reported and the value of different parts of the examinations are discussed. (Author/RH)

With the advent of computer-based testing (CBT) and the need to increase the number of items available in computer adaptive test pools, the idea of item variants was conceived. An item variant can be defined as an item with content based on an existing item to a greater or lesser degree. Item variants were first proposed as a way to enhance test…

The purpose of this study was to determine whether a Mexican version of the Peabody Picture Vocabulary Test could be improved by directly translating both forms of the American test, then using decision procedures to select the better item of each pair. The reliability of the simple translations suffered. (Author/BW)

Presents a characteristic curve procedure for comparing transformations of the item response theory ability scale assuming the multiple-choice model. Illustrates the use of the method with an example equating American College Testing mathematics tests. (SLD)