Studies the statistical validation of a multiple-choice test designed to assess instructional design competency. Compares test results of instructional design professionals, graduate and nongraduate education students, and graduate and nongraduate noneducation students. Results indicate that the test accurately sorted respondents into their…

Replicates R. P. Leow's 1993 study on the effects of simplification, type of linguistic item, and second/foreign language experience on learners' intake of linguistic items contained in written output. Results on the type of linguistic item underscore the need for research to consider seriously the role of modality while addressing cognitive…

The results of five studies into the characteristics of wrong answers as a class of divergent behavior are presented. The evidence from these studies, when taken in combination, suggests that the tendency of researchers to ignore wrong answers has been a fundamental procedural error of broad scope and serious consequences. Instead of the straight…

A statistical test for detecting answer copying on multiple-choice tests based on Cohen's kappa is proposed. The test is free of any assumptions on the response processes of the examinees suspected of copying and having served as the source, except for the usual assumption that these processes are probabilistic. Because the asymptotic null and…

The purpose of this study was to investigate the effects of multiple intelligences (MI) teaching approach on 8th Grade students' achievement in and attitudes toward science. This study used a pretest-posttest control group experimental design. While the experimental group (n=30) was taught a unit on acids and bases using MI teaching approach, the…

The effects of luck and misinformation on ability of multiple-choice test scores to estimate examinee ability were investigated. Two measures of examinee ability were defined. Misinformation was shown to have little effect on ability of raw scores and a substantial effect on ability of corrected-for-guessing scores to estimate examinee ability.…

It has been demonstrated that corrected-for-guessing scores will be superior to number-right scores in providing estimates of examinee standing on the trait measured by a multiple-choice test, if it can be assumed that examinees can and will comply with the appropriate directions. The purpose of the present study was to test the validity of that…

Responses to a sample test were simulated for examinees under free-response and multiple-choice formats. Test score sets were correlated with randomly generated sets of unit-normal measures. The extent of superiority of free response tests was sufficiently small so that other considerations might justifiably dictate format choice. (Author/DWH)

Laird studies the relationship between two computerized nursing tests and finds a relationship between the two sets of scores. (Contains 2 tables.)

This paper describes qualitative and quantitative research conducted with middle school students participating in a Future Cities Engineering course. Insights were sought regarding both affective and cognitive changes which transpired during the one-semester schedule of activities focused on modeling the infrastructure of a city built 150 years in…

Practical and effective methods for detecting copying of multiple-choice test responses have been available for many years. These methods have been used routinely by large admissions and licensing testing programs. However, these methods are seldom applied in the areas of standardized or classroom testing in schools or colleges, and knowledge…

A novel scoring procedure was investigated in order to obtain scores from a conventional multiple-choice test that would be free of the guessing component or contain a known guessing component even though examinees were permitted to guess at will. Scores computed with the experimental procedure are based not only on the number of items answered…

A method for establishing minimal acceptable performance levels for criterion referenced multiple choice examinations is described and two procedures for evaluating its validity are discussed. The method involves assigning a priori item difficulties based on the similarity between the distractor and the correct response. In estimating the validity…

The two phases in the development and tryout of a Guidance Counselor Test to be added to the National Teacher Examinations Program are discussed. In Phase One, a 150-item written test and a 50-item written test based on taped stimulus material were produced. Each test consisted of five-choice multiple-choice questions. In Phase Two, the tests were…