A meta-analysis of the difficulty and discrimination of the "none-of-the-above" (NOTA) test option was conducted with 12 articles (20 effect sizes) for difficulty and 7 studies (11 effect sizes) for discrimination. Findings indicate that using the NOTA option does not result in items of lesser quality. (SLD)

Two methods are proposed for the construction of weakly parallel tests based on a prespecified information function. A method is then described for selecting weakly parallel tests that are optimal with respect to the Maximin criterion. Numerical examples demonstrate the practicality of the tests. (SLD)

Reports on introspective and retrospective accounts from test takers, in an attempt to examine the validity of reading and test-taking "skills." It is noted that there are clearly certain skills or processes involved in answering test items in a particular format that are not necessarily specified by the test writer. (15 references) (GLR)

Discusses the use of multiple-choice mathematics test items to diagnose student misunderstandings. Properties of semi-dense items (response interpretability, response discrimination, rule discrimination, exhaustive rule set usage, and semi-density) are discussed and illustrated with an example and by using a refined item digraph. (18 references)…

Two studies with 290 college students and 95 business managers investigated the latent structure of items from the Multifactor Leadership Questionnaire (MLQ). Results support models in which transformational and transactional leadership items load on separate factors and suggest that charismatic and inspirational leadership scales converge for…

A group of 25 Cuban Americans performed two daily living tasks relevant to Hispanic culture and 2 culture-free tasks. Their response patterns were consistent with those of non-Hispanic subjects. The Hispanic-relevant tasks showed the same psychometric characteristics as existing tasks on the Assessment for Motor and Process Skills, supporting…

Item overlap coefficient (IOC) formulas are discussed, providing six warnings about their calculation and interpretation and some explanations of why item overlap influences the Minnesota Multiphasic Personality Inventory and the Millon Clinical Multiaxial Inventory factor structures. (SLD)

A Monte Carlo study, which simulated 10,000 examinees' responses to four tests, investigated the effect of item stratification on parameter estimation in multiple matrix sampling of achievement data. Practical multiple matrix sampling is based on item stratification by item discrimination and a sampling plan with moderate number of subtests. (SLD)

The Content Validation Form is presented as a means of proving that occupational tests provide a representative work sample or knowledge, skill, or ability necessary for a job. It is best used during test construction by a panel of subject matter experts. (SK)

Polynomial algorithms are presented that are used to solve selected problems in test theory, and computational results from sample problems with several hundred decision variables are provided that demonstrate the benefits of these algorithms. The algorithms are based on optimization theory in networks (graphs). (SLD)

The use of the "none of the above" (NOTA) option in test items is explored. Empirical research on use of this option is obscuring the fact that, when NOTA is the correct answer, it can reward examinees with serious knowledge deficiencies or misinformation. This option should not be used. (SLD)

A model for solving very large item selection problems is presented. The model builds on binary programming applied to test construction. A heuristic for selecting items that satisfy the constraints in the model is also presented, and various problems are solved using the model and heuristic. (SLD)

Studies with 174 college students and 41 college faculty attempted to define trick questions and to determine whether students could distinguish between trick and not-trick questions. Evidence seems to suggest that the concept of trickiness is not as clear as some test construction textbooks indicate. (SLD)

Using simulation, the effect that misspecification of elements in the weight matrix has on estimates of basic parameters of the linear logistic test model was studied. Results indicate that, because specifying elements of the weight matrix is a subjective process, it must be done with great care. (SLD)

This National Council on Measurement in Education (NCME) instructional module compares classical test theory and item response theory and describes their applications in test development. Related concepts, models, and methods are explored; and advantages and disadvantages of each framework are reviewed. (SLD)