Uses data from the National Assessment of Educational Progress to demonstrate the frequent lack of fidelity between cognitively complex construct definitions and the simple cognitive assumptions embedded in common test-development practices. Describes alternative,construct-centered test development approaches for each stage of the test-development…

Proposes a theoretical index of dimensionality, the theoretical DETECT index, to provide a theoretical foundation for the DETECT procedure, a way to assess aspects of the latent dimensional structure of a test. Applies the procedure to some real and simulated data. (SLD)

Presents a simple method for generating simulated plasmodes and artificial test clusters with user-defined shape, size, and orientation. For "J" clusters, indicator validity is defined as the squared correlation ratio between the cluster indicator and J-1 dummy variables. Illustrates the method through simulation. (SLD)

This study outlines the initial development and validation of a set of scales designed to detect noncontent responding on the Basic Personality Inventory. Of the scales, the Consistency Scale and the infrequent Triplets Scale were the most effective in detecting partially random protocols. These two scales would be the most effective in applied…

Presents a broad definition of "testlet" and suggests a framework for classifying types of testlets. Considers several issues that bear on the conceptualization of testlets and analyses of scores from tests composed of testlets. Suggests some research topics that seem particularly important to advancing the meaningful and appropriate use…

Identifies and evaluates alternative methods for weighting tests. Presents formulas for composite reliability and validity as a function of component weights and suggests a rational process that identifies and considers trade-offs in determining weights. Discusses drawbacks to implicit weighting and explicit weighting and the difficulty of…

Presents six computational methods based on mixed-integer programming for assembling tests from a bank with an item-set structure and evaluated these methods using mathematical programming feasibiity and expected solution times. Illustrates these methods with two data sets from the Law School Admission Test. Discusses the best approximations to…

Presents two binary programming models with a special network structure that can be explored computationally for simultaneous test construction. Uses an efficient special purpose network algorithm to solve these models. An empirical study illustrates the approach. (SLD)

Includes an interview with a noted figure in the field of language assessment. Focuses on a range of test development projects, including several related to the American Council on the Teaching of Foreign Languages (ACTFL) scale. (Author/VWL)

This sixth volume of the Programme for International Student Assessment 2009 (PISA 2009) results explores students' use of information technologies to learn. For PISA 2009, the framework for reading literacy has been developed to encompass reading electronic texts. This has led to an expansion of the description of text types to take account of…

The importance of student assessment, particularly for summative purposes, has increased greatly over the past thirty years. At the same time, emphasis on including all students in assessment programs has also increased. Assessment programs, whether they are large-scale, district-based, or teacher developed, have traditionally attempted to assess…

Instructors in electrical and computer engineering and in computer science have developed innovative methods to teach digital logic circuits. These methods attempt to increase student learning, satisfaction, and retention. Although there are readily accessible and accepted means for measuring satisfaction and retention, there are no widely…

A foundational mission of our public schools is dedicated to preserving a democratic republic dependent on a literate and actively engaged citizenry. Civic literacy is essential to supporting the rights and responsibilities of all citizens in a democratic society. Civic knowledge is the foundation of our citizens' civic literacy. National…

This paper describes the development and validation of a new 40-item Internet Attitude Scale (IAS), a one-dimensional inventory for measuring the Internet attitudes. The first experiment initiated a generic Internet attitude questionnaire, ensured construct validity, and examined factorial validity and reliability. The second experiment further…

Multistage tests are those in which sets of items are administered adaptively and are scored as a unit. These tests have all of the advantages of adaptive testing, with more efficient and precise measurement across the proficiency scale as well as time savings, without many of the disadvantages of an item-level adaptive test. As a seemingly…