This paper serves as an illustration of the usefulness of structurally incomplete designs as an approach to reduce the length of educational questionnaires. In structurally incomplete test designs, respondents only fill out a subset of the total item set, while all items are still provided to the whole sample. The scores on the unadministered…

Reviews some results on optimal design of tests with items of dichotomous and polytomous response formats and offers rules and guidelines for optimal test assembly. Discusses the problem of optimal test design for two optimality criteria. (Author/SLD)

Quantitative item models are item structures that may be expressed in terms of mathematical variables and constraints. An item model may be developed as a computer program from which large numbers of items are automatically generated. Item models can be used to produce large numbers of items for use in traditional, large-scale assessments. But…

The National Assessment of Educational Progress (NAEP) for the arts measures students' knowledge and skills in creating, performing, and responding to works of music, theatre, and visual arts. This framework document asserts that dance, music, theatre and the visual arts are important parts of a full education. When students engage in the arts,…

This technical report describes the development of fifth grade progress monitoring measures in the area of Passage Reading Fluency. This measure was designed to target the fluency component of a developmental model of reading. Twenty alternate forms were written by graduate students and reviewed by the lead author. The passages were piloted and…

Test items undergo multiple iterations of review before states and vendors deem them acceptable to be placed in a live statewide assessment. This article reviews three approaches that can add validity evidence to states' item review processes. The first process is a structured sensitivity review process that focuses on universal design…

This article describes the three-stage protocol employed in development and validation of the Inventory of Family Protective Factors (IFPF), a brief-form formal instrument intended to assess the primary protective factors that contribute to family resilience. Following construction of the instrument, data collections and analyses of a total sample…

Surprising version-dependent differences are noted in student performance on certain questions in a standardized general chemistry exam. The exam in question has two versions, on which both questions and answers are ordered differently. For the questions suspected of answer-order bias, the performance is better in ten of twelve cases when students…

A survey instrument using everyday teaching scenarios was developed to measure teacher conceptions of inquiry. Validity of the instrument was established by comparing responses for a group of secondary teachers to narrative writing and group discussion. Participating teachers used only three of the five essential features of inquiry detailed in…

Four studies were conducted on the development and validation of the Measure of Sexual Identity Exploration and Commitment (MoSIEC). Exploratory factor analysis of an initial item pool yielded a 22-item measure with 4 distinct factors assessing commitment, exploration, sexual orientation identity uncertainty, and synthesis/integration. Exploratory…

CB[subscript 1] receptor-compromised animals show profound deficits in extinguishing learned behavior from aversive conditioning tasks, but display normal extinction learning in appetitive operant tasks. However, it is difficult to discern whether the differential involvement of the endogenous cannabinoid system on extinction results from the…

One promising application of diagnostic classification models (DCM) is in the area of cognitive diagnostic assessment in education. However, the successful application of DCM in educational testing will likely come with a price--and this price may be in the form of new test development procedures and practices required to yield data that satisfy…

The use of "MapleTA"[R] in the assessment of engineering mathematics at Liverpool John Moores University (JMU) is discussed with particular reference to the design of questions. Key aspects in the formulation and coding of questions are considered. Problems associated with the submission of symbolic answers, the use of randomly generated numbers…

Scores of colleges and universities have pledged to promote lifelong learning in their most central document, the mission statement. Moreover, "A Test of Leadership: Charting the Future of Higher Education," the report from the Secretary of Education's Commission on the Future of Higher Education (2006), stresses the importance of lifelong…