Techniques for quantifying the degree of fit between test items and curricula are classified according to the purposes of assessing: overall fit, fit of individual items to content domain, and the impact of test specifications on performance. Procedures for calculating each index and their properties are included. (SLD)

Educational tests used for accountability purposes must represent the content domains they purport to measure. When such tests are used to monitor progress over time, the consistency of the test content across years is important for ensuring that observed changes in test scores are due to student achievement rather than to changes in what the test…

DIMTEST is a statistical test procedure for assessing essential unidimensionality of binary test item responses. The test statistic T used for testing the null hypothesis of essential unidimensionality is a nonparametric statistic. That is, there is no particular parametric distribution assumed for the underlying ability distribution or for the…

The Graduate Record Examination (GRE) in Physics was analyzed as a specific indicator of learning outcomes in that undergraduate major. Textbooks were selected as a measure of curriculum content. A representative sample of colleges and universities (n=59) responded to questions about physics courses and textbooks and the existence of a graduate…

College faculty served as judges to rate the instructional validity of items on the National Teacher Examinations Core Battery. The ratings were examined in relation to actual test performance, as well as panelists' ratings of item difficulty and relevance. (Author/GDC)

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

The effects of using item response theory (IRT) ability estimates based on customized tests formed by selecting areas from a nationally standardized achievement test were examined. For some populations, in some conditions, IRT ability estimates can be equivalent to scores based on full-length tests. (SLD)

Three related Canadian studies assessed the content validity of 59 clinical problems designed as part of a test of medical decision-making skills. Focus was on the key features, i.e., the critical or essential steps in identification and management of the clinical problem. Results support content validity of the key features. (MSE)

The purpose of this research was to examine the validity of the 55-item Revised Token Test (RTT) and to compare traditional and Rasch-based scores in their ability to detect group differences and change over time. The 55-item RTT was administered to 108 left- and right-hemisphere stroke survivors, and the data were submitted to Rasch analysis.…

A panel of expert referees from the Philadelphia school district categorized items from secondary-level standardized mathematics tests according to National Assessment of Educational Progress (NAEP) subobjectives for mathematics. The following tests were covered by the study: (1) California Achievement Tests (Levels 19 and 20); (2) Comprehensive…

The agreement between the Educational Testing Service (ETS) and the Golden Rule Insurance Company of Illinois is interpreted as setting the general principles on which items must be selected to be included in a licensure test. These principles put a limit to the difficulty level of any item, and they also limit the size of the difference in…

The study compared two promising item response theory (IRT) item-selection methods, optimal and content-optimal, with two non-IRT item selection methods, random and classical, for use in fixed-length certification exams. The four methods were used to construct 20-item exams from a pool of approximately 250 items taken from a 1985 certification…

There are indications that the new technologies could have radical implications for conventional teaching and learning processes. It notes that, in reconfiguring how teachers and learners gain access to knowledge and information, the new technologies challenge conventional conceptions of both teaching and learning materials, and teaching and…

The validity of teachers' reports of students' instructional experiences (content exposure or coverage) and content validity of a given course were studied by examining the consistency of reported content coverage for teachers across two consecutive years (1988 and 1989). In addition, the sensitivity of the test to instruction was examined by…

This document contains the framework and a set of recommendations for the NAEP 2007 mathematics assessment, which will assess student achievement nationally and state-by-state, as well as in select urban districts, in grades 4 and 8. It includes descriptions of the mathematical content of the test, the types of test questions, and recommendations…