An overview is given of the consensus process for development of the frameworks underlying the National Assessment of Educational Progress (NAEP) assessments, with emphasis on those for the 1990 and 1992 mathematics assessments, the 1992 reading assessment, and the 1994 science assessments. Innovative techniques for 1992 are described. (SLD)

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

Describes the theoretical framework and practical application of the International Adult Literacy Survey (IALS). Concludes that the survey is based on an empirically-proven statistical construct that has been executed accurately with results that shed light on the relationship between functional literacy and national and individual well being.…

Describes the development of an instrument to assess teachers' context beliefs about using technology in the classroom based on a study of teachers in a professional development program on technology integration. Highlights include capability beliefs; context beliefs; personal agency belief patterns; content validity; and construct and predictive…

A form for assessing the multicultural content of instructional materials at the elementary and secondary school levels is presented. It consists of 41 statements about the content extent, content validity, and cognitive content of classroom materials, each to be rated on a scale of 0 to 5. The statements address the degree to which the materials…

During a period when the reform-minded are very critical of the degree to which testing is actually related to the conditions for which data are employed, authentic assessment offers the opportunity to evaluate learning in settings closely related to the real world. It also allows the evaluator to tailor assessment conditions for individual…

A study was conducted to: (1) test for the factorial validity of the 22-item Maslach Burnout Inventory (MBI) separately for 742 male and 801 female elementary school teachers and 659 male and 721 female secondary school teachers in Central Canada; (2) cross-validate findings across a second independent sample for each teacher group; and (3) test…

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

This study was conducted to: (1) determine the validity of five Educational Testing Service (ETS) tests as measures of the knowledge and academic skills required for specific endorsements of professional public school personnel in Arkansas; and (2) formulate recommendations on minimum qualifying scores for tests that are valid to use for…

In its three parts, this presentation: (1) describes five aspects of James Coleman's concept of "social capital"; (2) describes how the concept of social capital was used to develop a questionnaire for assessing teachers' investment of emotional self (personality, warmth, enthusiasm, etc.) in caregiving; and (3) provides related…

Most validity studies of ISLLC standards and indicators rely heavily on focus groups and perceptual surveys. This study included self-report and observational data on principals' use of time. A content analysis tested ISLLC's descriptions of instructional leadership with a related set of Kentucky's Standards and Indicators for School Improvement…

To test the validity of the National Literary Braille Competency Test (NLBCT), 181 Florida teachers of students with visual impairments were asked if they transcribe Braille using a Braillewriter, a slate and stylus, Braille computer programs, or transcriber aides. The majority transcribed using computer software or a Braillewriter. (CR)

The effects of using item response theory (IRT) ability estimates based on customized tests formed by selecting areas from a nationally standardized achievement test were examined. For some populations, in some conditions, IRT ability estimates can be equivalent to scores based on full-length tests. (SLD)

Presents a comprehensive review of validity that includes an empirical evaluation of the actual and potential consequences of score interpretation and use, how those consequences come about, and what determines them. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of…

Three related Canadian studies assessed the content validity of 59 clinical problems designed as part of a test of medical decision-making skills. Focus was on the key features, i.e., the critical or essential steps in identification and management of the clinical problem. Results support content validity of the key features. (MSE)