With increasing reliance being placed on the results of their surveys, the National Center for Education Statistics (NCES) recognized a need for these survey results to be valid and reliable. As part of the work of the Statistical Analysis Group in Education (SAGE), an effort was undertaken to investigate validity and reliability in survey…

The development and tryout of an instrument designed to measure college students' attitudes toward alcohol demonstrate the utility of Guttman's facet analysis for developing and validating instruments. Findings from the survey, administered to 1,049 students, support the construct validity of the instrument. (SLD)

The lack of valid, research-based methods to identify potential artistic talent hampers the inclusion of the arts in programs for the gifted and talented. The Talent Assessment Process in Dance, Music, and Theater (D/M/T TAP) was designed to identify potential performing arts talent in diverse populations, including bilingual and special education…

This study describes the development and psychometric evaluation of four scales measuring leadership for health promotion at an organizational level in the baseline survey (n = 144) of the Alberta Heart Health Project. Content validity was established through a series of focus groups and expert opinion appraisals, pilot testing of a draft based on…

The objectives of this study were: (1) to examine the psychometric properties of the Assessment of Life Habits (LIFE-H) for children; and (2) to draw a profile of the level of participation among children of 5 to 13 years of age with various impairments. The research team adapted the adult version of the LIFE-H in order to render it more…

This paper presents the investigation of the psychometric properties of the Graduate Program Self-Assessment (GPSA) questionnaires, developed by the Educational Testing Service, for the evaluation of nursing doctoral education. The data are from the 1984 cooperative program evaluation from 326 faculty, 659 doctoral students, and 296 alumni. The…

An exploratory analysis comparing two test batteries for English-as-a-Foreign-Language reading comprehension used a single framework of communicative language ability and test method facets to investigate construct validity. The framework's use in the content analysis of communicative language tests, and for the comparison of content across tests,…

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

Describes the development of an instrument to assess teachers' context beliefs about using technology in the classroom based on a study of teachers in a professional development program on technology integration. Highlights include capability beliefs; context beliefs; personal agency belief patterns; content validity; and construct and predictive…

During a period when the reform-minded are very critical of the degree to which testing is actually related to the conditions for which data are employed, authentic assessment offers the opportunity to evaluate learning in settings closely related to the real world. It also allows the evaluator to tailor assessment conditions for individual…

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

Presents a comprehensive review of validity that includes an empirical evaluation of the actual and potential consequences of score interpretation and use, how those consequences come about, and what determines them. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of…

This paper focuses on the validity of the research conducted under the leading paradigm in the evaluation of teaching in higher education. Messick's framework on validity is used to identify the strengths and limitations of the research, mostly centered on the study of student ratings of instruction. Critical issues that need to be addressed by…

Objectives: Psychometric properties of the Chinese version of the Interpersonal Reactivity Index (C-IRI) for the assessment of empathy in Chinese people were examined. Method: The Interpersonal Reactivity Index (IRI) was translated to Chinese, and an expert panel reviewed its content validity and cultural relevance. The translated instrument…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…