The main problem of the educational evaluation validity is that it just copies the conceptual framework system of validity from educational measurement to its own conceptual system. The validity conceptual system that fits the need of theory and practice of educational evaluation has not been established yet. According to the inherent attributive…

Students tend to believe that RateMyProfessors.com (RMP) is an unfailingly valid measure of teaching effectiveness, and in fact viewing that site prior to taking a course can have a direct influence on their future evaluations of faculty. The authors describe an activity whose objective is to have students analyze different types of validity using…

In this "FastFacts," a state asks the Center on Enhancing Early Learning Outcomes (CEELO) to recommend experts in the field of assessing young children who are English Language Learners (ELL) to train administrators and psychologists working in district preschool programs for young children with special needs? This is particularly…

Life sciences faculty agree that developing scientific literacy is an integral part of undergraduate education and report that they teach these skills. However, few measures of scientific literacy are available to assess students' proficiency in using scientific literacy skills to solve scenarios in and beyond the undergraduate biology classroom.…

Describes content-validity theory and illustrates new and traditional approaches for conducting content-validity studies. Newer approaches are based on multidimensional scaling analysis of item-similarity ratings, while traditional approaches are based on ratings of item-objective congruence and relevance. (Author/SLD)

As a result of the "No Child Left Behind Act," there is increased emphasis on assessment in P-12 schools today. School administrators are responsible for assessing student achievement, teacher and staff effectiveness, school climate, and graduates' perceptions of school programs. At the university level, organizations, such as the National Council…

Discussion of electronic learning focuses on outcomes, improving quality of assessment, and evaluation of electronic learning initiatives. Highlights include new directions in assessment, with examples from a variety of fields; blending assessment with learning; multiple roles for learning assessment; criteria for better assessment; and content…

A review of articles in Psychological Assessment reveals that many researchers develop instruments without the benefit of consultation with members of the target population. To the extent that researchers do consult the target population, most fail to bring consultation in early enough to inform the identification and specification of key…

Item content-relevance is an important consideration for researchers when developing scales used to measure psychological constructs. Aiken (1980) proposed a statistic, "V," that can be used to summarize item content-relevance ratings obtained from a panel of expert judges. This article proposes the application of the Score confidence interval to…

One of the many responsibilities teacher-librarians have recently assumed is the development of their school library's web site. Such site provide an organic "window" to the library's programs, services and resources that can be accessed by students, teachers, administrators, parents and community members. As such, they represent another vital…

When a college or university needs an assessment instrument, it has two choices: select an existing instrument or develop a new one. Since the cost of instrument development in both time and human resources is often prohibitive, many assessment programs rely on existing instruments. The challenge then becomes choosing one that provides the best…

This article discusses the main purposes of reading comprehension assessment and identifies the key features of good assessment. The article also identifies pitfalls that clinicians and educators should avoid to conduct valid assessments of reading comprehension, such as the degree to which the measure taps the constructive and integrative…

A system of evaluation which generates copious information with minimal demands on teachers and administrators can improve the quality of teacher assessment while lowering the tensions associated with the process. Multiple-Strategies Model for Effective Teaching is made up of 10 component parts. Each component represents an element in a framework…

An overview is given of the consensus process for development of the frameworks underlying the National Assessment of Educational Progress (NAEP) assessments, with emphasis on those for the 1990 and 1992 mathematics assessments, the 1992 reading assessment, and the 1994 science assessments. Innovative techniques for 1992 are described. (SLD)