Two experiments studied teachers' proficiency in assessing students' higher order thinking skills. After training alone or after training plus implementation of an instructional unit on correlational thinking, teacher ratings of student samples did not correspond highly with an expert's assessment although they showed sensitivity to student age…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

Assessing students' knowledge is complex. Ideally, an assessment measures what students know about a given construct. Too often, however, assessments are complicated by miscommunication. Miscommunication occurs when students misinterpret the intent of the teacher's question and/or the teacher misinterprets the students' answers. This article…

In early December 2005, the School District of Philadelphia announced that, for the fourth consecutive year, students showed measurable improvement on standardized, nationally normed TerraNova tests. The school's good performance was induced by a well managed instructional program that includes data-driven instruction and decision-making…

Large scale testing in English affects second-language students not only greatly but also differently than first-language learners. The research literature reports that confounding factors in such large-scale testing such as varying test formats may differentially affect the performance of students from diverse backgrounds. An investigation of…

This research investigated the effects of two contrasting pre-k curricula, relative to practice as usual, on subsequent academic achievement. One curriculum had a strong literacy focus, the other was a less didactic "developmentally appropriate" curriculum that allowed children to have more influence on classroom activities. The purpose…

This study examines the appropriateness of a large-scale state standards-based English-Language Arts (ELA) assessment for students who are deaf or hard of hearing by comparing the internal test structures for these students to students without disabilities. The Grade 4 and 8 ELA assessments were analyzed via a series of parcel-level exploratory…

Two inherently contradictory forces are pushing for reform in portfolio assessment. On the one hand there is a felt need for creating more rigid standards that operate to promote uniformity of ratings in appraisal practice to certify achievement. However, on the other hand, critical questions are being raised about separating acclaimed portfolio…

This paper outlines purposes of program evaluation and provides practical information to help individuals from a wide spectrum of backgrounds use evaluation to move their program ahead in a purposeful manner. Wisely moving ahead requires an assessment of an organization's past and present as well as an examination of its assumptions about the…

Five of the common misuses of tests are reviewed: (1) acceptance of the test title as an accurate and complete description of the variable being measured (failure to examine the manual and the items carefully to know the specific aspects to be tested can result in misuse through selection of an inappropriate test for a particular purpose or…

This chapter discusses current methods of formative evaluation and suggests that these methods themselves need to be subjected to more critical research and evaluation in order to provide them with a more scientific base. Topics addressed include problems and methods associated with data gathering, evaluation designs, number of subjects available,…

The viability of persuasion theory as a framework for the assessment of program evaluation utilization was assessed. Independent variables studied included credibility, involvement, and role groups. More specifically, the research was designed to address three questions concerning: (1) the occurrence of peripheral involvement persuasive effects…

Research on student evaluation of college teachers' performance is briefly summarized. Lawrence M. Aleamoni offers four arguments in favor of student ratings: (1) students are the main source of information about the educational environment; (2) students are the most logical evaluators of student satisfaction and effectiveness of course elements;…

Discusses evaluation issues that developed during implementation of the nation's first statewide career ladder program in Tennessee. After three years of development major issues have centered around communication, confidentiality, paperwork, career development, multidata source systems, and the evaluation cycle. (CJH)

Evaluability assessment is a diagnostic and prescriptive technique that can be used to determine the extent to which different problems inhibit program evaluation. It involves policymakers, managers, and staff in developing program theory, clarifying intended uses of evaluation information, and planning further evaluations that would stimulate…