Analyzes approximately 4,800 independent evaluations of 796 essays written by 241 students in 13 first-year writing classes at two colleges. Finds very low consistency of holistically scored student performance from essay to essay, suggesting that drawing conclusions from one or even a few writing samples of a particular student is problematic.…

Examines the assumption that the parvocellular system is suppressed by the magnocellular system during saccadic eye movements and that this visual deficit is associated with dyslexia. Evidence from six studies indicates the magnocellular system is suppressed during saccadic eye movements, disproving the magnocellular deficit theory of dyslexia.…

Discusses shortcomings in both cognitive- and competency-based assessment approaches to art learning. Asserts that they fail on a number of fronts to reflect the full extent of art and how it operates. Questions the degree of accuracy that these assessment approaches can achieve when considering art education. (EV)

Reviews evidence regarding the content, standards, and use validity of the International Adult Literacy Survey's performance scales and self-assessment scales. Concludes that there are serious questions about the performance scales and that self-assessment data may help identify adults who believe they have poor literacy skills. Suggests that…

A new report published by the Buckeye Institute for Public Policy Solutions is a minor variant on six similar reports published by the Friedman Foundation over the past three years. The new report repeats some of the errors in the previous reports, and it follows a parallel structure, arguing that the costs of dropping out are dramatic for the…

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

This experiment involved college students (N = 464) working on an authentic learning task (writing an essay) under 3 conditions: no feedback, detailed feedback (perceived by participants to be provided by the course instructor), and detailed feedback (perceived by participants to be computer generated). Additionally, conditions were crossed with 2…

Teacher preparation programs have continued to see the ever-increasing control of teacher candidates by policymakers. To control means to regulate. The problem, according to these authors, is that there are currently at least three regulating measurement and assessment obstacles faced by teacher candidates in teacher preparation programs. The…

In this article, the authors provide their critique on a set of papers that investigated Mathematics Knowledge for Teachers (MKT) assessment and the underlying theory and characteristics of the validity enterprise. Three types of assumptions and inferences--elemental, structural, and ecological--are discussed in these papers. These assumptions…

In this issue of Measurement: Interdisciplinary Research and Perspectives, Schilling et al. are explicit about the centrality of assessment design and development and psychometric analysis in validation. Schilling and colleagues, Kane (2004, 2006), other contemporary validity theorists and practitioners, and their predecessors typically discuss…

Assessment of learning is critical to the learners, teachers, and designers of learning environments. Current assessment techniques in web-based distance learning apply age-old techniques to a new medium and are not adequate for web-based distance learning environments (WBDLE). The goals of this article are to extend existing critiques of…

Promoting ethical practices in assessment is considered to be a very important goal of the organizations involved in assessment. Codes are intended to increase the awareness of ethical practice among their memberships and to promote ethical uses of assessment in various contexts such as teaching, counseling, evaluation, and research. The level of…

American national standards for the evaluation of educational programs were developed by the Joint Committee on Standards for Educational Evaluation in 1994. This paper describes the Joint Committee's standard setting process. The Joint Committee is a coalition of professional organizations concerned with the quality of evaluations in education.…

A study examined the relationship of the respondent and averaged associate ratings on the Listening Practices Feedback Report (LPFR). As part of LPFR listening training sessions, LPFR respondent and associate(s) scores were gathered from several major companies and organizations. Each subject completed an LPFR on his/her own listening behavior and…