The five papers in this special issue of the "Journal of Applied Testing Technology" address fundamental issues of validity when tests are modified or accommodations are provided to English Language Learners (ELL) or students with disabilities. Three papers employed differential item functioning (DIF) and factor analysis and found the…

Presents entirely automatic methods for gathering documents for a hypertext, for linking the set, and for annotating those connections with a description of the type (that is, the nature) of the link. Document linking is based on information retrieval similarity measures with adjustable levels of strictness. Evaluation problems are also…

Discusses contemporary controversies in evaluation that are likely to be of continuing importance in the near future, Including: (1) the nature and role of substantive theory in evaluation; (2) the importance of advances in methods; and (3) the meaning of "success as a profession." Asserts the necessity of positioning evaluation as part of…

This brief describes estimation and measurement issues relevant to estimating the quality of instruction in the context of a cumulative model of learning. It also discusses implications for the use of value-added estimates in personnel and compensation matters. The discussion highlights the importance of accounting for student differences and the…

The constraints of conducting evaluations in real-world settings often necessitate the implementation of less than ideal designs. Unfortunately, the standard method for estimating the precision of a result (i.e., confidence intervals [CI]) cannot be used for evaluative conclusions that are derived from multiple indicators, measures, and data…

Authentic assessment is a growing alternative to conventional testing. This research-to-practice article describes a framework for implementing authentic assessment. The R-E-A-L framework shows how roles, equipment, assessment tools, and location can be incorporated into early childhood practices.

This paper is a polemical discussion of assessment in teacher education. Working from the proposition that assessment serves a number of important purposes for a range of stakeholders (students, employers, quality assurance agencies, government), it argues that there is considerable potential for conflict between the different purposes. In an age…

Discusses the use of information retrieval techniques for the automatic authoring of hypertext. Presents a typology of hypertext links, describes examples of automatic construction of hypertext, and considers evaluation problems. (LRW)

Describes the challenges faced by researchers in evaluating a neighborhood revitalization project. Places the challenges in the context of three of the Program Evaluation Standards of the Joint Committee on Standards for Educational Evaluation: Values Identification, Fiscal Responsibility, and Analysis of Quantitative Information. (SLD)

Drawing from personal experiences, writings, observations, evaluation training activities, and professional consultations, this article identifies 50 propositions inherent in personnel evaluation. Propositons fall into three categories: professional premises, contextual realities, and constraints. (MLH)

Discussion of evaluation methodology for computer software focuses on the evaluation of electronic performance support systems. Highlights include problems with evaluation; a usage-oriented methodology, including a theoretical framework, a purpose aspect, and an activities aspect; decision making; and rapid prototypes. (LRW)

When tasked with selecting a Course Management System (CMS), the first step many responsible colleges, universities and consortia take is to name a selection committee of faculty, administration, students and possibly IT staff. They do some Web searching and talk to colleagues, friends and counterparts at other institutions. This same committee…

Course evaluation is integral to medical education. We discuss (1) distinctive features of medical education that impact on course evaluation, (2) a framework for course evaluations, (3) details that shape the evaluation process, (4) key measurement issues important to data gathering and interpretation, and (5) opportunities for expanding the…

Increasingly, institutions of higher education are required to evaluate student progress and programme effectiveness through implementation of performance assessment practices. Faculty members frequently resist performance assessment because of concerns that assessment activities will increase workloads, reduce time for scholarly activities,…

Maintains that the recent statewide trend in teacher evaluation systems may not evaluate music educators adequately. Provides four case studies on music teacher evaluation results. Shows that music teachers are below the norm on the majority of competencies. Evaluates results of the study and discusses possible reasons why music educators have low…