Purpose: This policy brief, the second AERI-NEPC eBrief in the series "Understanding validity issues around the world", focuses on validity as it applies to test-based models of evaluation employed for schools, instructional programs, and teachers around the world. It discusses validity issues that could arise when data from student…

Modern test construction strategies in the areas of personality and psychopathology differ in the use of disguise within test stimulus material. Previous research on the validity of using disguised test item content has favored the rational strategy of test construction which views disguise as a liability under normal test-taking circumstances.…

This paper considers the measurement of person-centered planning with developmentally disabled individuals. It reports on the development of three instruments to assess person-centered planning and both a process and an outcome index. Psychometric evaluation indicated test-retest reliability and measures of internal consistency were adequate.…

A new indicator of item difficulty, which identifies effectiveness ranges, overcomes the limitations of other item difficulty indexes in describing the difficulty of an item or a test as a whole and in aiding the selection of appropriate ability level items for a test. There are three common uses of the term "item difficulty": (1) the probability…

Community coalitions (CCs) have labored with some difficulty to demonstrate empirical evidence of effectiveness in preventing a wide range of adolescent problem behaviors. Training and technical assistance (TA) have been identified as important elements in promoting improved functioning of CCs. A reliable, valid, and inexpensive method to assess…

Based on seven years of surveying students, parents, and educators, the following conclusions were reached: (1) preliminary telephoning of graduates to verify addresses did not produce higher returns from those contacted; (2) cover letters printed on more expensive colored-letterhead stationary did not produce a higher return rate than the same…

While supervisory research focuses on trainee performance in counseling situations as the primary outcome criterion, few instruments have been developed for evaluating behavior in the supervision interview. To develop a scale that reflects critical factors in the supervisory relationship, the Supervisor Personal Reaction Scale (SPRS) and the…

A battery of tests was designed to measure four components of creativity (fluency, flexibility, originality, and elaboration) in secondary school members of the Mizo culture in India. The battery included tests on seeing problems, unusual uses, consequences, making things more interesting, finding similarities, constructing and completing…

Educational item banking presents observers with a considerable paradox. The development of test items from scratch is viewed as wasteful, a luxury in times of declining resources. On the other hand, item banking has failed to become a mature technology despite large amounts of money and the efforts of talented professionals. The question of which…

This examination of the Rasch scaling model concludes that the model could potentially facilitate objective comparisons of status and change of young children with disabilities at individual and group levels. The paper discusses applications of the model to early childhood assessment in the areas of item banking, test analysis, and subject…

A culture-specific approach to identifying artistic talent in African-American students is presented, called Tactuality. Tactuality identifies four characteristics: emotional intensity, flexibility and open-endedness, holistic perception, and tactile sensitivity. A pilot test with 63 fourth graders resulted in statistical problems with validation.…

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…

Coordination between research and practice in performance appraisal is essential. Specifically, researchers should focus on utilization methods while practitioners should focus on appraisal content. Cognitive process research may increase raters' ability to judge accurately but fails to address raters' willingness to provide accurate ratings. (BL)

Evidence-centered assessment design (ECD) is an approach to constructing educational assessments in terms of evidentiary arguments. This paper provides an introduction to the basic ideas of ECD, including some of the terminology and models that have been developed to implement the approach. In particular, it presents the high-level models of …

The nine-volume Survey Kit is designed to help readers prepare and conduct surveys and become better users of survey results. All the books in the series contain instructional objectives, exercises and answers, examples of surveys in use, illustrations of survey questions, guidelines for action, checklists of "dos and don'ts," and…