The study aims to examine the interplay of two critical constructs in evaluation: essential evaluator competency and evaluator practice. The research questions in this study, according to Smith (2008), are essentially, what he defined as "fundamental issues in evaluation." These issues fall into one or multiple of the four aspects…

Measurement invariance is a prerequisite for comparing measurement scores from different groups. In medical education, multi-source feedback (MSF) is utilized to assess core competencies, including the professionalism. However, little attention has been paid to the measurement invariance of assessment instruments; that is, whether an instrument…

The study of competencies in student affairs began more than 4 decades ago, but no instrument currently exists to measure competencies broadly. This study builds upon previous research by developing an instrument to measure student affairs competencies. Results not only validate the competencies espoused by NASPA and ACPA, but also suggest adding…

Construct validity has been an issue in assessment centers literature. This study developed a model for competency-based assessment centers by integrating competency modeling, training design, assessment centers, and multi-source feedback assessment. Several propositions in conjunction with the model were also developed to help resolve construct…

The construct validity of the standardized-patient (SP) examination used at Southern Illinois University (Springfield) School of Medicine was assessed by comparing 66 second-year and 70 fourth-year medical students on 5 SP cases. The results show sizable differences between the groups. The usefulness of passing rates the effect-size measures as a…

This study compared two instruments for evaluating the performance of individual college-level academic advisors: (1) a student form assessing abilities in listening and other counseling skills, knowledge, and technology use; and (2) a professional scale assessing task competence, other-orientation, and professional networking. Both showed high…

This document contains eight papers from an action research program to foster good practice in adult literacy provision and policy. "Introduction" (J. Joy Cumming, Christina E. van Kraayenoord) presents an overview of the action research project and individual reports. "Assessment: Making a Difference in Adult Literacy and Numeracy…