Measurement invariance is a prerequisite for comparing measurement scores from different groups. In medical education, multi-source feedback (MSF) is utilized to assess core competencies, including the professionalism. However, little attention has been paid to the measurement invariance of assessment instruments; that is, whether an instrument…

The Tuning-Medicine Project produced a set of "level one" and "level two" learning outcomes/competences to be met by European medical graduates. In the learner-centered era self-assessment becomes more and more important. Our aim was to develop a self-completion questionnaire ("iCAN!") evaluating graduates' learning…

Research on the effectiveness of competence-based education (CB-education) across educational contexts and levels requires a new evaluation measurement. This study explores the face validity, construct validity, and robustness of a competency self-report instrument that is aligned with contemporary competence theory and with current educational…

This paper describes the development and validation of an item bank designed for students to assess their own achievements across an undergraduate-degree programme in seven generic competences (i.e., problem-solving skills, critical-thinking skills, creative-thinking skills, ethical decision-making skills, effective communication skills, social…

Objective: Assess validity of the ecSatter Inventory (ecSI) to measure eating competence (EC). Design: Concurrent administration of ecSI with validated measures of eating behaviors using on-line and paper-pencil formats. Setting: The on-line survey was completed by 370 participants; 462 completed the paper version. Participants: Participants…

Examination of the available literature regarding the development of the MacArthur Competence Assessment Tool-Criminal Adjudication (MacCAT-CA) reveals 2 theoretical factor structures on which the MacCAT-CA was based: one in which 3 lower-order constructs are proposed (understanding, reasoning, appreciation) and one in which 2 higher-order…

This study first found that an adaptation of the Pictorial Scale of Perceived Competence and Social Acceptance for Young Children exhibited construct validity and test-retest reliability in assessing preschool children's sensitivity to age-related differences in peers' developmental abilities. Second, children with disabilities were viewed as less…

The construct validity of the standardized-patient (SP) examination used at Southern Illinois University (Springfield) School of Medicine was assessed by comparing 66 second-year and 70 fourth-year medical students on 5 SP cases. The results show sizable differences between the groups. The usefulness of passing rates the effect-size measures as a…

The types of validity evidence that are appropriate for teacher licensure tests are discussed. Included are a discussion of the current popularity of teacher competency tests and the reasons for that popularity. Licensure, certification, and employment examinations are differentiated. Because the area of interest is the minimum competency…

This study compared two instruments for evaluating the performance of individual college-level academic advisors: (1) a student form assessing abilities in listening and other counseling skills, knowledge, and technology use; and (2) a professional scale assessing task competence, other-orientation, and professional networking. Both showed high…

This paper addresses the cross-cultural development and use of the Behavior Description Index (BDI). The development of culturally-transportable scales; cross-cultural comparisons of results for 12 Spanish, 15 Hungarian, 15 Indonesian, and U.S. managers; and the transportability of competencies as constructs are considered. A competency is an…