Measurement invariance is a prerequisite for comparing measurement scores from different groups. In medical education, multi-source feedback (MSF) is utilized to assess core competencies, including the professionalism. However, little attention has been paid to the measurement invariance of assessment instruments; that is, whether an instrument…

The study of competencies in student affairs began more than 4 decades ago, but no instrument currently exists to measure competencies broadly. This study builds upon previous research by developing an instrument to measure student affairs competencies. Results not only validate the competencies espoused by NASPA and ACPA, but also suggest adding…

The purpose of this study was twofold: to assess evidences of construct validity of the Brazilian Scale of Tutors Competences in the field of Open and Distance Learning and to examine if variables such as professional experience, perception of the student´s learning performance and prior experience influence the development of technical and…

Supervisor assessments are critical for both formative and summative assessment in the workplace. Supervisor ratings remain an important source of such assessment in many educational jurisdictions even though there is ambiguity about their validity and reliability. The aims of this evaluation is to explore the: (1) construct validity of ward-based…

Examined the reliability and construct validity in an older adult population (n=149 older adults and their informants) of scores on the Behavioral Competence Inventory (BCI) (P. Hartman-Stein). Results indicate that scores on the BCI's seven scales show adequate internal consistencies and represent seven overlapping but distinct constructs in this…

Studies of the Angoff method of standard setting suggest that judges agree in their estimates of the relative difficulties of test questions for minimally competent examinees and that each judge's estimates correlate well with the observed item difficulties for examinees whose total test scores are near the judge's personal standard (G. E.…