The definition and measurement of counsellor trainee competency is an issue that has received increased attention yet lacks quantitative study. This research evaluates item responses, scale reliability and intercorrelations, interrater agreement, and criterion-related validity of the Professional Performance Fitness Evaluation/Professional…

The unit determined that "Assessment 5: Effect on Student Learning" would be best measured by student teachers and interns utilizing an action research activity in their clinical experience. Twenty four action research projects were evaluated by the Director of Student Teaching. Interraters blind to the Director's scores evaluated the projects.…

This study investigated the cognitive strategies that underpin assessors' holistic judgments of a school-based vocationally-related portfolio performance. Using a portfolio already identified as containing borderline qualities, quantitative data were gathered about features that six assessors attended to as they holistically evaluated the…

Many researchers and clinicians believe that the therapeutic relationship is essential in bringing about clinical change. Empirical research to support this contention is scarce in part due to the difficulty of specifying and measuring theoretically derived mechanisms of change and the important dimensions of the client-therapist relationship.…

To address the need for a standardized system to classify the gross motor function of children with cerebral palsy, the authors developed a five-level classification system analogous to the staging and grading systems used in medicine. Nominal group process and Delphi survey consensus methods were used to examine content validity and revise the…

Visual inspection is the primary method used to analyze graphed behavioral data produced by functional analyses of problem behavior. The purpose of this study was to examine rater reliability of functional analysis graphs using visual inspection. Forty-three participants responded to a one-time anonymous survey (N = 454) mailed to graduate…

It is particularly important that GCSE and A-level marking is valid and reliable as it affects the life chances of many young people in England. Current developments in marking technology are coinciding with potential changes in procedures to ensure valid and reliable marking. In this research the effectiveness of procedures to facilitate the…

The Autism Observation Scale for Infants (AOSI) was developed to detect and monitor early signs of autism as they emerge in high-risk infants (all with an older sibling with an autistic spectrum disorder). Here we describe the scale and its development, and provide preliminary data on its reliability. Inter-rater reliability both for total scores…

The study sought to develop consensus opinion on the core competencies required to succeed as a female executive in the C-Suites of Alberta, Canada. The study was prompted by the significant under-representation of women in Canadian corporate executive positions and by a post-secondary institution's interest in determining whether a market exists…

Counselor ability to accurately self-assess their competence is important to ethical practice. However, research indicates that people in general are not reliable in judging their own competence. This study compared the self-assessments of skills of 69 counselors-in-training to the skill ratings of trained expert-raters at three points during…

Objective: Research on child and adolescent anxiety disorders has seen a surge in investigations of parenting factors potentially associated with their etiology. However, many of the well-established parenting measures are limited by over-reliance on self-report or lengthy behavioral observation procedures. Such measures may not assess factors…

This study investigated the effects of workshop and lecture methods on pastoralists' learning in Ilam Province, west of Iran. A quasi-experimental research method and non-equivalent control group design was used. Sixty pastoralists participated in this study. An open-ended questionnaire was used as the instrument of the study and found to have…

Clinical judgment is foundational to psychological practice. Accurate judgment forms the basis for establishing reasonable goals and selecting appropriate treatments, which in turn are essential in achieving positive therapeutic outcomes. Therefore, Spengler and colleagues' meta-analytic finding--clinical judgment accuracy improves marginally with…

This research evaluated the inter-rater reliability of the Performance Assessment for California Teachers (PACT). Multiple methods for estimating overall rater consistency include percent agreement and Cohen's Kappa (1960), which yielded discrepancies between rater agreement in terms of whether candidates passed or failed particular PACT rubrics.…

The research presented in this manuscript was focused on the development of assessments for engineering design outcomes. The primary goal was to support efforts by the Transferrable Integrated Design Engineering Education (TIDEE) consortium in developing assessment instruments for multidisciplinary engineering capstone courses. Research conducted…