A regional business school chose to self develop an assessment test of the fundamental concepts of the undergraduate business core. Above and beyond the demands of AACSB accreditation, faculty identified feedback from such a test as an essential precursor to changing both overall curriculum and individual class content. The authors describe the…

Purpose: The purpose of the study was to empirically test items of a new measure designed to assess person-directed care (PDC) practices in long-term care. Design and Methods: After reviewing the literature, we identified five areas related to PDC: personhood, comfort care, autonomy, knowing the person, and support for relationships. We also…

This article uses the case of designing a new course questionnaire to discuss the issues of validity, reliability and diagnostic power in good questionnaire design. Validity is often not well addressed in course questionnaire design as there are no straightforward tests that can be applied to an individual instrument. The authors propose the…

The temporal stability of the effects induced by the Cued Reaction Time Task (CRTT) on the orienting of attention was assessed across four weekly sessions. Benefits, costs, and validity effects were computed for each session, and the correlation coefficients between each session were calculated (interindividual stability index). Intraindividual…

Tested the assumption that familial self-reports are biased by social desirability and other factors, through the use of a latent variables modeling approach that evaluated rater reliability and bias in mother, father, and child ratings of parent-child negativity. Results based on 78 families demonstrated that family member ratings contained a…

The primary purpose of this study was to determine whether the data from the qualitative study fit Rasch model requirements for the definition of a measure, as well as to address concern in the extant literature regarding the appropriate number of items needed in analysis to assure unidimensionality. The self-report victimization scale was…

We report the results of a test-retest and alternate form reliability study of grade 1, 3, 5, and 8 reading measures from the easyCBM assessment system. Approximately 50 students in each grade participated in the study. In Grade 1, we studied the following measures: Phoneme Segmenting, Letter Sounds, Letter Names, Word Reading Fluency, and Passage…

The Chinese Career Key (CCK) Online was studied for its effectiveness and user satisfaction. Study participants were 92 students at a public high school in Hong Kong. The research findings provide preliminary evidence of reliability, validity, and user satisfaction for the CCK Online. Limitations and implications for future studies and counseling…

The purpose of this study was to perform a cross-cultural adaptation of the Disability of Arm, Shoulder, and Hand (DASH) questionnaire to Spanish for Puerto Rico. Five steps were followed for the cross-cultural adaptation: forward translations into Spanish for Puerto Rico, synthesis of the translations, back translations into English, revision by…

Purpose: Construct validity and concurrent validity were investigated in a prototype survey instrument, the "Public Opinion Survey of Human Attributes-Experimental Edition" (POSHA-E). The POSHA-E was designed to measure public attitudes toward stuttering within the context of eight other attributes, or "anchors," assumed to range from negative…

This paper reports on observational approaches developed within a UK study to the identification and assessment of metacognition and self-regulation in young children in the 3-5 year age range. It is argued that the development of observational tools, although containing methodological difficulties, allows us to make more valid assessments of…

Critical to precise quantitative research is reliability estimation. Researchers have limited tools, however, to assess the reliability of evolving instruments. Consequently, cursory assessment is typical and in-depth evaluation is rare. This paper presents a rationale for and description of PIAS, a computerized instrument analysis system. PIAS…

To test the reliability of four tasks of the Michigan Restricted Association Norms--Superordinates, Parts, Following Words, and Free Associations--30 subjects were asked to respond to 33 stimulus items under each of the four instructions and to perform identical tasks 7-14 days later. Comparisons of the intra-individual reliability and…

Three experienced neuropsychologists rated brain damaged and control subjects for brain damage using the Halstead-Reitan Battery and the Luria-Nebraska Neuropsychological Battery. Using either battery, raters were accurate in judging the presence of brain damage. There was a high degree of consistency between raters and test batteries when both…

This program computes multiple judge reliability levels under the following conditions. (1) different sets of judges perform the ratings; (2) the number of judges is a constant; and (3) the scale of measurement is nominal. (Author)