ERIC Number: EJ1276475
Record Type: Journal
Publication Date: 2021-Jan
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1098-3007
EISSN: N/A
Available Date: N/A
Reliability Assessment of an Observation Tool to Measure Praise Characteristics
Markelz, Andrew M.; Riden, Benjamin S.; Zoder-Martell, Kimberly A.; Miller, Joseph E.; Bolinger, Sarah J.
Journal of Positive Behavior Interventions, v23 n1 p17-29 Jan 2021
Supported by decades of research on praise and its effect on student behaviors, we developed the Behavior-Specific Praise--Observation Tool (BSP-OT) to measure characteristics of effective praise. We evaluated interrater reliability of the BSP-OT to measure praise specificity, contingency, and variety using intraclass correlation (ICC) and Cohen's kappa statistics. In addition, we assessed usefulness and practicality of the tool with social validity measures. Four raters with experience in praise research completed a survey and coded videos (n = 14) of teachers in authentic situations delivering praise. Overall assessment indicated strong reliability between raters with ICC(2, k) of 0.80: 95% confidence interval (CI) = [0.77, 0.83], F(269, 19906) = 5.1, p < 0.001, and mean kappa score of 0.91. Furthermore, high social validity ratings suggest the BSP-OT is a valuable contribution to the field concerning praise research and teacher development. The process of developing the BSP-OT and study findings are presented, with a discussion of implications and suggestions for future research.
Descriptors: Test Reliability, Classroom Observation Techniques, Positive Reinforcement, Interrater Reliability, Behavior Change, Test Construction, Test Validity
SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A