NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED669363
Record Type: Non-Journal
Publication Date: 2020
Pages: 78
Abstractor: As Provided
ISBN: 979-8-5355-8643-4
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Interrater Reliability of Curriculum-Based Measures in Reading (R-CBMs) for English Learners
Ashley Marinez
ProQuest LLC, Ph.D. Dissertation, The Pennsylvania State University
The purpose of the current study was to determine interrater reliability (IRR) of Oral Reading Fluency (ORF) Curriculum-based Measures (R-CBM) when used with Spanish-speaking English Learner (EL) students. The ORF R-CBM probes obtained from AIMSweb are measures of a student's reading accuracy skills and reading fluency skills. Certified school psychologists who have graduated from The Pennsylvania State University School Psychology program, current school psychologists in the field, and current school psychology students and faculty from various other graduate training programs were recruited as raters. Participants were asked to score several ORF passages twice. During the first round of scoring (T1), raters followed the standard directions provided by the AIMSweb program. About two months later (T2), raters scored the four additional passages using more comprehensive instructions that targeted issues presented by EL students. The sample demographics and the distribution of ratings for the ORF passage for both administrations were analyzed (e.g., M, SD, range). IRR was calculated for T1 and T2 using the two-way, random-effects intra-class correlation (ICC) approach. Lastly, the average difference and consistency for passages between T1 and T2 were tested for significance using a two-way, mixed-effects model. A total of 35 raters scored 8 EL student passages over both administrations, resulting in 70 ratings. Overall, good to excellent interrater reliability emerged when scoring the ORF R-CBMs for both T1 and T2, indicating statistically significant IRR indices (p < 0.05). Results provide evidence to support the use of R-CBMs with Spanish-speaking EL students. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com.bibliotheek.ehb.be/en-US/products/dissertations/individuals.shtml.]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com.bibliotheek.ehb.be/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Pennsylvania
Grant or Contract Numbers: N/A
Author Affiliations: N/A