NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED671051
Record Type: Non-Journal
Publication Date: 2020-Jan
Pages: 46
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: 0000-00-00
Do Response Styles Affect Estimates of Growth on Social-emotional Constructs? Evidence from Four Years of Longitudinal Survey Scores. EdWorkingPaper No. 20-194
James Soland; Megan Kuhfeld
Annenberg Institute for School Reform at Brown University
Survey respondents use different response styles when they use the categories of the Likert scale differently despite having the same true score on the construct of interest. For example, respondents may be more likely to use the extremes of the response scale independent of their true score. Research already shows that differing response styles can create a construct-irrelevant source of bias that distorts fundamental inferences made based on survey data. While some initial studies examine the effect of response styles on survey scores in longitudinal analyses, the issue of how response styles affect estimates of growth is underexamined. In this study, we conducted empirical and simulation analyses in which we scored surveys using item response theory (IRT) models that do and do not account for response styles, and then used those different scores in growth models and compared results. Generally, we found that response styles can affect estimates of growth parameters including the slope, but that the effects vary by psychological construct, response style, and model used.
Annenberg Institute for School Reform at Brown University. Brown University Box 1985, Providence, RI 02912. Tel: 401-863-7990; Fax: 401-863-1290; e-mail: annenberg@brown.edu; Web site: https://annenberg.brown.edu/
Publication Type: Reports - Research
Education Level: Elementary Education; Grade 5; Intermediate Grades; Middle Schools; Grade 8; Junior High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Annenberg Institute for School Reform at Brown University
Identifiers - Location: California
Grant or Contract Numbers: N/A
Author Affiliations: N/A