ERIC Number: ED599866
Record Type: Non-Journal
Publication Date: 2017-Apr-28
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-
EISSN: N/A
Available Date: N/A
The AVCs of Response Processing Data: The Latest What, When, and How of Think-Alouds
Leighton, Jacqueline P.
AERA Online Paper Repository, Paper presented at the Annual Meeting of the American Educational Research Association (San Antonio, TX, Apr 27-May 1, 2017)
Over the last three decades, there has been increased attention on the collection and interpretation of "response processing data" to inform claims of learners' knowledge and skills (e.g., see Ercikan et al., 2010; Kobrin & Young, 2003; see also, Leighton, 2004). Response processing data are perhaps most consequential in the development of validation arguments to support claims or inferences about test-takers (see AERA, APA & NCME, 2014). However, these data may also serve to inform test development and encourage dialogue on fair student assessment of 21st century skills. One challenge is that methods for collecting response processing data vary in non-trivial ways and must be employed judiciously depending on the cognition of interest being measured. Thus, the objective of the paper is to highlight how two methods -- cognitive labs and think alouds -- can and should be used adaptively to inform distinct goals in test development, validity arguments, and to further the credibility of claims made about test-takers.
Descriptors: Protocol Analysis, Responses, Data Collection, Interviews, Cognitive Processes, Validity, Credibility, Adjustment (to Environment), Psychological Patterns, Social Influences, Generalization, 21st Century Skills, Tests
AERA Online Paper Repository. Available from: American Educational Research Association. 1430 K Street NW Suite 1200, Washington, DC 20005. Tel: 202-238-3200; Fax: 202-238-3250; e-mail: subscriptions@aera.net; Web site: http://www.aera.net
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A