ERIC Number: EJ982770
Record Type: Journal
Publication Date: 2012-Dec
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0013-1644
EISSN: N/A
Available Date: N/A
Examining Contexts-of-Use for Web-Based and Paper-Based Questionnaires
Hardre, Patricia L.; Crowson, H. Michael; Xie, Kui
Educational and Psychological Measurement, v72 n6 p1015-1038 Dec 2012
Questionnaire instruments are frequently administered in digital formats, largely web-based, without much systematic investigation of possible effects from these administration methods. Furthermore, little attention has been given to the contextual lack of control for extraneous factors that may influence user responses. In this study, 263 university students were randomly assigned to one of two administration formats, web-based (WBA) or paper-based (PBA), to complete a set of questionnaires in an environment of their choice. Data collection included reporting context characteristics along three parameters: location, companions, and concurrent activities (including help-seeking). Outcomes of interest included location and conditions of user-chosen contexts, instrument performance, generative data quantity and quality, independence of completion, administrative efficiency, and participant affect. Participants did choose and allow distracters in their contexts-of-use, completing the questionnaires while engaged in multiple social and asocial concurrent activities. There were generally small but significant differences in instrument performance and user response characteristics by administration method and contexts-of-use. Participant comfort and data returned were both higher in PBA than WBA. Quantity return of generative data was higher in WBA while overall quality (completeness, coherence, correctness) of generative data was not significantly different. These findings present implications of administrative methods and contextual influences that inform measurement professionals' selection and design of administrative systems and conditions for research and evaluation data collection. (Contains 2 notes and 2 tables.)
Descriptors: Questionnaires, Online Surveys, Testing, Context Effect, College Students, Response Style (Tests), Geographic Location, Activities, Help Seeking, Reliability, Factor Analysis
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Need for Cognition Scale
Grant or Contract Numbers: N/A
Author Affiliations: N/A