ERIC Number: ED592756
Record Type: Non-Journal
Publication Date: 2018
Pages: 26
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Detecting Inattentive Responding on a Psychosocial Measure of College Readiness. Research Report 2018-5
Steedle, Jeffrey
ACT, Inc.
Self-report inventories are commonly administered to measure social and emotional learning competencies related to college readiness. If students respond inattentively or dishonestly, validity will suffer. This study applies several methods of detecting insufficient effort responding (IER) to data from ACT® Engage®. Different methods indicated that between 0.8% and 20.3% of respondents exhibited IER, but filtering those students from the data resulted in negligible improvements in criterion-related validity, coefficient alpha, convergent validity, and confirmatory factor analysis model-data fit. Even so, researchers are advised to investigate IER. Analyses affirmed that the IER detection methods effectively flagged suspect item score patterns, so these methods may still be used to flag individual results as potentially invalid.
Descriptors: College Readiness, Response Style (Tests), Test Validity, Measurement Techniques, Incidence, Measures (Individuals), Social Development, Emotional Development, High School Students, Goodness of Fit, Correlation
ACT, Inc. 500 ACT Drive, P.O. Box 168, Iowa City, IA 52243-0168. Tel: 319-337-1270; Web site: http://www.act.org
Publication Type: Reports - Research
Education Level: High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: ACT, Inc.
Grant or Contract Numbers: N/A
Author Affiliations: N/A