ERIC Number: EJ950650
Record Type: Journal
Publication Date: 2011-Mar
Pages: 21
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1098-2140
EISSN: N/A
Available Date: N/A
Measures of Program Effectiveness Based on Retrospective Pretest Data: Are All Created Equal?
Nimon, Kim; Zigarmi, Drea; Allen, Jeff
American Journal of Evaluation, v32 n1 p8-28 Mar 2011
This study analyzed data from four evaluation designs incorporating the retrospective pretest (i.e., thentest), analyzing the effects of self-report pretesting and post-program survey format on a set of self-report measures. Validity of self-report data was assessed by comparing the criterion validity of then ratings to established benchmarks and by including a control condition. This study found that designs incorporating separate posttest and thentest surveys yielded the most comparable levels of criterion validity for then ratings and the least biased measures of program effectiveness. Conversely, designs that incorporated a single post-program survey, with adjacent post and then items, yielded the least comparable levels of criterion validity for then ratings and the most biased measures of program effectiveness. This study also found a slight interaction between the effects of self-report pretesting and post-program survey format. Implications for program evaluation are discussed. (Contains 3 figures and 4 tables.)
Descriptors: Program Effectiveness, Pretests Posttests, Pretesting, Predictive Validity, Program Evaluation, Time Perspective
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com.bibliotheek.ehb.be
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A