ERIC Number: EJ1264222
Record Type: Journal
Publication Date: 2020-Sep
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0007-0998
EISSN: N/A
Available Date: N/A
Scrutinizing the Basis of Originality in Divergent Thinking Tests: On the Measurement Precision of Response Propensity Estimates
Forthmann, Boris; Paek, Sue Hyeon; Dumas, Denis; Barbot, Baptiste; Holling, Heinz
British Journal of Educational Psychology, v90 n3 p683-699 Sep 2020
Background: The originality of divergent thinking (DT) production is one of the most critical indicators of creative potential. It is commonly scored using the statistical infrequency of responses relative to all responses provided in a given sample. Aims: Response frequency estimates vary in terms of measurement precision. This issue has been widely overlooked and is addressed in the current study. Sample and method: Secondary data analysis of 202 participants was performed. A total of 900 uniquely identified responses were generated on three DT tasks and subjected to a 1-parameter logistic model with a response as the unit of measurement which allowed for the calculation of response-level conditional reliability (and marginal reliability as an overall summary of measurement precision). Results: Marginal reliability of response propensity estimates ranged from 0.62 to 0.67 across the DT tasks. Unique responses in the sample (the basis for the classic uniqueness scoring) displayed the lowest conditional reliability (across tasks: [approximately equal to] 0.50). Reliability increased nonlinearly as a function of both the frequency of occurrence predicted by the model (conditional reliability) and sample size (conditional and marginal reliability). Conclusions: This study indicates that the common practice of frequency-based originality scoring with typical sample sizes (e.g., N = 100 to N = 200) yields unacceptable levels of measurement precision (i.e., in particular for highly original responses). We further offer recommendations to mitigate the lack of measurement precision of frequency-based originality scores for DT research.
Descriptors: Creative Thinking, Creativity Tests, Item Response Theory, Scores, Test Reliability, Scoring, Sample Size
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www-wiley-com.bibliotheek.ehb.be/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A