ERIC Number: EJ1190094
Record Type: Journal
Publication Date: 2016
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1364-5579
EISSN: N/A
Available Date: N/A
What to Do Instead of Significance Testing? Calculating the 'Number of Counterfactual Cases Needed to Disturb a Finding'
Gorard, Stephen; Gorard, Jonathan
International Journal of Social Research Methodology, v19 n4 p481-490 2016
This brief paper introduces a new approach to assessing the trustworthiness of research comparisons when expressed numerically. The 'number needed to disturb' a research finding would be the number of counterfactual values that can be added to the smallest arm of any comparison before the difference or 'effect' size disappears, minus the number of cases missing key values. This way of presenting the security of findings has several advantages over the use of significance tests, effect sizes and confidence intervals. It is not predicated on random sampling, full response or any specific distribution of data. It bundles together the sample size, magnitude of the finding and the level of attrition in a way that is standardised and therefore comparable between studies.
Descriptors: Statistical Significance, Testing, Sampling, Attrition (Research Studies), Reliability, Effect Size, Research Problems, Robustness (Statistics), Heuristics, Computation
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A