What's Wrong With Bonferroni Adjustments - PubMed

Clipboard, Search History, and several other advanced features are temporarily unavailable. Skip to main page content

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation Search: Search Advanced Clipboard Save Email Send to

• Clipboard
• My Bibliography
• Collections
• Citation manager

Display options Display options Format Abstract PubMed PMID

Save citation to file

Format: Summary (text) PubMed PMID Abstract (text) CSV Create file Cancel

Email citation

Subject: 1 selected item: 9553006 - PubMed To: From: Format: Summary Summary (text) Abstract Abstract (text) MeSH and other data Send email Cancel

Add to Collections

• Create a new collection
• Add to an existing collection

Name your collection: Name must be less than 100 characters Choose a collection: Unable to load your collection due to an error Please try again Add Cancel

Add to My Bibliography

• My Bibliography

Unable to load your delegates due to an error Please try again Add Cancel

Your saved search

Name of saved search: Search terms: Test search terms Would you like email updates of new search results? Saved Search Alert Radio Buttons

• Yes
• No

Email: (change) Frequency: Monthly Weekly Daily Which day? The first Sunday The first Monday The first Tuesday The first Wednesday The first Thursday The first Friday The first Saturday The first day The first weekday Which day? Sunday Monday Tuesday Wednesday Thursday Friday Saturday Report format: Summary Summary (text) Abstract Abstract (text) PubMed Send at most: 1 item 5 items 10 items 20 items 50 items 100 items 200 items Send even when there aren't any new results Optional text in email: Save Cancel

Create a file for external citation management software

Create file Cancel

Your RSS Feed

Name of RSS Feed: Number of items displayed: 5 10 15 20 50 100 Create RSS Cancel RSS Link Copy

Full text links

HighWire Free PMC article Full text links

Actions

CiteCollectionsAdd to Collections

• Create a new collection
• Add to an existing collection

Name your collection: Name must be less than 100 characters Choose a collection: Unable to load your collection due to an errorPlease try again Add Cancel Display options Display options Format AbstractPubMedPMID

Share

• Permalink Copy

Page navigation

• Title & authors
• Comment in
• Similar articles
• Cited by
• References
• Publication types
• MeSH terms
• Related information
• LinkOut - more resources

Title & authors Comment in Similar articles Cited by References Publication types MeSH terms Related information LinkOut - more resources Full text links CiteDisplay options Display options Format AbstractPubMedPMID No abstract available

PubMed Disclaimer

Comment in

• Other method for adjustment of multiple testing exists. Aickin M. Aickin M. BMJ. 1999 Jan 9;318(7176):127-8. doi: 10.1136/bmj.318.7176.127a. BMJ. 1999. PMID: 9880302 Free PMC article. No abstract available.
• Multiple test procedures other than Bonferroni's deserve wider use. Bender R, Lange S. Bender R, et al. BMJ. 1999 Feb 27;318(7183):600-1. doi: 10.1136/bmj.318.7183.600a. BMJ. 1999. PMID: 10037651 Free PMC article. No abstract available.

Similar articles

• Sifting the evidence-what's wrong with significance tests? Sterne JA, Davey Smith G. Sterne JA, et al. BMJ. 2001 Jan 27;322(7280):226-31. doi: 10.1136/bmj.322.7280.226. BMJ. 2001. PMID: 11159626 Free PMC article. Review. No abstract available.
• What's wrong with this picture? Hage SJ. Hage SJ. Radiol Manage. 1994 Winter;16(1):63-4. Radiol Manage. 1994. PMID: 10132557
• [Multiple testing and subgroup analysis (what's wrong in always searching for significant results)]. Catelan D, Biggeri A, Barbone F. Catelan D, et al. Epidemiol Prev. 2011 Mar-Apr;35(2):150-4. Epidemiol Prev. 2011. PMID: 21628761 Italian. No abstract available.
• [Low p-values are not all!]. Lindberg G. Lindberg G. Lakartidningen. 2002 Oct 3;99(40):3979; author reply 3979. Lakartidningen. 2002. PMID: 12422764 Swedish. No abstract available.
• Statistics for clinicians: 4: Basic concepts of statistical reasoning: hypothesis tests and the t-test. Carlin JB, Doyle LW. Carlin JB, et al. J Paediatr Child Health. 2001 Feb;37(1):72-7. doi: 10.1046/j.1440-1754.2001.00634.x. J Paediatr Child Health. 2001. PMID: 11168875 Review. No abstract available.

See all similar articles

Cited by

• The Fragility of Statistically Significant Binary Outcomes for Treating Achilles Tendinopathy: A Systematic Review of Randomized Trials. Anaspure OS, Patel S, Baumann AN, Newsom A, Anastasio AT, Amendola A. Anaspure OS, et al. Foot Ankle Orthop. 2024 Nov 20;9(4):24730114241300160. doi: 10.1177/24730114241300160. eCollection 2024 Oct. Foot Ankle Orthop. 2024. PMID: 39575398 Free PMC article.
• Impact of astaxanthin supplementation on markers of cardiometabolic health and tactical performance among firefighters. Gonzalez DE, Dickerson BL, Johnson SE, Woodruff KE, Leonard M, Yoo C, Ko J, Xing D, Martinez V, Kendra J, Estes L, Sowinski RJ, Rasmussen CJ, Martin SE, Kreider RB. Gonzalez DE, et al. J Int Soc Sports Nutr. 2024 Dec;21(1):2427751. doi: 10.1080/15502783.2024.2427751. Epub 2024 Nov 20. J Int Soc Sports Nutr. 2024. PMID: 39568140 Free PMC article. Clinical Trial.
• Medial temporal atrophy predicts the limbic comorbidities in lewy body disease. Sakurai K, Kaneda D, Morimoto S, Uchida Y, Inui S, Shang C, Kimura Y, Cai C, Kato T, Ito K, Hashizume Y. Sakurai K, et al. Neuroradiology. 2024 Nov 12. doi: 10.1007/s00234-024-03502-z. Online ahead of print. Neuroradiology. 2024. PMID: 39531077
• Complement proteins and complement regulatory proteins are associated with age-related macular degeneration stage and treatment response. Thomsen AK, Steffensen MA, Villarruel Hinnerskov JM, Nielsen AT, Vorum H, Honoré B, Nissen MH, Sørensen TL. Thomsen AK, et al. J Neuroinflammation. 2024 Nov 1;21(1):284. doi: 10.1186/s12974-024-03273-7. J Neuroinflammation. 2024. PMID: 39487449 Free PMC article.
• Boundaries on Parent Involvement in Their Child's Anxiety Cognitive-Behavioral-Treatment Outcome: Parent Reinforcement and Relationship Behaviors Moderate Outcome. Silverman WK, Rey Y, Marin CE, Boutris P, Jaccard J, Pettit JW. Silverman WK, et al. Clin Psychol Sci. 2024 Sep;12(5):936-944. doi: 10.1177/21677026231209331. Epub 2023 Nov 30. Clin Psychol Sci. 2024. PMID: 39474312 Free PMC article.

See all "Cited by" articles

References

1. 1. Tukey JW. Some thoughts on clinical trials, especially problems of multiplicity. Science. 1977;198:679–684. - PubMed
2. 1. Greenhalgh T. Statistics for the non-statistician. l. Different types of data need different statistical tests. BMJ. 1997;315:364–366. - PMC - PubMed
3. 1. Bland JM, Altman DG. Multiple significance tests: the Bonferroni method. BMJ. 1995;310:170. - PMC - PubMed
4. 1. Rothman KJ. No adjustments are needed for multiple comparisons. Epidemiology. 1990;1:43–46. - PubMed
5. 1. Savitz DA, Olshan AF. Multiple comparisons and related issues in the interpretation of epidemiologic data. Am J Epidemiol. 1995;142:904–908. - PubMed

Show all 12 references

Publication types

• Research Support, Non-U.S. Gov't Actions
  • Search in PubMed
  • Search in MeSH
  • Add to Search
• Review Actions
  • Search in PubMed
  • Search in MeSH
  • Add to Search

MeSH terms

• Data Interpretation, Statistical Actions
  • Search in PubMed
  • Search in MeSH
  • Add to Search
• Probability Actions
  • Search in PubMed
  • Search in MeSH
  • Add to Search
• Statistics as Topic / methods* Actions
  • Search in PubMed
  • Search in MeSH
  • Add to Search

Related information

• Cited in Books

LinkOut - more resources

• Full Text Sources

  • Europe PubMed Central
  • HighWire
  • Ovid Technologies, Inc.
  • PubMed Central

• Medical

  • MedlinePlus Health Information

Full text links [x] HighWire Free PMC article [x] Cite Copy Download .nbib .nbib Format: AMA APA MLA NLM Send To

• Clipboard
• Email
• Save
• My Bibliography
• Collections
• Citation Manager

[x]

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.