"If you torture your data long enough, they will tell you whateveryou want to hear" has become a popular observation in our office.In plain English, this means that study data, if manipulatedin enough different ways, can be made to prove whatever theinvestigator wants to prove. Unfortunately, this is generallytrue. Because every investigator wants to present results inthe most exciting way, we all look for the most dramatic, positivefindings in our data. When this process goes beyond reasonableinterpretation of the facts, it becomes data torturing. Theunfortunate result of torturing data is the . . . [Full Text of this Article]
Opportunistic Data Torturing
Procrustean Data Torturing
Clues to Data Torturing
P Values and Confidence Intervals
Can Data Torturers Be Stopped?
References
Related Letters:
More on Torturing Data
Stryer D. B., Browner W., Newman T., Dix D., Schneiderman M. A., De Geeter F., Mills J. L.
Extract |
Full Text
N Engl J Med 1994;
330:861-862, Mar 24, 1994.
Correspondence
Guns and Homicide in the Home
Litaker D., Blackman P. H., Saint Louis UniversitySt. Louis, MO 63108 , LeClaire J. E., Saint Louis UniversitySt. Louis, MO 63108 , Gillette R. D., Saint Louis UniversitySt. Louis, MO 63108 , Baranello P., Saint Louis UniversitySt. Louis, MO 63108 , Beckmann C. R.B., Saint Louis UniversitySt. Louis, MO 63108 , Pipas J. M., Saint Louis UniversitySt. Louis, MO 63108 , Kellermann A. L., Somes G., Rivara F. P., Saint Louis UniversitySt. Louis, MO 63108 , Kassirer J. P., Saint Louis UniversitySt. Louis, MO 63108 Extract |
Full Text
N Engl J Med 1994;
330:365-368, Feb 3, 1994.
Correspondence
This article has been cited by other articles:
Kryscio, R. J.
(2008). Fampridine for MS responders: Clinically relevant or hypothesis generating?. Neurology
71: 1130-1131
[Full Text]
Sallmen, M, Neto, M, Mayan, O N
(2008). Reduced fertility among shoe manufacturing workers. Occup. Environ. Med.
65: 518-524
[Abstract][Full Text]
Moye, L. A
(2008). Disciplined analyses in clinical trials: the dark heart of the matter. Stat Methods Med Res
17: 253-264
[Abstract]
Lang, T.
(2007). Documenting Research in Scientific Articles: Guidelines for Authors: 2. Reporting Hypothesis Tests. Chest
131: 317-319
[Full Text]
Lang, T.
(2006). Documenting research in scientific articles: guidelines for authors: reporting research designs and activities.. Chest
130: 1263-1268
[Full Text]
Young, J., Graham, P., Blakely, T.
(2006). Modeling the Relation between Socioeconomic Status and Mortality in a Mixture of Majority and Minority Ethnic Groups. Am J Epidemiol
164: 282-291
[Abstract][Full Text]
Vardy, J., Tannock, I. F.
(2004). Quality of cancer care. Ann Oncol
15: 1001-1006
[Abstract][Full Text]
Chan, A.-W., Hrobjartsson, A., Haahr, M. T., Gotzsche, P. C., Altman, D. G.
(2004). Empirical Evidence for Selective Reporting of Outcomes in Randomized Trials: Comparison of Protocols to Published Articles. JAMA
291: 2457-2465
[Abstract][Full Text]
CROW, T.J.
(2003). Obstetric Complications and Schizophrenia. Am. J. Psychiatry
160: 1011-1012
[Full Text]
Blum, R. S.
(2002). Legal Considerations in Off-Label Medication Prescribing. Arch Intern Med
162: 1777-1779
[Full Text]
Rethman, M., Hujoel, P. P., Drangsholt, M. T., Spiekerman, C. F., DeRouen, T. A.
(2002). Pre-existing cardiovascular disease and periodontitis: a follow-up study.. J. Dent. Res.
81: 372-373
[Full Text]
Wu, C. L., Fleisher, L. A.
(2000). Outcomes Research in Regional Anesthesia and Analgesia. Anesth. Analg.
91: 1232-1242
[Full Text]
Li, F. P.
(1999). Cancer Control in Susceptible Groups: Opportunities and Challenges. JCO
17: 719-719
[Abstract][Full Text]
Stryer, D. B., Browner, W., Newman, T., Dix, D., Schneiderman, M. A., De Geeter, F., Mills, J. L.
(1994). More on Torturing Data. NEJM
330: 861-862
[Full Text]
Litaker, D., Blackman, P. H., Saint Louis UniversitySt. Louis, MO 63108, , LeClaire, J. E., Saint Louis UniversitySt. Louis, MO 63108, , Gillette, R. D., Saint Louis UniversitySt. Louis, MO 63108, , Baranello, P., Saint Louis UniversitySt. Louis, MO 63108, , Beckmann, C. R.B., Saint Louis UniversitySt. Louis, MO 63108, , Pipas, J. M., Saint Louis UniversitySt. Louis, MO 63108, , Kellermann, A. L., Somes, G., Rivara, F. P., Saint Louis UniversitySt. Louis, MO 63108, , Kassirer, J. P., Saint Louis UniversitySt. Louis, MO 63108,
(1994). Guns and Homicide in the Home. NEJM
330: 365-368
[Full Text]
Altman, D G
(1994). The scandal of poor medical research. BMJ
308: 283-284
[Full Text]