A new type of research, termed meta-analysis, attempts to analyze and combine the results of previous reports. We found 86 meta-analyses of reports of randomized controlled trials in the English-language literature. We evaluated the quality of these meta-analyses, using a scoring method that considered 23 items in six major areas--study design, combinability, control of bias, statistical analysis, sensitivity analysis, and application of results. Only 24 meta-analyses (28 percent) addressed all six areas, 31 (36 percent) addressed five, 25 (29 percent) addressed four, 5 (6 percent) addressed three, and 1 (1 percent) addressed two. Of the 23 individual items, between 1 and 14 were addressed satisfactorily (mean +/- SD, 7.7 +/- 2.7). We conclude that an urgent need exists for improved methods in literature searching, quality evaluation of trials, and synthesizing of the results.
This article has been cited by other articles:
O'Rourke, K.
(2007). An historical perspective on meta-analysis: dealing quantitatively with varying study results. JRSM
100: 579-582
[Full Text]
Bohannon, R. W
(2007). Number of Pedometer-Assessed Steps Taken Per Day by Adults: A Descriptive Meta-Analysis. ptjournal
87: 1642-1650
[Abstract][Full Text]
Sultana, A., Smith, C. T., Cunningham, D., Starling, N., Neoptolemos, J. P., Ghaneh, P.
(2007). Meta-Analyses of Chemotherapy for Locally Advanced and Metastatic Pancreatic Cancer. JCO
25: 2607-2615
[Abstract][Full Text]
Rathmell, J. P., Ballantyne, J. C.
(2005). Local Anesthetics for the Treatment of Neuropathic Pain: On the Limits of Meta-Analysis. Anesth. Analg.
101: 1736-1737
[Full Text]
Paracchini, V., Pedotti, P., Taioli, E.
(2005). Genetics of Leptin and Obesity: A HuGE Review. Am J Epidemiol
162: 101-114
[Abstract][Full Text]
Ioannidis, J P A
(2005). Large scale evidence and replication: insights from rheumatology and beyond. Ann Rheum Dis
64: 345-346
[Full Text]
Popat, S., Hubner, R., Houlston, R.S.
(2005). Systematic Review of Microsatellite Instability and Colorectal Cancer Prognosis. JCO
23: 609-618
[Abstract][Full Text]
Eng, J., Krishnan, J. A., Segal, J. B., Bolger, D. T., Tamariz, L. J., Streiff, M. B., Jenckes, M. W., Bass, E. B.
(2004). Accuracy of CT in the Diagnosis of Pulmonary Embolism: A Systematic Literature Review. Am. J. Roentgenol.
183: 1819-1827
[Abstract][Full Text]
Zhuo, X.-G., Melby, M. K., Watanabe, S.
(2004). Soy Isoflavone Intake Lowers Serum LDL Cholesterol: A Meta-Analysis of 8 Randomized Controlled Trials in Humans. J. Nutr.
134: 2395-2400
[Abstract][Full Text]
Babbs, C. F.
(2004). Meta-Analysis of 2-Treatment Clinical Trials Including Both Continuous and Dichotomous Results. Med Decis Making
24: 299-312
[Abstract]
Popat, S., Matakidou, A., Houlston, R. S.
(2004). Thymidylate Synthase Expression and Prognosis in Colorectal Cancer: A Systematic Review and Meta-Analysis. JCO
22: 529-536
[Abstract][Full Text]
Delgado-Bolton, R. C., Fernandez-Perez, C., Gonzalez-Mate, A., Carreras, J. L.
(2003). Meta-Analysis of the Performance of 18F-FDG PET in Primary Tumor Detection in Unknown Primary Tumors. JNM
44: 1301-1314
[Abstract][Full Text]
Matakidou, A., Eisen, T., Houlston, R.S.
(2003). TP53 polymorphisms and lung cancer risk: a systematic review and meta-analysis. Mutagenesis
18: 377-385
[Abstract][Full Text]
Bhandari, M., Morrow, F., Kulkarni, A. V., Tornetta, P. III
(2003). Meta-Analyses in Orthopaedic Surgery : A Systematic Review of Their Methodologies. JBJS
83: 15-15
[Abstract][Full Text]
Poynard, T., Munteanu, M., Ratziu, V., Benhamou, Y., Martino, V. D., Taieb, J., Opolon, P.
(2002). Truth Survival in Clinical Research: An Evidence-Based Requiem?. ANN INTERN MED
136: 888-895
[Abstract][Full Text]
Nichol, G, McAlister, F, Pham, B, Laupacis, A, Shea, B, Green, M, Tang, A, Wells, G
(2002). Meta-analysis of randomised controlled trials of the effectiveness of antiarrhythmic agents at promoting sinus rhythm in patients with atrial fibrillation. Heart
87: 535-543
[Abstract][Full Text]
Chalmers, I., Hedges, L. V., Cooper, H.
(2002). A Brief History of Research Synthesis. Eval Health Prof
25: 12-37
[Abstract]
Shea, B., Moher, D., Graham, I., Pham, B., Tugwell, P.
(2002). A Comparison of the Quality of Cochrane Reviews and Systematic Reviews Published in Paper-Based Journals. Eval Health Prof
25: 116-129
[Abstract]
Horvitz-Lennon, M., Normand, S.-L. T., Gaccione, P., Frank, R. G.
(2001). Partial Versus Full Hospitalization for Adults in Psychiatric Distress: A Systematic Review of the Published Literature (1957-1997). Am. J. Psychiatry
158: 676-685
[Abstract][Full Text]
Ross, S. D.
(2001). Drug-Related Adverse Events: A Readers' Guide to Assessing Literature Reviews and Meta-analyses. Arch Intern Med
161: 1041-1046
[Full Text]
Fouque, D., Wang, P., Laville, M., Boissel, J.-P.
(2000). Low protein diets delay end-stage renal disease in non-diabetic adults with chronic renal failure. Nephrol Dial Transplant
15: 1986-1992
[Abstract][Full Text]
Arrivé, L., Renard, R., Carrat, F., Belkacem, A., Dahan, H., Le Hir, P., Monnier-Cholley, L., Tubiana, J.-M.
(2000). A Scale of Methodological Quality for Clinical Studies of Radiologic Examinations. Radiology
217: 69-74
[Abstract][Full Text]
Spierings, E. L. H., Al-Shekhlee, A., Reed, R., Goadsby, P. J., Ferrari, M. D., Stovner, L. J., Senard, J. M., Jackson, N. C., Poole, P. H., Stat., C.
(2000). Eletriptan in acute migraine: A double-blind, placebo-controlled comparison to sumatriptan. Neurology
55: 735-742
[Full Text]
Glantz, M. J., Cole, B. F., Forsyth, P. A., Recht, L. D., Wen, P. Y., Chamberlain, M. C., Grossman, S. A., Cairncross, J. G.
(2000). Practice parameter: Anticonvulsant prophylaxis in patients with newly diagnosed brain tumors: Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology
54: 1886-1893
[Full Text]
Wood, M. A., Brown-Mahoney, C., Kay, G. N., Ellenbogen, K. A.
(2000). Clinical Outcomes After Ablation and Pacing Therapy for Atrial Fibrillation : A Meta-Analysis. Circulation
101: 1138-1144
[Abstract][Full Text]
Ferreira, I. M., Brooks, D., Lacasse, Y., Goldstein, R. S.
(2000). Nutritional Support for Individuals With COPD: A Meta-analysis. Chest
117: 672-678
[Abstract][Full Text]
Kelley, G. A., Kelley, K. S.
(2000). Progressive Resistance Exercise and Resting Blood Pressure : A Meta-Analysis of Randomized Controlled Trials. Hypertension
35: 838-843
[Abstract][Full Text]
Anderson, J. W, Allgood, L. D, Lawrence, A., Altringer, L. A, Jerdack, G. R, Hengehold, D. A, Morel, J. G
(2000). Cholesterol-lowering effects of psyllium intake adjunctive to diet therapy in men and women with hypercholesterolemia: meta-analysis of 8 controlled trials1. Am. J. Clin. Nutr.
71: 472-479
[Abstract][Full Text]
Ross, S. D., Allen, I. E., Connelly, J. E., Korenblat, B. M., Smith, M. E., Bishop, D., Luo, D.
(1999). Clinical Outcomes in Statin Treatment Trials: A Meta-analysis. Arch Intern Med
159: 1793-1802
[Abstract][Full Text]
Houlston, R. S.
(1999). Glutathione S-Transferase M1 Status and Lung Cancer Risk: A Meta-Analysis. Cancer Epidemiol. Biomarkers Prev.
8: 675-682
[Abstract][Full Text]
Luca, A., D'Amico, G., La Galla, R., Midiri, M., Morabito, A., Pagliaro, L.
(1999). TIPS for Prevention of Recurrent Bleeding in Patients with Cirrhosis: Meta-analysis of Randomized Clinical Trials. Radiology
212: 411-421
[Abstract][Full Text]
Wahlbeck, K., Cheine, M., Essali, A., Adams, C.
(1999). Evidence of Clozapine's Effectiveness in Schizophrenia: A Systematic Review and Meta-Analysis of Randomized Trials. Am. J. Psychiatry
156: 990-999
[Abstract][Full Text]
Cook, D., Giacomini, M.
(1999). The Trials and Tribulations of Clinical Practice Guidelines. JAMA
281: 1950-1951
[Full Text]
Hull, R. D., Brant, R. F., Pineo, G. F., Stein, P. D., Raskob, G. E., Valentine, K. A.
(1999). Preoperative vs Postoperative Initiation of Low-Molecular-Weight Heparin Prophylaxis Against Venous Thromboembolism in Patients Undergoing Elective Hip Replacement. Arch Intern Med
159: 137-141
[Abstract][Full Text]
Mandelblatt, J. S., Kanetsky, P., Eggert, L., Gold, K.
(1999). Is HIV Infection a Cofactor for Cervical Squamous Cell Neoplasia?. Cancer Epidemiol. Biomarkers Prev.
8: 97-106
[Abstract][Full Text]
VAN DER KUY, P-H M, LOHMAN;, J J H M, MEIJLER;, W. J, KLEIN;, K. B, GOADSBY, P J
(1999). A triptan too far?. J. Neurol. Neurosurg. Psychiatry
66: 121-121
[Full Text]
Stason, W. B., Schmid, C. H., Niedzwiecki, D., Whiting, G. W., Caubet, J.-F., Cory, D., Luo, D., Ross, S. D., Chalmers, T. C.
(1999). Safety of Nifedipine in Angina Pectoris : A Meta-Analysis. Hypertension
33: 24-31
[Abstract][Full Text]
Rembold, C. M
(1998). Number needed to screen: development of a statistic for disease screening. BMJ
317: 307-312
[Abstract][Full Text]
Jadad, A. R., Moher, D., Klassen, T. P.
(1998). Guides for Reading and Interpreting Systematic Reviews: II. How Did the Authors Find the Studies and Assess Their Quality?. Arch Pediatr Adolesc Med
152: 812-817
[Full Text]
Klassen, T. P., Jadad, A. R., Moher, D.
(1998). Guides for Reading and Interpreting Systematic Reviews: I. Getting Started. Arch Pediatr Adolesc Med
152: 700-704
[Full Text]
Barnes, D. E., Bero, L. A.
(1998). Why Review Articles on the Health Effects of Passive Smoking Reach Different Conclusions. JAMA
279: 1566-1570
[Abstract][Full Text]
Mahoney, C B.
(1998). Heparin-bonded circuits: clinical outcomes and costs. Perfusion
13: 192-204
[Abstract]
Olson, B. H., Anderson, S. M., Becker, M. P., Anderson, J. W., Hunninghake, D. B., Jenkins, D. J. A., LaRosa, J. C., Rippe, J. M., Roberts, D. C. K., Stoy, D. B., Summerbell, C. D., Truswell, A. S., Wolever, T. M. S., Morris, D. H., Fulgoni III, V. L.
(1997). Psyllium-Enriched Cereals Lower Blood Total Cholesterol and LDL Cholesterol, but Not HDL Cholesterol, in Hypercholesterolemic Adults: Results of a Meta-Analysis. J. Nutr.
127: 1973-1980
[Abstract][Full Text]
Flores, G., Horwitz, R. I.
(1997). Efficacy of beta 2-Agonists in Bronchiolitis: A Reappraisal and Meta-analysis. Pediatrics
100: 233-239
[Abstract][Full Text]
Stason, W. B., Schmid, C. H., Niedzwiecki, D., Whiting, G. W., Luo, D., Ross, S. D., Chalmers, T. C.
(1997). Safety of Nifedipine in Patients With Hypertension : A Meta-Analysis. Hypertension
30: 7-14
[Abstract][Full Text]
Stason, W. B., Schmid, C. H., Niedzwiecki, D., Whiting, G. W., Luo, D., Ross, S. D., Chalmers, T. C.
(1997). Safety of Nifedipine in Patients With Hypertension : A Meta-Analysis. Hypertension
30
: 7-14
[Abstract][Full Text]
ROWE, D. E., BERNSTEIN, S. M., RIDDICK, M. F., ADLER, F., EMANS, J. B., GARDNER-BONNEAU, D.
(1997). A Meta-Analysis of the Efficacy of Non-Operative Treatments for Idiopathic Scoliosis*{{dagger}}. JBJS
79: 664-74
[Abstract][Full Text]
Schmidt, F., Hunter, J. E.
(1995). The Impact of Data-Analysis Methods on Cumulative Research Knowledge: Statistical Significance Testing, Confidence Intervals, and Meta-Analysis. Eval Health Prof
18: 408-427
[Abstract]
Bausell, R. B., Li, Y.-F., Gau, M.-L., Soeken, K. L.
(1995). The Growth of Meta-Analytic Literature from 1980 to 1993. Eval Health Prof
18: 238-251
[Abstract]
Yeation, W. H., Langenbrunner, J. C., Smyth, J. M., Wortman, P. M.
(1995). Exploratory Research Synthesis: Methodological Considerations for Addressing Limitations in Data Quality. Eval Health Prof
18: 283-303
[Abstract]
Jackson, J. D.
(1995). Outcomes Research: Issues of Evidence, Timing and Application. Journal of Pharmacy Practice
8: 178-184
[Abstract]
Hazell, P, O'Connell, D, Heathcote, D, Robertson, J, Henry, D
(1995). Efficacy of tricyclic drugs in treating child and adolescent depression: a meta-analysis. BMJ
310: 897-901
[Abstract][Full Text]
Oxman, A D
(1994). Systematic Reviews: Checklists for review articles. BMJ
309: 648-651
[Full Text]
Midgette, A. S., Wong, J. B., Beshansky, J. R., Porath, A., Fleming, C., Pauker, S. G.
(1994). Cost - Effectiueness of Streptokinase for Acute Myocardial Infarction: A Combined Meta-analysis and Decision Analysis of the Effects of Infarct Location and of Likelihood of Infarction. Med Decis Making
14: 108-117
[Abstract]
(1994). Book Review : The Handbook of Research Synthesis. Edited by HARRIS COOPER and LARRY V. HEDGES. New York: Russell Sage Foundation, 1994. Cloth, 576 pp, $49.95. Med Decis Making
14: 204-205
Fleiss, J.
(1993). Review papers : The statistical basis of meta-analysis. Stat Methods Med Res
2: 121-145
[Abstract]
Sandoz, M O.
(1993). The logic and role of meta-analysis in clinical research. Stat Methods Med Res
2: 147-160
[Abstract]
Harvard, T. C., Lau, J.
(1993). Meta-analytic stimulus for changes in clinical trials. Stat Methods Med Res
2: 161-172
[Abstract]
Yeaton, W. H., Wortman, P. M.
(1993). On the Reliability of Meta-Analytic Reviews: The Role of Intercoder Agreement. Eval Rev
17: 292-309
[Abstract]
Wiswell, T. E., Hachey, W. E.
(1993). Urinary Tract Infections and the Uncircumcised State: An Update. CLIN PEDIATR
32: 130-134
[Abstract]
Tabak, E. R., Mullen, P. D., Simons-Morton, D. G., Green, L. W., Mains, D. A., Eilat-Greenberg, S., Frankowski, R. F., Glenday, M. C.
(1991). Definition and Yield of Inclusion Criteria for a Meta-Analysis of Patient Education Studies in Clinical Preventive Services. Eval Health Prof
14: 388-411
[Abstract]
Dawson, N. V., Cebul, R. D.
(1990). Advances in Quantitative Techniques for Making Medical Decisions: The Last Decade. Eval Health Prof
13: 37-62
[Abstract]
Cunningham, A. S.
(1989). Pig Roasts, Science and Babies: A Reply to Leventhal, Shapiro, and Bauchner. J Hum Lact
5: 128-130
Wortman, P. M., Vinokur, A., Sechrest, L.
(1988). Do Consensus Conferences Work? A Process Evaluation of the NIH Consensus Development Program. Journal of Health Politics, Policy and Law
13: 469-498
[Abstract]
Cunningham, A. S.
(1988). Studies of breastfeeding and infections. How good is the evidence? A critique of the answer from Yale. J Hum Lact
4: 54-56
Schaffarzick, R. W.
(1987). Health Care Technology and Quality of Care. American Journal of Medical Quality
2: 84-89
[Abstract]
Previous
