FREE NEJM E-TOC    HOME   |   SUBSCRIBE   |   CURRENT ISSUE   |   PAST ISSUES   |   COLLECTIONS   |   Search Term  Advanced Search

Sign in | Get NEJM's E-Mail Table of Contents — Free | Subscribe

Previous Volume 335:251-256 July 25, 1996 Number 4 Next

	Full Text PDF Letters Add to Personal Archive Add to Citation Manager Notify a Friend E-mail When Cited PubMed Citation

ABSTRACT

Background Reports on the comparative performance of physicians are becoming increasingly common. Little is known, however, about the credibility of these reports with target audiences or their influence on the delivery of medical services.

Methods Since 1992, Pennsylvania has published the Consumer Guide to Coronary Artery Bypass Graft Surgery, which lists annual risk-adjusted mortality rates for all hospitals and surgeons providing such surgery in the state. In 1995, we surveyed a randomly selected sample of 50 percent of Pennsylvania cardiologists and cardiac surgeons to find out whether they were aware of the guide and, if so, to determine their views on its usefulness, limitations, and influence on providers.

Results Eighty-two percent of the cardiologists and all the cardiac surgeons were aware of the guide. Only 10 percent of these respondents reported that its mortality rates were "very important" in assessing the performance of a cardiothoracic surgeon. Less than 10 percent reported discussing the guide with more than 10 percent of their patients who were candidates for a coronary-artery bypass graft (CABG). Eighty-seven percent of the cardiologists reported that the guide had a minimal influence or none on their referral recommendations. For both groups, the most important limitations of the guide were the absence of indicators of quality other than mortality (cited by 78 percent), inadequate risk adjustment (79 percent), and the unreliability of data provided by hospitals and surgeons (53 percent). Fifty-nine percent of the cardiologists reported increased difficulty in finding surgeons willing to perform CABG surgery in severely ill patients who required it, and 63 percent of the cardiac surgeons reported that they were less willing to operate on such patients.

Conclusions The Consumer Guide to Coronary Artery Bypass Graft Surgery has limited credibility among cardiovascular specialists. It has little influence on referral recommendations and may introduce a barrier to care for severely ill patients. If publicly released performance reports are intended to guide the choice of providers without impeding access to medical care, strengthening the collaborative process involving physicians may enhance the credibility and usefulness of the reports.

Source Information

From the Section on Health Services and Policy Research, Division of General Medicine, Brigham and Women's Hospital; the Department of Health Care Policy, Harvard Medical School; and the Department of Health Policy and Management, Harvard School of Public Health — all in Boston.

Address reprint requests to Dr. Epstein at the Department of Health Care Policy, Harvard Medical School, 25 Shattuck St., Parcel B, 1st Fl., Boston, MA 02115.

Full Text of this Article

Related Letters:

Cardiac-Surgery Performance Reports
Krieger L. M., Sessa E. J., Schneider E., Epstein A.
Extract | Full Text  
N Engl J Med 1997; 336:442-443, Feb 6, 1997. Correspondence

This article has been cited by other articles:

• Grant, S W, Grayson, A D, Jackson, M, Au, J, Fabri, B M, Grotte, G, Jones, M, Bridgewater, B (2008). Does the choice of risk-adjustment model influence the outcome of surgeon-specific mortality analysis? A retrospective analysis of 14 637 patients under 31 surgeons. Heart 94: 1044-1049 [Abstract] [Full Text]  
• Hollenbeak, C. S., Gorton, C. P., Tabak, Y. P., Jones, J. L., Milstein, A., Johannes, R. S. (2008). Reductions in Mortality Associated With Intensive Public Reporting of Hospital Outcomes. American Journal of Medical Quality 23: 279-286 [Abstract]  
• Bridgewater, B, Keogh, B (2008). Surgical "league tables": Ischaemic heart disease. Heart 94: 936-942 [Full Text]  
• Segev, D. L., Simpkins, C. E., Thompson, R. E., Locke, J. E., Warren, D. S., Montgomery, R. A. (2008). Obesity Impacts Access to Kidney Transplantation. J. Am. Soc. Nephrol. 19: 349-355 [Abstract] [Full Text]  
• Fung, C. H., Lim, Y.-W., Mattke, S., Damberg, C., Shekelle, P. G. (2008). Systematic Review: The Evidence That Publishing Patient Care Performance Data Improves Quality of Care. ANN INTERN MED 148: 111-123 [Abstract] [Full Text]  
• Simunovic, M., Baxter, N. N. (2007). Lymph Node Counts in Colon Cancer Surgery: Lessons for Users of Quality Indicators. JAMA 298: 2194-2195 [Full Text]  
• Westaby, S., Archer, N., Manning, N., Adwani, S., Grebenik, C., Ormerod, O., Pillai, R., Wilson, N. (2007). Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality. BMJ 335: 759-759 [Abstract] [Full Text]  
• Bridgewater, B., Grayson, A. D, Brooks, N., Grotte, G., Fabri, B. M, Au, J., Hooper, T., Jones, M., Keogh, B., on behalf of the North West Quality Improvement Pr, (2007). Has the publication of cardiac surgery outcome data been associated with changes in practice in northwest England: an analysis of 25 730 patients undergoing CABG surgery under 30 surgeons over eight years. Heart 93: 744-748 [Abstract] [Full Text]  
• Shahian, D. M., Edwards, F. H., Ferraris, V. A., Haan, C. K., Rich, J. B., Normand, S.-L. T., DeLong, E. R., O'Brien, S. M., Shewan, C. M., Dokholyan, R. S., Peterson, E. D. (2007). Quality Measurement in Adult Cardiac Surgery: Part 1--Conceptual Framework and Measure Selection. Ann. Thorac. Surg. 83: S3-S12 [Full Text]  
• Casalino, L. P., Alexander, G. C., Jin, L., Konetzka, R. T. (2007). General Internists' Views On Pay-For-Performance And Public Reporting Of Quality Scores: A National Survey. Health Aff (Millwood) 26: 492-499 [Abstract] [Full Text]  
• Pine, M., Jordan, H. S., Elixhauser, A., Fry, D. E., Hoaglin, D. C., Jones, B., Meimban, R., Warner, D., Gonzales, J. (2007). Enhancement of Claims Data to Improve Risk Adjustment of Hospital Mortality. JAMA 297: 71-76 [Abstract] [Full Text]  
• Epstein, A. J. (2006). Do cardiac surgery report cards reduce mortality? Assessing the evidence.. Med Care Res Rev 63: 403-426 [Abstract]  
• Stevenson, D. G. (2006). Is a public reporting approach appropriate for nursing home care?. Journal of Health Politics, Policy and Law 31: 773-810 [Abstract]  
• Jha, A. K., Epstein, A. M. (2006). The predictive accuracy of the new york state coronary artery bypass surgery report-card system.. Health Aff (Millwood) 25: 844-855 [Abstract] [Full Text]  
• Kesselheim, A. S., Ferris, T. G., Studdert, D. M. (2006). Will physician-level measures of clinical performance be used in medical malpractice litigation?. JAMA 295: 1831-1834 [Full Text]  
• Stensland, J., Winter, A. (2006). Do Physician-Owned Cardiac Hospitals Increase Utilization?. Health Aff (Millwood) 25: 119-129 [Abstract] [Full Text]  
• Guru, V., Anderson, G. M., Fremes, S. E., O'Connor, G. T., Grover, F. L., Tu, J. V., Canadian CABG Surgery Quality Indicator Consensus, (2005). The identification and development of Canadian coronary artery bypass graft surgery quality indicators. J. Thorac. Cardiovasc. Surg. 130: 1257-1257 [Abstract] [Full Text]  
• Schwartz, L. M, Woloshin, S., Birkmeyer, J. D (2005). How do elderly patients decide where to go for major surgery? Telephone interview survey. BMJ 331: 821- [Abstract] [Full Text]  
• Wolff, J. L., Boult, C. (2005). Moving beyond Round Pegs and Square Holes: Restructuring Medicare To Improve Chronic Care. ANN INTERN MED 143: 439-445 [Abstract] [Full Text]  
• Williams, S. C., Schmaltz, S. P., Morton, D. J., Koss, R. G., Loeb, J. M. (2005). Quality of Care in U.S. Hospitals as Reflected by Standardized Measures, 2002-2004. NEJM 353: 255-264 [Abstract] [Full Text]  
• Hilton, C. J., Hamilton, J.R. L., Vitale, N., Haaverstad, R. (2005). Effects of 'Bristol' on surgical practice in the United Kingdom. ICVTS 4: 197-199 [Abstract] [Full Text]  
• Thompson, A M, Stonebridge, P A (2005). Building a framework for trust: critical event analysis of deaths in surgical care. BMJ 330: 1139-1142 [Full Text]  
• Ito, H, Sugawara, H (2005). Relationship between accreditation scores and the public disclosure of accreditation reports: a cross sectional study. Qual Saf Health Care 14: 87-92 [Abstract] [Full Text]  
• Werner, R. M., Asch, D. A., Polsky, D. (2005). Racial Profiling: The Unintended Consequences of Coronary Artery Bypass Graft Report Cards. Circulation 111: 1257-1263 [Abstract] [Full Text]  
• Werner, R. M., Asch, D. A. (2005). The Unintended Consequences of Publicly Reporting Quality Information. JAMA 293: 1239-1244 [Abstract] [Full Text]  
• Narins, C. R., Dozier, A. M., Ling, F. S., Zareba, W. (2005). The Influence of Public Reporting of Outcome Data on Medical Decision Making by Physicians. Arch Intern Med 165: 83-87 [Abstract] [Full Text]  
• Saver, B. G. (2004). Commentary on "Opportunities and Challenges for Measuring Cost, Quality, and Clinical Effectiveness in Health Care": The Fault Lies Not in our Stars but in Our System. Med Care Res Rev 61: 151S-160S  
• Keogh, B., Spiegelhalter, D., Bailey, A., Roxburgh, J., Magee, P., Hilton, C. (2004). The legacy of Bristol: public disclosure of individual surgeons' results. BMJ 329: 450-454 [Full Text]  
• Daly, J. M. (2004). Society of Surgical Oncology Presidential Address: Volume, Outcome, and Surgical Specialization. Ann. Surg. Oncol. 11: 107-114 [Full Text]  
• McKee, M. (2004). Not everything that counts can be counted; not everything that can be counted counts. BMJ 328: 153-153 [Full Text]  
• Shahian, D. M. (2004). Improving Cardiac Surgery Quality--Volume, Outcome, Process?. JAMA 291: 246-248 [Full Text]  
• Liu, J. H., Etzioni, D. A., O'Connell, J. B., Maggard, M. A., Hiyama, D. T., Ko, C. Y. (2003). Inpatient Surgery in California: 1990-2000. Arch Surg 138: 1106-1112 [Abstract] [Full Text]  
• Castle, N. G. (2003). Providing Outcomes Information to Nursing Homes: Can It Improve Quality of Care?. Gerontologist 43: 483-492 [Abstract] [Full Text]  
• Sheeran, T. (2003). A Survey of Psychiatric Outpatients on Quality of Care. Psychiatr. Serv. 54: 1031-1033 [Abstract] [Full Text]  
• Marshall, M. N., Shekelle, P. G., Davies, H. T.O., Smith, P. C. (2003). Public Reporting On Quality In The United States And The United Kingdom. Health Aff (Millwood) 22: 134-148 [Abstract] [Full Text]  
• Jacobson, B., Mindell, J., McKee, M. (2003). Hospital mortality league tables. BMJ 326: 777-778 [Full Text]  
• Mor, V., Berg, K., Angelelli, J., Gifford, D., Morris, J., Moore, T. (2003). The Quality of Quality Measurement in U.S. Nursing Homes. Gerontologist 43: 37-46 [Abstract] [Full Text]  
• TU, J. V., CAMERON, C. (2003). Impact of an acute myocardial infarction report card in Ontario, Canada. Int J Qual Health Care 15: 131-137 [Abstract] [Full Text]  
• Newhouse, J. P. (2002). Why Is There A Quality Chasm?. Health Aff (Millwood) 21: 13-25 [Abstract] [Full Text]  
• Rider, E. A., Perrin, J. M. (2002). Performance Profiles: The Influence of Patient Satisfaction Data on Physicians' Practice. Pediatrics 109: 752-757 [Abstract] [Full Text]  
• Pace, N. (2002). Surgeons should beware of plans to print individual performance. BMJ 324: 979-979 [Full Text]  
• Naylor, C. D. (2002). Public Profiling of Clinical Performance. JAMA 287: 1323-1325 [Full Text]  
• Adab, P., Rouse, A. M, Mohammed, M. A, Marshall, T. (2002). Performance league tables: the NHS deserves better. BMJ 324: 95-98 [Full Text]  
• Shahian, D. M., Normand, S.-L., Torchiana, D. F., Lewis, S. M., Pastore, J. O., Kuntz, R. E., Dreyer, P. I. (2001). Cardiac surgery report cards: comprehensive review and statistical critique. Ann. Thorac. Surg. 72: 2155-2168 [Abstract] [Full Text]  
• Scanlon, D. P., Chernew, M., Doty, H. E., Smith, D. G. (2001). Options for Assessing PPO Quality: Accreditation and Profiling as Accountability Strategies. Med Care Res Rev 58: 70-100 [Abstract]  
• Schneider, E C, Lieberman, T (2001). Publicly disclosed information about the quality of health care: response of the US public. Qual Saf Health Care 10: 96-103 [Abstract] [Full Text]  
• Davies, H T O (2001). Public release of performance data and quality improvement: internal responses to external data by US health care providers. Qual Saf Health Care 10: 104-110 [Abstract] [Full Text]  
• Ayanian, J. Z., Quinn, T. J. (2001). Quality Of Care For Coronary Heart Disease In Two Countries. Health Aff (Millwood) 20: 55-67 [Abstract] [Full Text]  
• Harlan, B. J. (2001). Statewide reporting of coronary artery surgery results: A view from California. J. Thorac. Cardiovasc. Surg. 121: 409-417 [Full Text]  
• Weil, T. P. (2001). Commentary: Public Disclosure in the Health Field: Is There a Relevant Option?. American Journal of Medical Quality 16: 23-33 [Abstract]  
• Peterson, E. D., DeLong, E. R., Muhlbaier, L. H., Rosen, A. B., Buell, H. E., Kiefe, C. I., Kresowik, T. F. (2000). Challenges in comparing risk-adjusted bypass surgery mortality results: Results from the Cooperative Cardiovascular Project. J Am Coll Cardiol 36: 2174-2184 [Abstract] [Full Text]  
• Shahian, D. M., Yip, W., Westcott, G., Jacobson, J. (2000). Selection of a cardiac surgery provider in the managed care era. J. Thorac. Cardiovasc. Surg. 120: 978-989 [Abstract] [Full Text]  
• Friedenberg, R. M. (2000). Managed Care and Social Justice. Radiology 217: 11-13 [Full Text]  
• Jencks, S. F. (2000). Clinical Performance Measurement--A Hard Sell. JAMA 283: 2015-2016 [Full Text]  
• Marshall, M. N., Shekelle, P. G., Leatherman, S., Brook, R. H. (2000). The Public Release of Performance Data: What Do We Expect to Gain? A Review of the Evidence. JAMA 283: 1866-1874 [Abstract] [Full Text]  
• Epstein, A. M. (2000). Public Release of Performance Data: A Progress Report From the Front. JAMA 283: 1884-1886 [Full Text]  
• Marshall, M. N, Shekelle, P. G, Leatherman, S., Brook, R. H (2000). Public disclosure of performance data: learning from the US experience. Qual Saf Health Care 9: 53-57 [Full Text]  
• Eagle, K. A., Guyton, R. A., Davidoff, R., Ewy, G. A., Fonger, J., Gardner, T. J., Gott, J. P., Herrmann, H. C., Marlow, R. A., Nugent, W. C., O'Connor, G. T., Orszulak, T. A., Rieselbach, R. E., Winters, W. L., Yusuf, S., Gibbons, R. J., Alpert, J. S., Eagle, K. A., Gardner, T. J., Garson, A. Jr., Gregoratos, G., Russell, R. O., Smith, S. C. Jr. (1999). ACC/AHA guidelines for coronary artery bypass graft surgery: A report of the American College of Cardiology/ American Heart Association task force on Practice Guidelines (Committee to revise the 1991 Guidelines for Coronary Artery Bypass Graft Surgery). J Am Coll Cardiol 34: 1262-1347 [Full Text]  
• Cohn, L. H. (1999). WHAT THE CARDIOTHORACIC SURGEON OF THE TWENTY-FIRST CENTURY OUGHT TO BE. J. Thorac. Cardiovasc. Surg. 118: 581-587 [Full Text]  
• Burack, J. H., Impellizzeri, P., Homel, P., Cunningham, J. N. Jr (1999). Public reporting of surgical mortality: a survey of New York State cardiothoracic surgeons. Ann. Thorac. Surg. 68: 1195-1200 [Abstract] [Full Text]  
• Thomas, J. W., Hofer, T. P. (1998). Research Evidence on the Validity of Risk-Adjusted Mortality Rate as a Measure of Hospital Quality of Care. Med Care Res Rev 55: 371-404 [Abstract]  
• McColl, A., Roderick, P., Gabbay, J., Smith, H., Moore, M. (1998). Performance indicators for primary care groups: an evidence based approach. BMJ 317: 1354-1360 [Full Text]  
• Mozes, B., Olmer, L., Galai, N., Simchen, E. (1998). A national study of postoperative mortality associated with coronary artery bypass grafting in Israel. Ann. Thorac. Surg. 66: 1254-1262 [Abstract] [Full Text]  
• Rosenthal, G. E., Chren, M.-M., Lasek, R. J., Landefeld, C. S. (1998). What Patients Should Ask of Consumers' Guides to Health Care Quality. Eval Health Prof 21: 316-331 [Abstract]  
• Marshall, E C., Spiegelhalter, D. J, Sanderson, C., McKee, M. (1998). Reliability of league tables of in vitro fertilisation clinics: retrospective analysis of live birth rates • Commentary: How robust are rankings? The implications of confidence intervals. BMJ 316: 1701-1705 [Abstract] [Full Text]  
• Epstein, A. M. (1998). Rolling Down the Runway: The Challenges Ahead for Quality Report Cards. JAMA 279: 1691-1696 [Abstract] [Full Text]  
• Schneider, E. C., Epstein, A. M. (1998). Use of Public Performance Reports: A Survey of Patients Undergoing Cardiac Surgery. JAMA 279: 1638-1642 [Abstract] [Full Text]  
• Krieger, L. M., Sessa, E. J., Schneider, E., Epstein, A. (1997). Cardiac-Surgery Performance Reports. NEJM 336: 442-443 [Full Text]  
• Blumenthal, D., Epstein, A. M. (1996). The Role of Physicians in the Future of Quality Management- Part Six of Six. NEJM 335: 1328-1332 [Full Text]  
• (1996). PHYSICIANS' VIEWS ON PERFORMANCE ""REPORT CARDS"". JWatch General 1996: 3-3 [Full Text]