FREE NEJM E-TOC    HOME   |   SUBSCRIBE   |   CURRENT ISSUE   |   PAST ISSUES   |   COLLECTIONS   |   Search Term  Advanced Search

Sign in | Get NEJM's E-Mail Table of Contents — Free | Subscribe

Previous Volume 356:486-496 February 1, 2007 Number 5 Next

	Full Text PDF PDA Full Text PowerPoint Slide Set Supplementary Material Editorial by Epstein, A. M. Add to Personal Archive Add to Citation Manager Notify a Friend E-mail When Cited E-mail When Letters Appear PubMed Citation

ABSTRACT

Background Public reporting and pay for performance are intended to accelerate improvements in hospital care, yet little is known about the benefits of these methods of providing incentives for improving care.

Methods We measured changes in adherence to 10 individual and 4 composite measures of quality over a period of 2 years at 613 hospitals that voluntarily reported information about the quality of care through a national public-reporting initiative, including 207 facilities that simultaneously participated in a pay-for-performance demonstration project funded by the Centers for Medicare and Medicaid Services; we then compared the pay-for-performance hospitals with the 406 hospitals with public reporting only (control hospitals). We used multivariable modeling to estimate the improvement attributable to financial incentives after adjusting for baseline performance and other hospital characteristics.

Results As compared with the control group, pay-for-performance hospitals showed greater improvement in all composite measures of quality, including measures of care for heart failure, acute myocardial infarction, and pneumonia and a composite of 10 measures. Baseline performance was inversely associated with improvement; in pay-for-performance hospitals, the improvement in the composite of all 10 measures was 16.1% for hospitals in the lowest quintile of baseline performance and 1.9% for those in the highest quintile (P<0.001). After adjustments were made for differences in baseline performance and other hospital characteristics, pay for performance was associated with improvements ranging from 2.6 to 4.1% over the 2-year period.

Conclusions Hospitals engaged in both public reporting and pay for performance achieved modestly greater improvements in quality than did hospitals engaged only in public reporting. Additional research is required to determine whether different incentives would stimulate more improvement and whether the benefits of these programs outweigh their costs.

Source Information

From the Division of Healthcare Quality, Baystate Medical Center, Springfield, MA (P.K.L., M.B.R., E.M.B.); the Department of Medicine, Tufts University School of Medicine, Boston (P.K.L., M.B.R., E.M.B.); Premier Healthcare Informatics, Premier, Charlotte, NC (D.R.); the Centers for Medicare and Medicaid Services, Baltimore (S.R.); and the Oklahoma Foundation for Medical Quality, Oklahoma City (A.M., D.W.B.).

Address reprint requests to Dr. Lindenauer at the Division of Healthcare Quality, Baystate Medical Center, 759 Chestnut St., P-5931, Springfield, MA 01199, or at peter.lindenauer{at}bhs.org.

Full Text of this Article

This article has been cited by other articles:

• LINDENAUER, P. (2009). Public reporting and pay-for-performance programs in perioperative medicine: Are they meeting their goals?. Cleveland Clinic Journal of Medicine 76: S3-S8 [Abstract] [Full Text]  
• Tanenbaum, S. J. (2009). Pay for Performance in Medicare: Evidentiary Irony and the Politics of Value. Journal of Health Politics, Policy and Law 34: 717-746 [Abstract]  
• McDonald, R., White, J., Marmor, T. R. (2009). Paying for Performance in Primary Medical Care: Learning about and Learning from "Success" and "Failure" in England and California. Journal of Health Politics, Policy and Law 34: 747-776 [Abstract]  
• Bartick, M., Stuebe, A., Shealy, K. R., Walker, M., Grummer-Strawn, L. M. (2009). Closing the Quality Gap: Promoting Evidence-Based Breastfeeding Care in the Hospital. Pediatrics 124: e793-e802 [Abstract] [Full Text]  
• Sandora, T. J., Desai, R., Miko, B. A., Harper, M. B. (2009). Assessing Quality Indicators for Pediatric Community-Acquired Pneumonia. American Journal of Medical Quality 24: 419-427 [Abstract]  
• Campbell, S. M., Reeves, D., Kontopantelis, E., Sibbald, B., Roland, M. (2009). Effects of Pay for Performance on the Quality of Primary Care in England. NEJM 361: 368-378 [Abstract] [Full Text]  
• Lee, T. H., Ferris, T. G. (2009). Pay for Performance: A Work in Progress. Circulation 119: 2965-2966 [Full Text]  
• Auerbach, A. D., Hilton, J. F., Maselli, J., Pekow, P. S., Rothberg, M. B., Lindenauer, P. K. (2009). Shop for Quality or Volume? Volume, Quality, and Outcomes of Coronary Artery Bypass Surgery. ANN INTERN MED 150: 696-704 [Abstract] [Full Text]  
• McCahill, L. E., Privette, A., James, T., Sheehey-Jones, J., Ratliff, J., Majercik, D., Krag, D. N., Stanley, M., Harlow, S. (2009). Quality Measures for Breast Cancer Surgery: Initial Validation of Feasibility and Assessment of Variation Among Surgeons. Arch Surg 144: 455-462 [Abstract] [Full Text]  
• Hlatky, M. A., Heidenreich, P. A. (2009). The Year in Epidemiology, Health Services Research, and Outcomes Research. J Am Coll Cardiol 53: 1459-1466 [Full Text]  
• Ting, H. H., Shojania, K. G., Montori, V. M., Bradley, E. H. (2009). Quality Improvement: Science and Action. Circulation 119: 1962-1974 [Full Text]  
• Coiera, E, Braithwaite, J (2009). Market-based control mechanisms for patient safety. Qual Saf Health Care 18: 99-103 [Abstract] [Full Text]  
• Needham, D. M., Sinopoli, D. J., Dinglas, V. D., Berenholtz, S. M., Korupolu, R., Watson, S. R., Lubomski, L., Goeschel, C., Pronovost, P. J. (2009). Improving data quality control in quality improvement projects. Int J Qual Health Care 21: 145-150 [Abstract] [Full Text]  
• Brush, J. E. Jr, Rensing, E., Song, F., Cook, S., Lynch, J., Thacker, L., Gurram, S., Bonow, R. O., Brough, J., Valentine, C. M. (2009). A Statewide Collaborative Initiative to Improve the Quality of Care for Patients With Acute Myocardial Infarction and Heart Failure. Circulation 119: 1609-1615 [Abstract] [Full Text]  
• Bhattacharyya, T., Freiberg, A. A., Mehta, P., Katz, J. N., Ferris, T. (2009). Measuring The Report Card: The Validity Of Pay-For-Performance Metrics In Orthopedic Surgery. Health Aff (Millwood) 28: 526-532 [Abstract] [Full Text]  
• Gupta, R. S., Weiss, K. B. (2009). The 2007 National Asthma Education and Prevention Program Asthma Guidelines: Accelerating Their Implementation and Facilitating Their Impact on Children With Asthma. Pediatrics 123: S193-S198 [Abstract] [Full Text]  
• Pronovost, P. J., Goeschel, C. A., Marsteller, J. A., Sexton, J. B., Pham, J. C., Berenholtz, S. M. (2009). Framework for Patient Safety Research and Improvement. Circulation 119: 330-337 [Full Text]  
• Mehrotra, A., Damberg, C. L., Sorbero, M. E. S., Teleki, S. S. (2009). Pay for Performance in the Hospital Setting: What Is the State of the Evidence?. American Journal of Medical Quality 24: 19-28 [Abstract]  
• Davis, K., Schoen, C., Shea, K., Haran, C. (2008). Aiming High for the U.S. Health System: A Context for Health Reform.. J Law Med Ethics 36: 629-643  
• Christianson, J. B., Leatherman, S., Sutherland, K. (2008). Lessons From Evaluations of Purchaser Pay-for-Performance Programs: A Review of the Evidence. Med Care Res Rev 65: 5S-35S [Abstract]  
• Walker, A S., Spiegelhalter, D., Crook, D. W, Wyllie, D., Morris, J., Peto, T. E A (2008). Fairness of financial penalties to improve control of Clostridium difficile. BMJ 337: a2097-a2097 [Full Text]  
• Murphy, K. M., Nash, D. B. (2008). Nonprimary Care Physicians' Views on Office-Based Quality Incentive and Improvement Programs. American Journal of Medical Quality 23: 427-439 [Abstract]  
• Hamblin, R. (2008). Regulation, measurements and incentives. The experience in the US and UK: does context matter?. The Journal of the Royal Society for the Promotion of Health 128: 291-298 [Abstract]  
• Weston, C. F M (2008). Performance indicators in acute myocardial infarction: a proposal for the future assessment of good quality care. Heart 94: 1397-1401 [Full Text]  
• Tu, J. V. MD PhD, Khalid, L. MD, Donovan, L. R. BScN MBA, Ko, D. T. MD MSc, for the Canadian Cardiovascular Outcomes Research, (2008). Indicators of quality of care for patients with acute myocardial infarction. CMAJ 179: 909-915 [Abstract] [Full Text]  
• An, L. C., Bluhm, J. H., Foldes, S. S., Alesci, N. L., Klatt, C. M., Center, B. A., Nersesian, W. S., Larson, M. E., Ahluwalia, J. S., Manley, M. W. (2008). A Randomized Trial of a Pay-for-Performance Program Targeting Clinician Referral to a State Tobacco Quitline. Arch Intern Med 168: 1993-1999 [Abstract] [Full Text]  
• Lewis, W. R., Peterson, E. D., Cannon, C. P., Super, D. M., LaBresh, K. A., Quealy, K., Liang, L., Fonarow, G. C. (2008). An Organized Approach to Improvement in Guideline Adherence for Acute Myocardial Infarction: Results With the Get With The Guidelines Quality Improvement Program. Arch Intern Med 168: 1813-1819 [Abstract] [Full Text]  
• Kurtzman, E. T., Dawson, E. M., Johnson, J. E. (2008). The Current State of Nursing Performance Measurement, Public Reporting, and Value-Based Purchasing. Policy Politics Nursing Practice 9: 181-191 [Abstract]  
• Shojania, K. G. MD, Forster, A. J. MD MSc (2008). Hospital mortality: when failure is not a good measure of success. CMAJ 179: 153-157 [Full Text]  
• Duckett, S., Daniels, S., Kamp, M., Stockwell, A., Walker, G., Ward, M. (2008). Pay for performance in Australia: Queensland's new Clinical Practice Improvement Payment. J Health Serv Res Policy 13: 174-177 [Abstract] [Full Text]  
• Wachter, R. M., Flanders, S. A., Fee, C., Pronovost, P. J. (2008). Public Reporting of Antibiotic Timing in Patients with Pneumonia: Lessons from a Flawed Performance Measure. ANN INTERN MED 149: 29-32 [Abstract] [Full Text]  
• Bhattacharyya, T., Mehta, P., Freiberg, A. A. (2008). Hospital Characteristics Associated with Success in a Pay-for-Performance Program in Orthopaedic Surgery. JBJS 90: 1240-1243 [Abstract] [Full Text]  
• Werner, R. M., Goldman, L. E., Dudley, R. A. (2008). Comparison of Change in Quality of Care Between Safety-Net and Non-Safety-Net Hospitals. JAMA 299: 2180-2187 [Abstract] [Full Text]  
• Ross, J. S., Keyhani, S., Keenan, P. S., Bernheim, S. M., Penrod, J. D., Boockvar, K. S., Federman, A. D., Krumholz, H. M., Siu, A. L. (2008). Use of Recommended Ambulatory Care Services: Is the Veterans Affairs Quality Gap Narrowing?. Arch Intern Med 168: 950-958 [Abstract] [Full Text]  
• Clarke, S. P., Raphael, C., Disch, J. (2008). Challenges and Directions for Nursing in the Pay-for-Performance Movement. Policy Politics Nursing Practice 9: 127-134 [Abstract]  
• Bever, C. T., Holloway, R. G., Iverson, D. J., Dubinsky, R. M., Richardson, R. M., Sheffield, J. K., Wang, D. Z., Franklin, G. M., Miyasaki, J. M., Tonn, S. T., Stevens, J. C. (2008). Invited Article: Neurology and quality improvement: An introduction. Neurology 70: 1636-1640 [Full Text]  
• Pronovost, P. J., Berenholtz, S. M., Goeschel, C. A. (2008). Improving the Quality of Measurement and Evaluation in Quality Improvement Efforts. American Journal of Medical Quality 23: 143-146  
• Shorr, A. F., Wunderink, R. G. (2008). There Is No "Cap" on the Importance of Community-Acquired Pneumonia in the ICU. Chest 133: 590-592 [Full Text]  
• Welker, J. A., Huston, M., McCue, J. D. (2008). Antibiotic Timing and Errors in Diagnosing Pneumonia. Arch Intern Med 168: 351-356 [Abstract] [Full Text]  
• Schneeweiss, S., Seeger, J. D., Landon, J., Walker, A. M. (2008). Aprotinin during Coronary-Artery Bypass Grafting and Risk of Death. NEJM 358: 771-783 [Abstract] [Full Text]  
• Locke, R. G., Srinivasan, M. (2008). Attitudes Toward Pay-for-Performance Initiatives Among Primary Care Osteopathic Physicians in Small Group Practices. JAOA: Journal of the American Osteopathic Association 108: 21-24 [Abstract] [Full Text]  
• Miller, E. A., Mor, V. (2008). Balancing Regulatory Controls and Incentives: Toward Smarter and More Transparent Oversight in Long-Term Care. Journal of Health Politics, Policy and Law 33: 249-279 [Abstract]  
• Tosi, L. L., Gliklich, R., Kannan, K., Koval, K. J. (2008). The American Orthopaedic Association's "Own the Bone" Initiative to Prevent Secondary Fractures. JBJS 90: 163-173 [Abstract] [Full Text]  
• Glickman, S. W., Baggett, K. A., Krubert, C. G., Peterson, E. D., Schulman, K. A. (2007). Promoting quality: the health-care organization from a management perspective. Int J Qual Health Care 19: 341-348 [Abstract] [Full Text]  
• Langfitt, J. T. (2007). Do we know quality epilepsy care when we see it?. Neurology 69: 1968-1969 [Full Text]  
• Pronovost, P. J., Berenholtz, S. M., Needham, D. M. (2007). A Framework for Health Care Organizations to Develop and Evaluate a Safety Scorecard. JAMA 298: 2063-2065 [Full Text]  
• Rosenthal, M. B., Landon, B. E., Howitt, K., Song, H. R., Epstein, A. M. (2007). Climbing Up The Pay-For-Performance Learning Curve: Where Are The Early Adopters Now?. Health Aff (Millwood) 26: 1674-1682 [Abstract] [Full Text]  
• Pronovost, P. J., Miller, M., Wachter, R. M. (2007). The GAAP in Quality Measurement and Reporting. JAMA 298: 1800-1802 [Full Text]  
• Chien, A. T., Chin, M. H., Davis, A. M., Casalino, L. P. (2007). Pay for Performance, Public Reporting, and Racial Disparities in Health Care: How Are Programs Being Designed?. Med Care Res Rev 64: 283S-304S [Abstract]  
• Lilford, R. J, Brown, C. A, Nicholl, J. (2007). Use of process measures to monitor the quality of clinical practice. BMJ 335: 648-650 [Full Text]  
• Lee, T. H. (2007). Eulogy for a Quality Measure. NEJM 357: 1175-1177 [Full Text]  
• Leonardi, M. J., McGory, M. L., Ko, C. Y. (2007). Publicly Available Hospital Comparison Web Sites: Determination of Useful, Valid, and Appropriate Information for Comparing Surgical Quality. Arch Surg 142: 863-869 [Abstract] [Full Text]  
• Desai, A. A., Garber, A. M., Chertow, G. M. (2007). Rise of Pay for Performance: Implications for Care of People with Chronic Kidney Disease. CJASN 2: 1087-1095 [Abstract] [Full Text]  
• O'Brien, S. M., Peterson, E. D. (2007). Identifying High-Quality Hospitals: Consult the Ratings or Flip a Coin?. Arch Intern Med 167: 1342-1344 [Full Text]  
• Chien, A. T., Dudley, R. A. (2007). Pay-for-Performance in Pediatrics: Proceed With Caution. Pediatrics 120: 186-188 [Full Text]  
• Himmelfarb, J., Berns, A., Szczech, L., Wesson, D. (2007). Cost, Quality, and Value: The Changing Political Economy of Dialysis Care. J. Am. Soc. Nephrol. 18: 2021-2027 [Full Text]  
• Glickman, S. W., Ou, F.-S., DeLong, E. R., Roe, M. T., Lytle, B. L., Mulgund, J., Rumsfeld, J. S., Gibler, W. B., Ohman, E. M., Schulman, K. A., Peterson, E. D. (2007). Pay for Performance, Quality of Care, and Outcomes in Acute Myocardial Infarction. JAMA 297: 2373-2380 [Abstract] [Full Text]  
• Bell, C. M., Levinson, W. (2007). Pay for performance: learning about quality. CMAJ 176: 1717-1719 [Full Text]  
• Morris, P. E. (2007). Critical Care Professionalism in the Age of Pay-for-Performance: From ICUs to Outpatient Critical Care Clinics. Am J Crit Care 16: 200-203 [Full Text]  
• Casalino, L. P., Elster, A., Eisenberg, A., Lewis, E., Montgomery, J., Ramos, D. (2007). Will Pay-For-Performance And Quality Reporting Affect Health Care Disparities?. Health Aff (Millwood) 26: w405-w414 [Abstract] [Full Text]  
• Mullen, K. J., Bradley, E. H., Mansi, I. A., Schumacher, D. N., Cooper, B. W., Lindenauer, P., Remus, D., Bratzler, D. (2007). Public Reporting and Pay for Performance. NEJM 356: 1782-1784 [Full Text]  
• Davis, K. (2007). Paying for Care Episodes and Care Coordination. NEJM 356: 1166-1168 [Full Text]  
• Epstein, A. M. (2007). Pay for Performance at the Tipping Point. NEJM 356: 515-517 [Full Text]  
• (2007). Pay for Performance Delivers Modest Changes in Practice. Journal Watch Cardiology 2007: 3-3 [Full Text]  
• (2007). Pay-for-Performance Delivers Modest Changes in Practice. JWatch General 2007: 4-4 [Full Text]