We studied the effect of informing physicians of the charges for outpatient diagnostic tests on their ordering of such tests in an academic primary care medical practice. All tests were ordered at microcomputer workstations by 121 physicians. For half (the intervention group), the charge for the test being ordered and the total charge for tests for that patient on that day were displayed on the computer screen. The remaining physicians (control group) also used the computers but received no message about charges. The primary outcomes measured were the number of tests ordered and the charges for tests per patient visit. In the 14 weeks before the study, the number of tests ordered and the average charge for tests per patient visit were similar for the intervention and control groups. During the 26-week intervention period, the physicians in the intervention group ordered 14 percent fewer tests per patient visit than did those in the control group (P less than 0.005), and the charges for tests were 13 percent ($6.68 per visit) lower (P less than 0.05). The differences were greater for scheduled visits (17 percent fewer tests and 15 percent lower charges for the intervention group; P less than 0.01) than for unscheduled (urgent) visits (11 percent fewer tests and 10 percent lower charges; P greater than 0.3). During the 19 weeks after the intervention ended, the number of tests ordered by the physicians in the intervention group was only 7.7 percent lower than the number ordered by the physicians in the control group, and the charges for tests were only 3.5 percent lower (P greater than 0.3). Three measures of possible adverse outcomes--number of hospitalizations, emergency room visits, and outpatient visits during the study period and the following six months--were similar for the patients seen by the physicians in both groups. We conclude that displaying the charges for diagnostic tests significantly reduced the number and cost of tests ordered, especially for patients with scheduled visits. The effects of this intervention did not persist after it was discontinued.
Source Information
Department of Medicine, Indiana University School of Medicine, Indianapolis.
This article has been cited by other articles:
Shahangian, S., Snyder, S. R.
(2009). Laboratory Medicine Quality Indicators: A Review of the Literature. Am J Clin Pathol
131: 418-431
[Abstract][Full Text]
Collin, S., Reeves, B. C, Hendy, J., Fulop, N., Hutchings, A., Priedane, E.
(2008). Implementation of computerised physician order entry (CPOE) and picture archiving and communication systems (PACS) in the NHS: quantitative before and after study. BMJ
337: a939-a939
[Abstract][Full Text]
Hogg, W., Lemelin, J., Moroz, I., Soto, E., Russell, G.
(2008). Improving prevention in primary care: Evaluating the sustainability of outreach facilitation. cfp
54: 712-720
[Abstract][Full Text]
Poley, M. J., Edelenbos, K. I., Mosseveld, M., van Wijk, M. A.M., de Bakker, D. H., van der Lei, J., Rutten-van Molken, M. P.M.H.
(2007). Cost Consequences of Implementing an Electronic Decision Support System for Ordering Laboratory Tests in Primary Care: Evidence from a Controlled Prospective Study in The Netherlands. Clin. Chem.
53: 213-219
[Abstract][Full Text]
Miyakis, S., Karamanof, G., Liontos, M., Mountokalakis, T. D
(2006). Factors contributing to inappropriate ordering of tests in an academic medical department and the effect of an educational feedback strategy. Postgrad. Med. J.
82: 823-829
[Abstract][Full Text]
Sidorov, J.
(2006). It Ain't Necessarily So: The Electronic Health Record And The Unlikely Prospect Of Reducing Health Care Costs.. Health Aff (Millwood)
25: 1079-1085
[Abstract][Full Text]
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., Shekelle, P. G.
(2006). Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care. ANN INTERN MED
144: 742-752
[Abstract][Full Text]
Sox, C. M., Koepsell, T. D., Doctor, J. N., Christakis, D. A.
(2006). Pediatricians' Clinical Decision Making: Results of 2 Randomized Controlled Trials of Test Performance Characteristics. Arch Pediatr Adolesc Med
160: 487-492
[Abstract][Full Text]
Ozdas, A., Speroff, T., Waitman, L. R., Ozbolt, J., Butler, J., Miller, R. A.
(2006). Integrating "Best of Care" Protocols into Clinicians' Workflow via Care Provider Order Entry: Impact on Quality-of-Care Indicators for Acute Myocardial Infarction. J. Am. Med. Inform. Assoc.
13: 188-196
[Abstract][Full Text]
Rosenbloom, S. T., Chiu, K.-W., Byrne, D. W., Talbert, D. A., Neilson, E. G., Miller, R. A.
(2005). Interventions to Regulate Ordering of Serum Magnesium Levels: Report of an Unintended Consequence of Decision Support. J. Am. Med. Inform. Assoc.
12: 546-553
[Abstract][Full Text]
Ray-Coquard, I., Philip, T., de Laroche, G., Froger, X., Suchaud, J.-P., Voloch, A., Mathieu-Daude, H., Lurkin, A., Farsi, F., Bertrand, P., Chauvin, F.
(2005). Persistence of Medical Change at Implementation of Clinical Guidelines on Medical Practice: A Controlled Study in a Cancer Network. JCO
23: 4414-4423
[Abstract][Full Text]
Rosenbloom, S. T., Geissbuhler, A. J., Dupont, W. D., Giuse, D. A., Talbert, D. A., Tierney, W. M., Plummer, W. D., Stead, W. W., Miller, R. A.
(2005). Effect of CPOE User Interface Design on User-Initiated Access to Educational and Patient Information during Clinical Care. J. Am. Med. Inform. Assoc.
12: 458-473
[Abstract][Full Text]
Neilson, E. G., Johnson, K. B., Rosenbloom, S. T., Dupont, W. D., Talbert, D., Giuse, D. A., Kaiser, A., Miller, R. A., the Resource Utilization Committee*,
(2004). The Impact of Peer Management on Test-Ordering Behavior. ANN INTERN MED
141: 196-204
[Abstract][Full Text]
Weiner, M., Callahan, C. M., Tierney, W. M., Overhage, J M., Mamlin, B., Dexter, P. R., McDonald, C. J.
(2003). Using Information Technology To Improve the Health Care of Older Adults. ANN INTERN MED
139: 430-436
[Abstract][Full Text]
Kralj, B., Iverson, D., Hotz, K., Ashbury, F. D.
(2003). The Impact of Computerized Clinical Reminders on Physician Prescribing Behavior: Evidence From Community Oncology Practice. American Journal of Medical Quality
18: 197-203
[Abstract]
Kuperman, G. J., Gibson, R. F.
(2003). Computer Physician Order Entry: Benefits, Costs, and Issues. ANN INTERN MED
139: 31-39
[Abstract][Full Text]
Oniki, T. A., Clemmer, T. P., Pryor, T. A.
(2003). The Effect of Computer-generated Reminders on Charting Deficiencies in the ICU. J. Am. Med. Inform. Assoc.
10: 177-187
[Abstract][Full Text]
Bates, D. W., Ebell, M., Gotlieb, E., Zapp, J., Mullins, H.C.
(2003). A Proposal for Electronic Medical Records in U.S. Primary Care. J. Am. Med. Inform. Assoc.
10: 1-10
[Abstract][Full Text]
Doolan, D. F., Bates, D. W., James, B. C.
(2003). The Use of Computers for Clinical Care: A Case Series of Advanced U.S. Sites. J. Am. Med. Inform. Assoc.
10: 94-107
[Abstract][Full Text]
Miller, R. H., Bovbjerg, R. R.
(2002). Efforts to Improve Patient Safety in Large, Capitated Medical Groups: Description and Conceptual Model. Journal of Health Politics, Policy and Law
27: 401-440
[Abstract]
Winkens, R., Dinant, G.-J.
(2002). Evidence base of clinical diagnosis: Rational, cost effective use of investigations in clinical practice. BMJ
324: 783-785
[Full Text]
Morris, A H
(2002). Decision support and safety of clinical environments. Qual Saf Health Care
11: 69-75
[Abstract][Full Text]
Murff, H. J., Kannry, J.
(2001). Physician Satisfaction with Two Order Entry Systems. J. Am. Med. Inform. Assoc.
8: 499-511
[Abstract][Full Text]
Overhage, J. M., Perkins, S., Tierney, W. M., McDonald, C. J.
(2001). Controlled Trial of Direct Physician Order Entry: Effects on Physicians' Time Utilization in Ambulatory Primary Care Internal Medicine Practices. J. Am. Med. Inform. Assoc.
8: 361-371
[Abstract][Full Text]
Sherertz, R. J., Ely, E. W., Westbrook, D. M., Gledhill, K. S., Streed, S. A., Kiger, B., Flynn, L., Hayes, S., Strong, S., Cruz, J., Bowton, D. L., Hulgan, T., Haponik, E. F.
(2000). Education of Physicians-in-Training Can Decrease the Risk for Vascular Catheter Infection. ANN INTERN MED
132: 641-648
[Abstract][Full Text]
Takemura, Y., Ishida, H., Inoue, Y., Beck, J. R.
(1999). Common Diagnostic Test Panels for Clinical Evaluation of New Primary Care Outpatients in Japan: A Cost-Effectiveness Evaluation. Clin. Chem.
45: 1752-1761
[Abstract][Full Text]
VAN Wijk, M. A. M., Bohnen, A. M., VAN DER Lei, J.
(1999). Analysis of the Practice Guidelines of the Dutch College of General Practitioners with Respect to the Use of Blood Tests. J. Am. Med. Inform. Assoc.
6: 322-331
[Abstract][Full Text]
Heathfield, H., Louw, G.
(1999). New challenges for clinical informatics: knowledge management tools. Health Informatics Journal
5: 67-73
[Abstract]
Weiner, M., Gress, T., Thiemann, D. R., Jenckes, M., Reel, S. L., Mandell, S. F., Bass, E. B.
(1999). Contrasting Views of Physicians and Nurses about an Inpatient Computer-based Provider Order-entry System. J. Am. Med. Inform. Assoc.
6: 234-244
[Abstract][Full Text]
Hampers, L. C., Cha, S., Gutglass, D. J., Krug, S. E., Binns, H. J.
(1999). The Effect of Price Information on Test-ordering Behavior and Patient Outcomes in a Pediatric Emergency Department. Pediatrics
103: 877-882
[Abstract][Full Text]
Ornstein, S. M., MacFarlane, L. L., Jenkins, R. G., Pan, Q., Wager, K. A.
(1999). Medication Cost Information in a Computer-Based Patient Record System: Impact on Prescribing in a Family Medicine Clinical Practice. Arch Fam Med
8: 118-121
[Abstract][Full Text]
Solomon, D. H., Hashimoto, H., Daltroy, L., Liang, M. H.
(1998). Techniques to Improve Physicians' Use of Diagnostic Tests: A New Conceptual Framework. JAMA
280: 2020-2027
[Abstract][Full Text]
van Walraven, C., Naylor, C. D.
(1998). Do We Know What Inappropriate Laboratory Utilization Is?: A Systematic Review of Laboratory Clinical Audits. JAMA
280: 550-558
[Abstract][Full Text]
Bates, D. W., Kuperman, G. J., Jha, A., Teich, J. M., Orav, E. J., Ma'luf, N., Onderdonk, A., Pugatch, R., Wybenga, D., Winkelman, J., Brennan, T. A., Komaroff, A. L., Tanasijevic, M. J.
(1997). Does the Computerized Display of Charges Affect Inpatient Ancillary Test Utilization?. Arch Intern Med
157: 2501-2508
[Abstract]
Miller, R. A., Gardner, R. M.
(1997). Recommendations for Responsible Monitoring and Regulation of Clinical Software Systems. J. Am. Med. Inform. Assoc.
4: 442-457
[Abstract][Full Text]
Harpole, L. H., Khorasani, R., Fiskio, J., Kuperman, G. J., Bates, D. W.
(1997). Automated Evidence-based Critiquing of Orders for Abdominal Radiographs: Impact on Utilization and Appropriateness. J. Am. Med. Inform. Assoc.
4: 511-521
[Abstract][Full Text]
Miller, R. A, Gardner, R. M, For the American Medical Informatics Association (,
(1997). Recommendations for Responsible Monitoring and Regulation of Clinical Software Systems. J Am Med Inform Assoc
4: 442-457
[Abstract][Full Text]
Harpole, L. H, Khorasani, R., Fiskio, J., Kuperman, G. J, Bates, D. W
(1997). Automated Evidence-based Critiquing of Orders for Abdominal Radiographs: Impact on Utilization and Appropriateness. J Am Med Inform Assoc
4: 511-521
[Abstract][Full Text]
Overhage, J. M., Tierney, W. M., Zhou, X.-H.(A., McDonald, C. J.
(1997). A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission. J. Am. Med. Inform. Assoc.
4: 364-375
[Abstract][Full Text]
Overhage, J M., Tierney, W. M, Zhou, X.-H., McDonald, C. J
(1997). A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission. J Am Med Inform Assoc
4: 364-375
[Abstract][Full Text]
Elson, R. B., Faughnan, J. G., Connelly, D. P.
(1997). An Industrial Process View of Information Delivery to Support Clinical Decision Making: Implications for Systems Design and Process Measures. J. Am. Med. Inform. Assoc.
4: 266-278
[Abstract][Full Text]
Elson, R. B, Faughnan, J. G, Connelly, D. P
(1997). An Industrial Process View of Information Delivery to Support Clinical Decision Making: Implications for Systems Design and Process Measures. J Am Med Inform Assoc
4: 266-278
[Abstract][Full Text]
Auleley, G.-R., Ravaud, P., Giraudeau, B., Kerboull, L., Nizard, R., Massin, P., de Loubresse, C. G., Vallee, C., Durieux, P.
(1997). Implementation of the Ottawa Ankle Rules in France: A Multicenter Randomized Controlled Trial. JAMA
277: 1935-1939
[Abstract]
Balas, E. A., Austin, S. M., Mitchell, J. A., Ewigman, B. G., Bopp, K. D., Brown, G. D.
(1996). The Clinical Value of Computerized Information Services: A Review of 98 Randomized Clinical Trials. Arch Fam Med
5: 271-278
[Abstract]
Jones, D. L., Kroenke, K., Landry, F. J., Tomich, D. J., Ferrel, R. J.
(1996). Cost Savings Using a Stepped-Care Prescribing Protocol for Nonsteroidal Anti-inflammatory Drugs. JAMA
275: 926-930
[Abstract]
Winkens, R. A G, Pop, P., Grol, R. P T M, Bugter-Maessen, A. M A, Kester, A. D M, Beusmans, G. H M I, Knottnerus, J A.
(1996). Effects of routine individual feedback over nine years on general practitioners' requests for tests. BMJ
312: 490-490
[Full Text]
Davis, D. A., Thomson, M. A., Oxman, A. D., Haynes, R. B.
(1995). Changing Physician Performance: A Systematic Review of the Effect of Continuing Medical Education Strategies. JAMA
274: 700-705
[Abstract]
Elson, R. B., Connelly, D. P.
(1995). Computerized Patient Records in Primary Care: Their Role in Mediating Guideline-Driven Physician Behavior Change. Arch Fam Med
4: 698-705
[Abstract]
Yano, E. M., Fink, A., Hirsch, S. H., Robbins, A. S., Rubenstein, L. V.
(1995). Helping Practices Reach Primary Care Goals: Lessons From the Literature. Arch Intern Med
155: 1146-1156
[Abstract]
Chilingerian, J. A., Glavin, M. P. V.
(1994). Temporary Firms in Community Hospitals: Elements of a Managerial Theory of Clinical Efficiency. Med Care Res Rev
51: 289-335
Davis, D. A., Thomson, M. A., Oxman, A. D., Haynes, R. B.
(1992). Evidence for the Effectiveness of CME: A Review of 50 Randomized Controlled Trials. JAMA
268: 1111-1117
[Abstract]
Plasencia, C. M., Alderman, B. W., Baron, A. E., Rolfs, R. T., Boyko, E. J.
(1992). A Method to Describe Physician Decision Thresholds and Its Application in Examining the Diagnosis of Coronary Artery Disease Based on Exercise Treadmill Testing. Med Decis Making
12: 204-212
[Abstract]
Schectman, J. M., Elinsky, E. G., Pawlson, L. G.
(1991). Effect of Education and Feedback on Thyroid Function Testing Strategies of Primary Care Clinicians. Arch Intern Med
151: 2163-2166
[Abstract]
Rosenstein, A. H.
(1991). Utilization Review: Health Economics and Cost-Effective Resource Management. American Journal of Medical Quality
6: 85-90
[Abstract]
Woodside, J. R., Bodne, R., Tonnesen, A. S., Frazier, J.
(1991). Intensive, Focused Utilization Management in a Teaching Hospital An Exploratory Study. American Journal of Medical Quality
6: 47-50
[Abstract]
Osheroff, J. A., Forsythe, D. E., Buchanan, B. G., Bankowitz, R. A., Blumenfeld, B. H., Miller, R. A.
(1991). Physicians' Information Needs: Analysis of Questions Posed during Clinical Teaching. ANN INTERN MED
114: 576-581
[Abstract]
WOOLF, S. H., KAMEROW, D. B.
(1990). Testing for Uncommon Conditions: The Heroic Search for Positive Test Results. Arch Intern Med
150: 2451-2458
[Abstract]
(1990). HOUSE OFFICERS ORDER FEWER TESTS WHEN REMINDED ABOUT COSTS. JWatch General
1990: 5-5
[Full Text]