Background The sensitivity and specificity of a screening testare biased when disease status is not verified in all subjectsand when the likelihood of confirmation depends on the testresult itself. We assessed the screening characteristics ofthe prostate-specific antigen (PSA) measurement after correctionfor verification bias.
Methods Between 1995 and 2001, 6691 men underwent PSA-basedscreening for prostate cancer. Of these men, 705 (11 percent)subsequently underwent biopsy of the prostate. Under the assumptionthat the chance of undergoing a biopsy depends only on the PSA-testresult and other observed clinical variables, we used a mathematicalmodel to estimate adjusted receiver-operating-characteristic(ROC) curves.
Results Adjusting for verification bias significantly increasedthe area under the ROC curve (i.e., the overall diagnostic performance)of the PSA test, as compared with an unadjusted analysis (0.86vs. 0.69, P<0.001, for men less than 60 years of age; 0.72vs. 0.62, P=0.008, for men 60 years of age or older). If thethreshold PSA value for undergoing biopsy were set at 4.1 ngper milliliter, 82 percent of cancers in younger men and 65percent of cancers in older men would be missed. A digital rectalexamination that is abnormal but not suspicious for cancer doesnot affect the overall performance characteristics of the test.
Conclusions A lower threshold level of PSA for recommendingprostate biopsy, particularly in younger men, may improve theclinical value of the PSA test.
Source Information
From the Joint Center for Radiation Therapy, Harvard Medical School, Boston (R.S.P.); the Department of Radiation Oncology, Brigham and Women's Hospital and the DanaFarber Cancer Institute, Boston (A.V.D.); the Division of Urologic Surgery, Washington University School of Medicine, St. Louis (W.J.C., K.A.R.); the Department of Urology, Northwestern University, Fineberg School of Medicine, Chicago (W.J.C.); and the Department of Health Policy and Management, Harvard School of Public Health, Boston (K.M.K.).
Address reprint requests to Dr. Kuntz at the Center for Risk Analysis, Harvard School of Public Health, 718 Huntington Ave., Boston, MA 02115-5924, or at kmk{at}hsph.harvard.edu.
Eekers, D. B. P., Laschet, A., de Groot, M., Roelofs, E., Kester, A., Delaere, K., Lambin, P., van Gils, F., Nap, M., ten Kate, J.
(2008). Why determine only the total prostate-specific antigen, if the free-to-total ratio contains the information?. Ann Clin Biochem
45: 270-274
[Abstract][Full Text]
Haas, G. P., Delongchamps, N. B., Jones, R. F., Chandan, V., Serio, A. M., Vickers, A. J., Jumbelic, M., Threatte, G., Korets, R., Lilja, H., de la Roza, G.
(2007). Needle Biopsies on Autopsy Prostates: Sensitivity of Cancer Detection Based on True Prevalence. JNCI J Natl Cancer Inst
99: 1484-1489
[Abstract][Full Text]
Bundy, D. G., Byerley, J. S., Liles, E. A., Perrin, E. M., Katznelson, J., Rice, H. E.
(2007). Does This Child Have Appendicitis?. JAMA
298: 438-451
[Abstract][Full Text]
Holsinger, T., Deveau, J., Boustani, M., Williams, J. W. Jr
(2007). Does This Patient Have Dementia?. JAMA
297: 2391-2404
[Abstract][Full Text]
Lauer, M. S., Murthy, S. C., Blackstone, E. H., Okereke, I. C., Rice, T. W.
(2007). [18F]Fluorodeoxyglucose Uptake by Positron Emission Tomography for Diagnosis of Suspected Lung Cancer: Impact of Verification Bias. Arch Intern Med
167: 161-165
[Abstract][Full Text]
Lee, S. E., Byun, S.-S., Park, H. K., Shim, H. B., Ku, J. H.
(2006). Detection of Prostate Cancer at Low and Intermediate Serum Prostate-Specific Antigen Levels in a Country with a Low Incidence of Prostate Cancer. Jpn J Clin Oncol
36: 376-380
[Abstract][Full Text]
Catalona, W. J., Loeb, S., Han, M.
(2006). Viewpoint: expanding prostate cancer screening.. ANN INTERN MED
144: 441-443
[Abstract][Full Text]
Punglia, R. S., Kuntz, K. M., Catalona, W. J., D'Amico, A.
(2005). Operating Characteristics of Prostate-Specific Antigen and Verification Bias. JAMA
294: 2698-2698
[Full Text]
Ankerst, D. P., Chi, C., Thompson, I. M.
(2005). Operating Characteristics of Prostate-Specific Antigen and Verification Bias--Reply. JAMA
294: 2698-2699
[Full Text]
Klein, E. A., Tangen, C. M., Goodman, P. J., Lippman, S. M., Thompson, I. M.
(2005). Assessing Benefit and Risk in the Prevention of Prostate Cancer: The Prostate Cancer Prevention Trial Revisited. JCO
23: 7460-7466
[Abstract][Full Text]
Hricak, H
(2005). MR imaging and MR spectroscopic imaging in the pre-treatment evaluation of prostate cancer. Br. J. Radiol.
78: S103-S111
[Abstract][Full Text]
van Asperen, C J, Brohet, R M, Meijers-Heijboer, E J, Hoogerbrugge, N, Verhoef, S, Vasen, H F A, Ausems, M G E M, Menko, F H, Gomez Garcia, E B, Klijn, J G M, Hogervorst, F B L, van Houwelingen, J C, van't Veer, L J, Rookus, M A, van Leeuwen, F E, on behalf of the Netherlands Collaborative Group o,
(2005). Cancer risks in BRCA2 families: estimates for sites other than breast and ovary. J. Med. Genet.
42: 711-719
[Abstract][Full Text]
Soletormos, G., Semjonow, A., Sibley, P. E.C., Lamerz, R., Petersen, P. H., Albrecht, W., Bialk, P., Gion, M., Junker, F., Schmid, H.-P., Van Poppel, H., on behalf of the European Group on Tumor Markers,
(2005). Biological Variation of Total Prostate-Specific Antigen: A Survey of Published Estimates and Consequences for Clinical Practice. Clin. Chem.
51: 1342-1351
[Abstract][Full Text]
Thompson, I. M., Ankerst, D. P., Chi, C., Lucia, M. S., Goodman, P. J., Crowley, J. J., Parnes, H. L., Coltman, C. A. Jr
(2005). Operating Characteristics of Prostate-Specific Antigen in Men With an Initial PSA Level of 3.0 ng/mL or Lower. JAMA
294: 66-70
[Abstract][Full Text]
Garzotto, M., Beer, T. M., Hudson, R. G., Peters, L., Hsieh, Y.-C., Barrera, E., Klein, T., Mori, M.
(2005). Improved Detection of Prostate Cancer Using Classification and Regression Tree Analysis. JCO
23: 4322-4329
[Abstract][Full Text]
Bradley, S. V., Oravecz-Wilson, K. I., Bougeard, G., Mizukami, I., Li, L., Munaco, A. J., Sreekumar, A., Corradetti, M. N., Chinnaiyan, A. M., Sanda, M. G., Ross, T. S.
(2005). Serum Antibodies to Huntingtin Interacting Protein-1: A New Blood Test for Prostate Cancer. Cancer Res.
65: 4126-4133
[Abstract][Full Text]
Gu, Z., Rubin, M. A., Yang, Y., Deprimo, S. E., Zhao, H., Horvath, S., Brooks, J. D., Loda, M., Reiter, R. E.
(2005). Reg IV: A Promising Marker of Hormone Refractory Metastatic Prostate Cancer. Clin. Cancer Res.
11: 2237-2243
[Abstract][Full Text]
Saiag, P., Bernard, M., Beauchet, A., Bafounta, M.-L., Bourgault-Villada, I., Chagnon, S.
(2005). Ultrasonography Using Simple Diagnostic Criteria vs Palpation for the Detection of Regional Lymph Node Metastases of Melanoma. Arch Dermatol
141: 183-189
[Abstract][Full Text]
Etzioni, R., Falcon, S., Gann, P. H., Kooperberg, C. L., Penson, D. F., Stampfer, M. J.
(2004). Prostate-Specific Antigen and Free Prostate-Specific Antigen in the Early Detection of Prostate Cancer: Do Combination Tests Improve Detection?. Cancer Epidemiol. Biomarkers Prev.
13: 1640-1645
[Abstract][Full Text]
Claus, F. G., Hricak, H., Hattery, R. R.
(2004). Pretreatment Evaluation of Prostate Cancer: Role of MR Imaging and 1H MR Spectroscopy. RadioGraphics
24: S167-S180
[Abstract][Full Text]
Alibhai, S. M.H.
(2004). What is the prevalence of prostate cancer among men with low prostate-specific antigen levels?. CMAJ
171: 572-572
[Full Text]
Blackstone, E. H., Lauer, M. S.
(2004). Caveat emptor: The treachery of work-up bias. J. Thorac. Cardiovasc. Surg.
128: 341-344
[Full Text]
Morgentaler, A.
(2004). A 66-Year-Old Man With Sexual Dysfunction. JAMA
291: 2994-3003
[Full Text]
Sreekumar, A., Laxman, B., Rhodes, D. R., Bhagavathula, S., Harwood, J., Giacherio, D., Ghosh, D., Sanda, M. G., Rubin, M. A., Chinnaiyan, A. M.
(2004). Humoral Immune Response to {alpha}-Methylacyl-CoA Racemase and Prostate Cancer. JNCI J Natl Cancer Inst
96: 834-843
[Abstract][Full Text]
Thompson, I. M., Pauler, D. K., Goodman, P. J., Tangen, C. M., Lucia, M. S., Parnes, H. L., Minasian, L. M., Ford, L. G., Lippman, S. M., Crawford, E. D., Crowley, J. J., Coltman, C. A. Jr.
(2004). Prevalence of Prostate Cancer among Men with a Prostate-Specific Antigen Level <=4.0 ng per Milliliter. NEJM
350: 2239-2246
[Abstract][Full Text]
Kuller, L. H., Thomas, A., Grandits, G., Neaton, J. D.
(2004). Elevated Prostate-Specific Antigen Levels Up to 25 Years Prior to Death from Prostate Cancer. Cancer Epidemiol. Biomarkers Prev.
13: 373-377
[Abstract][Full Text]
Law, M.
(2004). Screening without evidence of efficacy. BMJ
328: 301-302
[Full Text]
Rhoden, E. L., Morgentaler, A.
(2004). Risks of Testosterone-Replacement Therapy and Recommendations for Monitoring. NEJM
350: 482-492
[Full Text]
Davis, A. M
(2003). High result in prostate specific antigen test: Repeated testing and free tests might help. BMJ
327: 1227-1227
[Full Text]
Henderson, A. R.
(2003). A Triptych of Statistics. Clin. Chem.
49: 1959-1962
[Full Text]
Leiner, S., Chatterton, H. T., Punglia, R. S., Catalona, W. J., Kuntz, K. M.
(2003). Verification Bias in Screening for Prostate Cancer. NEJM
349: 1672-1673
[Full Text]
Gottlieb, S.
(2003). Study shows poor reliability of prostate cancer test. BMJ
327: 249-249
[Full Text]
Schroder, F. H., Kranse, R.
(2003). Verification Bias and the Prostate-Specific Antigen Test -- Is There a Case for a Lower Threshold for Biopsy?. NEJM
349: 393-395
[Full Text]