|
Background The accuracy of multidetector computed tomographic angiography (CTA) for the diagnosis of acute pulmonary embolism has not been determined conclusively.
Methods The Prospective Investigation of Pulmonary Embolism Diagnosis II trial was a prospective, multicenter investigation of the accuracy of multidetector CTA alone and combined with venous-phase imaging (CTACTV) for the diagnosis of acute pulmonary embolism. We used a composite reference test to confirm or rule out the diagnosis of pulmonary embolism.
Results Among 824 patients with a reference diagnosis and a completed CT study, CTA was inconclusive in 51 because of poor image quality. Excluding such inconclusive studies, the sensitivity of CTA was 83 percent and the specificity was 96 percent. Positive predictive values were 96 percent with a concordantly high or low probability on clinical assessment, 92 percent with an intermediate probability on clinical assessment, and nondiagnostic if clinical probability was discordant. CTACTV was inconclusive in 87 of 824 patients because the image quality of either CTA or CTV was poor. The sensitivity of CTACTV for pulmonary embolism was 90 percent, and specificity was 95 percent. CTACTV was also nondiagnostic with a discordant clinical probability.
Conclusions In patients with suspected pulmonary embolism, multidetector CTACTV has a higher diagnostic sensitivity than does CTA alone, with similar specificity. The predictive value of either CTA or CTACTV is high with a concordant clinical assessment, but additional testing is necessary when the clinical probability is inconsistent with the imaging results.
Visualization of segmental and subsegmental pulmonary arteries is substantially better with four-slice CTA and thin collimation (1.25 mm) than with single-slice CTA.5,6 In two studies of fewer than 100 patients, sensitivities for the detection of pulmonary embolism with four-slice CTA have been reported to be 96 percent7 and 100 percent,8 with respective specificities of 98 percent and 89 percent.
Pulmonary embolism and deep venous thrombosis are two manifestations of one pathologic process. The majority of patients with pulmonary embolism also have deep venous thrombosis.9,10 For this reason, testing for deep venous thrombosis has become an integral part of the diagnosis of pulmonary embolism. Venous-phase multidetector CT venography (CTV) in combination with single-slice CTA (CTACTV) improved the detection of pulmonary embolism.11,12 The sensitivity of four-slice CTACTV appears to be higher than that of four-slice CTA alone.13,14,15
Meta-analyses of outcome, mostly performed after single-slice CTA, showed that imaging of the lower extremities should be normal16,17 or the clinical probability of pulmonary embolism should be low or intermediate18 to rule out disease in patients with normal findings on CTA. Most outcome studies that are performed after normal findings have been obtained on 4-slice or 16-slice CTA have used additional diagnostic tests to rule out pulmonary embolism.13,19,20,21 However, Perrier et al.22 showed a potential ability to rule out pulmonary embolism on the basis of normal findings on multidetector CTA without ultrasonography of the lower limbs. The Christopher Study investigators23 showed pulmonary embolism during three-month follow-up in only 0.7 percent of untreated patients and deep venous thrombosis in 0.6 percent after normal findings had been obtained on single-row or multidetector CTA alone.
The Prospective Investigation of Pulmonary Embolism Diagnosis II (PIOPED II) trial was designed with two primary objectives: to determine whether multidetector CTA can reliably detect and rule out acute pulmonary embolism and whether the addition of CTV improves the ability to detect and rule out pulmonary embolism. We also determined whether the addition of a validated clinical assessment (the Wells score) (Table 1)24 improves the ability to detect or rule out pulmonary embolism by CTA or CTACTV in patients with suspected pulmonary embolism.
|
The PIOPED II trial was a prospective, multicenter study designed by the authors and sponsored by the National Heart, Lung, and Blood Institute. The protocol and consent forms were approved by the institutional review board of each center and by a data safety monitoring board appointed by the institute. All recruited patients gave written informed consent. All the criteria of the Standards for Reporting of Diagnostic Accuracy were met.25,26
Study Population and Enrollment
All patients who were at least 18 years of age and had clinically suspected acute pulmonary embolism were seen on either an inpatient or outpatient basis at the eight participating clinical centers between September 2001 and July 2003. Patients who were referred for diagnostic imaging for suspected pulmonary embolism were identified for recruitment, as well as patients for whom the study nurse was aware of a consultation request for suspected pulmonary embolism. Patients were recruited consecutively during periods of staff availability, usually during the daytime on weekdays. Exclusion criteria are shown in Figure 1.
|
All patients who were enrolled in the study underwent a clinical assessment of the probability of pulmonary embolism, including a Wells score (Table 1).24 In addition, all patients consented to undergo diagnostic testing, including CTACTV, ventilationperfusion scanning, venous compression ultrasonography of the lower extremities, and if necessary, pulmonary digital-subtraction angiography (DSA).27 For ethical reasons, conventional pulmonary DSA was restricted to patients in whom pulmonary embolism was not conclusively diagnosed or ruled out by the noninvasive tests.
A composite reference standard was used to diagnose or rule out pulmonary embolism. The diagnosis of pulmonary embolism according to the composite reference standard required one of the following conditions: ventilationperfusion lung scanning showing a high probability of pulmonary embolism in a patient with no history of pulmonary embolism, abnormal findings on pulmonary DSA, or abnormal findings on venous ultrasonography in a patient without previous deep venous thrombosis at that site and nondiagnostic results on ventilationperfusion scanning (not normal and not high probability without previous pulmonary embolism). Abnormal venous ultrasonography in such a patient was interpreted as a surrogate for the diagnosis of pulmonary embolism.
Exclusion of pulmonary embolism according to the composite reference standard required one of the following conditions: normal findings on DSA, normal findings on ventilationperfusion scanning, ventilationperfusion scanning showing either a low or very low probability of pulmonary embolism, a clinical Wells score of less than 2 (Table 1),24 and normal findings on venous ultrasonography.
To confirm the accuracy of the exclusion of pulmonary embolism according to the composite reference standard, patients in whom pulmonary embolism was ruled out by the reference test underwent telephone interviews three and six months after enrollment. Deaths and new evaluations for venous thromboembolic disease were reviewed by an outcome committee.
CTA and CTV
The study was performed with 4-row, 8-row, or 16-row multidetector scanners, as described in the Supplementary Appendix (available with the full text of this article at www.nejm.org). Diagnostic criteria for acute pulmonary embolism by CTA were as follows: failure of contrast material to fill the entire lumen because of a central filling defect (the artery may be enlarged, as compared with similar arteries; a partial filling defect surrounded by contrast material on a cross-sectional image; contrast material between the central filling defect and the artery wall on an in-plane, longitudinal image; and a peripheral intraluminal filling defect that forms an acute angle with the artery wall. The criterion for acute deep venous thrombosis on CTV was a complete or partial central filling defect.
Central Readings
Image interpretations for all diagnostic tests except venous ultrasonography were based on agreement of two certified readers in the PIOPED II trial who were from centers other than that at which the image was obtained. Additional readers were used until agreement of two was obtained. Readers were unaware of all clinical information and of the results of other imaging tests except chest radiographs, which were included with ventilationperfusion scans. Local readings of venous ultrasonography were accepted after site visits to validate technique and interpretation. The reading of multidetector CTA and conventional DSA required agreement regarding at least one lobe for a diagnosis of pulmonary embolism, and pulmonary embolism was ruled out if two readers agreed that the condition was absent. In interpreting CTV results, two readers had to agree on the leg that was affected by deep venous thrombosis. Separate consensus of readers was required for both CTA and CTV. For CTACTV, pulmonary embolism was diagnosed if there was consensus that either test showed abnormal findings. Pulmonary embolism was ruled out if there was consensus that both CTA and CTV showed normal findings.
Statistical Analysis
We used standard methods to calculate the sensitivity, specificity, and positive and negative predictive values.28 Patients for whom results on CTA or CTACTV were unclassified were excluded from these calculations. For the calculation of the negative predictive value of CTA among patients who were deemed to have a low probability of disease, we included only patients with a reference test diagnosis obtained by ventilationperfusion scanning or conventional pulmonary DSA. We calculated exact 95 percent confidence intervals for sensitivity, specificity, and unadjusted positive and unadjusted negative predictive values from the binomial distribution with the use of StatXact5 software, release 5.0.3 (Cytel Software). Values for likelihood ratios for a positive test were calculated as the sensitivity, divided by 1 minus the specificity; and likelihood ratios for a negative test were calculated as 1 minus the sensitivity, divided by the specificity.29,30,31
In a separate analysis, values for the sensitivity and specificity of CTA were adjusted for possible inaccuracy of the composite reference standard with the use of the lowest reported false positive and false negative rates for the tests that make up that standard.32,33,34,35,36 Calculations were also performed with the use of the highest reported false positive and false negative rates for the composite reference standard tests.24,32,33,34,37
Results
During the 23-month recruitment period, 7284 patients were screened, 3262 were eligible for study, and 1090 were enrolled (Figure 1). A majority of the 1090 enrolled patients were women; the mean age was 51.7 years. Most patients were deemed to have a low or moderate probability of pulmonary embolism on the basis of the Wells score (Table 1 and Table 2). Of the 1090 patients enrolled, 28 did not undergo CT and 238 did not receive a reference test diagnosis. The remaining 824 patients underwent subsequent analysis. Demographic and clinical features of the 238 patients without a reference diagnosis and the 824 patients who received a diagnosis are shown in Table 2.
|
On the basis of the composite reference standard, pulmonary embolism was diagnosed in 192 of the 824 patients who received a reference diagnosis (23 percent) (Table 3). Among the 632 in whom pulmonary embolism was ruled out, the 592 patients who also had an interpretable CTA were followed for six months; 590 patients did not receive anticoagulants. Clinical courses in 2 of 590 patients (<1 percent) suggested an initially unrecognized pulmonary embolism.
|
Of the 824 patients with a reference diagnosis and a completed CT study, the quality of the CTA was insufficient for conclusive interpretation in 51 (Table 4). Of the 773 patients with an adequate CTA (94 percent), the sensitivity of CTA for the diagnosis of pulmonary embolism was 83 percent (150 of 181 patients; 95 percent confidence interval, 76 to 92 percent), and the specificity was 96 percent (567 of 592 patients; 95 percent confidence interval, 93 to 97 percent). The likelihood ratio for a positive test was 19.6 (95 percent confidence interval, 13.3 to 29.0), and the likelihood ratio for a negative test was 0.18 (95 percent confidence interval, 0.13 to 0.24). The positive predictive value was 86 percent (150 of 175 patients; 95 percent confidence interval, 79 to 90 percent), and the negative predictive value was 95 percent (567 of 598 patients; 95 percent confidence interval, 92 to 96 percent). Positive predictive values were 97 percent (116 of 120 patients) for pulmonary embolism in a main or lobar artery, 68 percent (32 of 47 patients) for a segmental vessel, and 25 percent (2 of 8 patients) for a subsegmental branch.
|
If the composite reference standard is not assumed to be an absolute standard for the diagnosis of pulmonary embolism but is considered to have its own false positive and false negative rates, the diagnostic accuracy of CTA and CTACTV is altered slightly. Sensitivity analysis using the lowest reported false positive and false negative rates of the components of the composite reference test gave an adjusted sensitivity of CTA of 84 percent (150 of 178 patients) and adjusted sensitivity of CTACTV of 92 percent (164 of 179 patients). The use of the highest reported false positive and false negative rates resulted in an adjusted value of the sensitivity of CTA of 82 percent (150 of 182 patients); the adjusted sensitivity of CTACTV was unchanged at 90 percent (164 of 183 patients). Specificities changed 1 percent or less.
CT Results and Clinical Assessment
As would be anticipated, the predictive value of CTA and CTACTV varied substantially when the clinical assessment was taken into account. Among patients with a previous clinical assessment of high or intermediate probability of pulmonary embolism, the respective positive predictive values for pulmonary embolism were 96 percent (22 of 23 patients) and 92 percent (93 of 101 patients) for CTA (Table 5). Among patients with a low clinical probability of pulmonary embolism, 42 percent of the CTA readings were false positive. Similar positive predictive values were obtained for CTACTV (Table 5).
|
Complications
Complications associated with 1095 CTA procedures were a mild allergic reaction (itching, swollen eyelid, or vomiting) in four patients (<1 percent), urticaria in one patient (<1 percent), and moderately severe extravasation of contrast material into the antecubital fossa in two patients (<1 percent). One patient with diabetes mellitus had a transient episode of acute renal failure characterized by an increase in the serum creatinine level from 1.3 to 2.9 mg per deciliter (115 to 256 µmol per liter) after CTACTV, which was followed 22 hours later by DSA. The elevated creatinine level returned to normal after the administration of intravenous fluids. No other complications were reported with 209 DSA procedures or with any other reference tests. No other elevations in creatinine levels were attributed to the procedures. Serum creatinine levels were typically checked daily in hospitalized patients, but the test results were not required by protocol and typically were not obtained from outpatients after CTA and DSA.
Discussion
Our data show that multidetector CTACTV had a higher sensitivity (90 percent) than CTA alone (83 percent), with similar specificity (about 95 percent for both testing techniques). Positive results on CTA in combination with a high probability or intermediate probability of pulmonary embolism on the basis of clinical assessment or normal findings on CTA with a low clinical probability had a predictive value (positive or negative) of 92 to 96 percent. Such values are consistent with those generally considered adequate to confirm or rule out the diagnosis of pulmonary embolism.
We report sensitivity based on the number of patients who had conclusive interpretations of CTA or CTACTV. The sensitivity of diagnostic imaging with CTA and CTACTV would be lower if patients with inconclusive interpretations owing to poor image quality were included. However, since patients with inconclusive findings on CTA or CTACTV in clinical practice would probably undergo additional testing, we regard the values for diagnostic accuracy given here to be appropriate for clinical use and for comparison with other techniques. The data we report were primarily obtained with four-slice CT. We did not study enough patients with 8-slice or 16-slice scanners to determine whether accuracy improved with the use of more advanced scanners.
Both multidetector CTACTV and multidetector CTA alone would require additional testing to diagnose or rule out pulmonary embolism if the previous assessment of clinical probability did not agree with the imaging results. It has been suggested that the clinical probability of pulmonary embolism should be considered in combination with CTA because of false positive or false negative results of CTA in patients with discordant clinical findings.39
Other studies have examined a variety of approaches to the use of CTA in the evaluation of patients with suspected pulmonary embolism; the findings of these studies have been generally consistent with ours. In a meta-analysis, Quiroz et al.18 showed that pulmonary embolism could be ruled out safely with primarily single-detector CTA in cases in which the clinical probability was low or intermediate. On the basis of a meta-analysis of primarily single-detector CTA, Moores et al.16,17 concluded that lower-extremity imaging should be normal before anticoagulation is withheld in patients with suspected pulmonary embolism and normal findings on CTA. Perrier et al.22 showed that normal findings on D-dimer testing among patients with a low or intermediate clinical probability of pulmonary embolism safely eliminated the need for further diagnostic testing. In this alternative strategy, such patients do not appear to require CTA.
Strengths of this investigation include incorporation of all the criteria of the Standards for Reporting of Diagnostic Accuracy.25,26 Recruited patients were inpatients and outpatients of both sexes with a wide range of ages and associated illnesses. The composite reference test was shown to be robust by sensitivity analysis and by the generally benign outcome among patients with a negative reference test.
Weaknesses of the investigation include the use of noninvasive diagnostic tests as part of the reference standard. This was necessary, since it was deemed to be unethical to require DSA in all recruited patients. With the use of data from previous reports,24,32,33,34,35,36,37 the composite reference standard overall is estimated to have had false positive rates of no more than 9.3 percent and false negative rates of no more than 2.4 percent. In patients with pulmonary embolism diagnosed by the composite reference test, demonstration of deep venous thrombosis by CTV was interpreted as a surrogate for pulmonary embolism. The validity of this approach is supported by the literature.9,10 Patients with suspected pulmonary embolism in whom the diagnosis is confirmed by diagnostic imaging generally have deep venous thrombosis of the lower extremities, particularly if patients with deep venous thrombosis of the upper extremities are excluded, as we did in the PIOPED II trial.
Other weaknesses of the study include the restriction of recruitment to patients who could safely undergo the extra tests within 36 hours after the reference test. The reported values of diagnostic accuracy may not apply to pregnant women, patients with renal failure, and patients who are critically ill, in shock, or receiving ventilatory support. Among 1090 recruited patients, 238 did not complete the diagnostic reference testing, primarily because the diagnosis was inconclusive on noninvasive testing and patients or their clinical team declined DSA. A smaller proportion of these patients had a low clinical probability of pulmonary embolism. It is not apparent whether this affected the results. It is also not apparent whether a lack of screening and recruiting of patients during night and weekend shifts affected the results. Patients who presented on weekdays may have had generally milder symptoms than those who presented at night or on weekends.
In conclusion, among patients with suspected pulmonary embolism, multidetector CTACTV has a higher sensitivity for the diagnosis than does CTA alone, with similar specificity. The false negative rate of 17 percent for CTA alone indicates the need for additional information to rule out pulmonary embolism. The predictive value of either CTA or CTACTV is high with a concordant clinical assessment, but additional testing is necessary when clinical probability is inconsistent with the imaging results.
Supported by grants (HL63899, HL63928, HL63931, HL063932, HL63940, HL63941, HL63942, HL63981, HL63982, and HL67453) from the National Heart, Lung, and Blood Institute.
Dr. Gottschalk reports having received consulting fees from GE Healthcare. No other potential conflict of interest relevant to this article was reported.
Source Information
From the Department of Research, St. Joseph Mercy Oakland Hospital, Pontiac, Mich., and the Department of Medicine, Wayne State University, Detroit (P.D.S.); the Biostatistics Center, Department of Epidemiology and Biostatistics, George Washington University, Rockville, Md. (S.E.F.); the Department of Radiology, Medical College of Wisconsin, Milwaukee (L.R.G.); the Department of Radiology, Michigan State University, East Lansing (A.G.); the Department of Medicine, Massachusetts General Hospital, and Harvard Medical School both in Boston (C.A.H., D.A.Q.); the Department of Medicine, University of Calgary, Calgary, Alta., Canada (R.D.H.); the Department of Medicine, Emory University, Atlanta (K.V.L.); the Department of Medicine, Henry Ford Hospital, Detroit (J.P.); the Department of Radiology, Weill Cornell Medical College, New York (T.A.S.); Weill Cornell Medical College and Methodist Hospital, Houston (H.D.S.); the Department of Medicine, Duke University, Durham, N.C. (V.F.T.); the Departments of Surgery (T.W.W.) and Medicine (J.G.W.), University of Michigan, Ann Arbor; and the Department of Radiology, Washington University, St. Louis (P.K.W.).
Address reprint requests to Dr. Stein at St. Joseph Mercy Oakland Hospital, 44405 Woodward Ave., Pontiac, MI 48341, or at steinp{at}trinity-health.org.
References
The following people participated in the PIOPED II trial: Cornell University, New York H. Sostman (principal investigator), A. Fisher, S. Goldsmith, C. Henschke, K. Kandarpa, A. Ng, A. Sanders, T. Sos, R. Sullivan, D. Trost, D. Yankelevitz; Duke University, Durham, N.C. V. Tapson (principal investigator), T. Carmon, R. Coleman, L. Heyneman, A. Krichman, H. McAdams, T. Smith, C. Yetsko; Emory University, Atlanta K. Leeper (principal investigator), P. Dean, D. Entzian, B. Hatfield, L. Herndon, K. Horlander, K. Scheidt, M. Sheline, G. Skardasis, R. Woodcock; Henry Ford Hospital, Detroit J. Popovich (principal investigator), R. Almario, M. Brown, J. Buckley, A. Fogel, M. Ford, K. Karvelis, M. Major, K. McHugh, D. McVinnie, A. Shepard, D. Spizarny, D. Simmons-Villanueva, L. Willcock; Massachusetts General Hospital, Boston C. Hales (principal investigator), J. Cahill, A. Greenfield, T. McLoud, E. Palmer, D. Quinn, J. Scott, J. Shepard, A. Waltman, C. Wittram; University of Calgary, Calgary, Alta., Canada R. Hull (principal investigator), B. Behan, D. Bradley, W. Brunet, P. Burrowes, M. Carson, P. Elliott, L. Hoddinott, R. Kloiber, J. MacGregor, C. Molnar, G. Pineo, M. Sheldon, B. So, K. Weber, C. Wrona; University of Michigan, Ann Arbor J. Weg (principal investigator), L. Sawyer, E. Alahmad, K. Cho, B. Fex, K. Frey, S. Gay, E. Kazerooni, V. Lama, M. Lowell, T. Ojo, S. Patel, P. Shreve, T. Wakefield, D. Schmidtke; Washington University, St. Louis P. Woodard (principal investigator), J. Battaile, S. Bhalla, D. Brown, L. Crouch, R. Gropler, R. Hachem, J. Heiken, A. Lamb, L. Lewis, M. Mohrman, G. Polites, H. Royal, B. Rubin, D. Wehrle, R. Yusen; Consultants A. Gottschalk, Michigan State University, East Lansing; L. Goodman, Medical College of Wisconsin, Milwaukee; Data and Coordinating Center, George Washington University, Rockville, Md. S. Fowler (principal investigator), J. Bamdad, S. Bergman, C. Christophi, S. Grau, M. Hanson, K. Hirst, K. Jablonski, L. Pyle, A. Sapozhnikova, G. Styles, F. Walker-Murray; Administrative Center, St. Joseph Mercy Oakland Hospital, Pontiac, Mich. P. Stein (principal investigator), A. Beemath, F. Kayali; Project Office, National Heart, Lung, and Blood Institute, Bethesda, Md. C. Vreim, M. Wu, G. Zheng; Data Safety Monitoring Board J. Dalen (chair), C. Freund, B. Hillman, T. Hyers, R. Matthay, F. Miller, D. Naidich, M. Schluchter, B. Thompson, H. Peavy (executive secretary); Steering Committee P. Stein (chair), S. Fowler, L. Goodman, A. Gottschalk, C. Hales, R. Hull, K. Leeper, J. Popovich, H. Sostman, V. Tapson, C. Vreim, J. Weg, P. Woodard; Operations Committee P. Stein (chair), S. Fowler, C. Hales, R. Hull, H. Sostman, V. Tapson, C. Vreim, J. Weg; Writing Committee P. Stein (chair), S. Fowler, C. Hales, R. Hull, H. Sostman, J. Weg; Outcome Committee D. Quinn (chair), J. Buckley, K. Leeper, G. Pineo, J. Popovich, A. Sanders, H. Sostman, V.F. Tapson, T. Wakefield, J. Weg, P. Woodard, R. Yusen; Ethics Committee J. Weg (chair), S. Fowler, A. Greenfield, H. Royal, A. Shepard, C. Vreim, D. Yankelevitz; Ancillary Studies Committee G. Pineo (chair), C. Hales, S. Fowler, P. Stein: DSA Working Group T. Sos (chair), D. Brown, K. Cho, C. Fan, K. Kandarpa, D. McVinnie, M. Sheline, T. Smith, B. So, D. Trost, A. Waltman; CT Working Group L. Goodman (chair), P. Burrowes, B. Hatfield, J. Heiken, C. Henschke, L. Heyneman, E. Kazerooni, J. MacGregor, H. McAdams, T. McLoud, S. Patel, J. Shepard, D. Spizarny, C. Wittram, P. Woodard, R. Woodcock, D. Yankelevitz; VentilationPerfusion Scan Working Group A. Gottschalk (chair), M. Brown, R. Coleman, S. Goldsmith, C. Molnar, E. Palmer, H. Royal, J. Scott; Venous Ultrasound Working Group T. Wakefield (chair), G. Brunet, B. Fex, A. Fisher, K. Fiest, M. McPharlin, B. Rubin, A. Shepard, G. Skardasis, A. Waltman, P. Woodard; Clinical Science Working Group R. Hull (chair), C. Hales, K. Leeper, G. Pineo, J. Popovich, D. Quinn, P. Stein, V. Tapson, J. Weg, J. Buckley, R. Yusen; Publications Committee C. Hales, H. Sostman (cochairs), S. Fowler, G. Pineo, P. Stein, V. Tapson, P. Woodard.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||
Related Letters:
Computed Tomography for Pulmonary Embolism
Altschuler E. L., Brotman D. J., Stein P. D., Goodman L. R., Sostman H. D.
Extract |
Full Text |
PDF
N Engl J Med 2006;
355:955-956, Aug 31, 2006.
Correspondence
This article has been cited by other articles:
HOME | SUBSCRIBE | SEARCH | CURRENT ISSUE | PAST ISSUES | COLLECTIONS | PRIVACY | HELP | beta.nejm.org Comments and questions? Please contact us. The New England Journal of Medicine is owned, published, and copyrighted © 2008 Massachusetts Medical Society. All rights reserved. |