(Circulation. 2000;102:380.)
© 2000 American Heart Association, Inc.
Clinical Investigation and Reports |
From the Department of Epidemiology, University of Michigan, Ann Arbor (L.F.B., P.A.P.), and the Division of Cardiovascular Diseases (J.A.R., R.S.S.) and Department of Diagnostic Radiology (P.F.S.), Mayo Clinic and Foundation, Rochester, Minn. Dr Rumberger is currently at HeartCare Inc, Gahanna, Ohio, and is Professor of Medicine in the Department of Cardiology, Ohio State University, Columbus.
| Abstract |
|---|
|
|
|---|
50% stenosis) and determined the
optimal strata for quantity of coronary artery calcification to
facilitate clinical decision-making.
Methods and ResultsClinical research patients (n=213) were
examined with coronary angiography and EBCT (angiography
group), and 765 research participants were examined with only EBCT
(nonangiography group). Of the angiography group, 53% had obstructive
CAD. After adjustment for verification bias, the estimated sensitivity
and specificity for calcium score
1 were 97.0% and 72.4%,
respectively. Likelihood ratios for strata of calcium score associated
with obstructive CAD were calculated in each sex and 2 age groups.
Among those
50 years old, the same 4 strata of EBCT calcium scores
were identified in each sex; likelihood ratios ranged from 0.03
(calcium score 0) to 12.85 (calcium score
200). The same 3 strata of
EBCT calcium scores were identified in each sex among those <50 years
old; likelihood ratios ranged from 0.13 (calcium score 0) to 190
(calcium score
100).
ConclusionsA calcium score
200 among those
50 years old and
calcium score
100 among those <50 years old provided strong evidence
that patients of either sex had obstructive CAD. A calcium score of 0
provided strong evidence that patients
50 years old did not have
obstructive CAD.
Key Words: coronary disease calcium tomography
| Introduction |
|---|
|
|
|---|
The usefulness of EBCT in diagnostic clinical decision-making has not been clearly established in a probabilistic model. Application of cardiac testing (eg, exercise-induced ST-segment response8 ) is predicated on first defining the probability of CAD on the basis of clinical information (pretest probability) and then revising the probability up or down based on test results (posttest probability).
Estimates of the sensitivity of the presence of CAC at EBCT to detect
obstructive CAD, defined as
50% stenosis at angiography, are
high, and the negative predictive value approaches 100% in most
studies.9 10 11 12 13 14 The estimates of sensitivity and specificity
are biased, however, because the information regarding the ability of
EBCT to predict obstructive CAD comes to us through studies of
symptomatic patients who had their CAD status verified with
coronary angiography. Generally, as a result of this
"verification" bias, sensitivity will be overestimated (because
positive EBCT results will be overrepresented) and
specificity will be underestimated (because negative EBCT results will
be underrepresented) in those receiving angiography.
Methods to adjust for its presence have been demonstrated for other
noninvasive tests for CAD, such as exercise
echocardiography15 16 and
201Tl single photon emission CT17
but not for EBCT.
The clinical interpretation of quantity of CAC to estimate the probability of obstructive CAD remains ill-defined and has not been investigated via a traditional Bayesian approach to pretest and posttest probabilities of disease. The posttest probability of disease is derived from the pretest probability and the likelihood ratio. A likelihood ratio is an expression of the odds that a given test result will occur in an individual with the disease as opposed to an individual without the disease.18 Likelihood ratios can be calculated simultaneously for different levels (strata) of quantitative test results; therefore, it is possible to separate a slightly positive test result from a markedly positive test result and to weigh the value of each accordingly.19
The purpose of this investigation was to (1) estimate sex- and age-groupspecific likelihood ratios for EBCT to predict obstructive CAD after adjustment for verification bias and (2) use these adjusted likelihood ratios to determine strata of quantity of CAC within sex and age groups to facilitate probabilistic clinical decision-making.
| Methods |
|---|
|
|
|---|
The sample and study protocol of the angiography group have been described previously.14 Patients undergoing clinically indicated angiography for the diagnosis of obstructive CAD were invited to participate in the study and be examined with EBCT if they had not had previous angioplasty, bypass surgery, or heart transplantation. Seventy-five percent (n=160) underwent angiography for assessment of chest pain, 12% (n=25) had abnormal stress tests, 8% (n=17) had unexplained heart failure, and the remainder (5%, n=11) had a questionable history of prior infarction, pericarditis, or unexplained dyspnea.
Patients were not preselected for angiography on the basis of the
results of their EBCT examinations, and most had EBCT after their
angiography, usually on the following morning. These patients were
selected for angiography on the basis of conventional clinical factors
and at the request of their consulting cardiologist. Most were men (162
of 213, 76%) and were
50 years old (155 of 213, 73%). Because of
the sex and age distribution and given that these patients were highly
"likely" to have obstructive CAD, they would be expected to have a
higher prevalence and quantity of CAC than individuals chosen from a
random sample of the general population.20 21 Thus,
verification bias would be present in this angiography group.
To adjust for this bias, data on sex, age, and calcium score from 765
research participants who were examined with EBCT but not with
angiography during the same time period were incorporated into these
analyses. Individuals in this nonangiography group were
examined as part of a community-based study of the
epidemiology of CAC as described in detail
elsewhere.22 These participants were not physician- or
self-referred. None had a history of previous angioplasty, bypass
surgery, or other coronary surgery. Approximately half of the
nonangiography group were men (375 of 765, 49%), and half were
50
years old (383 of 765, 50%).
Measures
All angiograms were visually assessed by 2 angiographers. In the
case of disagreement in the interpretation of an angiogram, it was read
by a third angiographer, and the interpretation was arbitrated. CAD was
defined as obstructive CAD (
50% stenosis in
1 major
artery). Quantity of CAC was defined as the calcium score according to
Agatston et al.23
Statistical Analysis
The method of Begg and Greenes24 was used to
estimate the adjusted sensitivity and specificity of EBCT for
obstructive CAD in all patients undergoing EBCT. In the angiography
group, logistic regression models were used to estimate the probability
of having obstructive CAD. Variables included in the models were
age, sex, and a calcium score within a given stratum as described
below. By use of parameter estimates from these models, the
predicted probability of obstructive CAD was calculated for each
patient in the nonangiography group. These predicted probabilities were
then summed separately for those with a calcium score within the given
calcium score stratum and those with calcium scores outside the calcium
score stratum for each sex and for 2 age groups (those
50 years old
and those <50 years old). The adjusted sensitivities and specificities
within specific sex and age groups were estimated by combining these
sums for the nonangiography group with the observed numbers in the
angiography group. This process was repeated for each calcium score
stratum. The adjusted sensitivities and specificities were then used to
calculate stratum-specific likelihood ratios (SSLRs) for EBCT.
The likelihood ratio of a positive test is defined as sensitivity/(1-specificity), and the likelihood ratio of a negative test is defined as (1-sensitivity)/specificity.25 Likelihood ratios are the odds that a given test result will occur in an individual with the disease as opposed to an individual without the disease. Likelihood ratios range from zero to infinity.
The method of Peirce and Cornell26 was used to determine SSLRs along with their 95% CIs for stratum of calcium score in detecting obstructive CAD. This method has been used to investigate the validity of prostate-specific antigen levels in detecting prostate cancer.27 28 A likelihood ratio equal to 1 indicates that the given stratum of calcium score is not able to discriminate between those with and those without the disease, and there should be no revision of the pretest probability based on the test result. The pretest probability would be revised upward if the SSLR were >1 or downward if the SSLR were <1. The magnitude of the SSLR defines the amount of the revision.
Initially, the following 7 strata of EBCT coronary calcium
scores were evaluated: 0, 1 to 9, 10 to 49, 50 to 99, 100 to 199, 200
to 499, and
500. Two adjacent strata of calcium scores were combined
into one if the 95% CI of one SSLR overlapped an adjacent SSLR. The
process was repeated in each sex- and age-specific subgroup until there
was a monotonic increase in the SSLRs and the 95% CI of one stratum
did not overlap with the SSLRs of adjacent strata.26
To compare the findings with those presented by others, we
estimated the unadjusted sensitivity and specificity in the angiography
group and the adjusted sensitivity and specificity in the entire study
group for calcium score
1.
| Results |
|---|
|
|
|---|
|
In the angiography group, half (112 of 213, 52.6%) of the patients had
obstructive CAD, and calcium scores ranged from 0 to 4091.76.
Only 1 patient with obstructive CAD (0.9%) had a calcium score of 0,
but 39 patients without obstructive CAD (38.6%) had a calcium score of
0. Conversely, half (52 of 112, 46.4%) of the patients with
obstructive CAD had calcium scores
500, but few (3 of 101, 3.0%)
patients without obstructive CAD had calcium scores
500 (Table 1
). In the nonangiography group, more than half had calcium
scores of 0 (453 of 765, 59.2%), whereas few (33 of 765, 4.3%) had
calcium scores
500 (Table 1
).
Among patients
50 years old, 116 men and 39 women were in the
angiography group; 187 men and 196 women were in the nonangiography
group. After adjustment for verification bias, there were 4 optimal
strata of calcium score (Table 2
). In
both men and women, a calcium score equal to 0 had an SSLR close to 0.
Calcium scores of
200 had a high SSLR in both men [SSLR=12.85 (5.95,
27.76)] and women [SSLR=12.85 (5.46, 30.22)].
|
Among patients <50 years old, 46 men and 12 women were in the
angiography group; 188 men and 194 women were in the nonangiography
group. After adjustment for verification bias, there were 3 optimal
strata of calcium score (Table 3
). In
men, a calcium score equal to 0 had an SSLR that was close to 0.
Calcium scores
100 had a very high SSLR in men [SSLR=54.44 (13.41,
220.98)] and women [SSLR=189.69 (15.6, 2306.13)].
|
In the angiography group, the unadjusted sensitivity and specificity
for calcium score
1 were 99.1% and 38.6%, respectively. After
adjustment for verification bias, the estimated sensitivity and
specificity for calcium score
1 were 97.0% and 72.4%,
respectively.
| Discussion |
|---|
|
|
|---|
The higher prevalence and quantity of CAC in the angiography versus the nonangiography group indicate verification bias in the angiography group. Ideally, this bias would be avoided by randomly assigning patients having EBCT to CAD verification with angiography, without regard to clinical signs or symptoms. This is not possible because of the invasive nature of angiography. Using information from the nonangiography group, we adjusted for verification bias. The adjusted specificity of EBCT was substantially higher than the unadjusted estimate, whereas sensitivity was minimally lowered.
Application of the method of Peirce and Cornell26
identified 4 strata of EBCT calcium scores in patients
50 years old
and 3 strata of EBCT calcium scores in patients <50 years old for the
determination of obstructive CAD. Although categorization of patients
into 2 age groups (those
50 and those <50 years old) was useful for
clinical purposes, it is important to note that age and calcium score
are continuous variables. Future studies in a larger study group
could investigate likelihood ratios in more age groups. Below are
interpretations of the SSLRs, based on guidelines suggested by Jaeschke
et al.29
In men and women
50 years old, a calcium score of 0 indicated a large
downward revision of the probability of obstructive CAD. In men, scores
between 1 and 49 provided small downward revisions in the pretest
probability, whereas in women, there would be no revision in the
pretest probability of obstructive CAD. For both sexes, scores between
50 and 199 provided a small upward revision in the pretest probability.
Calcium scores of
200 provided strong evidence in both sexes of
obstructive CAD, and the pretest probability should be revised upward.
In the angiography group, 48% of the men and women
50 years old had
calcium scores of
200; in the nonangiography group, 14% of the men
and women
50 years old had calcium scores
200.
In men and women <50 years old, a calcium score of 0 indicated only a
moderate downward revision in the probability of obstructive CAD. In
men <50 years old, scores between 1 and 49 provided no revision in the
pretest probability, whereas in women <50 years old, there would be a
small upward revision in the pretest probability of obstructive CAD.
Scores
100 provided very strong evidence in both sexes of obstructive
CAD, and the pretest probability should be revised upward. In the
angiography group, 14% of the men and women <50 years old had calcium
scores
100; in the nonangiography group, 3% of the men and women
<50 years old had calcium scores
100.
In previous studies,9 10 11 12 13 14 the negative predictive value of
a calcium score of 0 for obstructive CAD approached 100%. In the
present study, a calcium score of 0 provided very strong evidence
that patients
50 years old did not have obstructive CAD, and the
pretest probability would be revised downward. In patients <50 years
old, however, a calcium score of 0 would provide for only a small
downward revision in the pretest probability of CAD. This is
consistent with the high prevalence of CAC and CAD found in
individuals
50 years old and the low prevalence of CAC and CAD found
in individuals <50 years old.20 21 Interestingly, among
the 14 patients with obstructive CAD and positive calcium scores <50,
11 of 14 (78.6%) had CAC in the same artery as the obstructive lesion
(data not shown).
Application
Graphs of the posttest probabilities illustrate the discriminating
power of EBCT examinations for CAC for men and women
50 years old
(Figures 1
and 2
) and men and women <50 years old
(Figures 3
and 4
). These figures show the posttest
probabilities of obstructive CAD as functions of the pretest
probabilities and the SSLRs. The pretest probabilities range from 0%
to 100%. For a specific pretest probability, the vertical distance
between a point on the line indicating the posttest probability and the
equity line indicates the size of the difference between the pretest
and posttest probabilities as well as the direction of the
revision.
|
|
|
|
For all strata of calcium score, differences between pretest and posttest probabilities were greatest for patients with an intermediate pretest probability. For pretest probabilities close to 0 or 1, the gain in information from the EBCT examination was relatively small. Thus, patients with a very low or very high pretest likelihood of obstructive disease may not receive much benefit from testing with EBCT. This same trend has also been observed with other noninvasive tests for CAD, such as traditional stress testing.30
The following examples illustrate how to interpret the figures.
Consider a patient who, on the basis of clinical information, was
judged to have a low to moderate pretest probability for having
obstructive CAD. This could be a man, 60 years old, with nonanginal
chest pain, described by Diamond and Forrester31 to have a
pretest probability of obstructive CAD of 0.28. For illustrative
purposes, suppose that this patient had a calcium score of 250. The
pretest probability for obstructive CAD of 0.28 would be noted on the
x axis of Figure 1
. Defining a vertical line to the
uppermost curve indicating a calcium score
200 and then noting the
corresponding coordinates on the y axis, the patients
posttest probability of obstructive CAD has increased substantially, to
0.85. Thus, this patient is very likely to have obstructive CAD and
may need to go on for further testing.
In the above example, if the same man had a score of 0 rather than a
score of 250, the posttest probability of obstructive CAD would be
revised to be very low (
0.01). With a CAC score of 0, this patient
and his clinician would most likely be reassured, and further testing
could be directed toward investigation of noncardiac sources of chest
pain.
Figure 2
for women
50, Figure 3
for men <50, and
Figure 4
for women <50 years old may be used in the same way to
evaluate pretest and posttest probabilities. If the tests are used in
series (eg, Diamond and Forrester combined the results of fluoroscopy
to detect CAC with stress testing in the diagnosis of obstructive
CAD31 ), the uncertainty in the posttest probability from
one test may be reduced by the use of another test. Thus, EBCT calcium
scores can be used alone or combined with other tests to contribute to
diagnostic clinical decision-making.
| Acknowledgments |
|---|
| Footnotes |
|---|
Received October 7, 1999; revision received February 11, 2000; accepted February 21, 2000.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. L. Kelly, D. Thickman, S. D. Abramson, P. R. Chen, S. F. Smazal, M. J. Fleishman, and S. C. Lingam Coronary CT Angiography Findings in Patients Without Coronary Calcification Am. J. Roentgenol., July 1, 2008; 191(1): 50 - 55. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. E. Cassidy-Bushrow, L. F. Bielak, P. F. Sheedy II, S. T. Turner, I. J. Kullo, X. Lin, and P. A. Peyser Coronary Artery Calcification Progression Is Heritable Circulation, July 3, 2007; 116(1): 25 - 31. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. E. Cassidy, L. F. Bielak, Y. Zhou, P. F. Sheedy II, S. T. Turner, J. F. Breen, P. A. Araoz, I. J. Kullo, X. Lin, and P. A. Peyser Progression of Subclinical Coronary Atherosclerosis: Does Obesity Make a Difference? Circulation, April 19, 2005; 111(15): 1877 - 1882. [Abstract] [Full Text] [PDF] |
||||
![]() |
M Frick, F Karakolcu, H Gschnitzer, H F Alber, A Stoeger, P Obrist, G Friedrich, F Weidinger, O Pachinger, and S P Schwarzacher Calcium score as assessed by multi-slice computed tomography does not predict maximum plaque burden: an in vitro study Heart, September 1, 2004; 90(9): 1057 - 1058. [Full Text] [PDF] |
||||
![]() |
M. Fornage, E. Boerwinkle, P. A. Doris, D. Jacobs, K. Liu, and N. D. Wong Polymorphism of the Soluble Epoxide Hydrolase Is Associated With Coronary Artery Calcification in African-American Subjects: The Coronary Artery Risk Development In Young Adults (CARDIA) Study Circulation, January 27, 2004; 109(3): 335 - 339. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Watanabe, T. Hiroki, and N. Koga Relation of Thoracic Aorta Calcification on Computed Tomography and Coronary Risk Factors to Obstructive Coronary Artery Disease on Angiography Angiology, July 1, 2003; 54(4): 433 - 441. [Abstract] [PDF] |
||||
![]() |
P. Hunold, F. M. Vogt, A. Schmermund, J. F. Debatin, G. Kerkhoff, T. Budde, R. Erbel, K. Ewen, and J. Barkhausen Radiation Exposure during Cardiac CT: Effective Doses at Multi-Detector Row CT and Electron-Beam CT Radiology, January 1, 2003; 226(1): 145 - 152. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Rumberger Noninvasive Coronary Angiography Using Computed Tomography: Ready to Kick It Up Another Notch? Circulation, October 15, 2002; 106(16): 2036 - 2038. [Full Text] [PDF] |
||||
![]() |
R. Vliegenthart, M. Oudkerk, B. Song, D.A.M. van der Kuip, A. Hofman, and J.C.M. Witteman Coronary calcification detected by electron-beam computed tomography and myocardial infarction. The Rotterdam Coronary Calcification Study Eur. Heart J., October 2, 2002; 23(20): 1596 - 1603. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Peyser, L. F. Bielak, J. S. Chu, S. T. Turner, D. L. Ellsworth, E. Boerwinkle, and P. F. Sheedy II Heritability of Coronary Artery Calcium Quantity Measured by Electron Beam Computed Tomography in Asymptomatic Adults Circulation, July 16, 2002; 106(3): 304 - 308. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. A. Lange, E. M. Lange, L. F. Bielak, C. D. Langefeld, S. L. Kardia, P. Royston, S. T. Turner, P. F. Sheedy II, E. Boerwinkle, and P. A. Peyser Autosomal Genome-Wide Scan for Coronary Artery Calcification Loci in Sibships at High Risk for Hypertension Arterioscler. Thromb. Vasc. Biol., March 1, 2002; 22(3): 418 - 423. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Wayhs, A. Zelinger, and P. Raggi High coronary artery calcium scores pose an extremely elevated risk for hard events J. Am. Coll. Cardiol., January 16, 2002; 39(2): 225 - 230. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. C. Keelan, L. F. Bielak, K. Ashai, L. S. Jamjoum, A. E. Denktas, J. A. Rumberger, P. F. Sheedy, II, P. A. Peyser, and R. S. Schwartz Long-Term Prognostic Value of Coronary Calcification Detected by Electron-Beam Computed Tomography in Patients Undergoing Coronary Angiography Circulation, July 24, 2001; 104(4): 412 - 417. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. K. Nallamothu, S. Saint, L. F. Bielak, S. S. Sonnad, P. A. Peyser, M. Rubenfire, and A. M. Fendrick Electron-Beam Computed Tomography in the Diagnosis of Coronary Artery Disease: A Meta-analysis Arch Intern Med, March 26, 2001; 161(6): 833 - 838. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. J. Budoff, G. A. Diamond, P. Raggi, Y. Arad, A. D. Guerci, T. Q. Callister, and D. Berman Continuous Probabilistic Prediction of Angiographically Significant Coronary Artery Disease Using Electron Beam Tomography Circulation, April 16, 2002; 105(15): 1791 - 1796. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Circulation Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2000 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |