(Circulation. 2003;107:1864.)
© 2003 American Heart Association, Inc.
Clinical Investigation and Reports |
From the University of Texas Southwestern Medical Center, Dallas, Tex (D.K.M.), and the Outcomes Research and Assessment Group, Duke Clinical Research Institute, Durham, NC (K.J.A., E.D.P.).
Correspondence to Darren K. McGuire, MD, MHSc, 5323 Harry Hines Blvd, Dallas, TX 75390-9047. E-mail darren.mcguire{at}utsouthwestern.edu
| Abstract |
|---|
|
|
|---|
Methods and Results The practice patterns of coronary revascularization among patients with diabetes and multivessel coronary artery disease (CAD) were analyzed using data collected in 1994 to 1997 from 13 centers participating in the National Cardiovascular Network. The study population included patients with diabetes and multivessel CAD who underwent elective coronary revascularization (n=9619). Over the 4 years of the study, the Clinical Alert had no significant impact on the proportion of diabetic patients undergoing percutaneous revascularization (28.6% before versus 26.8% after the Clinical Alert; P=0.06). Among individual hospitals, the probability of diabetic patients receiving percutaneous revascularization varied by >13-fold (4.3% to 56.6%). Adjusting for clinical factors and the BARI Clinical Alert did not alter this variability. Among the investigators surveyed, although 91% were aware of the Clinical Alert and 76% felt the findings were valid, >50% felt the Clinical Alert had limited or no impact on their personal or institutions care patterns.
Conclusions Limited consensus exists regarding the most appropriate method of revascularization for diabetic patients with multivessel CAD. The results from a large, randomized, clinical trial and subsequent Clinical Alert had no measurable impact on this practice variability.
Key Words: diabetes mellitus coronary disease revascularization bypass angioplasty
| Introduction |
|---|
|
|
|---|
See p 1837
The primary purpose of the present study was to evaluate the influence of the BARI trial diabetic findings and the associated NHLBI Clinical Alert on practice patterns. Using data from the National Cardiovascular Network (NCN) Coronary Revascularization Database, we evaluated the rates of percutaneous versus surgical revascularization among diabetic patients meeting BARI clinical eligibility criteria before and after the Clinical Alert release. We also examined the major clinical predictors of percutaneous coronary intervention (PCI) versus CABG, compared revascularization strategies among individual centers, examined the rates of use of coronary stents, and surveyed the principal investigators about their impressions of revascularization issues in diabetic patients.
| Methods |
|---|
|
|
|---|
Data Definitions
The NCN Data Standards Committee prospectively defined all data elements.5 For the present study, diabetes was defined by the use of insulin or oral hypoglycemic medication at the time of revascularization. Multivessel CAD was defined as >70% stenosis in
2 coronary arteries, without significant left main disease. PCI included balloon angioplasty, stenting, atherectomy, or excimer laser. Patients with >1 revascularization procedure were defined by the first procedure reported. An academic medical center was defined as having direct affiliation with a medical school.
Data Analysis
Baseline characteristics were compared using
2 tests for discrete variables and Kruskal-Wallis tests for continuous variables. A nonlinear mixed logistic regression model was used (SAS version 8.2) to test the association between the Clinical Alert and revascularization strategy. The response variable was PCI, and the hospitals were considered random effects. The fixed effects portion of the model was constructed using backward variable selection with significance set at 0.05, using univariate predictors (P<0.05) as candidate variables. Sensitivity analyses examined if either the date of the manuscript publication or the date of catheterization as a continuous variable coded as the number of days from beginning of the study interval (January 1, 1994) was statistically associated with PCI rates.
To adjust for possible confounding due to differences in patient mix before and after the alert, a propensity score model was developed based on patient and hospital characteristics to estimate each individuals probability of undergoing revascularization before the Clinical Alert. Patients were categorized into 5 groups based on the estimated propensity scores, and PCI rates were calculated using the method of direct adjustment.6 This method was also used to test possible associations between time period (ie, before or after the Clinical Alert) and revascularization strategy among individual hospitals and types of medical facilities. All statistical tests were 2-sided with a significance level of 0.05.
Physician Survey
All 29 principal investigators (cardiac surgeons and interventionalists) from the 13 NCN sites were asked to respond to a survey (Appendix 2) about the influence of the BARI diabetic finding on practice patterns at his or her institution.
| Results |
|---|
|
|
|---|
Baseline Characteristics
Table 1 presents baseline demographic and clinical information by treatment strategy. Patients undergoing PCI versus CABG were younger, more often female, more often minority, less likely to require insulin, and more likely to have renal insufficiency and a prior myocardial infarction. PCI patients were less likely to have congestive heart failure, hypertension, chronic lung disease, and peripheral vascular disease. PCI patients also had better systolic function and less severe CAD (31.2% had 3-vessel CAD versus 72.1% of CABG patients; P=0.001). Among the patients who underwent CABG and had detailed surgical information reported (n=5344), an internal mammary artery graft was used in 86.6% of the cases.
|
Influence of the Clinical Alert on Practice Patterns
Overall, 27.5% of the population underwent PCI and 72.5% underwent CABG. Neither the release of the Clinical Alert on September 21, 1995 (28.6% before versus 26.8% after; P=0.06), nor the publication of the main BARI article on July 25, 1996 (28.0% before versus 26.8% after, P=0.20), altered the proportion of diabetic patients undergoing PCI procedures compared with CABG (Figure 1). Although patients with 3-vessel CAD were less likely to have PCI than those with 2-vessel CAD throughout the study period, the Alert did not alter treatment patterns significantly in either patient subgroup (14.9% versus 13.6%, P=0.16; 49.8% versus 47.4%, P=0.16, respectively).
|
Table 2 displays the variables included in the regression model. The strongest predictor of treatment was CAD severity. Specifically, after controlling for other factors, patients with 3-vessel versus 2-vessel CAD were much less likely to undergo PCI versus CABG. Similarly, among patients with 2-vessel CAD, those with proximal left anterior descending artery stenosis were much less likely to undergo PCI. The presence of insulin treatment, chronic obstructive pulmonary disease, increased age, moderate or severe mitral regurgitation, Canadian Cardiovascular Society angina class 3 or 4, and history of congestive heart failure also decreased the likelihood of PCI. Other significant predictors of PCI included renal insufficiency and female sex. After multivariable adjustment, patients treated after the clinical alert were slightly more likely to receive PCI compared with those treated before the alert (odds ratio, 1.15; 95% confidence interval, 1.01 to 1.31; P=0.04). When the date of revascularization was included as a continuous variable in the model, which also adjusted for clinical case-mix, use of PCI tended to increase over time (odds ratio, 1.06 per 365 days; 95% confidence interval, 1.00 to 1.12; P=0.05).
|
Interhospital Variability in Revascularization Strategies
Overall, the use of PCI varied markedly among NCN sites (4.3% to 56.6%). Similar results were observed after stratification by number of diseased vessels, ranging from 25% to 84% among patients with 2-vessel CAD and from 1% to 46% among patients with 3-vessel CAD. After adjusting for clinical variables, there remained significant variability in the PCI rates, and significant changes in PCI likelihood after the Clinical Alert were observed in only 2 of 13 sites, both of which increased use of PCI (Figure 2).
|
Effect of Hospital Type on Treatment Selection
Overall, academic medical centers were more likely to use PCI compared with those not affiliated with a university (30.0% versus 23.3%; P=0.001). After adjusting for case mix, the rate of PCI did not change after the Alert among academic centers (30.1% versus 32.4%; P=0.07) or among centers not affiliated with a medical school (22.1% versus 23.4%; P=0.39) (Figure 3). Centers that had participated in BARI were less likely to use PCI than non-BARI affiliated centers (20.9% versus 29.0%; P=0.001). The adjusted rates of PCI after the Alert among centers that were BARI sites (24.6% versus 27.0%; P=0.31) and among centers not affiliated with the BARI study (28.7% versus 29.5%; P=0.46) were not statistically different.
|
Changes in PCI Strategy
During the study period, the use of intracoronary stents was emerging as an adjunct to conventional balloon angioplasty and may have contributed to the lack of effect of the Clinical Alert on practice. As expected, patients undergoing PCI after versus before the Clinical Alert were more likely to be treated with a coronary stent (50.8% versus 11.7%; P=0.001; Figure 4) However, we found no significant correlation between frequency of stent use among PCI cases and overall rate of PCI among centers (R2=0.01; Figure 5)
|
|
Physician Survey
We obtained survey responses from 21 of the 29 (72%) principal investigators at the 13 NCN sites, of whom 11 were interventional cardiologists and 10 were cardiac surgeons. Among respondents, 19 (91%) were aware of the BARI diabetic findings, 16 (76%) felt the diabetic findings were valid, and 14 (67%) believed they were generalizable to current practice at their institution. However, 10 (48%) felt that the BARI findings had limited or no influence on their institutions overall treatment decisions, and 11 (52%) felt the findings had limited or no impact on their personal practice patterns. The most common reasons offered for why practice patterns did not change markedly in the wake of BARI are presented in Figure 6; these included technological advances in revascularization care that made the BARI results obsolete (67%) and treatment preferences of the patient or referring physician (57%). Although 50% of cardiac surgeons viewed the BARI diabetic findings as "still relevant," only 20% of interventional cardiologists felt the study applied to current practice due to therapeutic advances.
|
| Discussion |
|---|
|
|
|---|
National Institutes of Health Clinical Alerts
The National Institutes of Health (NIH) adopted a policy in 1991 of publicizing results from NIH trials when the findings were felt to warrant an immediate change in clinical practice.9 These announcements are released as Clinical Alerts and Advisories on the National Library of Medicine website.10 To date, 23 Clinical Alerts and 5 Clinical Advisories have been released.
The impact of the NIH Clinical Alert program on practice patterns is unclear. One recent study found that carotid endarterectomy use increased almost immediately after each of 2 NIH Clinical Alerts were released.11 In contrast, we found no change in practice patterns over an extended period after the BARI Clinical Alert. These discordant observations provide an opportunity to review some of the challenges associated with incorporating clinical trial evidence into practice.
Dissemination of Information
To affect practice, clinical trial findings must be disseminated.12 The BARI results were summarized in the Clinical Alert, presented at scientific meetings, reported in the media, and summarized in the scientific press. The Alert was distributed to physicians, other healthcare providers, medical societies, government agencies, medical school libraries, and the press, and it is archived on the National Library of Medicine website.10 The primary BARI article, along with several reports exploring the diabetes findings, have been published and widely discussed.13,1316 As a result, >90% of the clinicians in our survey were aware of the BARI findings. Therefore, limited dissemination of the BARI results does not explain the lack of effect on clinical practice patterns.
Study Validity and Generalizability
Physicians must determine whether new study results are valid and applicable to their patients.17,18 The BARI study was a multicenter, randomized trial with complete follow-up that used "intention-to-treat" analysis, thereby meeting all of the major criteria for trial validity.17 Although the validity of the overall BARI results is not questioned, the appropriateness of the BARI diabetic substudy analysis has been debated.15,16 Specifically, the BARI diabetic findings are subject to all of the potential limitations of post hoc subgroup analyses.19
The validity of subgroup analyses can be strengthened by results from other studies. Similar to BARI, other randomized trials have reported improved survival among diabetic patients with multivessel CAD treated with CABG versus PCI.2022 Analyses from observational registries, however, have produced conflicting results.8,14,23,24 Despite these discrepancies, 76% of physicians surveyed thought the diabetic findings from BARI were valid, suggesting that these concerns do not account for their lack of influence on clinical practice.
Technological Advances
Another important challenge in the application of trial results involves the rapid advancement of healthcare technology, cited by 67% of the survey respondents as the major factor explaining the lack of influence of the Clinical Alert. Since BARI was initiated in 1988, coronary revascularization has changed markedly; it now includes the widespread use of coronary stents, glycoprotein IIb/IIIa receptor antagonists, and arterial bypass conduits.5,25 In the present study, we observed a 10-fold increase in the rate of stent use over the relatively short 4-year period. However, we observed no correlation between the rate of PCI and the respective institutional rate of stent use among PCI cases, suggesting that increasing use of intracoronary stents does not explain lack of influence of the Clinical Alert.
Whether these therapeutic advances will translate into improved outcomes compared with CABG among patients with diabetes and multivessel CAD undergoing PCI remains to be determined. Meta-analyses of glycoprotein IIb/IIIa trials suggest a mortality benefit associated with this class of drugs among the diabetic cohort,26,27 but their relative effects compared with CABG remain undefined. Further confounding these considerations is the emergence of drug-coated stents. The absence of a clinical consensus demonstrated by the present data and therapeutic advances in revascularization warrant continued clinical investigation.
Clinical Receptivity and Economic Challenges
The influence of data from randomized trials on clinical practice may also be affected by the receptiveness of the medical community to change and on the economic impact of these changes. For example, the 2 carotid endarterectomy Clinical Alerts promoted a strategy for stroke prevention beyond medical therapy that had been the mainstay of care11 and supported increases in diagnostic studies and surgical case volume. In contrast, the BARI results challenged the rapidly evolving clinical application of PCI as an alternative to CABG for the diabetic cohort. With diabetes affecting as many as 30% of patients undergoing PCI, surgical referral represents a significant decrease in caseload for interventional cardiologists. As such, it is not surprising that although 80% of the interventional cardiologists felt technological changes have made BARI "nonapplicable to current practice," the majority of cardiac surgeons believe that the results are still relevant (Figure 6).
Practice Variability
Perhaps the most remarkable finding in our study was the marked variability in revascularization strategies among 13 US centers (Figure 2). Even after accounting for CAD severity and other clinical factors, the rate of PCI varied widely from one center to another. Similarly, the use of stents during the study period varied considerably among the participating centers (Figure 5). These observations underscore the need to develop clinical consensus as therapeutic strategies emerge.
Limitations
We used the BARI clinical inclusion criteria; we were unable to review coronary angiograms as was done in BARI and, therefore, our study population approximates the BARI population. The 13 NCN centers may not accurately reflect national practice patterns. However, these sites represent a diverse geographic area and a balanced mix of academic and nonacademic centers. Our database did not have detailed anatomic information that may influence treatment, nor did we have data on the use of glycoprotein IIb/IIIa antagonists. Finally, it was not our intent to compare the long-term clinical outcome data of these revascularization strategies.
Conclusions
At 13 clinical centers participating in the NCN, a remarkable degree of variability was observed in the rate of PCI versus CABG among diabetic patients with multivessel CAD, demonstrating a lack of clinical consensus regarding revascularization in this high-risk population. Among these centers, the BARI diabetes findings and the resulting Clinical Alert had no measurable impact on overall clinical practice patterns or on intersite variability. The inability of the Clinical Alert, which was based on a multimillion dollar large-scale randomized trial, to modify clinical practice highlights a number of the challenges associated with implementing evidence-based medicine. These observations underscore the need for clinical trials to be planned, executed, analyzed, and reported in a timely fashion so that the findings are not obsolete before the results are known, and for clinicians to consistently apply the results of clinical trials to practice.
| Appendix 1 |
|---|
|
|
|---|
| Appendix 2 |
|---|
|
|
|---|
| Acknowledgments |
|---|
Received October 22, 2002; accepted February 5, 2003.
| References |
|---|
|
|
|---|
Related Article:
This article has been cited by other articles:
![]() |
A. Breeman, M. E. Bertrand, J. P. Ottervanger, S. Hoeks, M. Lenzen, U. Sechtem, V. Legrand, M.-J. de Boer, W. Wijns, E. Boersma, et al. Diabetes does not influence treatment decisions regarding revascularization in patients with stable coronary artery disease. Diabetes Care, September 1, 2006; 29(9): 2003 - 2011. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. B. King III, G. Dangas, J. W. Moses, S. B. King III, G. Dangas, and J. W. Moses Surgery Is Preferred for the Diabetic With Multivessel Disease Circulation, September 6, 2005; 112(10): 1500 - 1515. [Full Text] [PDF] |
||||
![]() |
T. P. Murphy, G. Soares, and M. Kim Increase in Utilization of Percutaneous Renal Artery Interventions by Medicare Beneficiaries, 1996-2000 Am. J. Roentgenol., September 1, 2004; 183(3): 561 - 568. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. L. Frye, M. M. Brooks, and R. W. Nesto Gap Between Clinical Trials and Clinical Practice: Lessons From the Bypass Angioplasty Revascularization Investigation (BARI) Circulation, April 15, 2003; 107(14): 1837 - 1839. [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Circulation Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2003 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |