| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Circulation. 2007;115:3103-3110.)
© 2007 American Heart Association, Inc.
Heart Failure |
From the University of Toronto, St Michaels Hospital, Toronto, Ontario, Canada (G.W.M.); McGill University, Montreal, Quebec, Canada (H.Z.); Harvard Medical School, Massachusetts General Hospital, Boston (J.L.J.); and Dalhousie University, Queen Elizabeth II Health Sciences Center, Halifax, Nova Scotia, Canada (J.H.).
Correspondence to Gordon W. Moe, MD, St. Michaels Hospital, 30 Bond St, Toronto, Ontario, Canada, M5B1W8. E-mail moeg{at}smh.toronto.on.ca
Received October 25, 2006; accepted April 9, 2007.
| Abstract |
|---|
|
|
|---|
Methods and Results We tested the hypothesis that NT-proBNP testing improves the management of patients presenting with dyspnea to emergency departments in Canada by prospectively comparing the clinical and economic impact of a randomized management strategy either guided by NT-proBNP results or without knowledge of NT-proBNP concentrations. Five hundred patients presenting with dyspnea to 7 emergency departments were studied. The median NT-proBNP level among the 230 subjects with a final diagnosis of heart failure was 3697 compared with 212 pg/mL in those without heart failure (P<0.00001). Knowledge of NT-proBNP results reduced the duration of ED visit by 21% (6.3 to 5.6 hours; P=0.031), the number of patients rehospitalized over 60 days by 35% (51 to 33; P=0.046), and direct medical costs of all ED visits, hospitalizations, and subsequent outpatient services (US $6129 to US $5180 per patient; P=0.023) over 60 days from enrollment. Adding NT-proBNP to clinical judgment enhanced the accuracy of a diagnosis; the area under the receiver-operating characteristic curve increased from 0.83 to 0.90 (P<0.00001).
Conclusions In a universal health coverage system mandating judicious use of healthcare resources, inclusion of NT-proBNP testing improves the management of patients presenting to emergency departments with dyspnea through improved diagnosis, cost savings, and improvement in selected outcomes.
Key Words: costs and cost analysis healthcare economics and organizations heart failure natriuretic peptides
| Introduction |
|---|
|
|
|---|
A potential strategy to improve the management of patients with acute HF involves the use of biomarkers with demonstrated incremental value in diagnosis that would result in improved therapeutic decisions and cost savings. Among the cardiac biomarkers, the natriuretic peptides, namely B-type natriuretic peptide (BNP) and the amino-terminal fragment of the precursor protein (NT-proBNP), have been shown to be useful in establishing the diagnosis of acute HF and providing short-term prognostic information in patients presenting to urgent care settings with dyspnea.1018 However, previous trials, particularly those of NT-proBNP, involved a relatively small number of patients,10,14 were conducted in single centers,10,12,14 or were not randomized in design.15 Furthermore, the larger-scale studies of BNP and NT-proBNP were conducted in centers in the United States,12,15 where per capita healthcare spending is about twice that of Canada.3 These published data, although important, are not necessarily applicable to Canada or other countries with publicly funded universal healthcare coverage systems that mandate judicious allocation of health resources.3 Although natriuretic peptide testing is proposed to be cost-effective for the evaluation and management of patients with dyspnea,1820 no data exist that are based on practice patterns endorsed by universal coverage systems. Accordingly, the overall objective of our prospective, randomized, controlled multicenter trial was to test the hypothesis that a strategy that included knowledge of NT-proBNP results would improve the management of patients with suspected acute HF in Canada. The specific objectives were to evaluate whether NT-proBNP added incremental value to clinical judgment in diagnosing acute HF and whether a management strategy that incorporated knowledge of NT-proBNP results would lead to cost-savings without compromising clinical outcomes compared with conventional care.
Editorial p 3045
Clinical Perspective p 3110
| Methods |
|---|
|
|
|---|
Study Sample
A total of 534 subjects >18 years of age presenting to the emergency departments (EDs) from 7 participating sites with dyspnea of suspected cardiac origin were screened from December 2004 to December 2005. Thirty-four subjects were excluded from the study on the basis of either protocol violation or not fulfilling protocol inclusion/exclusion criteria. Exclusion criteria were advanced renal failure (serum creatinine >250 µmol/L), acute myocardial infarction, malignant disorders, and dyspnea from clinically overt origins, including pneumothorax and chest wall trauma.
Study Protocol and Data Collection
The overall study design and protocol are displayed in Figure 1. Patients were screened consecutively from the participating sites. After enrollment, baseline demographics, medical history, and clinical signs were documented, along with standard diagnostic tests such as ECG, chest x-ray, and standard blood tests. A separate blood sample was collected for NT-proBNP measurement. Open-label BNP or NT-proBNP measurements were not used at any time during the study. At the end of the clinical evaluation and with knowledge of the results of standard diagnostic tests except for NT-proBNP, the ED physician was asked to commit to a diagnosis of whether a patient had HF or not and separately to estimate on a scale of 0% to 100% the likelihood that acute HF was the cause of dyspnea. Afterward, patients were randomly assigned to 2 groups based on management strategies that involved only conventional measures (the usual care group) or conventional measures plus knowledge of NT-proBNP results (the NT-proBNP group). A randomization schedule was generated in each center in blocks of 4 patients by sealed envelope accessible only by the research coordinator. The schedule linked sequential numbers to treatment codes allocated at random and was prepared on a 1:1 basis. Details of the treatment codes were unknown to anyone except the staff who assigned the patient to one of the diagnostic arms in a consecutive manner. The results of NT-proBNP were made available only to the ED and other physicians who managed the patients in the NT-proBNP group and were provided immediately after randomization. These physicians were provided with information to interpret the NT-proBNP results based initially on data supplied by the manufacturer of the assay and later on information derived from the N-Terminal Pro-BNP Investigation of Dyspnea in the Emergency Department (PRIDE) study when the primary results from the present study were published.12 In hospitalized patients, NT-proBNP measurements also were obtained 72 hours after admission to provide predischarge NT-proBNP values to further guide subsequent management.
|
Confirmation of Diagnosis
For adjudication, 2 cardiologists were provided with hospital records, including the discharge summary, results of laboratory and radiographic testing, echocardiograms if performed, clinical notes from the time of ED presentation to the 60-day follow-up, and outcome of the telephone interview. Using all available data, the cardiologists assigned a diagnosis without knowledge of the NT-proBNP results. Patients were classified by diagnosis at presentation into 1 of 3 categories: acute HF, not HF in a patient who had previous HF and/or left ventricular dysfunction, or no incident or prevalent HF.
NT-proBNP Assays
NT-proBNP analysis was performed with the commercially available immunoassay using the Elecsys 1010, 2010, or E170 proBNP assay (Roche Diagnostics GmbH, Manheim, Germany). Details of the assays, including cross-reactivity and coefficients of variation, have previously been reported.12,21
Cost Analysis
The total direct medical costs, including the costs of the NT-proBNP test at the initial ED visits, initial and subsequent ED visits, hospitalizations, physician fees, and outpatient services, were calculated. The frequencies of ED visits and hospitalizations were collected from hospital chart records, and those of outpatient services were estimated from the 60-day patient telephone interviews and chart records. The total costs were calculated by multiplying the frequencies by the unit costs. All costs were translated into 2005 Canadian dollars using the Consumer Price Index healthcare component for Canada and converted into 2005 US dollars using the Bank of Canada annual exchange rate for 2005 (1.21163).22 Economic analysis was conducted from the perspective of third-party payers with an analytic horizon of 60 days.23,24 Time to discharge from the ED between the patients arrival and clinical decision by an ED physician regarding patient disposition was calculated. The costs of the ED visits were based on the ED hospital budget records of 496 reporting hospitals using the Canadian Institute of Health Information Database, the national data source for financial and statistical information. Standard Canadian Institute of Health Information costing methodology was used to calculate hospital costs.25 Briefly, the medical records of 2.4 million patient records of all discharges from hospitals were categorized annually by the Canadian Institute of Health Information into case-mix groups. Each case-mix group was assigned a relative intensity weight, further divided into 4 complexity levels and 3 age groups,25 and then translated into costs. Physician fees and costs of outpatient diagnostic and laboratory services were estimated using the average reimbursement fees from the provinces of Ontario and Quebec,26,27 representing >60% of healthcare expenditures. The cost of the NT-proBNP test provided in the ED, including operating and capital costs, was estimated to be $37.
Data and Statistical Analyses
Receiver-operating characteristic (ROC) curve analyses were performed for NT-proBNP with the adjudicated diagnosis as the reference standard. ROC curves for NT-proBNP and ED physicianestimated likelihood of HF were plotted. A logistic regression model that contained a combination of NT-proBNP and physician-estimated likelihood was analyzed in predicting the final adjudicated diagnosis. A likelihood-ratio
2 test obtained from the logistic regression models was used to assess whether NT-proBNP added incremental value to clinical judgment in predicting HF.
The primary analysis was a comparison of the 2 study groups, with the duration of the initial ED visit and the total direct medical costs of treatment as primary end points. Secondary end points included initial hospital length of stay, in-hospital and 60-day mortality, and rehospitalization. In the sample size calculation, the trial was designed to enroll at least 239 patients in each group, providing a power of 80% to detect a reduction in ED time from 9 to 7.2 hours (20% reduction) with the use of NT-proBNPguided strategy. Assumptions included the use of a 2-tailed test, a 5% level of significance, and an SD of 7 hours in both groups. All data were analyzed according to the intention-to-treat principle. Comparisons were made with the Student unpaired 2-sided t test and the Wilcoxon 2-sample test when the values were not distributed normally. Between-group comparisons of baseline clinical characteristics were performed with
2 or Fisher exact test for categorical data and t tests or Wilcoxon rank sum tests for continuous data when appropriate. Blood NT-proBNP levels and other data that are not normally distributed are expressed as medians and interquartile range (Q1 to Q3). Comparisons of NT-proBNP values between the diagnostic categories were performed with the Kruskal-Wallis test. All analyses were performed with SAS software version 9.1.3 for Windows (SAS Institute Inc, Cary, NC). A value of P<0.05 was considered significant.
The authors had full access to and take full responsibility for the integrity of the data. All authors have read and agree to the manuscript as written.
| Results |
|---|
|
|
|---|
Baseline Patient Characteristics
Baseline demographic and clinical characteristics of the NT-proBNP and usual care group are shown in Table 1. Both groups had similar characteristics. Patients recruited were mostly elderly with an even gender distribution. More than a third had prior history of HF or left ventricular dysfunction by self-report or medical records. By definition, all patients presented with dyspnea; however, fewer than half of the patients had symptoms and signs that were conventionally associated with HF.
|
Clinical Diagnoses and Decisions
The final diagnoses adjudicated by 2 cardiologists blinded to the results of NT-proBNP were acute HF in 230 subjects (46%), not acute HF in patients with a history of HF and/or left ventricular dysfunction in 45 subjects (9%), and not acute HF in patients without prior HF in 225 subjects (45%). For all patients, the mean duration of stay in the ED was 7.2±5.4 hours (mean±SD). Two hundred eighty-five patients (57%) were subsequently admitted to hospital from the ED.
Comparison of Strategies of Usual Care and NT-proBNPGuided Care
The clinical outcome data for the 2 randomized groups in all 500 patients are shown in Table 2. The median duration of the initial ED visit was 5.6 hours in the NT-proBNP group and 6.3 hours in the usual care group (P=0.0309). The differences in initial hospitalizations, the hospital length of stay, the initial intensive care unit admissions and length of stay, and initial and 60-day mortality were not statistically significant. However, a significant reduction in the number of patients rehospitalized by 60 days (13% versus 20%; P=0.0463) was observed. Direct medical costs over 60 days of follow-up are shown in Table 3. The use of NT-proBNP tests reduced total direct medical costs to the healthcare system by 15% from $6129 to $5180 (P=0.0232). To understand the contribution of outpatient use of diagnostic tests to the overall cost reduction, the proportion of patients who had undergone various advanced diagnostic tests related to the assessment of dyspnea are shown in Figure 2. Overall, the frequency of outpatient use of these diagnostic tests was relatively low, but there was a tendency for less use of echocardiography, radionuclide ventriculography, and computed tomography scan of the chest in the NT-proBNP group. Finally, to understand whether the benefit of knowing NT-proBNP results was derived from patients with an intermediate likelihood of a diagnosis of HF as judged by the ED physicians, the data of clinical outcomes and direct medical costs of the 2 treatment groups were analyzed for the 219 patients with a 20% to 80% likelihood of HF. As shown in Tables 4 and 5
, knowledge of NT-proBNP results appears to have a greater impact on the duration of ED visits and the costs of initial and subsequent ED visits in these patients compared with the entire study group.
|
|
|
|
|
NT-proBNP Combined With Clinical Judgment in the Diagnosis of HF
Median NT-proBNP level (3697 pg/mL) was significantly greater in patients with a confirmed diagnosis of acute HF than in patients whose dyspnea was not due to HF (212 pg/mL) (Figure 3). ROC curves comparing the sensitivity and specificity of clinical judgment alone, NT-proBNP testing, and the 2 combined are shown in Figure 4. Clinical judgment alone using different levels of certainty generated an area under the curve (AUC) of 0.83 (95% CI, 0.80 to 0.84; P<0.001). When clinician assessment of acute HF was expressed as a binary outcome, the sensitivity and specificity were 78% and 81%, respectively. Adding NT-proBNP results to those of clinical judgment alone significantly improved performance, increasing the AUC to 0.90 (95% CI, 0.90 to 0.93; P<0.0001; P=0.00001 versus clinical judgment alone). Although not a prespecified analysis, compared with clinical judgment alone, NT-proBNP results had an AUC of 0.86 (95% CI, 0.84 to 0.89; P<0.001), which was numerically superior to clinical judgment, but the difference was not statistically significant.
|
|
| Discussion |
|---|
|
|
|---|
The findings of the present study confirm our primary hypothesis that the use of NT-proBNPguided strategy is superior to a sole conventional clinically guided strategy in the management of patients with suspected acute HF. Our patients were representative of patients assessed at the participating sites. As expected, NT-proBNP levels were higher in patients with an adjudicated diagnosis of HF compared with those without, consistent with previous nonrandomized studies of BNP and NT-proBNP,12,13,15 and the addition of NT-proBNP testing to clinical judgment provided incremental value to help establish a diagnosis of HF. Interestingly, NT-proBNP testing was not statistically superior to clinical judgment alone, which differed from findings of previous trials.12,16 The reasons for the smaller AUC of the ROC curve of NT-proBNP testing alone in the present study are unclear but may relate in part to the fact that the present study was a multicenter trial and in part to demographic differences in our patient population. Furthermore, we did not perform age-stratified analyses in this primary report, which, in the PRIDE and International Collaborative of NT-proBNP studies, yielded higher sensitivity and specificity for the "rule-in" cutoffs.12,13 Our findings therefore strongly support the position adopted by recently published HF consensus guidelines that advocate the use of NT-proBNP as a complement rather than an alternative to clinical assessment.28
Although the additive diagnostic value of NT-proBNP is important to define in our healthcare system, the primary study objective was to prospectively evaluate potential cost savings associated with a management strategy that involves knowing NT-proBNP testing. Knowledge of NT-proBNP results reduced the time spent in the ED, the number of patients hospitalized, and the total direct medical costs over the 60-day follow-up. The observation that less expensive tests associated with the investigation of dyspnea were performed in patients from the NT-proBNP group raises the possibility of a contribution of a more careful outpatient use of resources to the overall cost savings demonstrated. Finally, the demonstration that the knowledge of NT-proBNP results appeared to have greater impact on patients with an intermediate probability of a diagnosis of HF suggests that the NT-proBNPguided strategy should be valuable in this patient subgroup.
The cost savings observed in the present study are consistent with those reported in another randomized trial, the Acute Shortness of Breath Evaluation (BASEL) study,18 which used the point-of-care BNP assay. In this single-center study, a cost reduction of 25% over 180 days was reported.19 Cost savings also have been reported recently in a decision model analysis of the PRIDE study.20 Our health economic findings, the first derived from a randomized multicenter study sample, fit well with those from other healthcare systems and therefore provide a strong rationale for the inclusion of natriuretic peptides testing in the ED.
Several limitations of the present study are worthy of mention. Other than reducing the number of subjects readmitted to the hospital during the first 60 days from evaluation, knowledge of NT-proBNP results did not result in any major improvement in clinical outcomes to 60 days, including lack of statistically significant differences in the initial rate of hospitalization, hospital length of stay, or mortality rates, among those in the NT-proBNPguided arm. This lack of improvement also was observed in the BASEL study.18 These findings, however, are not unexpected given that both studies were not powered to assess hard clinical outcomes and follow-up was relatively short. In addition, we point out that, while nonsignificant, the cost and outcome results are all directionally consistent, favoring NT-proBNPguided evaluation over usual care. The mechanism for the reduced number of patients rehospitalized remains unclear. It is possible that a more confident diagnosis of HF led to use of therapies that favorably affected outcome; alternatively, for those with low NT-proBNP levels, physicians might have diverted more to outpatient instead of inpatient management. Finally, in light of the multiple testing without corresponding adjustment of per-test significance levels, even though our results provide evidence of benefit from NT-proBNPbased evaluation of the dyspneic patient on the primary end point of the present study, interpretation of our results for other end points should be approached with caution. Further studies should evaluate potential reductions in morbidity or mortality and the cost-effectiveness related to natriuretic peptideguided management of dyspnea.
In summary, the present study shows that, in a universal-access publicly funded healthcare system that mandates judicious resource allocation, a strategy that uses NT-proBNP testing in conjunction with clinical assessment improves the overall management of patients presenting to the ED with suspected acute HF through the facilitation of diagnosis and provides health cost savings that are accompanied by an improvement in selected clinical outcomes.
| Acknowledgments |
|---|
Source of Funding
The present study was supported by Roche Diagnostics Canada, Laval, Quebec, Canada.
Disclosures
Dr Moe has received a research grant and honoraria from Roche Diagnostics Canada. Dr Januzzi has received research grants, honoraria, and consulting fees from Roche Diagnostics, Dade-Behring, and Ortho Clinical Diagnostics. H. Zowall has received a research grant and consulting fees from Roche Diagnostics Canada. Dr Howlett reports no disclosures.
| References |
|---|
|
|
|---|
| Footnotes |
|---|
This article has been cited by other articles:
![]() |
H. J Schunemann, A. D Oxman, J. Brozek, P. Glasziou, R. Jaeschke, G. E Vist, J. W Williams Jr, R. Kunz, J. Craig, V. M Montori, et al. Grading quality of evidence and strength of recommendations for diagnostic tests and strategies BMJ, May 17, 2008; 336(7653): 1106 - 1110. [Full Text] [PDF] |
||||
![]() |
E. Braunwald Biomarkers in Heart Failure N. Engl. J. Med., May 15, 2008; 358(20): 2148 - 2159. [Full Text] [PDF] |
||||
![]() |
T. Chung, A. Sindone, and S. B. Freedman Letter by Chung et al Regarding Article, "N-Terminal Pro B-Type Natriuretic Peptide Testing Improves the Management of Patients With Suspected Acute Heart Failure: Primary Results of the Canadian Prospective Randomized Multicenter IMPROVE-CHF Study" Circulation, January 1, 2008; 117(1): e5 - e5. [Full Text] [PDF] |
||||
![]() |
G. W. Moe, J. Howlett, J. L. Januzzi, and H. Zowall Response to Letter Regarding Article, "N-Terminal Pro B-Type Natriuretic Peptide Testing Improves the Management of Patients With Suspected Acute Heart Failure: Primary Results of the Canadian Prospective Randomized Multicenter IMPROVE-CHF Study" Circulation, January 1, 2008; 117(1): e6 - e6. [Full Text] [PDF] |
||||
![]() |
L. B. Daniels and A. S. Maisel Natriuretic Peptides J. Am. Coll. Cardiol., December 18, 2007; 50(25): 2357 - 2368. [Abstract] [Full Text] [PDF] |
||||
![]() |
W.H. W. Tang and G. S. Francis The Year in Heart Failure J. Am. Coll. Cardiol., December 11, 2007; 50(24): 2344 - 2351. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Circulation Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2007 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |