Published Online
on March 12, 2007

A more recent version of this article appeared on March 27, 2007

This Article Full Text (PDF) All Versions of this Article: 115/12/1518    most recent CIRCULATIONAHA.106.633008v1 Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Request Permissions Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Shahian, D. M. Articles by Normand, S.-L. T. Search for Related Content PubMed PubMed Citation Articles by Shahian, D. M. Articles by Normand, S.-L. T. Pubmed/NCBI databases Medline Plus Health Information Coronary Artery Bypass Surgery Personal Medical Records Related Collections Health policy and outcome research CV surgery: coronary artery disease Related Article

Submitted on April 10, 2006
Accepted on December 22, 2006

Comparison of Clinical and Administrative Data Sources for Hospital Coronary Artery Bypass Graft Surgery Report Cards

David M. Shahian MD, Treacy Silverstein BS, Ann F. Lovett RN, MA, Robert E. Wolf MS, and Sharon-Lise T. Normand PhD^*

From Tufts University School of Medicine (D.M.S.), Harvard Medical School (T.S., A.F.L., R.E.W., S.-L.T.N.), and Harvard School of Public Health (S.T.N.), Boston, Mass.

^* To whom correspondence should be addressed. E-mail: Sharon{at}hcp.med.harvard.edu.

Background--Regardless of statistical methodology, public performance report cards must use the highest-quality validated data, preferably from a prospectively maintained clinical database. Using logistic regression and hierarchical models, we compared hospital cardiac surgery profiling results based on clinical data with those derived from contemporaneous administrative data.

Methods and Results--Fiscal year 2003 isolated coronary artery bypass grafting surgery results based on an audited and validated Massachusetts clinical registry were compared with those derived from a contemporaneous state administrative database, the latter using the inclusion/exclusion criteria and risk model of the Agency for Healthcare Research and Quality. There was a 27.4% disparity in isolated coronary artery bypass grafting surgery volume (4440 clinical, 5657 administrative), a 0.83% difference in observed in-hospital mortality (2.05% versus 2.88%), corresponding differences in risk-adjusted mortality calculated by various statistical methodologies, and 1 hospital classified as an outlier only with the administrative data-based approach. The discrepancies in volumes and risk-adjusted mortality were most notable for higher-volume programs that presumably perform a higher proportion of combined procedures that were misclassified as isolated coronary artery bypass grafting surgery in the administrative cohort. Subsequent analyses of a patient cohort common to both databases revealed the smoothing effect of hierarchical models, a 9% relative difference in mortality (2.21% versus 2.03%) resulting from nonstandardized mortality end points, and 1 hospital classified as an outlier using logistic regression but not using hierarchical regression.

Conclusions--Cardiac surgery report cards using administrative data are problematic compared with those derived from audited and validated clinical data, primarily because of case misclassification and nonstandardized end points.

Key words: coronary artery bypass surgery • databases • health policy • outcome assessment (health care) • statistics

Related Article:

Issue Highlights
Circulation 2007 115: 1503. [Extract] [Full Text]

This article has been cited by other articles:

				D. L. Davenport, C. W. Holsapple, and J. Conigliaro Assessing Surgical Quality Using Administrative and Clinical Data Sets: A Direct Comparison of the University HealthSystem Consortium Clinical Database and the National Surgical Quality Improvement Program Data Set American Journal of Medical Quality, September 1, 2009; 24(5): 395 - 402. [Abstract] [PDF]

				J. G. Modrall, E. B. Rosero, S. T. Smith, F. R. Arko, R. J. Valentine, G. P. Clagett, and C. H. Timaran Effect of Hospital Volume on In-Hospital Mortality for Renal Artery Bypass Vascular and Endovascular Surgery, August 1, 2009; 43(4): 339 - 345. [Abstract] [PDF]

				J. P. Jacobs, R. J. Cerfolio, and R. M. Sade The Ethics of Transparency: Publication of Cardiothoracic Surgical Outcomes in the Lay Press. Ann. Thorac. Surg., March 1, 2009; 87(3): 679 - 686. [Full Text] [PDF]

				K. F. Welke, B. S. Diggs, T. Karamlou, and R. M. Ungerleider Comparison of Pediatric Cardiac Surgical Mortality Rates From National Administrative Data to Contemporary Clinical Standards Ann. Thorac. Surg., January 1, 2009; 87(1): 216 - 223. [Abstract] [Full Text] [PDF]

				P. Garg, S.-L. T. Normand, T. S. Silbaugh, R. E. Wolf, K. Zelevinsky, A. Lovett, M. R. Varma, Z. Zhou, and L. Mauri Drug-Eluting or Bare-Metal Stenting in Patients With Diabetes Mellitus: Results From the Massachusetts Data Analysis Center Registry Circulation, November 25, 2008; 118(22): 2277 - 2285. [Abstract] [Full Text] [PDF]

				A. F. Hernandez and S. M. O'Brien Sex Differences in Hospital Risk-Adjusted Mortality Rates for Medicare Beneficiaries Undergoing CABG Surgery--Invited Commentary Arch Intern Med, November 24, 2008; 168(21): 2323 - 2325. [Full Text] [PDF]

				L. Mauri, T. S. Silbaugh, R. E. Wolf, K. Zelevinsky, A. Lovett, Z. Zhou, F. S. Resnic, and S.-L. T. Normand Long-Term Clinical Outcomes After Drug-Eluting and Bare-Metal Stenting in Massachusetts Circulation, October 28, 2008; 118(18): 1817 - 1827. [Abstract] [Full Text] [PDF]

				S. C. Hammill and J. Curtis Publicly Reporting Implantable Cardioverter Defibrillator Outcomes: Grading the Report Card Circ Arrhythm Electrophysiol, October 1, 2008; 1(4): 235 - 237. [Full Text] [PDF]

				T.R. Vogel, R.G. Symons, and D.R. Flum Longitudinal Outcomes After Endovascular Repair of Abdominal Aortic Aneurysms Vascular and Endovascular Surgery, October 1, 2008; 42(5): 412 - 419. [Abstract] [PDF]

				L. Mauri, T. S. Silbaugh, P. Garg, R. E. Wolf, K. Zelevinsky, A. Lovett, M. R. Varma, Z. Zhou, and S.-L. T. Normand Drug-Eluting or Bare-Metal Stents for Acute Myocardial Infarction N. Engl. J. Med., September 25, 2008; 359(13): 1330 - 1342. [Abstract] [Full Text] [PDF]

				S. Westaby, N. Archer, N. Manning, S. Adwani, C. Grebenik, O. Ormerod, R. Pillai, and N. Wilson Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality BMJ, October 13, 2007; 335(7623): 759 - 759. [Abstract] [Full Text] [PDF]

				T. J. Ryan To Understand Cardiac Surgical Report Cards: Look Both Ways Circulation, March 27, 2007; 115(12): 1508 - 1510. [Full Text] [PDF]