Donate Help Contact The AHA Sign In Home
American Heart Association
Circulation
Search: search_blue_button Advanced Search
Circulation. 2008;117:2534-2541
doi: 10.1161/CIRCULATIONAHA.107.726836
This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Dimick, J. B.
Right arrow Articles by Upchurch, G. R.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Dimick, J. B.
Right arrow Articles by Upchurch, G. R., Jr
Related Collections
Right arrow Health policy and outcome research
Right arrow Epidemiology

(Circulation. 2008;117:2534-2541.)
© 2008 American Heart Association, Inc.


Aortic Diseases

Measuring and Improving the Quality of Care for Abdominal Aortic Aneurysm Surgery

Justin B. Dimick, MD, MPH; Gilbert R. Upchurch, Jr, MD

From the Michigan Surgical Collaborative for Outcomes Research and Evaluation (M-SCORE), and the Section of Vascular Surgery, both in the Department of Surgery, University of Michigan Medical Center, Ann Arbor, Mich.

Correspondence to Justin Dimick, MD, MPH, M-SCORE Offices, 211 N Fourth Ave, Suite 2A, Ann Arbor, MI 48104. Email jdimick{at}umich.edu


Key Words: aneurysm • aorta • outcome assessment • process measures • quality of health care • surgery


*    Introduction
up arrowTop
*Introduction
down arrowMeasuring Quality
down arrowImproving Quality
down arrowChoosing the Best Approach
down arrowReferences
 
Because of widespread recognition of variations in surgical performance, patients and payers are placing renewed focus on holding providers accountable for the quality of care they provide. Patients are becoming more cautious informed consumers. Payers are stepping up efforts to align reimbursement to physicians and hospitals with the quality of care they provide. Providers can count on quality measurement and improvement being part of the health policy landscape for the foreseeable future. As stakeholders in this movement, we need to continually refine and update our understanding of the best approach to answer this call for accountability, and each of us needs to fulfill our obligation to contribute to the improvement of our clinical specialty.

The purpose of this article is to update our knowledge on the best methods to approach quality measurement and improvement in aortic surgery. Whereas many agree that improving the quality of care is important, few agree on the best way to go about it. The available approaches to measure the quality of care for high-risk abdominal aortic aneurysm surgery will be reviewed. In addition, the promise and pitfalls of existing improvement efforts will be considered.

Abdominal aortic aneurysm repair is both a relatively common and high-risk procedure. Many patients die each year after elective repair of abdominal aortic aneurysms.1 Improving the quality of care provided to these patients could potentially avert many of these deaths. For this reason, operations for aortic aneurysm disease are often the focus of quality measurement and improvement. Although most existing quality measurement initiatives focus on a narrow group of operations, they invariably include surgery for abdominal aortic aneurysms.


*    Measuring Quality
up arrowTop
up arrowIntroduction
*Measuring Quality
down arrowImproving Quality
down arrowChoosing the Best Approach
down arrowReferences
 
Before improving the quality of care in patients with aortic disease, it must first be decided on how to best measure it. Unfortunately, no consensus on how to go about measuring quality exists. A natural starting place is to introduce the Donabedian paradigm of structure, process, and outcomes.2 Structural elements include those attributes of the system in which the patient receives care. Process of care includes those specific details of how care was delivered to the patient. Outcomes are obviously the end results of the care provided. Although this paradigm has stood the test of time, a fourth option will be discussed—combining individual measures to create a composite measure. Composite measures are some combination of structure, process, and outcomes. Using composite measures has advantages that make this approach uniquely suited for measuring surgical quality, and these will be outlined.3

Structure
Structural elements that affect quality include attributes of the hospital or surgeon. Most previous studies focus on the relationship of hospital volume to operative mortality rates.4–6 Table 1 shows a summary of studies documenting the relationship of hospital volume to mortality rates for several vascular surgical procedures. Higher-volume hospitals consistently perform better than lower-volume hospitals for abdominal aortic surgery, with a 2-fold higher relative risk of mortality at low-volume hospitals (Table 1). No single threshold to define a high volume exists. Instead, it seems that the more you do, the better you get, with a stepwise decline in mortality with increasing volume. In most studies for abdominal aortic surgery, the highest volume group performs >30 to 40 cases per year. The median value following elective abdominal aortic aneurysm repair in a high-volume hospital for the 8 studies reviewed by Halm et al4 was 36 cases per year (Table 1).


View this table:
[in this window]
[in a new window]

 
Table 1. Summary of Articles Examining Associations Between Hospital Volume and Mortality for Vascular Surgery Operations*

Whereas most previous studies focus on open repair, an emerging body of evidence supports a similar relationship for endovascular aneurysm repair.7,8 This evidence is important, because the endovascular approach takes up a larger share of the market each year. We recently performed an updated analysis of volume and mortality using the Nationwide Inpatient Sample (NIS) from 2001 to 2003.7 We found a strong inverse relationship between hospital volume and adjusted mortality rates for both open and endovascular repair (P<0.001 for all comparisons). Hospitals in the lowest quintile of endovascular volume had mortality rates 3-fold higher than those in the highest quintile (2.4% versus 0.8%). Figure 1 shows the relationship of hospital volume and mortality in this updated analysis for all repairs together (labeled "overall") and for both open and endovascular repair alone.


Figure 1189596
View larger version (14K):
[in this window]
[in a new window]

 
Figure 1. Relationship of hospital volume to operative mortality for all types of repair considered together and each type separately. Data are from the Nationwide Inpatient Sample and Dimick et al.7

There also appears to be an inverse relationship between hospital volume and mortality rates with ruptured aneurysms when fixed via an endovascular approach. Greco et al used hospital discharge data sets from 4 states (Florida, Pennsylvania, New York, and New Jersey) to study the outcomes of ruptured aneurysms treated by an endovascular approach.8 The authors found much lower mortality rates in high-volume hospitals compared with low-volume hospitals (26% versus 46%).

A similar association has been found between individual surgeon volume and operative mortality.9 Many have questioned whether it is the surgeon’s or the hospital’s volume that is most important. A recent study provides the answer: both are equally important for abdominal aortic surgery. In an analysis of the national Medicare population, hospital and surgeon volume each explained approximately 50% of the variation in mortality rates across hospitals.9 This finding makes intuitive sense, because the surgeon lends his or her expertise and technical skill and the hospital system provides collective knowledge that impacts postoperative care (nurses, intensive care units, and diagnostic testing). The hospital system helps to avoid unnecessary deaths by preventing and rescuing patients from postoperative complications.

Surgeon training, specifically added qualification in general vascular surgery, independent of volume, is also associated with improved outcomes after abdominal aortic aneurysm repair.10 Using the Florida Agency for Health Care Administration state admission database, Pearce et al identified 13 415 patients undergoing repair from 1992 to 1996. The authors documented that surgeons with added qualification in general vascular surgery had significantly better outcomes, showing that aortic surgery performed by certified vascular surgeons had a 24%-lower risk rate of death or complications after the procedure (P=0.009).

In addition, increasing surgical specialization in vascular surgery, independent of board certification, was found to be associated with outcome for abdominal aortic aneurysm surgery.11 This study ascertained surgeon specialty using a profile of each surgeon’s practice (>75% vascular cases defined the specialty of vascular surgery). Using a nationally representative data set with 3912 patients undergoing abdominal aortic aneurysm repair in 1997, the authors found that lower mortality rates were achieved by vascular surgeons (2.2%) compared with cardiac surgeons (4.0%) and general surgeons (5.5%).11 After adjusting for hospital and surgeon volume, surgery performed by general surgeons was associated with a 76%-greater risk for death (95% confidence interval, 10% to 190%; P=0.02) compared with surgery performed by vascular surgeons.

Although most people would agree that these structural variables are important predictors of outcome, few agree on how to use this information to improve quality. The relative advantages and disadvantages of each measure need to be carefully considered. Table 2 shows the advantages and disadvantages of each type of measure included in this section. The primary advantage of using structural measures, such as hospital and surgeon volume, is that they are inexpensive and easy to obtain. Often they can be abstracted from readily available administrative data. Another advantage is that these structural measures are strongly correlated with important outcomes, including mortality and morbidity.


View this table:
[in this window]
[in a new window]

 
Table 2. Approaches to Measuring the Quality of Care for Aortic Surgery With Advantages and Disadvantages of Each Approach

The greatest disadvantage of these measures is that they are not good at discriminating between individual providers—they are only good at detecting differences between groups of providers.12 This results in misclassification, with some low-volume hospitals providing high-quality care and some high-volume hospitals providing low-quality care. Another disadvantage is that volume and other proxy variables are not actionable from the provider perspective. As discussed later, these measures lend themselves more easily to selective referral strategies.

Another disadvantage of using volume as a quality indicator is the nature of the evidence base. Many studies are criticized because they are conducted using administrative data.13,14 When compared with prospective clinical data registries, administrative data sources have less clinical detail available for risk adjustment. As a result, it is often argued that differences in mortality rates between high- and low-volume hospitals may be due to differences in patient characteristics. Two reasons explain why this scenario is unlikely. First, many studies using clinical data have also shown a significant effect of volume on outcome.4 Second, the "null" volume–outcome studies show no effect of volume on outcome even without risk adjustment. Perhaps the most often cited study in this category is from the Veterans Affairs (VA) National Surgical Quality Improvement Program.15 If the lack of a volume–outcome effect were due to more detailed clinical risk adjustment, a difference would be found in the unadjusted outcomes between high- and low-volume hospitals—but a difference is not found. The lack of an effect of volume on outcome is therefore not due to better risk adjustment. Rather, it is likely because VA hospitals are all low volume, are staffed by surgeons who often operate across the street in a high-volume university setting, or share other similar structural elements or processes of care. In summary, it is possible that the estimates of volume–outcome effects found in studies based on claims data would be different using more detailed risk adjustment, but no data support the notion that the effects will disappear entirely.

Process
A dearth exists of process measures for abdominal aortic surgery. Indeed, few process measures are available for most surgical procedures. This situation stands in contrast to that for most medical conditions. For example, numerous process measures are available for acute myocardial infarction, pneumonia, and congestive heart failure. Most process measures relevant to surgery focus on elements of perioperative care common to all surgical procedures. For example, the Center for Medicare and Medicaid Service’s (CMS) Surgical Care Improvement Project (SCIP) focuses on appropriate use of antibiotic prophylaxis to prevent surgical site infection; the appropriate use of measures to prevent venous thromboembolism; and other processes related to the prevention of cardiac events and nosocomial pneumonia.

The one process measure specific to aortic aneurysm surgery is the proportion of appropriate patients who receive β-blockers in the perioperative period.16 However, the evidence for this process measure is evolving. Although patients undergoing high-risk noncardiac surgery have been shown to benefit from the administration of β-blockade, newer data reveal that only patients with a history of myocardial ischemia are likely to benefit.17 Process measures will need to be continually refined to make sure they are consistent with the best available evidence.

Another process measure in abdominal aortic surgery is the type of approach used, open versus endovascular (Table 2). Using this as a quality measure is controversial. It is established that endovascular aortic aneurysm repair results in a lower short-term mortality rate. However, the endovascular method is less durable and has a much higher reintervention rate. In addition, the mortality difference appears to equal out after 2 years.18,19 As the body of data supporting the superiority of the endovascular approach for certain populations matures, this process measure will likely be touted as an important measure of quality. If the approach to repair is used as a quality measure, it will be important to ensure that the denominator is defined appropriately. Only a subset of patients is eligible for endovascular repair, and the denominator should be restricted to this group of patients. Because this level of clinical detail is not be available from claims data, using this as a quality measure will require detailed clinical data to make sure the denominator is correct.

One process measure related to endovascular surgery that may prove useful is the proportion of patients who receive follow-up imaging. Unlike patients with open repair, all patients who receive endovascular repair should be followed up for with serial imaging for the duration of their lives to ensure secure repair. Consensus exists on this guideline, and such information would be readily available from some administrative data sources (eg, Medicare or insurance plan data sets).

Process measures have many advantages over other approaches at quality measurement. First, they are very actionable from the provider perspective. Low rates of adherence to process measures can easily be targeted for improvement. Second, they represent the care that was actually given to the patient and are viewed as "fair" by providers. They are less influenced by patient severity of illness and random chance. However, they also have several drawbacks. Unfortunately, we do not know the processes that contribute to optimal care for most operations, including abdominal aortic surgery. Most of the details of care that contribute to optimal care are not measurable using current methods.

Outcomes
Direct ascertainment of quality using risk-adjusted outcomes is widely perceived to be the gold standard of quality measurement. For high-risk surgical procedures, including abdominal aortic surgery, risk-adjusted morbidity and mortality rates are used to measure quality. Whereas this approach is attractive at first glance, several problems with direct outcomes measurement conspire to threaten the validity of this approach. These problems are all derived from a single root cause: poor quality is not the only driver of bad outcomes. Outcomes are a function of patient characteristics (risk factors), quality (hospital and surgeon factors), and chance (random variation). No one knows how much each of these factors contributes to observed variation in outcomes. The only solution is to control or adjust for these other factors as much as possible.

Several strategies of risk adjustment have been developed to take differences in patient factors into account. Clearly, we must measure and adjust for these important variables. Prospective ascertainment of patient risk factors using a clinical registry is considered the best method to collect data for risk adjustment. A logistic regression model is then used to calculate the expected number of deaths for each hospital. The ratio of observed to expected deaths can then be used as a risk-adjusted quality metric. However, the collection of detailed clinical data from the medical chart is expensive and prohibitive in many settings.

It is much more difficult to fully account for random variation when using outcomes to measure quality. This problem can be explained by the small caseloads (ie, small sample sizes) in individual hospitals: the smaller the hospital, the less likely extreme mortality rates are to truly represent good or bad quality. When a small hospital has no deaths, this is much more likely to be due to the small numbers of cases than perfect care.20 Traditionally, this problem is dealt with by using probability values or 95% confidence intervals. Most hospital report cards define poor quality as those hospitals with mortality rates that are significantly higher than average (or whose 95% confidence intervals do not overlap with the average).

It readily becomes apparent that this traditional solution only solves part of the problem when you consider the smallest hospitals. They will have the largest confidence intervals, and it will be very difficult to demonstrate a significant difference between these hospitals and a benchmark. Although the problem of small sample size has received considerable attention in the context of clinical trials, it has received less consideration in quality measurement. We performed a recent study to explore this problem for the 7 surgical procedures suggested for mortality measurement by the Agency for Healthcare Research and Quality.21 Using data from the Nationwide Inpatient Sample, we defined the national average mortality rate for each procedure and the number of cases performed in each hospital. The minimum sample size needed was entered to identify a poorly performing hospital as significantly different from the national average mortality rate. Finally, the proportion of US hospitals that exceed this minimum caseload (ie, those hospitals for which mortality would reliably reflect quality) was determined. The findings suggest that only coronary bypass surgery fulfills these criteria.21 For the other 6 operations in the analysis, including abdominal aortic aneurysm repair, less than half of hospitals in the United States perform enough cases to detect a doubling of the mortality rate (Figure 2).


Figure 2189596
View larger version (8K):
[in this window]
[in a new window]

 
Figure 2. Big problems with small samples: The proportion of hospitals in the United States with sufficient caseloads (sample size) to reliably use mortality rates to measure quality.

Composite Measures
One approach for dealing with small samples is to combine multiple quality measures into a composite score. This approach also has the advantage of dealing with the problem of multiple measures and simplifying quality measurement by providing a single summary measure of performance. This approach has several other advantages and some disadvantages (Table 2).

Composite scores can be created in 2 ways: (1) by combining information across procedures to provide a measure of aggregate performance, and (2) by combining information across measures to reflect performance with a single procedure. The approach of combining multiple operations to create an aggregate measure of performance is used by the National Surgical Quality Improvement Program (NSQIP).22 In the NSQIP, all operations are combined to create an overall risk-adjusted mortality and morbidity rate. Aggregating operations in this way increases the sample size and result in a much more precise measure with narrow confidence intervals. Unfortunately, it is hard to interpret the results. If a hospital is labeled an outlier for "overall" mortality, few clues are provided about where to find the quality problem. In addition, hospitals with poor quality for certain operations can be masked by their average performance with more common operations. Such hospitals will not be labeled as outliers and will miss out on the opportunity to improve.

The approach of combining multiple measures for a single operation will avoid this problem. This type of measure can take several forms. Perhaps the most simple is to simply sum the adverse events or nonadherence to process measures in an "all or none" format.23,24 This approach is currently used in many pay-for-performance initiatives.25 An alternative approach relies on a combination of domains based on empirically derived weights. The measures that most reliably predict subsequent mortality are afforded the most weight. Inputs for such a composite measure could include risk-adjusted mortality, risk-adjusted morbidity, hospital volume, surgeon volume, and perhaps performance with other related procedures. A general approach to creating these measures using empirical Bayes techniques has proven useful in several clinical contexts.26,27

Composite measures are currently used and will be more widely used in many upcoming policy initiatives. Most existing pay-for-performance efforts already use an all-or-none type of measure. The Society for Thoracic Surgeons Measurement Task Force is piloting a new composite score that combines elements of outcomes and processes of care into a single measure.3 The Agency for Healthcare Research and Quality has convened a working group to work on composite measures and recently has proposed a technique based on an empirically derived weighting system.28


*    Improving Quality
up arrowTop
up arrowIntroduction
up arrowMeasuring Quality
*Improving Quality
down arrowChoosing the Best Approach
down arrowReferences
 
Two basic options are available for improving the quality of care for patients undergoing abdominal aortic surgery. The first option is to send patients to hospitals and surgeons who provide the highest-quality care. The second option is to improve care at those hospitals where patients already receive their care. Neither solution is perfect. The potential benefits and downsides associated with each of the approaches will be discussed. Table 3 is a summary of the 2 approaches, examples of each, and their primary advantages and disadvantages.


View this table:
[in this window]
[in a new window]

 
Table 3. Approaches to Improving the Quality of Care for Aortic Surgery With Advantages and Disadvantages of Each Approach

Selective Referral
The chief advantage of selectively referring patients to the best hospitals and surgeons is that it is easy to envision how to do it. Most efforts at selective referral rely on proxy measures of quality, such as hospital or surgeon volume. As discussed in the previous section, these measures are easily determined from readily available administrative data. Selective referral can be carried out by simply providing information to patients and letting them make informed decisions. Alternatively, payers can create incentives or restrict access to steer patients to specific centers of excellence.

The disadvantage of selective referral is that many patients may not have anywhere to go. Limiting access to the highest-volume providers is problematic if you happen to be located in an area that does not have any. Some large regions of the United States do not have a single high-volume hospital.29 Some regions are so sparsely populated that they could not provide a single high-volume hospital even if all cases were concentrated in a single center. However, most patients undergoing surgery at low-volume hospitals do so in urban settings. Some patients even drive by high-volume hospitals to undergo surgery in a low-volume hospital.30 Analysis of the Medicare population needing high-risk surgery shows that selective referral efforts could exclude rural areas and still realize most of the potential benefits.31

Another potential unintended consequence of selective referral, especially referral based on volume standards, is overuse of surgical services. Although the lowest-volume providers would likely stop performing targeted procedures altogether, some hospitals near the threshold may feel pressure to increase the number of cases they perform. This pressure may translate into unnecessary surgery at some centers. Although this is certainly a legitimate concern, it is largely theoretical because no evidence for this phenomenon exists. This phenomenon would also represent a failure in personal ethics of the hospitals and physicians involved and not an indictment of selective referral policy.

Quality Improvement
Improving care at all hospitals is certainly the most appealing option. However, it is problematic. Continuous quality improvement is a repetitive cycle of process and outcomes measurement, design of interventions to improve the processes of care, and then repeated measurement to determine the impact on outcomes. The principles and language of quality improvement are borrowed from industrial manufacturing principles and have only recently been put to use in medical care, with mixed results.

A few good examples exist of successful collaborative quality improvement within surgery. Usually, these take the form of regional or multicenter coalitions that collect data, share best practices, and train hospital staff to perform quality improvement projects. The success of this approach ultimately depends on the ability to identify those processes of care that contribute to the best outcomes. We should differentiate this regional type of quality improvement (macrosystems) from internal quality improvements projects that take place at the front line of medical care (microsystems). Microsystems represent all those resources and personnel who provide care are in a particular setting, which are unique to each hospital. We will concentrate on the macrolevel improvement.

Most of the experience with regional collaborative quality improvement comes from cardiac surgery. One of the most successful examples is the Northern New England Group, a coalition of hospitals performing cardiac surgery in this region.32 Through rigorous data collection and tracking of risk-adjusted mortality rates, feedback to hospitals, and sharing of best practices, this group has demonstrated reductions in the mortality rates since the inception of the program. The mechanism for improvement appears to be: (1) the systematic study of the relationship of processes of care to outcomes and then (2) the dissemination of these processes across all the hospitals.

More recently, the principles of continuous quality improvement have been used in noncardiac surgery. The most high-profile example is the NSQIP. The NSQIP was formed in VA hospitals with the goal of providing a platform for quality improvement.33 The NSQIP tracks risk-adjusted mortality and morbidity rates, provides feedback to hospitals, and encourages these sites to participate in quality-improvement efforts. Since the inception of this quality-measurement initiative, significant reductions in morbidity and mortality have been seen in VA hospitals.

However, no detailed accounting exists of how these improvements came about. The NSQIP is a good example of a system that expends a great deal of effort on measurement but has paid much less attention to the improvement part of the cycle. At least part of the difficulty with generating improvement is the nature of the quality measure used. As mentioned before, the NSQIP reports an aggregate mortality rate, which both acts to mask problems by diluting out the mortality experience for individual operations and also makes it difficult to know where to look for bad quality if you are flagged as a high-mortality outlier. As in the NSQIP, numerous examples exist of clinical registries within surgery and other disciplines that need to focus more on the improvement part of the cycle.

Whereas the NSQIP is a broad effort aimed at all surgical specialties, new registries have been specifically designed for improving quality in vascular surgery. For example, The Vascular Study Group of Northern New England (VSGNNE) consists of 45 vascular surgeons from 8 hospitals in Maine, New Hampshire, and Vermont.34 The VSGNNE has prospectively recorded data on risk factors and outcomes for carotid endarterectomy, abdominal aortic aneurysm repair, and lower extremity bypass since 2003. Preliminary data reveal significant improvements in the use of appropriate medications including preoperative β-blocker (72% to 88%), antiplatelet agents (74% to 83%), and statins (50% to 70%). Although these gains are important, further study will be needed to demonstrate whether they are sustained and eventually translate into meaningful differences in outcomes for this region.


*    Choosing the Best Approach
up arrowTop
up arrowIntroduction
up arrowMeasuring Quality
up arrowImproving Quality
*Choosing the Best Approach
down arrowReferences
 
Whether selective referral or collaborative process improvement is the best approach to improving care will ultimately depend on how much quality is determined by measurable processes of care that can be transported across settings. If most existing variation in outcomes is due to processes that cannot be measured or are not portable, then very little improvement will result from collaborative quality improvement. Consider the 2 paradigms in Figure 3. In paradigm I, most existing variation in quality is due to measurable processes of care. In this paradigm, improving quality is only a matter of discovering those processes and ensuring they are disseminated to all hospitals. As a result, all hospitals/surgeons can provide optimal care for patients undergoing surgery. Now consider paradigm II, where most variation is due to unmeasurable processes of care or processes that are not portable across settings. These processes likely include the skill of the surgeon and the collective skill of all those who support the surgeon in their hospital system. In paradigm II, the measurable processes of care make up a much smaller piece of the pie. If this is the case, process improvement can only get us so far. It will certainly not get us to the point where all patients receive optimal care.


Figure 3189596
View larger version (8K):
[in this window]
[in a new window]

 
Figure 3. Two paradigms for explaining the variation in performance across hospitals and surgeons are shown. In paradigm I, most existing variation is due to discrete, exportable, and measurable processes of care. In paradigm II, very little variation is due to measurable processes of care and most is due to surgeon skill and the collective knowledge of the hospital system, which are largely unmeasurable.

Ideally, we hope that we find ourselves in paradigm I, improving care at all centers through process improvement that is egalitarian and politically expedient. Unfortunately, evidence supporting paradigm II is accumulating. Most evidence comes from the literature of common medical conditions, such as acute myocardial infarction, for which more processes of care are known than any other medical condition. A recent study shows that only 6% of the observed variation in hospital mortality rates can be explained by the process measures used in the Joint Commission on Accreditation of Healthcare Organizations and Center for Medicare and Medicaid Services (JCAHO/CMS) set of measures.35

As more evidence accumulates, and some becomes available for surgical conditions, we may find observed differences in performance between good and bad hospitals only partly explained by known processes of care (paradigm II). Although it is important to continue to discover the processes of care that lead to higher quality, we should also be preparing to accept selective referral as a viable option in certain contexts. We owe it to our patients to strive for optimal care for everyone, whether it is delivered to them through quality improvement or they are delivered to it via selective referral. Most likely, however, both approaches will be needed as we strive to provide optimal care for surgical patients.


*    Acknowledgments
 
Disclosures

None.


*    Footnotes
 
Guest Editor for this article was Michael S. Conte, MD.


*    References
up arrowTop
up arrowIntroduction
up arrowMeasuring Quality
up arrowImproving Quality
up arrowChoosing the Best Approach
*References
 
1. Cowan JA, Dimick JB, Henke PK, Rectenwald J, Stanley JC, Upchurch GR Jr. Epidemiology of aortic aneurysm repair in the United Statnes. Ann N Y Acad Sci. 2006; 1085: 1–10.[CrossRef][Medline] [Order article via Infotrieve]

2. Birkmeyer JD, Dimick JB, Birkmeyer NJ. Measuring quality in surgery: structure, process, or outcomes? J Am Coll Surg. 2004; 198: 626–632.[CrossRef][Medline] [Order article via Infotrieve]

3. Shahian DM, Edwards FH, Ferraris VA, Haan CK, Rich JB, Normand SL, DeLong ER, O’Brien SM, Shewan CM, Dokholyan RS, Peterson ED; Society of Thoracic Surgeons Quality Measurement Task Force. Quality measurement in adult cardiac surgery: part 1: conceptual framework and measure selection. Ann Thorac Surg. 2007; 83 (Suppl): S3–S12.[Free Full Text]

4. Halm EA, Lee C, Chassin MR. Is volume related to outcome in health care? A systematic review and methodologic critique of the literature. Ann Intern Med. 2002; 137: 511–520.[Abstract/Free Full Text]

5. Dudley RA, Johansen KL, Brand R, Rennie DJ, Milstein A. Selective referral to high-volume hospitals: estimating potentially avoidable deaths. JAMA. 2000; 283: 1159–1166.[Abstract/Free Full Text]

6. Birkmeyer JD, Siewers AE, Finlayson EV, Stukel TA, Lucas FL, Batista I, Welch HG, Wennberg DE. Hospital volume and surgical mortality in the United States. N Engl J Med. 2002; 346: 1128–1137.[Abstract/Free Full Text]

7. Dimick JB, Cowan JA Jr, Upchurch GR Jr. Hospital volume and operative mortality with abdominal aortic aneurysm repair in the endovascular era. In: Pearce WH, Matsumura JS, Yao JST, eds. Trends in Vascular Surgery. Evanston, Ill. Greenwood Academic Press; 2007: 151–160.

8. Greco G, Egorova N, Anderson PL, Gelijns A, Moskowitz A, Nowygrod R, Arons R, McKinsey J, Morrissey NJ, Kent KC. Outcomes of endovascular treatment of ruptured abdominal aortic aneurysms. J Vasc Surg. 2006; 43: 453–459.[CrossRef][Medline] [Order article via Infotrieve]

9. Birkmeyer JD, Stukel TA, Siewers AE, Goodney PP, Wennberg DE, Lucas FL. Surgeon volume and operative mortality in the United States. N Engl J Med. 2003; 349: 2117–2127.[Abstract/Free Full Text]

10. Pearce WH, Parker MA, Feinglass J, Ujiki M, Manheim LM. The importance of surgeon volume and training in outcomes for vascular surgical procedures. J Vasc Surg. 1999; 29: 768–778.[CrossRef][Medline] [Order article via Infotrieve]

11. Dimick JB, Cowan JA Jr, Stanley JC, Henke PK, Pronovost PJ, Upchurch GR Jr. Surgeon specialty and provider volumes are related to outcome of intact abdominal aortic aneurysm repair in the United States. J Vasc Surg. 2003; 38: 739–744.[CrossRef][Medline] [Order article via Infotrieve]

12. Rathore SS, Epstein AJ, Volpp KG, Krumholz HM. Hospital coronary artery bypass graft surgery volume and patient mortality, 1998–2000. Ann Surg. 2004; 239: 110–117.[CrossRef][Medline] [Order article via Infotrieve]

13. Khuri SF. Invited commentary: Surgeons, not General Motors, should set standards for surgical care. Surgery. 2001; 130: 429–431.[CrossRef][Medline] [Order article via Infotrieve]

14. Christian CK, Gustafson ML, Betensky RA, Daley J, Zinner MJ. The volume-outcome relationship: don’t believe everything you see. World J Surg. 2005; 29: 1241–1244.[CrossRef][Medline] [Order article via Infotrieve]

15. Khuri SF, Daley J, Henderson W, Hur K, Hossain M, Soybel D, Kizer KW, Aust JB, Bell RH Jr, Chong V, Demakis J, Fabri PJ, Gibbs JO, Grover F, Hammermeister K, McDonald G, Passaro E Jr, Phillips L, Scamman F, Spencer J, Stremple JF. Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program. Ann Surg. 1999; 230: 414–429.[CrossRef][Medline] [Order article via Infotrieve]

16. Birkmeyer JD, Dimick JB. Potential benefits of the 2003 Leapfrog standards: effect of process and outcomes measures. Surgery. 2004; 135: 569–575.[CrossRef][Medline] [Order article via Infotrieve]

17. Lindenauer PK, Pekow P, Wang K, Mamidi DK, Gutierrez B, Benjamin EM. Perioperative beta-blocker therapy and mortality after major noncardiac surgery. N Engl J Med. 2005; 353: 349–361.[Abstract/Free Full Text]

18. Blankensteijn JD, de Jong SE, Prinssen M, van der Ham AC, Buth J, van Sterkenburg SM, Verhagen HJ, Buskens E, Grobbee DE; Dutch Randomized Endovascular Aneurysm Management (DREAM) Trial Group. Two-year outcomes after conventional or endovascular repair of abdominal aortic aneurysms. N Engl J Med. 2005; 352: 2398–2405.[Abstract/Free Full Text]

19. EVAR trial participants. Endovascular aneurysm repair versus open repair in patients with abdominal aortic aneurysm (EVAR trial 1): randomised controlled trial. Lancet. 2005; 365: 2179–2186.[CrossRef][Medline] [Order article via Infotrieve]

20. Dimick JB, Welch HG. The zero mortality paradox in surgery. J Am Coll Surg. 2008; 206: 13–16.[CrossRef][Medline] [Order article via Infotrieve]

21. Dimick JB, Welch HG, Birkmeyer JD. Surgical mortality as an indicator of hospital quality: the problem with small sample size. JAMA. 2004; 292: 847–851.[Abstract/Free Full Text]

22. Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, Chong V, Fabri PJ, Gibbs JO, Grover F, Hammermeister K, Irvin G 3rd, McDonald G, Passaro E Jr, Phillips L, Scamman F, Spencer J, Stremple JF. The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg. 1998; 228: 491–507.[CrossRef][Medline] [Order article via Infotrieve]

23. Nolan T, Berwick DM. All-or-none measurement raises the bar on performance. JAMA. 2006; 295: 1168–1170.[Free Full Text]

24. Reeves D, Campbell SM, Adams J, Shekelle PG, Kontopantelis E, Roland MO. Combining multiple indicators of clinical quality: an evaluation of different analytic approaches. Med Care. 2007; 45: 489–496.[CrossRef][Medline] [Order article via Infotrieve]

25. Kahn CN 3rd, Ault T, Isenstein H, Potetz L, Van Gelder S. Snapshot of hospital quality reporting and pay-for-performance under Medicare. Health Aff (Millwood). 2006; 25: 148–162.[Abstract/Free Full Text]

26. Dimick JB, Staiger DO, Birkmeyer JD. Are mortality rates for different operations related? Implications for measuring the quality of noncardiac surgery. Med Care. 2006; 44: 774–778.[CrossRef][Medline] [Order article via Infotrieve]

27. McClellan MB, Staiger DO. The Quality of Health Care Providers. National Bureau of Economic Research Working Paper 7327. August 1999. Available at: http://www.nber.org/papers/w7327. Accessed June 2007.

28. AHRQ Inpatient Quality Indicators Composite Measure. Draft Technical Report. Available at: http://qualityindicators.ahrq.gov/news/AHRQ_IQI_Composite_Draft.pdf. Accessed June 27, 2007.

29. Dimick JB, Finlayson SR, Birkmeyer JD. Regional availability of high-volume hospitals for major surgery. Health Aff (Millwood). 2004; Suppl Web Exclusives: VAR45–53.

30. Birkmeyer JD, Siewers AE, Marth NJ, Goodman DC. Regionalization of high-risk surgery and implications for patient travel times. JAMA. 2003; 290: 2703–2708.[Abstract/Free Full Text]

31. Dimick JB, Finlayson SR. Rural hospitals and volume standards in surgery. Surgery. 2006; 140: 367–371.[CrossRef][Medline] [Order article via Infotrieve]

32. O’Connor GT, Plume SK, Olmstead EM, Morton JR, Maloney CT, Nugent WC, Hernandez F Jr, Clough R, Leavitt BJ, Coffin LH, Marrin CA, Wennberg D, Birkmeyer JD, Charlesworth DC, Malenka DJ, Quinton HB, Kasper JF. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. JAMA. 1996; 275: 841–846.[Abstract/Free Full Text]

33. Khuri SF, Daley J, Henderson WG. The comparative assessment and improvement of quality of surgical care in the Department of Veterans Affairs. Arch Surg. 2002; 137: 20–27.[Abstract/Free Full Text]

34. Cronenwett JL, Likosky DS, Russell MT, Eldrup-Jorgensen J, Stanley AC, Nolan BW. A regional registry for quality assurance and improvement: The Vascular Study Group of Northern New England (VSGNNE). J Vasc Surg. 2007; 46: 1093–1102.[CrossRef][Medline] [Order article via Infotrieve]

35. Bradley EH, Herrin J, Elbel B, McNamara RL, Magid DJ, Nallamothu BK, Wang Y, Normand SL, Spertus JA, Krumholz HM. Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality. JAMA. 2006; 296: 72–78.[Abstract/Free Full Text]





This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Dimick, J. B.
Right arrow Articles by Upchurch, G. R.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Dimick, J. B.
Right arrow Articles by Upchurch, G. R., Jr
Related Collections
Right arrow Health policy and outcome research
Right arrow Epidemiology