| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Circulation. 2008;117:670-677.)
© 2008 American Heart Association, Inc.
Vascular Medicine |
From Birmingham University (A.R.M., P.G., K.A., I.A., R.A.W., P.T., M.P.F.), Birmingham, United Kingdom; School of Medicine, Cardiff University (A.B.M., P.E.J.), Cardiff, United Kingdom; Department of Cardiovascular Medicine (H.A.), University of Oxford, Oxford, United Kingdom; and William Harvey Research Institute (G.V.R.B.), London, United Kingdom.
Correspondence to Professor Michael P. Frenneaux, MD, Department of Cardiovascular Medicine, The Medical School, University of Birmingham, Birmingham, B15 2TT, United Kingdom. E-mail m.p.frenneaux{at}bham.ac.uk
Received June 12, 2007; accepted November 16, 2007.
| Abstract |
|---|
|
|
|---|
Methods and Results— Forty healthy volunteers were studied. After baseline infusion of 0.9% saline, sodium nitrite was infused at incremental doses from 40 nmol/min to 7.84 µmol/min. At each stage, forearm blood flow was measured by strain-gauge plethysmography. Forearm venous volume was assessed by radionuclide plethysmography. Changes in forearm blood flow and forearm venous volume in the infused arm were corrected for those in the control arm. The peak percentage of venodilation during normoxia was 35.8±3.4% (mean±SEM) at 7.84 µmol/min (P<0.001) and was similar during hypoxia. In normoxia, arterial blood flow, assessed by the forearm blood flow ratio, increased from 1.04±0.09 (baseline) to 1.62±0.18 (nitrite; P<0.05) versus 1.07±0.09 (baseline) to 2.37±0.15 (nitrite; P<0.005) during hypoxia. This result was recapitulated in vitro in vascular rings.
Conclusions— Nitrite is a potent venodilator in normoxia and hypoxia. Arteries are modestly affected in normoxia but potently dilated in hypoxia, which suggests the important phenomenon of hypoxic augmentation of nitrite-mediated vasodilation in vivo. The use of nitrite as a selective arterial vasodilator in ischemic territories and as a potent venodilator in heart failure has therapeutic implications.
Key Words: nitric oxide nitrites vasodilation heart failure veins hypoxia
| Introduction |
|---|
|
|
|---|
Editorial p 594
Clinical Perspective p 677
Controversy surrounds the relative importance of different endogenous NO species in mediating physiological vasodilation. These species include nitrite, S-nitrosothiols, N-nitrosamines, iron nitrosyls, and nitrated lipid.2 Nitrite has traditionally been considered a weak vasodilator. In aortic specimens, concentrations of nitrite as high as 100 to 1000 µmol/L are typically required under normoxic conditions to induce relaxation.2,4 The discrepancy between plasma nitrite levels in vivo and the levels required to elicit a biological effect in vitro, coupled with a study that demonstrated a lack of vasodilator activity of 200 µmol/L nitrite in the forearms of healthy volunteers, diminished interest in nitrite.5 In contrast, a greater focus was directed to hemoglobin acting as an NO store, oxygen sensor, and condition-sensitive NO donor, operating through release of the NO group from S-nitrosohemoglobin.6
More recently, nitrite has been recognized as a powerful signaling molecule and regulator of gene expression.7,8 Although in normoxia, nitrite is a relatively inefficacious vasodilator when acting directly, during hypoxia, this action may be enhanced. NO released from nitrite as a result of a hypoxic environment may play an important physiological role.2 Arteriovenous gradients of nitrite in the human forearm have been observed; these gradients are enhanced during exercise and during regional NO synthase inhibition.9,10 Thus, it has been suggested that nitrite is consumed to liberate bioactive NO.2,9,10 A vasoactive role for nitrite at normal physiological concentrations is still disputed, because the arteriovenous gradient in nitrite may result from decreased venous nitrite production through decreased NO synthase activity coupled with increased venous nitrite consumption.11
It has been proposed recently that deoxyhemoglobin is capable of acting as a nitrite reductase; hence, hemoglobin would act as an "oxygen sensor" and would liberate NO from nitrite along the physiological oxygen gradient. The work of Gladwin and others2 is at least hypothesis-generating with respect to a role for nitrite in the modulation of vascular tone in vivo.
In support of an enhanced role for nitrite in hypoxia, in vitro nitrite administration has been shown to confer protection against ischemia/reperfusion injury in the heart, kidney, brain, and liver.12–15 In addition, nitrite treatment has also proved beneficial in models of hypertension,16 pulmonary hypertension,17 and cerebral vasospasm.18
Accordingly, we hypothesized the following: (1) While subjects were breathing room air, nitrite would be a potent dilator of capacitance vessels in vivo because of their relatively low ambient oxygen tension; (2) when subjects were breathing 12% oxygen, which would render the resistance vessels relatively hypoxic, nitrite would become a potent arteriolar dilator. The present study focused on the forearm vascular bed, the small veins and venules of which are representative of vessels that constitute the bulk of the capacitance bed and which behave quite differently from conduit veins such as dorsal hand veins.19 To test the direct effect of nitrite on vascular tissue (hemoglobin independent), isolated rabbit vessels (aorta and vena cava) were exposed to a range of nitrite concentrations in both normoxia and hypoxia.
| Methods |
|---|
|
|
|---|
Measurement of Venous Volume
Forearm venous volume (FVV) was assessed with radionuclide plethysmography. The details and advantages of the technique are detailed elsewhere.20 Briefly, after the administration of stannous fluoride, venous blood was withdrawn, radiolabeled with technetium-99m, and then reinjected into the subject after 10 minutes incubation. After 15 minutes for stabilization, images were obtained. A region of interest was defined, and images were obtained during 1-minute acquisition periods. At least 90% of the injected isotope was confined to the intravascular space; therefore, forearm radioactive counts were proportional to forearm blood volume. Because the vast majority of blood in the peripheral circulation is contained within the veins, changes in counts reflect changes in FVV.20 During each cycle of acquisition, cuffs were inflated over both upper arms at pressures of 0, 10, 20, and 30 mm Hg. From these data, scintigraphic vascular volumes were plotted against cuff pressure to form a venous pressure-volume relationship. A parallel shift of the relationship indicated a change in venous tone.20 Data were acquired from both the study and control arms, and any changes observed were corrected for those that occurred in the control arm. We and others have previously validated this technique.20–22 Importantly, we have shown that the position of the pressure-volume relationship is not altered by large changes in arterial inflow.19 To allow presentation of grouped data, results were presented as percentages. The data were corrected for physical decay of technetium.
Biochemistry
Chemicals and Reagents
Chemicals were purchased from Sigma (St Louis, Mo), other than glacial acetic acid, high-performance liquid chromatography–grade nitrite-free water, and hydrochloric acid, which were purchased from Fisher Scientific (Loughborough, United Kingdom). Sodium nitrite in the human studies was purchased from Martindale Pharmaceuticals, UK (Brentwood, United Kingdom).
Ozone-Based Chemiluminescence
Plasma nitrite and protein-bound NO were measured with a triiodide reagent linked to ozone-based chemiluminescence, as described previously.23 The triiodide reagent is probably the most widely used in the NO metabolite field and has been validated against standards in several laboratories.10,24–27 The reader is referred to a complete discussion of the assay.6,23,28–33
Stock solution of triiodide reagent was prepared fresh each day.23,27 Immediately before analysis, frozen plasma samples were thawed in a water bath at 37°C for 3 minutes. We have previously shown that sample freezing has no effect on plasma NO metabolite stability.34 The area under the curve was used in analyses, and concentrations were calculated from a standard curve of sodium nitrite.
Study Protocols
Protocol A (Normoxia)
Subjects were rested in a supine position. Both forearms were positioned on the face of a gamma camera (Scintron, MiE America, Inc, Elk Grove Village, Ill, and ADAC-Transcam, Aalborg, Denmark). A 20-gauge venous cannula was inserted into an antecubital vein in each arm. Blood was drawn and sent for a full blood count and biochemical profile. A 27-gauge arterial needle (Coopers Engineering, Birmingham, United Kingdom) mounted onto a 16-gauge epidural catheter and sealed with dental wax was then inserted into the nondominant brachial artery under sterile conditions and kept patent by the continuous infusion of normal saline.
Heart rate and rhythm were monitored continuously (GE Marquette Dash 3000, GE Healthcare, Chalfont St Giles, United Kingdom). Blood pressure was monitored continuously with finger plethysmography (TNO TPD Biomedical Instrumentation, Delft, Netherlands). Mercury-in-Silastic strain gauges were used for the measurement of forearm blood flow (FBF; DE Hokanson, Inc, Bellevue, Wash), as described previously.35 Changes in FBF observed in the study arm were corrected for those that occurred in the control arm and expressed as a ratio (FBFR; infused arm:control arm). Two venous pressure-volume relationships were recorded, and FBF was assessed during the infusion of normal saline. Blood was drawn from both venous cannulas (infusion and control arm) at baseline and at each stage of the study. Blood samples were transferred after blood gas analysis (Bayer Rapidlab 865, Siemens, Tarrytown, NY) into 4-mL EDTA collection tubes and were centrifuged at 2000 rpm for 10 minutes at 4°C. Plasma was snap-frozen in liquid nitrogen and stored at –80°C for subsequent analysis. Plasma nitrite and protein-bound NO were measured at each stage in both protocols.
Intrabrachial nitrite infusion was then commenced at a dose of 40 nmol/min for 30 minutes. FVV was assessed at 5, 12, and 20 minutes, followed by assessment of FBF. The above was then repeated with doses of nitrite of 100 nmol/min, 314 nmol/min, 784 nmol/min, 3.14 µmol/min, and 7.84 µmol/min. Left ventricular ejection fraction was calculated by multiple-gated acquisition. In a subset of subjects (n=3), radial arterial samples were taken at baseline and at peak nitrite infusion in which levels of nitrite and protein-bound NO were measured.
Protocol B (Hypoxia)
Subjects were prepared as for protocol A. Oxygen saturation levels were monitored continuously with pulse oximetry (Nellcor N-180, Nellcor, Pleasanton, Calif). Baseline measurements of all parameters were taken during the initial saline infusion.
Hypoxia was induced with the subject breathing 12% oxygen via a facemask connected to a 2-way valve. When arterial oxygen saturation levels (as measured by pulse oximetry) were stable in the 83% to 88% range (estimated pO2=47.5 to 55 mm Hg, based on Severinghaus equation), FVV and FBF were assessed during saline infusion ("hypoxia alone") before the infusion of nitrite.
In 7 subjects, intrabrachial nitrite was infused at a dose of 7.84 µmol/min for 20 minutes in either normoxia or hypoxia, in random order. Saline was infused between the 2 infusions of nitrite for 60 minutes. FVV was assessed at 10 minutes into each nitrite infusion, followed by assessment of FBF. In the remaining 7 subjects, protocol B was performed with nitrite at a dose of 314 nmol/min to investigate the effects of hypoxia in the context of a plasma concentration of nitrite close to that found physiologically.
Vascular Tissue Assay
Male New Zealand White rabbits (weight 2 to 2.5 kg) were terminally anesthetized by intravenous injection of sodium pentobarbital (0.75 mL/kg). The abdominal aorta and vena cava were excised and placed in fresh Krebs buffer (NaCl 109.0 mmol/L, KCl 2.7 mmol/L, KH2PO4 1.2 mmol/L, MgSO4.7H2O 1.2 mmol/L, NaHCO3 25.0 mmol/L, C6H12O6 11.0 mmol/L, CaCl2.2H2O 1.5 mmol/L). Vessels were cleaned and cut into 2-mm rings. Rings were mounted on matched stainless steel hooks for isometric tension recording in 8-mL baths containing 5 mL of Krebs buffer.
Tissue was allowed to equilibrate for 60 minutes under a resting tension of 2g at 37°C, the buffer being exchanged every 15 minutes. After final adjustment of the passive tension to 2g, vascular segments were constricted with phenylephrine (1 µmol/L). Once tension had reached a plateau, acetylcholine (10 µmol/L) was added to demonstrate endothelium viability.
After extensive washout, under normoxic conditions (95% O2/5% CO2), vessels were again constricted with 1 µmol/L phenylephrine, and sodium nitrite in Krebs buffer (10, 100, and 1000 µmol/L final concentration) was administered. Under hypoxic conditions (95% N2/5% CO2, resulting in
1% tissue bath O2), the tissue was first incubated for 10 minutes before exposure to 3 µmol/L phenylephrine (to achieve a similar gram tension observed at 95% O2) before administration of sodium nitrite. Tension was recorded for a further 20 minutes with Chart for Windows (ADInstruments, Chalgrove, United Kingdom). The minimum tension achieved was used in all calculations. All relaxations are presented as a percentage of the maximum tension induced by phenylephrine under the relevant conditions.
Data and Statistical Analysis
All data are expressed as mean±SEM, and probability values <0.05 were considered statistically significant. Repeated-measures analyses were performed for changes in FBFR and FVV. In vitro data were analyzed with 2-way ANOVA.
The authors had full access to and take full responsibility for the integrity of the data. All authors have read and agree to the manuscript as written.
| Results |
|---|
|
|
|---|
|
Protocol A: Normoxia
Venous Tone
At doses of nitrite of 784 nmol/min, 3.14 µmol/min, and 7.84 µmol/min, very large decreases in forearm venous tone were observed (Figure 1). The time course over which the dilation occurred is presented in Table 2 and Figure 2. Peak venodilation (mean±SEM) at 3.14 and 7.84 µmol/min was 20.6±4.2% (P<0.05) and 35.8±7.5% (P<0.005), respectively.
|
|
|
Arterial Blood Flow
Only at 3.14 and 7.84 µmol/min were there noticeable increases in FBFR (Figure 3). At baseline, FBFR was 1.0±0.1 (mean±SEM). At 3.14 and 7.84 µmol/min, FBFR was 1.8±0.3 and 1.6±0.2, respectively (P<0.05).
|
Plasma Nitrite and Protein-Bound NO Levels
Venous plasma nitrite levels were significantly greater in the infused versus control arm at doses of
314 nmol/mL (P<0.05; Figure 4. No statistically significant differences were present in venous levels of plasma protein-bound NO between the 2 arms at any dose Figure 4).
Arterial levels of plasma protein-bound NO in the infused arm increased from 64.0±5.8 nmol/L at baseline to 83.8±23.8 nmol/L (Figure 5B; P=NS).
|
|
Protocol B: Hypoxia
Venous Tone and FBF
Venodilation was similar between normoxia and hypoxia; however, hypoxia significantly enhanced the increase in FBFR during nitrite infusion. The mean increase in FBFR during high-dose nitrite infusion (7.84 µmol/min) in hypoxia was significantly greater than that in normoxia (P<0.05; Figure 6). Low-dose nitrite (314 nmol/min) had little effect during normoxia but increased FBFR during hypoxia (P<0.05; Figure 7).
|
|
In Vitro Work
Nitrite-induced vessel relaxation increased proportionally with increasing nitrite concentrations in both the aorta and the vena cava (P<0.05; Figure 8). No statistical difference was observed between the degree of nitrite-induced relaxation in the aorta versus vena cava under normoxia. Hypoxia enhanced nitrite-induced relaxation in both vessel types compared with relaxation under normoxia; however, veins had a proportionally greater relaxation than arteries at 100 and 1000 µmol/L nitrite (P<0.01).
|
| Discussion |
|---|
|
|
|---|
30 µmol/L). Although hypoxia had no incremental influence on the effects of nitrite on capacitance vessels, at similar concentrations (
55 µmol/L), it had a profound relaxing effect on resistance vessels. The in vitro studies confirmed this influence of hypoxia on nitrite-induced relaxation in both arteries and veins, which suggests that oxygen tension is a major determinant of the degree of response to nitrite.
Until recently, the nitrite anion was regarded as a relatively inert byproduct of NO metabolism and even as a potentially carcinogenic source of N-nitroso compounds.36 Recently, research has shown nitrite to be a distinct and important signaling molecule.8 Normoxic studies with animal aortic strips appeared to preclude a physiological role,4 but in contradistinction, a physiological function for nitrite has been supported by the capacity of physiological nitrite concentrations (
1 to 2 µmol/L) to dilate human resistance vessels.9
We have now shown that exogenous nitrite is a potent dilator of the venous capacitance bed in humans under both normoxic and hypoxic conditions. At the peak dose, we observed
40% venodilation; this is a large effect. Because up to 70% of the circulating blood volume resides within the capacitance bed, even subtle modifications of venous tone can result in large changes in central blood volume and cardiac "preload." Accordingly, a strong selective venodilator may confer distinct benefits in the treatment of heart failure. We have previously used carbachol extensively in studies assessing venous capacitance.37 At its peak dose, a maximal 3- to 4-fold increase in FBF and a 40% venodilation was observed.19 Thus, nitrite exerts venodilatory effects similar to those of carbachol with comparatively modest effects on resistance vessels during normoxia.
The enhanced resistance-vessel response to nitrite during hypoxia is consistent with the findings of Cosby et al,9 who observed that the vasodilatory effects of intra-arterial nitrite were enhanced by the tissue hypoxia induced by exercise of the forearm. Moreover, the present study answers many of the questions that were raised after publication of the study by Cosby et al9 and demonstrates in particular that hypoxia per se is a primary determinant in the action of nitrite. We found that in normoxia, low-dose nitrite (314 nmol/min) had no discernable effect on FBF, whereas Cosby et al9 observed a 29% increase in FBF in response to nitrite infused at 400 nmol/min in normoxia, but Lauer et al5 reported that exogenous nitrite had no effect at all on FBF, even at doses as high as 36 µmol/min. The reasons for this discrepancy may pertain to differences in the subjects and the experimental protocols, although such differences are not obvious because the preparation of nitrite and its infusion were similar. It is unlikely that subjects in the present study differed significantly in sympathetic stimulation.38 It is possible, however, that heterogeneity exists in the handling of nitrite. In the present study, we found a significant degree of variation in the responses observed. Although in the majority of individuals, nitrite doses as low as 314 nmol/min had little measurable effect on FBFR, in a few subjects, the effect was more pronounced. In 1 individual, the FBFR increased by 27%. Such heterogeneity may explain some of the apparently contradictory findings in the literature and provides an interesting avenue for future work.
Although in normoxia, nitrite was a weak vasodilator of resistance vessels compared with agents such as acetylcholine39 and bradykinin40 that can induce a 3- to 4-fold increase in FBF, in hypoxia, we show that it becomes an arterial vasodilator of comparable potency to these agents. Importantly, a significant augmentation in FBFR during hypoxia was also seen with low-dose (314 nmol/min) nitrite, which implies a possible physiological role under hypoxic conditions.
Our vascular ring studies confirmed that in the absence of hemoglobin, nitrite-induced dilatation of veins and arteries is more profound in the context of hypoxia than in normoxia, which confirms the present findings in vivo. In vitro, during hypoxia, relaxation of veins was greater than that of arteries; however, it is not valid to directly compare potency between arteries and veins and extrapolate to the in vivo situation because of the nonphysiological nature of the preparation, which measures relaxation from a preconstricted state rather than changes in basal tone.
Although the present study confirms a role for hypoxia in facilitating exogenous nitrite-induced vasodilation, no conclusion can be drawn about the mechanisms subserving this effect. Both nonenzymatic chemical reactions41 and nitrite reductase species42 as diverse as hemoglobin,9,30,43 xanthine oxidase,15 and endothelial NO synthase,44 as well as the mitochondrial enzymes cytochrome c oxidase and the bc1 complex,45 reduce nitrite hypoxically in vitro; however, their relative contribution to the hypoxic vasodilatory response in vivo remains unresolved.2,11,42 In subjects infused with nitrite, NO adducts of hemoglobin are increased, and it has been suggested that hemoglobin is a key nitrite reductase.9 Hemoglobin can subserve a number of roles, including nitrite reductase in hypoxia; as an acceptor of the resulting NO (eg, through HbNO); and as a donor of NO precisely where it is required, ie, at the site of hypoxia (through S-nitrosohemoglobin). These multiple personalities make hemoglobin an attractive nitrite modulator. A recent in vitro study46 has observed that nitrite-dependent vasodilation conforms to first-order reaction kinetics with respect to nitrite concentration. Using selective inhibitors during hypoxia, that study indicated that nitrite-induced vasorelaxation was independent of the nitrite reductases listed above and importantly was inhibited by oxygenated hemoglobin but not by deoxygenated hemoglobin.46 The study did not exclude a role for hemoglobin as a nitrite modulator in vivo. If nitrite is subject to hemoglobin-mediated NO production, how the resulting products or NO itself escapes from the red blood cell is not yet clear, because such an escape is difficult to reconcile with the diffusional limitations and the time constraints of an extremely quick A-to-V transit time.11
To reconcile the site and mechanism of action of nitrite in vivo, vascular preparations will need to be investigated further. Specific agents and inhibitors are required to identify putative nitrite reductases, eg, hemoglobin, myoglobin, neuroglobin, and other heme proteins, such as hypoxia-dependent nitrite reductases.47 The species to which nitrite is converted and which activate guanylate cyclase, eg, NO, iron nitrosyl, N-nitroso, and S-nitroso complexes, will also need to be identified. Parallel in vivo studies will supplement the in vitro studies. In the present study, venous plasma nitrosothiol levels rose similarly in both arms, which suggests that protein-bound NO in the plasma compartment did not mediate the venous dilation directly. This, however, does not preclude protein-bound NO within the red blood cells or within the vascular compartment contributing to the bioactive effects of nitrite.
Study Limitations
The present study was performed in healthy volunteers, and the response to nitrite may differ in disease. In addition, organ-chamber bioassays are limited by the complicating factor of varying baseline tension in precontracted vessels.11 Because different vessels (capacitance versus resistance) show different and nonlinear responses, such bioassay results should be assessed judiciously, and any interpretation of apparent differences between vessel types should be guarded. Nonetheless, the present in vivo and in vitro studies are consistent internally. Finally, the present results increase the understanding of the synergy between nitrite and hypoxia but provide limited insights into the role of endogenous nitrites in physiology. We speculate that the present study may also implicate a role for endogenous nitrites in hypoxic vessels, but we have limited any discussion of the role of nitrite in physiological hypoxic vasodilatation.11 Even in the in vitro assays, in which unphysiologically high concentrations of nitrite (100 µmol/L) have been required previously, careful attention to precontraction and incipient conditions reveals that physiological concentrations of nitrite (0.1 to 10 µmol/L) can modulate tone.46
Conclusions
The present study confirms that hypoxia per se is a prime determinant of the in vivo response to exogenous nitrite. Both capacitance and resistance vessels respond profoundly to relatively modest pharmacological concentrations of exogenous nitrite in hypoxia. Although for some years, it has been speculated on the basis of studies in normoxic and exercising patients that "therapeutic application of nitrite should result in selective vasodilation to hypoxemic tissue, and could be used to treat diseases associated with ischemia,"9 the present study confirms the role for nitrite in resistance-vessel dilatation in human hypoxic tissues. Corresponding therapeutic implications exist in conditions such as heart failure, in which selective venodilation would reduce intracardiac pressure in the absence of resistance-vessel dilatation, thus avoiding hypotension. Perhaps more importantly, pharmacological doses of nitrite may constitute a specific hypoxically bioactive agent that targets only hypoxic vessels.12,48,49 A preliminary indication of the importance of nitrite has been afforded by data presented by Arai,2 who demonstrated that a brief nitrite infusion (plasma concentration of
5 µmol/L) decreased myocardial infarction size from 70% to 20%. In addition to confirming the present findings, future studies will have to assess the therapeutic role of nitrite in disease.
| Acknowledgments |
|---|
Sources of Funding
This research was supported by the British Heart Foundation.
Disclosures
Dr Frenneaux has received a research grant from Medtronic. He has an ownership interest in a "method of use" patent held for Perhexiline in Chronic Heart Failure. He has also served on the advisory board or as a consultant to Medtronic and Biotronic and has received sponsorship from Medtronic, Biotronic, Servier, Novartis, and AstraZeneca to attend meetings.
| References |
|---|
|
|
|---|
Related Article:
Circulation 2008 117: 589-591.
This article has been cited by other articles:
![]() |
D. Kumar, B. G. Branch, C. B. Pattillo, J. Hood, S. Thoma, S. Simpson, S. Illum, N. Arora, J. H. Chidlow Jr., W. Langston, et al. Chronic sodium nitrite therapy augments ischemia-induced angiogenesis and arteriogenesis PNAS, May 27, 2008; 105(21): 7540 - 7545. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Gladwin Evidence Mounts That Nitrite Contributes to Hypoxic Vasodilation in the Human Circulation Circulation, February 5, 2008; 117(5): 594 - 597. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||