| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Circulation. 2003;108:198.)
© 2003 American Heart Association, Inc.
Basic Science Reports |
From the Departments of Pediatrics, Ophthalmology, and Pharmacology, Research Center of Hôpital Sainte-Justine (F.S., A.V.-T., D.C., S.B., F.G., M.H.B., B.M., S.C.); Departments of Pharmacology (D.R.V., B.M.) and Ophthalmology (P.L.), McGill University; and Faculty of Pharmacy, Université de Montréal (H.O.), Montreal, Québec, Canada, and Développement, Vieillissement et Pathologie de la Rétine, Institut National de la Santé et de la Recherche Médicale U450, Paris, France (F.V., Y.C., F.B.C.); Department of Ophthalmology, College of Medicine, King Saud University, Riyadh, Saudi Arabia (A.M.E.-A.); and Department of Pathology, University Hospitals Leuven, Belgium (K.G.).
Correspondence to Florian Sennlaub, MD, PhD, Department of Pediatrics, Centre de Recherche, Hôpital Sainte-Justine, 3175, chemin de la Côte-Sainte-Catherine, Montréal, Québec, Canada H3T 1C5. E-mail fsennlaub{at}justine.umontreal.ca
Received March 10, 2003; revision received May 20, 2003; accepted May 20, 2003.
| Abstract |
|---|
|
|
|---|
Methods and Results We describe here that COX-2 is induced in retinal astrocytes in human diabetic retinopathy, in the murine and rat model of ischemic proliferative retinopathy in vivo, and in hypoxic astrocytes in vitro. Specific COX-2 but not COX-1 inhibitors prevented intravitreal neovascularization, whereas prostaglandin E2, mainly via its prostaglandin E receptor 3 (EP3), exacerbated neovascularization. COX-2 inhibition induced an upregulation of thrombospondin-1 and its CD36 receptor, consistent with the observed antiangiogenic effects of COX-2 inhibition; EP3 stimulation reversed effects of COX-2 inhibitors on thrombospondin-1 and CD36.
Conclusion These findings point to an important role for COX-2 in ischemic proliferative retinopathy, as in diabetes.
Key Words: prostaglandins diabetes mellitus ischemia vasculature
| Introduction |
|---|
|
|
|---|
Cyclooxygenase (COX)-2 is also an immediate-early gene product of inflammation.6 Prostanoids are synthesized principally via activities of COX-1 and COX-2. COX-1 is mostly constitutive and is expressed in most tissues. COX-2 is induced by cytokines, mitogens, and endotoxins, accounting for elevated prostaglandin production during inflammation.6
COX-2 can be expressed developmentally and on ischemic stimuli in retina.7 COX-2 exerts an angiogenic effects in tumors8,9 and in corneal neovascularization.10 It has also been shown that prostanoids, notably prostaglandin E2 (PGE2), stabilize the hypoxia-inducible factor11 and stimulate expression of basic regulators of angiogenesis, including vascular endothelial growth factor (VEGF) in tumor endothelium,8 resulting in endothelial cell proliferation.12 We hereby investigated the role of COX-2 in a nontumoral condition, namely ischemic proliferative retinopathy, using human retinal tissue and experimental proliferative ischemic retinopathy. Our findings disclose an important role for this immediate-early gene product in proliferative retinopathy mediated (at least in part) by PGE2 mostly via prostaglandin E receptor 3 (EP3) through a previously undescribed action involving thrombospondin-1 (TSP-1) and CD36.
| Methods |
|---|
|
|
|---|
Animal Models of Ischemic Proliferative Retinopathy
All procedures were conducted in accordance with the Association for Research in Vision and Ophthalmologys statement, The Use of Animals in Ophthalmic and Vision Research.
In the murine model, C57BL/6 mice at postnatal day (P) 7 were exposed, with their mothers, for 5 days to hyperoxic conditions (75% O2), inducing vaso-obliteration of the central retinal vasculature.13 At P12, mice were returned to room air; extensive vitreal neovascularization was present in all mice, with the maximum effect observed on P17. Ischemic proliferative retinopathy was also reproduced in Sprague-Dawley rats exposed to 7 cycles of hyperoxia (80% O2, 20.5 hours) and hypoxia (10% O2, 0.5 hours) with a gradual return to 80% O2 over 3 hours, from P1 to P7.14 Thereafter, rats were returned to room air, and neovascularization was evaluated at P12.
Mice and rats were anesthetized with an intraperitoneal injection of a ketamine (100 mg/kg) and xylazine (15 mg/kg) solution and intravitreally injected using glass capillaries (
60 gauge). Right eyes of mice were injected intravitreally at P13 and P15 with 0.5 µL of vehicle (50% polyethylene glycol [Sigma-Aldrich], 40% PBS, and 10% ethanol); 2, 10, or 50 µmol/L of specific COX-2 inhibitor o-(Acetoxyphenyl)hept-2-ynyl sulfide (APHS)15 (Calbiochem, France Biochem) (n=16/group); vehicle (90% 0.9% NaCl and 10% ethanol); 2, 10, or 50 µmol/L of the selective COX-1 inhibitor SC-56016 (Calbiochem) (n=16/group); or 0.3 µmol/L 16,16-dimethyl-PGE2 (Sigma-Aldrich), resulting in estimated effective vitreal concentrations of drugs (estimated total eye volume of 10 µL based on spheric volume and volume-to-weight ratio calculation) of 0.2, 1, and 5 µmol/L (APHS and SC-560) and 0.03 µmol/L (16,16-dimethyl-PGE2). Eyes were enucleated at P17 and subjected to retinal histochemistry (n=8) and intravitreal neovascularization quantification (n=8) (see below). Rat pups (n=8 to 13/group) were injected in the right eye at P7 and P9 with either 1 µL of vehicle (NaCl 0.9%) or the selective COX-2 inhibitor etodolac 40 µmol/L16 (Sigma-Aldrich) with or without 16,16-dimethyl-PGE2 4 µmol/L (Cayman Chemicals), a specific EP2 or EP3 agonist, respectively, butaprost 400 µmol/L (Cayman Chemicals) or M&B28767 4 µmol/L (Rhone-Poulenc Rorer),17 to obtain estimated effective vitreal concentrations of drugs (estimated total eye volume of 40 µL) of 1 (etodolac), 0.1 (16,16-dimethyl-PGE2), 10 (butaprost), and 0.1 (M&B28767) µmol/L; EP2 and EP3 receptor agonists were used because antagonists are not readily available. Rats were euthanized at P12 and retinas stained for endothelial cells and flat mounted (see below).
Immunohistochemistry
Human and murine eyes were fixed in 4% paraformaldehyde and embedded, sectioned (5 µm), and deparaffinized. Sections were stained using a heat-induced antigen retrieval and a 3-step avidin-biotin complex technique using avidinalkaline phosphatase or avidin-FITC as previously described.4 Antibodies used were polyclonal COX-2 antibody (Biomol Laboratories and Cayman Chemical Co), monoclonal EP3 antibody (generous donation by Exalpha Biologicals), monoclonal glial fibrillary acidic protein (GFAP) (Oncogene), and TRITC-conjugated lectin griffonia simplicifolia (Sigma-Aldrich).
Cell Culture
Given the need for sufficient tissue quantities, primary astrocyte and endothelial cell cultures were obtained for practical reasons from neonatal porcine retinas; cells from this species respond to a variety of stimuli implicated in ischemic retinopathies in the same manner as that of rodent tissues.18,19 Neonatal porcine retinal astrocytes were isolated as described for brain astrocytes.20 Cells of the third to fourth passages were used. Cultures were
95% GFAP positive. Monolayers (80% confluent) of astrocytes were incubated at 37°C either under normoxic (95% air, 5% CO2) or hypoxic conditions (2% O2, 5% CO2, 93% N2) for 24 hours. Subsequently, the medium was changed and cells were incubated for 1 hour in the presence of APHS (1 µmol/L), etodolac (1 µmol/L), SC-560 (0.2 µmol/L), or etodolac (1 µmol/L) and SC-560 (0.2 µmol/L); drug concentrations used were equivalent to those estimated in vivo. PGE2 concentrations were measured in the supernatant, and the cells were harvested for protein quantification and Western blot analysis. The pH of the medium was unchanged during 24-hour hypoxia. For endothelial cell culture, newborn porcine neuroretinal microvessels were isolated as previously reported.18
Western Blot
Protein extraction of cells was performed as previously described.18 Rat retinas were pooled3,4 and membranous and cytosolic fractions were separated as previously described.21 Antibodies used were polyclonal antiCOX-2 (Cayman); polyclonal antiCOX-1 (Santa Cruz Biotechnology); mouse monoclonal EP2, EP3, and EP4 (Exalpha Biologicals); polyclonal anti-VEGF antibody (Chemicon); rat monoclonal antiVEGF receptor (VEGFR)2 (Chemicon); monoclonal antiTSP-1 (Oncogene); polyclonal purified anti-CD36; monoclonal anti-clathrin (Transduction Laboratories, BD Biosciences); monoclonal antiß-actin (Novus Biological); and monoclonal GFAP (Oncogene). Western blots were performed on equal amounts of proteins as described.18
PGE2 Radioimmunoassay
PGE2 concentrations in retinal tissue (n=3 per group) and astrocyte supernatant were determined as previously described.22
RNA Isolation and Reverse TranscriptionPolymerase Chain Reaction (PCR) Analysis
Retinal mRNA expression from whole retinal extracts (n=3 per group) was analyzed using reverse transcriptionPCR (cycles below the saturating conditions) as previously described.4 Oligonucleotide primers were the following: for COX-2, antisense 5'-GGAGAAGGCTTCCCAGCTTTTG-3', and sense 5'-GCAAATCCTTGCTGTTCCAATC-3', resulting in a PCR product of 336 bp; for actin, antisense 5'-GCTCATTGCC-GATAGTGATGACCT-3', and sense 5'-GGTGGGTATGGGT-CAGAAGGA-3', resulting in a 630-bp PCR product.
Quantification of Vitreal Neovascularization and Intraretinal Revascularization
Mouse eyes were paraffin embedded, cut sagitally (parallel to the optic nerve), and stained with periodic acid-Schiff and Hemalun. Vitreal neovascularization (vascular cell nuclei found on the vitreal side of the inner limiting membrane) was counted by blinded investigators as previously described.4 Neovascular nuclei were absent in animals raised in room air. Intraretinal vasculature was visualized on retinal flat mounts stained with TRITC-conjugated lectin griffonia simplicifolia (Sigma-Aldrich),23 and the surface of the capillary free area measured using a computerized image-analysis system (Scion Image). In the rat model, intravitreal neovascularization was evaluated by counting intravitreal neovascular tufts on lectin-stained retinal flat mounts.
Statistical Analysis
Results are expressed as mean±SEM. Statistical analyses were performed using the Mann-Whitney test and ANOVA. Statistical significance was set at P<0.05.
| Results |
|---|
|
|
|---|
|
|
COX-2 Expression and Localization, and PGE2 Concentrations in Experimental Ischemic Retinopathy
COX-2 expression is altered by ischemia in neural tissue.24 We explored the involvement of COX-2 in a murine model of retinopathy of prematurity. Equivalent COX-2 mRNA expression was observed in room air and after hyperoxia exposure at P12, P14, and P17 (Figure 2A). Immunolocalization of COX-2 was studied in mouse retina and was found to be similar to that in humans. In normoxic mice at P14, COX-2 protein was robustly expressed in retinal pigment epithelial cells both in the outer photoreceptor segment and in the inner plexiform layer (data not shown). In the posthyperoxia-exposed retinas, COX-2 expression was also detected in the NFL at P14 (Figure 3a) predominantly in astrocytes (GFAP positive) (Figure 3e and 3f).
|
|
COX-2 protein expression was evaluated in membrane fractions of retina extracts from hyperoxia-exposed rats. At the end of the hyperoxic period (P1 through P7), COX-2 immunoreactivity diminished and tended to increase in the early hours after resuming exposure to room air (24 hours after hyperoxia; Figure 2C). COX-1 exhibited the reverse pattern, and consequently whole retina concentrations of PGE2, a mediator involved in angiogenesis,25 were unaltered during the posthyperoxia period (Figure 2B); although this does not exclude a local paracrine effect of this autacoid. Consistent with these observations, primary retinal astrocyte cultures exposed for 24 hours to relative hypoxia (2% O2, 5% CO2, 93%) exhibited increased COX-2 expression (Figure 2D) and PGE2 levels (Figure 2E) compared with those in normoxia (95% air, 5% CO2), whereas COX-1 expression remained steady. Specific COX-2 inhibitors, APHS and etodolac, markedly diminished PGE2 levels, whereas COX-1selective SC-560 only caused a small decrease in PGE2 concentrations (Figure 2E) even at highest dose tested (5 µmol/L), suggesting a dominant role for COX-2 in PGE2 generation during hypoxia.
In age-adjusted normoxic whole retinas, COX-1 and -2 expression did not change. Immunolocalization of COX-2 in rat retina was similar to that observed in mouse (data not shown).
COX Inhibition in Ischemic Proliferative Retinopathy
The impact of COX inhibition on neovascularization was tested using specific COX-2 (APHS and etodolac) and COX-1 (SC-560) inhibitors; concentrations corresponded to effective ones on astrocyte PGE2 levels (Figure 2E). In vivo, posthyperoxia administration of the preferential COX-2 inhibitor APHS did not affect the degree of capillary-free area or the intraretinal revascularization of the ischemic retina studied 4 days after the first dose (P17) (Figure 4A and 4B). However, intravitreal neovascularization (revealed by intravitreal vascular nuclear counts) was dose-dependently diminished by APHS, whereas the selective COX-1 inhibitor SC-56015 was ineffective (Figure 4C). PGE2 levels in whole retina were reduced by 65% 24 hours after APHS treatment. Moreover, intravitreal injection of PGE2 after the hyperoxic period led to a significant (albeit mild) increase in intravitreal neovascularization.
|
To confirm the role of COX-2 in retinal neovascularization, its involvement was tested using a distinct selective COX-2 inhibitor, etodolac,16 as well as a different species, the rat model of ischemic proliferative retinopathy. Etodolac caused a marked decrease in retinal neovascularization (studied at 5 days after the first injection) (Figure 5A and 5B). This effect was reversed by PGE2.
|
To further explore the PGE2 pathway, PGE2 receptor expression and its changes during the posthyperoxia period were studied. Hyperoxia caused a slight decrease in EP4 (Figure 5C), whereas EP1 was undetectable (not shown). In contrast, EP2 and to a greater extent EP3 receptor expression was significantly decreased by hyperoxia and increased substantially during the posthyperoxia period (Figure 5C), coincidental with COX-2 changes (Figure 2C). Moreover, addition of the EP2 agonist butaprost and the EP3 agonist M&B2876717 reversed in part or exacerbated the inhibitory effects of etodolac on retinal neovascularization. EP3 receptor expression also increased in the same phase in that of the murine eye, predominantly localized in retinal endothelium (lectin griffoniapositive cells) (Figure 3f through 3h).
Effects of COX-2 Inhibition and EP3 Stimulation on Expression of Modulators of Angiogenesis
Involvement of COX-2 and EP3 on pro- and antiangiogenic factors, notably VEGF, VEGFR2, TSP-1, and CD36,26,27 was studied in retina of models of proliferative retinopathy. Twenty-four hours after removal from hyperoxia, there was an increase in TSP-1 expression. The COX-2 inhibitor etodolac induced a substantial increase in both TSP-1 and CD36, and addition of the EP3 agonist M&B28767 reversed this effect. In contrast, effects of COX-2 on neovascularization could not be explained by the VEGF pathway; VEGF expression, although as anticipated it increased during the posthyperoxic period, was marginally affected by etodolac and M&B28767 (Figure 6A), and VEGFR2 remained unaltered. In accord with in vivo observations, etodolac caused a slight increase in TSP-1 expression in neuroretinovascular endothelial cells, and this effect was reversed by M&B28767 (Figure 6B), consistent with EP3 expression on retinal endothelium (Figure 3f).
|
| Discussion |
|---|
|
|
|---|
COX-2 was abundantly present in synaptic regions of the retina of all species studied (human, mouse, and rat) as seen in the brain.29 In addition, COX-2 was induced in the NFL of retinas of humans with diabetes and vascular obstruction (case 12) and in animals after hyperoxia, hence during hypoxic-ischemic phases; in these instances, COX-2 was mostly induced in astrocytes (but also in endothelium [Figure 6B]) and seemed to account for a large portion of PGE2 generation (Figure 2E). Consistent with the time-dependent and propitious localization of COX-2, molecularly distinct inhibitors of this enzyme (APHS and etodolac15,16) markedly diminished preretinal neovascularization (Figures 4 and 5
), whereas COX-1 inhibition was ineffective. Moreover, administration of the well-recognized proangiogenic COX product PGE22,5,10 (Figure 4) reversed the antiangiogenic effects of COX-2 inhibitors in the retina (Figures 4 and 5
). In view of the significant COX-1 expression even during the hypoxic phase (Figure 2C and 2D), one would have predicted some effect of COX-1 inhibition on neovascularization. However, COX-2 seems to be coregulated and biochemically coupled with the inducible gene product microsomal PGE2 synthase, a dominant generator of PGE2 under certain inflammatory conditions,30 whereas COX-1 appears to be mostly coupled to the constitutive cytosolic PGE2 synthase. This inference may explain at least in part the differences observed between COX-1 and COX-2 inhibitors. Of note, we found augmented microsomal PGE2 synthase during the posthyperoxic period (data not shown) and, accordingly, a major role for COX-2 in PGE2 generation during hypoxia (Figure 2E).
The angiogenic effect of PGE2 seemed to be mediated via its EP2 and especially EP3 receptors, as specific stimulation of these receptors reversed the effects of etodolac on neovascularization (Figure 5); selective antagonists to these receptors are not readily available. Of interest, EP2 and EP3 have recently been reported to participate in colorectal tumor angiogenesis,31,32 and these effects may be mediated via VEGF, a major factor in ischemic proliferative retinopathy26; similarly, COX-2 inhibition downregulated VEGF in colon tumor endothelial cells.8 But in other endothelial cells (breast tumor and cornea), COX-2 inhibition affected the basic fibroblast growth factor pathway,9 which plays a minor role in ischemic proliferative retinopathy.33 Endothelial cells are not homogeneous throughout tissues, and in retina the effect of COX-2 inhibition was largely unrelated to the VEGF pathway (Figure 6). Thus, COX-2 inhibition may interfere with pathways that are independent of specific growth factors. Plausible candidate pathways are through TSP-1 and its receptor CD36, which inhibit angiogenesis via p38 mitogen-activated protein kinase and caspase 3.34 This conjecture is supported by an upregulation of TSP-1 and CD36 by COX-2 inhibitor and reversal of these effects by EP3 stimulation (Figure 6). Although a prostaglandin D2 metabolitedependent peroxisome proliferator-activated receptor-
mediated induction of TSP-1 and CD36 has been documented,35 an EP3-evoked one as we observed (Figure 6) discloses a previously undescribed mode of regulation of these antiangiogenic factors.
In summary, COX-2 contributes markedly to preretinal neovascularization in ischemic retinopathies, and this effect seems to be PGE2 mediated mostly via EP3 receptors implicating a new interaction through TSP-1 and CD36. Results suggest that selective COX-2 inhibitors could be used for the control of pathological vitreal neovascularization in ischemic proliferative retinopathy. More specifically, EP3 (and possibly EP2) antagonists may be more selective by sparing the potentially physiologically desirable effects of the various COX-2 products.
| Acknowledgments |
|---|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
stabilization and nuclear localization in a human prostate cancer cell line. J Biol Chem. 2002; 277: 5008150086.
)) in immature pig periventricular brain microvessels. Stroke. 2000; 31: 516525.
. J Lipid Res. 2000; 41: 688696.This article has been cited by other articles:
![]() |
M. S. Desai, M. M. Mariscalco, A. Tawil, J. G. Vallejo, and C. W. Smith Atherogenic diet-induced hepatitis is partially dependent on murine TLR4 J. Leukoc. Biol., June 1, 2008; 83(6): 1336 - 1344. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. R. Mwaikambo, F. Sennlaub, H. Ong, S. Chemtob, and P. Hardy Activation of CD36 Inhibits and Induces Regression of Inflammatory Corneal Neovascularization. Invest. Ophthalmol. Vis. Sci., October 1, 2006; 47(10): 4356 - 4364. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Wanggren, P.G. Lalitkumar, A. Stavreus-Evers, B. Stabi, and K. Gemzell-Danielsson Prostaglandin E2 and F2{alpha} receptors in the human Fallopian tube before and after mifepristone treatment Mol. Hum. Reprod., September 1, 2006; 12(9): 577 - 585. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Zhu, F. Sennlaub, M. H. Beauchamp, L. Fan, J. S. Joyal, D. Checchin, S. Nim, P. Lachapelle, M. Sirinyan, X. Hou, et al. Proangiogenic Effects of Protease-Activated Receptor 2 Are Tumor Necrosis Factor-{alpha} and Consecutively Tie2 Dependent Arterioscler. Thromb. Vasc. Biol., April 1, 2006; 26(4): 744 - 750. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. C. Amrite, S. P. Ayalasomayajula, N. P. S. Cheruvu, and U. B. Kompella Single Periocular Injection of Celecoxib-PLGA Microparticles Inhibits Diabetes-Induced Elevations in Retinal PGE2, VEGF, and Vascular Leakage. Invest. Ophthalmol. Vis. Sci., March 1, 2006; 47(3): 1149 - 1160. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. N. Jabbour, R. W. Kelly, H. M. Fraser, and H. O. D. Critchley Endocrine Regulation of Menstruation Endocr. Rev., February 1, 2006; 27(1): 17 - 46. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Pladys, F. Sennlaub, S. Brault, D. Checchin, I. Lahaie, N. L. O. Le, K. Bibeau, G. Cambonie, D. Abran, M. Brochu, et al. Microvascular rarefaction and decreased angiogenesis in rats with fetal programming of hypertension associated with exposure to a low-protein diet in utero Am J Physiol Regulatory Integrative Comp Physiol, December 1, 2005; 289(6): R1580 - R1588. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. S. Biswas, K. Banerjee, B. Kim, P. R. Kinchington, and B. T. Rouse Role of Inflammatory Cytokine-Induced Cycloxygenase 2 in the Ocular Immunopathologic Disease Herpetic Stromal Keratitis J. Virol., August 15, 2005; 79(16): 10589 - 10600. [Abstract] [Full Text] [PDF] |
||||
![]() |
X. Zhang and A. H. Neufeld Activation of the Epidermal Growth Factor Receptor in Optic Nerve Astrocytes Leads to Early and Transient Induction of Cyclooxygenase-2 Invest. Ophthalmol. Vis. Sci., June 1, 2005; 46(6): 2035 - 2041. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. E. Walshe, G. Ferguson, P. Connell, C. O'Brien, and P. A. Cahill Pulsatile Flow Increases the Expression of eNOS, ET-1, and Prostacyclin in a Novel In Vitro Coculture Model of the Retinal Vasculature Invest. Ophthalmol. Vis. Sci., January 1, 2005; 46(1): 375 - 382. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. S. Wall, R. L. Gendron, W. V. Good, E. Miskiewicz, M. Woodland, K. Leblanc, and H. Paradis Conditional Knockdown of Tubedown-1 in Endothelial Cells Leads to Neovascular Retinopathy Invest. Ophthalmol. Vis. Sci., October 1, 2004; 45(10): 3704 - 3712. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. L. Wahl, T. L. Moser, and S. V. Pizzo Angiostatin and Anti-angiogenic Therapy in Human Disease Recent Prog. Horm. Res., January 1, 2004; 59(1): 73 - 104. [Abstract] [Full Text] |
||||
![]() |
G. B. Perchick and H. N. Jabbour Cyclooxygenase-2 Overexpression Inhibits Cathepsin D-Mediated Cleavage of Plasminogen to the Potent Antiangiogenic Factor Angiostatin Endocrinology, December 1, 2003; 144(12): 5322 - 5328. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||