![]() |
|
|
3 Kintampo Health Research Centre, Kintampo, Ghana; 4 London School of Hygiene and Tropical Medicine, London, UK; 5 Noguchi Memorial Institute for Medical Research, Accra, Ghana; and 6 Navrongo Health Research Centre, Navrongo, Ghana
* To whom correspondence should be addressed. E-mail: sam.newton{at}ghana-khrc.org.
| ABSTRACT |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
In 2002, the Ministry of Health in Ghana introduced the pentavalent, diphtheria-pertussis-tetanus (DPT), hepatitis B (HepB), and Haemophilus influenzae type b (Hib) vaccine into Ghana's immunization program in place of the conventional DPT vaccine while maintaining the immunization schedule at 6, 10, and 14 wk. Studies confirm that the administration of vitamin A at the time of vaccination has no negative effect on seroconversion to DPT (7–11) but it does reduce the antibody response to measles vaccine when given at 6 mo, when maternal antibodies tend to be high, rather than at the usual 9 mo (12). The effect of vitamin A on the antibody response to the hepatitis B and Haemophilus influenzae type b antigens has not yet been established, although countries with support from the Global Alliance for Vaccines and Immunization have started introducing these new vaccines into their EPI schedules. This trial was therefore carried out to assess these effects.
The objective of the trial was to compare the seroprotection rates and geometric mean antibody concentrations at 18 wk of age to hepatitis B and Hib vaccines in infants who received, along with their vaccines at 6, 10, and 14 wk, 15 mg of retinol equivalent8 vitamin A with those infants who did not receive vitamin A. We hypothesized that the simultaneous administration of vitamin A (an immune enhancer) and the pentavalent vaccine to young infants in EPI clinics would reduce or enhance the serological response to hepatitis B and Hib vaccines.
| Methods |
|---|
|
|
|---|
The trial was an open randomized and controlled trial conducted by investigators from the Kintampo Health Research Center (KHRC). It was carried out in Akumadan, Afrancho, and Nkenkaasu, 3 towns in the Offinso District in the northern fringes of the Ashanti Region of Ghana, bordering the KHRC study area in the Brong Ahafo region. We estimated from an earlier study that >51% of children <5 y of age in this area have serum retinol concentrations
0.70 µmol/L (5). A recent survey among pregnant women attending an antenatal clinic in Nkoranza district, 30 km from the study area, showed a 51% prevalence of vitamin A deficiency (13).
Participants
Trained field workers identified newborn infants through active weekly surveillance in the community. Mothers who gave signed or thumb-printed informed consent, had infants between the ages of 6 and 10 wk at the time of 1st vaccination, and intended to stay in the study area for the entire duration of the trial (i.e., until their infants reached 18 wk of age), were considered eligible for enrollment. Breast-feeding was virtually universal in this area (14), and the newly introduced pentavalent vaccine (DPT+Hep+Hib) was routinely given at 6, 10, and 14 wk of age in health facilities.
Ethical issues
Informed consent for participation was sought from all mothers after they were given a detailed explanation of the purpose of the study. The trial was approved by the Ethical Review Committees of the Ghana Health Service, the WHO, and the London School of Hygiene and Tropical Medicine.
Sample size
We determined that a sample size of 948 mother infant pairs was required to detect a difference in seroprotection rates from 95 to 90%, with 80% power at the 5% significance level. Including a provision of 10% loss to follow-up gave a requirement of 1042 mother-infant pairs.
Intervention groups
All infants were vaccinated with polio plus the pentavalent vaccine (DPT+Hib+Hep) at 6, 10, and 14 wk of age; they were given 2 drops (0.1 mL) of live, attenuated oral poliomyelitis vaccine (Sabin) [Polioral, Lot A0PVB170AA] directly into the mouth and were injected with 0.5 mL Tritanrix HB+Hiberix, which contained combined diphtheria-tetanus-toxoid whole cell pertussis bacteria (Pw), the purified major surface antigen of the hepatitis B virus, adsorbed onto aluminum salts and purified polyribosyl-ribitol-phosphate capsular polysaccharide of Hib, covalently bound to tetanus toxoid (GlaxoSmithKline Biologicals, Lot AH IBB133BA).
Infants in the intervention group also received an oral dose of 15 mg retinol equivalent vitamin A at the time they received their vaccines, whereas those in the control group did not. All infants were given 30 mg retinol equivalent vitamin A at the end of the trial at 18 wk of age after all blood samples had been collected.
Mothers in both groups received 120 mg retinol equivalent vitamin A, as retinol palmitate, as soon as possible postdelivery according to current government policy and following the recommendations of the International Vitamin A Consultative Group (that postpartum mothers receive vitamin A in order for their infants to benefit from increased vitamin A intake through breast-feeding) (15).
Randomization
Mothers and their infants were allocated to the intervention or control groups based on the date of birth of their infants. Those born during wk 1 of recruitment (15 June 2004) were assigned to the intervention group, those born the following week were assigned to the control group, those born the next week were assigned to the intervention group, and so on, until recruitment was completed. The infant's date of birth was carefully verified to make sure that mothers could not influence which group their infant would be placed in.
Trial procedures
All vaccinations and vitamin A dosing were carried out in the clinic by community health nurses. Each week, listings of infants due for immunization the following week were generated from a computerized database of enrolled infants and were given to field workers who reminded mothers that an immunization visit was due. Study infants were identified at the clinic using trial ID cards by trained trial staff prior to immunization. If any infants were not brought to the clinic, fieldworkers made another reminder call to the home.
At the 1st EPI contact, i.e., at 6 wk of age and after the administration of vaccines, KHRC laboratory staff collected a 1 mL blood sample by heel prick from all infants whose mothers had given consent at enrollment to the measurement of antibodies to hepatitis B and Haemophilus influenzae type b. Another 1 mL blood sample was taken at the final 18 wk of age follow-up, and then all infants were given 30 mg retinol equivalent vitamin A.
Blinding
The study was not blinded because placebos could not be given to the control group due to logistical and cost constraints. However, the measurement of trial outcomes was blinded; blood samples sent to the laboratory for analysis were identified by ID number only, and the laboratory was blinded as to what samples belonged to what group.
Blood collection and antibody analyses
The blood samples were centrifuged at 1400 x g for 10 min at the KHRC laboratory in Kintampo and stored in aliquots at –20°C before being transported to the Noguchi Memorial Institute for Medical Research (NMIMR) at the University of Ghana for analysis for hepatitis B and Haemophilus influenzae type b antibodies, using standard ELISA tests.
ELISA for anti-Hib antibody determination. BINDAZYME Anti Haemophilus influenzae type B enzyme immunoassay kit, manufactured by Binding Site,was used. This assay is for the in-vitro measurement of specific IgG antibodies against Hib capsular polysaccharide, which is present in human sera. The assay has been found to be reproducible, consistent, and reliable and was chosen because it is more convenient than the standard, radio antigen binding assays (RABA) for the measurement of anti-Hib. ELISA has been shown to correlate well with the RABA assays and allows the selective quantification of the IgG isotype (16,17). Serum anti-Hib antibodies protect against the organism in-vivo, and protective levels have been established for unvaccinated and vaccinated individuals by RABA (18). The kit uses microplates coated with Hib capsular polysaccharide antigen conjugated to human serum albumin. Purified peroxidase labeled rabbit anti-human lgG was used as the enzyme conjugate with 3, 3', 5, 5' tetramethylbenzidine (TMB) as the substrate (19).
ELISA for anti-HepB antibody determination. EQUIPAR HBsAb enzyme immunoassay, manufactured by Equipar SRI, was used. This assay is for the quantitative determination of antibodies to hepatitis B virus. The kit uses microplates coated with a preparation of highly purified Hep B antigen. Following the addition of samples and subsequent washing, a different Hep B antigen conjugated to peroxide was added that binds to a 2nd site on the antibody. The enzyme specifically binds to wells by acting on the substrate/chromogen mixture, generating an optical signal proportional to the amount of Hep B antibodies in the sample and detectible by an ELISA reader. The concentration of antibodies is then estimated by means of a standard curve calibrated against the WHO reference preparation (20).
Outcomes
The impact of vitamin A supplementation was assessed by comparing treatment groups with respect to seroprotection rates and geometric mean antibody concentrations for hepatitis B and Hib at 18 wk of age and following a full course of 3 doses of vaccines at 6, 10, and 14 wk of age. Two levels were used for assessing seroprotection to Hib: a level of
0.15 µg/mL for short-term protection, and
1.0 µg/mL for long-term protection (21,22). For hepatitis B seroprotection level was defined as
10 mIU/mL (23).
Data management and statistical methods
Microsoft Access data management software was used for data entry and Stata software, version 7, was used for the analyses. All data were doubly entered on computers, range and consistency checks performed, and discrepancies resolved. All analyses were based on the infants who successfully completed all stages of the trial and received all 3 doses of vaccines plus all 3 doses of vitamin A (if in the vitamin A group) and on those who received just the vaccines (if in the control group) and gave blood samples at 6 wk and 18 wk.
Baseline comparability between the treatment groups, those completing the trial, and those lost to follow-up, was assessed by a simple tabulation of means for numerical variables and percentages for categorical variables.
Antibody responses to Haemophilus influenzae B and hepatitis B were assessed against standard cut-off levels as follows: 2 levels were used for Haemophilis influenzae type b,
0.15 µg/mL indicating short-term protection and
1.0 µg/mL indicating long-term protection; and one cut-off,
10.0 mIU/mL, was used to indicate protection against hepatitis B. The percentages of infants with adequate seroprotection levels in the vitamin A and control groups were compared using simple chi-squared tests, and the results were presented as relative risks with 95% CI. The geometric mean concentrations (GMC) of antibody levels were also assessed and compared between the treatment groups. These analyses were carried out by calculating the relevant means of logarithmically transformed antibody concentrations, i.e., those that were reported below the assay cut-off given an arbitrary value equal to one-half of the assay cut-off. The means were compared at 6 and 18 wk using Student t tests and then anti-logged to give GMC. The GMC were reported with their 95% CI. Infants' antibody responses were also compared at 18 wk of age, and data were analyzed using multiple linear regression after adjustment for baseline levels. Differences were considered significant at P < 0.05.
| Results |
|---|
|
|
|---|
|
4 wk postpartum), but before the child received any vaccines or doses of vitamin A.
|
|
|
Impact of vitamin A on antibody responses.
The overall antibody response to the Hib vaccine was high and was not influenced by the simultaneous administration of vitamin A. At 18 wk of age, 98% of infants in both the vitamin A and control groups had levels of antibody higher than the minimum cut-off (
0.15 µg/mL) for short-term protection, and 94% had levels
1.0 µg/mL, indicating long-term protection (Table 2).
More infants in the vitamin A group had an increased antibody response to hepatitis B (
10 mIU/mL) than in the control group, although the increase was marginal (Table 2); the response rates in both groups were high (93.9 vs. 90.2%, P = 0.04). This finding was unchanged when the analysis was repeated with the adjustment for baseline antibody levels.
There was no evidence of any differential impact on the geometric mean concentrations of the antibody responses to the vaccines (Table 3).
| Discussion |
|---|
|
|
|---|
At 6 wk of age,
76% of infants in our study had levels of antibody for Haemophilus influenzae type b
0.15 µg/mL, which is the threshold conferring short-term protection. This indicates that a high percentage of infants had maternal antibodies (IgG), which is considerably higher than the 43.7% reported by Hussey et al. (24) in 6-wk–old infants of Cape Town. Our short-term protection response rate of 98% at 18 wk after 3 doses of vaccine is similar to that reported by Hussey et al. (24) in Cape Town and Win et al. (25) in Burma. Although a significantly higher proportion of infants in the vitamin A group met the long-term threshold (
1 µg/mL) at baseline, this difference is unlikely to have affected our 18-wk response rates after vaccination. The antibodies present at 6 wk of age are mainly maternal antibodies, which are not relevant for long-term protection of the infant and do not last long (24). The 18-wk response rates indicate that infants' own antibodies increased in response to the 3 doses of vaccines. These rates were high (94%) and did not differ between the vitamin A and control groups; they were similar to those found in studies carried out by Watemberg et al. (26) in Israel and Capeding et al. (27) in Philippines.
Hepatitis B virus infection is highly endemic in Ghana as demonstrated by a high rate, i.e., 15% of hepatitis B–infected blood donors following blood screening (28). At 6 wk of age, 10.8% of infants in our study had seroprotection to hepatitis B
10 mIU/mL, indicating the presence of maternal IgG immunoglobulin.
In our study, at 18 wk of age, 94% of infants supplemented with vitamin A were seroprotected to hepatitis B compared with 90% in the control group (P = 0.04). Neither group achieved the WHO recommendation, which states that, for effective immunization, seroprotection rates for hepatitis B vaccine must exceed 95% (29). However, we could not locate comparable studies that assessed seroprotection to hepatitis B 1 mo after the 3rd vaccine dose, 14 wk EPI vaccine, had been given. Our study was not designed to look at complex mechanisms that might explain the differences between groups, but, considering that vitamin A is an immune enhancer, minor changes in the immune response to the hepatitis B vaccine could have occurred.
Semba et al. (12) observed significant suppression of seroconversion rates to the measles vaccine in Indonesian infants 6 mo of age when maternal antibody was high. They hypothesized that immune enhancement by vitamin A might limit the ability of live viruses, such as the measles vaccine, to establish infection; although others have attributed the observation to the type of measles vaccine used (the Schwarz vaccine) (30). In contrast, in Guinea Bissau, immunogenicity of the measles vaccine given to 6-mo–old infants carrying the maternal antibody was enhanced after administration of high doses of vitamin A (31), a phenomenon we observed in our study with hepatitis B. The administration of vitamin A to infants at 6, 10, and 14 wk of age, at the same time as they received oral polio vaccine, which, like measles, is a live vaccine, did not interfere with the immune response to any of the 3 polioviruses and was associated with an enhanced response to poliovirus type 1 (32).
The number of mother-infant pairs that finally completed the study was 888, less than the 948 required to detect a difference in seroprotection rates from 95 to 90% between the groups. The 888 mother-infant pairs that we finally obtained were higher than the 704 required to detect a 6% difference in seroprotection. Other investigators, including Bahl et al. (32) and Aristegui et al. (33), recruited infants with sample sizes based on a 15% difference between groups. We therefore think that our estimated 5% difference gave us a sample size that was too high, and that this study could have been carried out with fewer subjects.
In our study, there was a good immune response to both vaccines. There was no impact of vitamin A supplementation on the Haemophilus influenzae type b component of the pentavalent vaccine; but, even though there was an improvement in the immune response to the hepatitis B vaccination (93.9 vs. 90.2%), the difference was small. However, given the high percentage of infants with seroprotection in the control group, it is doubtful that including vitamin A in the EPI would be justified on these grounds alone.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
2 Author disclosures: S. Newton, no conflicts of interest; S. Owusu-Agyei, no conflicts of interest; W. Ampofo, no conflicts of interest; C. Zandoh, no conflicts of interest; M. Adjuik, no conflicts of interest; G. Adjei, no conflicts of interest; S. Tchum, no conflicts of interest; S. Filteau, no conflicts of interest; and B. R. Kirkwood, no conflicts of interest. ![]()
7 Abbreviations used: DPT, diphtheria, pertussis, tetanus; EPI, Expanded Program on Immunization; GMC, geometric mean concentration; Hep B, hepatitis B; Hib, Haemophilus influenzae type b; RABA, radio antigen binding assay. ![]()
8 120 mg retinol equivalent (400,000 IU); 15 mg retinol equivalent (50,000 IU). ![]()
Manuscript received 13 December 2006. Initial review completed 8 January 2007. Revision accepted 13 February 2007.
| LITERATURE CITED |
|---|
|
|
|---|
1. Beaton GH, Martorell R, Aronson KJ. Effectiveness of vitamin A supplementation in control of young child morbidity and mortality in developing countries. State of the Art Series Nutrition Policy Discussion Paper No 13; United Nations ACC/SCN. 1993; New York.
2. Ghana Vast Study Team. Vitamin A supplementation in northern Ghana. Effects on clinic attendances, hospital admissions and child mortality. Lancet. 1993;342:7–12.[Medline]
3. Barreto ML, Santos LMP, Assis AMO, Araujo MPN, Farenzena GG, Santos PAB, Fiaccone RL. Effect of vitamin A supplementation on diarrhoea and acute lower respiratory tract infections in young children in Brazil. Lancet. 1994;344:228–31.[Medline]
4. Expanded Programme on Immunization Global Advisory Group. WHO Wkly Record. 1987;65:5–12.
5. WHO/CHD Immunization Linked Vitamin A Supplementation Study Group. Randomized trial to assess benefits and safety of vitamin A linked to immunization in early infancy. Lancet. 1998;352:1257–63.[Medline]
6. World Health Organization. The potential contribution of the expanded programme of immunization to the control of vitamin A and iodine deficiency disorders. A discussion document submitted to the EPI Global Advisory Group Meeting, Washington DC, Nov 9–13. Geneva: World Health Organization. 1987; EPI/ GAG/87/WP.17.
7. Rahman MM, Mahalanabis D, Hossain S, Wahed MA, Alvarez JO, Siber GR, Thompson C, Santosham M, Fuchs GJ. Simultaneous Vitamin A administration at routine immunization contacts enhances antibody responses to diphtheria vaccine in infants younger than six months. J Nutr. 1999;129:2192–5.
8. Kutukculer N, Akil T, Egemen A, Kurugol Z, Aksit S, Ozmen D, Turgan N, Bayindir O, Caglayan S. Adequate immune responses to tetanus toxoid and failure of vitamin A and E supplementation to enhance antibody response in healthy children. Vaccine. 2000;18:2979–84.[Medline]
9. Brown KH, Rajan MM, Chakraborty J, Aziz KMA, Phil M. Failure of a large dose of vitamin A to enhance the antibody response to tetanus toxoid in children. Am J Clin Nutr. 1980;33:212–7.
10. Kutty PM, Mohanram M, Vinodini R. Humoral immune response in vitamin A deficient children. Acta Vitaminol Enzymol. 1981;3:231–5.[Medline]
11. Bhaskaram P, Jyothi SA, Rao KV, Rao BSN. Effects of subclinical vitamin A deficiency and administration of vitamin A as a single large dose on immune function in children. Nutr Res. 1989;9:1017–25.
12. Semba RD, Munasir Z, Beeler J, Akib A, Muhilal, Audet S, Sommer A. Reduced seroconversion to measles in infants given vitamin A with measles vaccination. Lancet. 1995;345:1330–2.[Medline]
13. Cox SE, Staalsoe T, Arthur P, Bulmer JN, Tagbor H, Hviid L, Frost C, Riley EM, Kirkwood BR. Maternal vitamin A supplementation and immunity to malaria in pregnancy in Ghanaian primigravids. Trop Med Int Health. 2005;10:1286–97.[Medline]
14. Edmond KM, Zandoh C, Quigley MA, Amenga Etego S, Owusu-Agyei S, Kirkwood BR. Delayed breastfeeding initiation increases the risk of neonatal mortality. Pediatrics. 2006;117:E380–6.[Medline]
15. Sommer A, Davidson FR. Assessment and control of vitamin A deficiency. The Annecy Accords. J Nutr. 2002;132(9 Suppl):2845S–50S.
16. Phipps DC, West J, Eby R, Koster M, Madore DV, Quataert SA. An ELISA employing a Haemophilus influenzae type b oligosaccharide-human serum albumin conjugate correlates with the Radio antigen binding assay. J Immunol Methods. 1990;135:121–8.[Medline]
17. Madore DV, Anderson P, Baxter BD, Carlone GM, Edwards KM, Hamilton RG, Holder P, Kayhty H, Phipps DC, et al. Interlaboratory study evaluating quantitation of antibodies to Haemophilus influenzae type b polysaccharide by enzyme-linked immunosorbent assay. Clin Diagn Lab Immunol. 1996;3:84–8.[Medline]
18. Peltola H, Kayhty H, Virtanen M, Makela PH. Prevention of Haemophilus influenzae type b bacteremic infections with the capsular polysaccharide vaccine. N Engl J Med. 1984;310:1561–6.[Abstract]
19. BINDAZYME test kit information booklet. Available at: www.bindingsite.co.uk.
20. EQUIPAR test kit information booklet. Available at: www.equipar.it.
21. Kayhty H, Peltola H, Karanko V, Makela PH. The protective level of serum antibodies to the capsular polysaccharide of Haemophilus influenzae type b. J Infect Dis. 1983;147:1100.[Medline]
22. Kayhty H. Difficulties in establishing a serological correlate of protection after immunization with Haemophilus influenzae conjugate vaccines. Biologicals. 1994;22:397–402.[Medline]
23. Frisch-Niggemeyer W, Ambrosch F, Hoffman H. The assessment of immunity against hepatitis b after vaccination. J Biol Stand. 1986;14:255–8.[Medline]
24. Hussey G, Malan H, Hughes J, Eley B, Piollet M, Charrondiere M, Sachs E. Safety and immunogenicity of TetractHib (a vaccine combining DTP vaccine and Haemophilus influenzae type b conjugate vaccine) administered to infants at 6, 10 and 14 weeks of age. S Afr Med J. 2002;92:53–7.[Medline]
25. Win KM, Aye M, Htay-Htay H, Safary A, Bock HL. Comparison of separate and mixed administration of DTPw-HBV and Hib vaccines: immunogenicity and reactogenicity profiles. Int J Infect Dis. 1997;2:79–84.
26. Watemberg N, Dagan R, Arbelli Y, Belmaker I, Morag A, Hessel L, Fritzell B, Bajard A. Peyron L Safety and Immunogenicity of Haemophilus influenzae type b tetanus protein conjugate vaccine, mixed in the same syringe with diphtheria-tetanus-pertussis vaccine in young infants. Pediatr Infect Dis J. 1991;10:758–63.[Medline]
27. Capeding MRZ. Immunogenicity of Haemophilus influenzae type b conjugate vaccines in developing countries. JAMA SE Asia Suppl. 1994;10:156–8.
28. Martinson FE, Weigle KA, Mushahwar IK, Weber WJ, Lemon SM. Sero-epidemiological survey of hepatitis B and C infections in Ghanaian children. J Med Virol. 1996;48:278–83.[Medline]
29. World Health Organization. Expanded programme on immunization: global advisory group, part 1. WER. 1992;67:11–5.[Medline]
30. Bhaskaram P, Rao K. Enhancement in seroconversion to measles vaccine with simultaneous administration of vitamin A in 9-month-old Indian infants. Indian J Pediatr. 1997;64:503–9.[Medline]
31. Benn CS, Whittle H, Aaby P, Bale C, Michaelsen KF, Olsen J. Vitamin A and measles vaccination. Lancet. 1995;346:503–4.[Medline]
32. Bahl R, Bhandari N, Kant S, Molbak K, Oestergaard E, Bhan MK. Effect of vitamin A administered at Expanded Program on Immunization contacts on antibody response to oral polio vaccine. Eur J Clin Nutr. 2002;56:321–5.[Medline]
33. Aristegui J, Dal-Re R, Diez-Delgado J, Mares J, Cassanovas JM, Garcia-Corbeira P, De Frutos E, Van Esso D, Verdaguer J, et al. Comparison of the reactogenicity and immunogenicity of a combined diphtheria, tetanus, acellular pertussis, hepatitis B, inactivated polio (DTPa-HBV-IPV) vaccine, mixed with the Haemophilus influenzae type b (Hib) conjugate vaccine administered as a single injection with the DTPa-IPV/Hib and hepatitis B vaccines administered in two simultaneous injections to infants at 2, 4 and 6 months of age. Vaccine. 2003;21:3593–600.[Medline]
This article has been cited by other articles:
![]() |
M. Savy, K. Edmond, P. E. M. Fine, A. Hall, B. J. Hennig, S. E. Moore, K. Mulholland, U. Schaible, and A. M. Prentice Landscape Analysis of Interactions between Nutrition and Vaccine Responses in Children J. Nutr., November 1, 2009; 139(11): 2154S - 2218S. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Gogia and H. S. Sachdev Neonatal vitamin A supplementation for prevention of mortality and morbidity in infancy: systematic review of randomised controlled trials BMJ, March 27, 2009; 338(mar27_1): b919 - b919. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. S. Benn, C. Martins, A. Rodrigues, H. Ravn, A. B. Fisker, D. Christoffersen, and P. Aaby The effect of vitamin A supplementation administered with missing vaccines during national immunization days in Guinea-Bissau Int. J. Epidemiol., February 1, 2009; 38(1): 304 - 311. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||