|
|
|
|
1 Department of Preventive Medicine, Hanyang University, College of Medicine, Seoul, 133-791, Korea and 2 Department of Health Promotion, Education, and Behavior, University of South Carolina, Columbia, SC 29208
* To whom correspondence should be addressed. E-mail: efrongil{at}gwm.sc.edu.
| ABSTRACT |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
A common model for the experience of stress depicts that the presence of certain resources as conditioning variables modifies the relation between a stressor and poor outcomes (23,24). Given that food insecurity can be considered a stressor, social resources such as participation in food assistance programs (FAP)3 could alleviate at least part of the effect of food insecurity on poor outcomes such as overweight and depression. Prior findings on the effect of participation in FAP on overweight are inconsistent (12,25–28), however, probably due partly to study limitations.
This study examined the effect of participation in FAP on overweight and depression among elders, paying specific attention to overcoming some of the limitations of previous studies. The main hypotheses were that food insecurity causes greater weight and depression among elders, and that elders' participation in FAP modifies this effect.
| Methods |
|---|
|
|
|---|
70 and their spouses regardless of age. Both HRS and AHEAD used multistage complex sampling with 4 distinct selection stages and the intentional oversampling of blacks, Hispanics, and Florida residents. The primary stage involved probability proportionate to size selection of U.S. counties. The 2nd stage selected area segments within sampled primary stage units. The 3rd sampling stage was a systematic selection of housing units from an enumeration of the selected area segments. The 4th stage was the selection of an age-eligible person within a sampled housing unit. HRS and AHEAD were poststratified to known 1990 census household totals and, at the individual level, to the 1990 Public Use Microdata Sample file. This study used data from 4 follow-up surveys (i.e., waves) beginning with 1995–1996 (1996, 1998, 2000, and 2002 for HRS and 1995, 1998, 2000, and 2002 for AHEAD), because food insecurity was measured starting in 1995. The age-eligible study sample numbered 9481 for HRS and 6354 for AHEAD (people who were >54 y of age for HRS and >71 y of age for AHEAD in 1996 and 1995, respectively). The mean age of respondents was 60.8 ± 4.2 for HRS and 79.6 ± 5.8 for AHEAD. The prevalence of food insecurity (modified measure, see below) was 8.4% for HRS and 6.7% for AHEAD, showing higher rate for HRS and similar for AHEAD compared with 6.5% from national survey data for the years 1995–2004 (31). HRS and AHEAD estimated individual prevalence, whereas the national survey data estimated household prevalence. In the national survey data, households with elders had lower prevalence than households without elders (Table 1). Because personal identifiers were not used, this study was exempted from human subjects review.
|
25 kg/m2, they were classified into the overweight group; the others were classified into the nonoverweight group. Depression was assessed by an 8-item version of the Center for Epidemiologic Studies-Depression (CES-D) scale. It included dichotomous questions about depression, happiness, loneliness, sadness, enjoyment of life, effort to do things, restless sleep, and ability to "get going" during the past week. The total CES-D score ranged from 0 to 8. A cut-off of >4 was used to identify those with depression (33). Independent variables. Modified food insecurity questions based on the U.S. Household Food Security Survey Module (HFSSM) were used to measure food insecurity status in elders over the past 2 y: whether they always had enough money to buy the food they need and whether they had skipped meals or eaten less than they felt they should because there was not enough food in the house. A respondent was classified as food insecure if he or she reported a negative response to the 1st question or an affirmative response to the 2nd question. A single-item of the HFSSM has shown validity in discriminating energy intake differences (34). This has been especially true in elders: the mean energy intake of food-insecure elders was 58% of their recommended daily allowance. Elders' food insecurity status might be underestimated, however, because only 2 items were used (35–38).
Control variables included age, gender, ethnicity (white and nonwhite; only 2% of HRS and 1% of AHEAD respondents were Hispanic), marital status (married and living together, never married, and divorced/widowed), education (no formal education, less than high school, graduated from high school, some college, college degree, and postcollege degree), smoking status (current smoker or nonsmoker), income, physical functioning, health conditions, and social interaction. Income was defined as the sum of all income for all household members, including money earned from working, investments, and transfers. Income was positively skewed, so a log-transformed variable was used in the regression models.
Physical functioning was assessed with 6 items of Activities of Daily Living (ADL) (i.e., walking across the room, dressing, bathing, eating, getting in and out of bed, and using the toilet) and 5 items of Instrumental Activities of Daily Living (IADL) (i.e., preparing meals, shopping for groceries, making telephone calls, taking medications, and managing money). Health conditions were measured with the number of chronic diseases ever diagnosed by a physician (39). The diseases included hypertension (or high blood pressure), diabetes (or high blood sugar), cancer (or a malignant tumor, excluding minor skin cancers), heart conditions (heart attack, coronary, heart disease, angina, congestive heart failure, or other heart problems), chronic lung disease (chronic bronchitis or emphysema), stroke, and arthritis (or rheumatism). Social interaction was categorized into 2 groups. If respondents had any good friends in the neighborhood (or near the facility), or if they got together with people nearby for a chat or a social visit, they were classified in the high social interaction group. Respondents were categorized into the physical activity group if they had engaged in vigorous physical activity or exercise such as sports, heavy housework, or a job that involves physical labor
3 times a week. Participation in FAP was defined as whether a respondent received food stamps at any time in the past 2 y or home-delivered meals currently.
Data analysis. Prevalence of overweight and depression over time were estimated using sampling weights to adjust for unequal selection probabilities and differences in response rates (40,41). The HRS and AHEAD includes poststratification weights that calibrate the estimate to the demographic characteristics of the U.S. elderly population. Weights from each wave were highly correlated, so the weight variable for 1998 was used. The relations among food insecurity, participation in FAP, and outcomes were assessed by a weighted multilevel linear regression analysis using 3 different models that account for variation within an individual: 1) current, 2) lagged, and 3) difference. These models have various advantages and disadvantages.
The effect of current food insecurity (FIS) and the effect of its interaction with participation in FAP on current outcomes were examined using the current model:
![]() |
![]() |
The current model captures the effect of food insecurity on outcomes in a timely manner, but the direction of causality is questionable; the outcomes may influence contemporaneous food insecurity.
For the lagged and the difference model, 4 waves were combined to make 3 intervals of 2 successive time points, so we used observations for waves 1, 2, and 3 as explanatory variables, and waves 2, 3, and 4, respectively, as dependent variables. The lagged model assessed whether previous food insecurity was related to subsequent change of outcomes, and whether there was an interaction effect of previous food insecurity and previous participation in programs on subsequent change of outcomes.
![]() |
![]() |
The lagged model better establishes the direction of effect than the current model, and distinguishes it from reverse causality by substituting lagged (i.e., earlier) food insecurity (41). This model may not capture the effect of food insecurity accurately if the 2-y period is the wrong period of time in which to see the effect. In addition, the lagged model cannot control for unobserved variables that affect outcomes and are also correlated with food insecurity. Thus, the effect of food insecurity on outcomes could be biased by unobserved factors.
The difference model examined whether the change in food insecurity was related to the change of outcomes, and whether the effect of the change in food insecurity on the change of outcomes was modified by the change of participation in programs.
![]() |
![]() |
The difference model can eliminate the effects of unobserved factors using differences within the same person but cannot establish the direction of causality (42).
Dropout and death rates were examined to assess any potential selection bias. The dropout rate was <3% at each wave for HRS and <4% at each wave for AHEAD. Death rate was <3% in HRS and 13% in AHEAD, and there was no association between food insecurity and death in AHEAD. Because dropout and death rates were low and not related to food insecurity, sampling attrition was considered ignorable (43). All analyses were conducted in SAS software (version 8.0, SAS Institute) with P < 0.5 as a reference P-value. As noted in the equations above, interactions between FIS and FAP were modeled as product terms, with FAP representing the dichotomy of participants vs. nonparticipants.
| Results |
|---|
|
|
|---|
For AHEAD, current food-insecure elders had higher BMI than current food-secure elders by 0.19 unit of BMI (P < 0.033) (Table 2). In the lagged model, previous food-insecure elders had a greater change in BMI than previous food-secure elders by 0.16 (P < 0.1) for AHEAD. As elders became food insecure after being food secure, their BMI increased by a mean of 0.3 for AHEAD (P < 0.025). For HRS, food insecurity was not related to BMI (Table 2). When the HRS respondents were categorized into 2 groups based on BMI level (<25 kg/m2 and
25 kg/m2), those with food insecurity increased BMI for the higher BMI group (ß = 0.35, P < 0.004) in the lagged model but did not for the lower BMI group (ß = 0.06, P < 0.564).
|
For HRS, interactions between food insecurity and participation in FAP on BMI were not significant (Table 3). For AHEAD, food insecurity was positively related to BMI among nonparticipants in the Food Stamp Program for the current and lagged models, but was not related to BMI among participants.
|
|
| Discussion |
|---|
|
|
|---|
In general, food insecurity was positively related to depression in HRS and to both BMI and depression in AHEAD. Other studies of women and children showed a similar association between food insecurity and overweight (11,12,14,18). Several explanations have been suggested for the relation of food insecurity and overweight. Episodic food shortages could cause individuals to overeat when there is enough food and adapt to increased body fat. Limited economic resources might also encourage food-insecure persons to purchase cheap and high energy-dense foods that would result in weight gains (14,46–48). Because food insecurity is a stressor, food-insecure persons may cope with stress by eating uninhibitedly or excessively and thus experience higher body weight (27,49). Future research should aim to understand the experiences and behaviors of food-insecure people that result in this link between food insecurity and overweight.
The positive association of food insecurity with depression can be explained by the relation between stressors and depression. Environmental adversity, disadvantage, and stressful events, especially those associated with low socio-economic status, are known to contribute to the onset of depression symptoms (50,51). Therefore, it is plausible that being food insecure can cause depression. Other studies have also found that the stress of food deprivation caused depression (52,53). Depression is associated with disability, which is highly prevalent in elders (54–57). Food insecurity is a risk factor for disability (58), which could occur in part through depression.
Participation in FAP modified the relation between food insecurity and BMI and depression. The positive effect of previous food insecurity on subsequent change of BMI did not occur when food-insecure elders participated in the Food Stamp Program in AHEAD. Similarly, depression score decreased slightly for elders who became food insecure after being food secure among home-delivered meal participants in HRS.
Previous studies on the effect of participation in FAP on overweight reported various findings. Participation in FAP was associated with a high risk of overweight in Townsend et al. (12) and in Gibson's studies (25,28), and with a low risk of overweight in a study by Jones et al. (26). Townsend et al. (12) and Jones et al. (26) used cross-sectional data so that they could not verify the direction of causality in their findings. Gibson's studies (25,28) could not include food insecurity in the analysis model, which likely biased the estimates of the relation between participation in FAP and overweight, because food insecurity probably influences both participation in FAP and being overweight.
A positive effect of government programs on depression was also shown by Rodriguez et al. (59). They found that receipt of government entitlement benefits was associated with a long-term reduction in depression symptoms among unemployed women.
This study found plausible evidence that food insecurity is related to increased weight and depression in elders. We used 2 longitudinal data sets and accounted for possible confounding factors in the regression models. In addition, we analyzed the data with various statistical approaches for longitudinal data because each model has both strengths and limitations. This study also found some evidence that the effect of food insecurity on weight and depression was modified by participation in FAP, although the results were not consistent across models and data sets. The samples were representative of the U.S. elderly population, strengthening the generalization of the findings. Using different-aged populations in the analyses allowed us to test consistency of findings.
The use of BMI calculated by self-reported measures of height and weight could have created measurement error. Elders could have reported a weight that they maintained for most of their adult life rather than an accurate current weight. Furthermore, BMI may not accurately represent the component of body fat, as it is assumed to do in younger adults. Several factors, such as skeletal muscle mass or bone loss due to aging, the presence of disease processes, or a reduction in height due to vertebral fractures caused by osteoporosis may have influenced the accuracy of using BMI as an assessment of body fat in elders (60,61). Thus, we compared the distribution of BMI and prevalence of overweight in this study with NHANES IIII and NHANES 1999–2000 data (44,45) to confirm the accuracy of BMI. There were no important differences among these data. Using BMI in the elderly population is, however, less sensitive than in adults to assess effects of relative weight on morbidity or mortality (62).
In conclusion, food insecurity was generally related to a greater relative weight in the oldest group of elders and greater depression among both groups of elders in this study. The relation of food insecurity with BMI and depression was modified by participation in FAP in some analyses. When food-insecure elders participated in FAP, in general, food insecurity did not appear to increase weight and depression. These findings imply that food insecurity and food assistance programs can have both nutritional and non-nutritional impacts. The positive impact of participation in FAP for reducing or preventing the risk of poor outcomes resulting from food insecurity will improve elders' quality of life and save on their healthcare expenditures in addition to meeting their nutritional needs. These findings on the multiple impacts of participation in FAP support further development of these programs for elders.
| FOOTNOTES |
|---|
Manuscript received 24 February 2006. Initial review completed 11 April 2006. Revision accepted 25 January 2007.
| LITERATURE CITED |
|---|
|
|
|---|
1. Launer LJ, Harris T, Rumpel C, Madans J. Body mass index, weight change, and risk of mobility disability in middle-aged and older women. JAMA. 1994;271:1093–8.
2. Roberts RE, Kaplan GA, Shema SJ, Strawbridge WJ. Prevalence and correlates of depression in an aging cohort: the Alameda county study. J Gerontol B Psychol Sci Soc Sci. 1997;52:S252–8.[Abstract]
3. Unutzer J, Patrick D, Simon G, Grembowski D, Walker E, Rutter C, Katon W. Depressive symptoms and the cost of health services in HMO patients aged 65 and older. JAMA. 1997;277:1618–23.
4. Stevens J, Cai J, Pamuk ER, Williamson DF, Thun MJ, Wood JL. The effect of age on the association between body-mass index and mortality. N Engl J Med. 1998;338:1–7.
5. Huang B, Cornoni-Huntley J, Hays J, Huntley R, Galanos A, Blazer DG. Impact of depressive symptoms on hospitalization risk in community-dwelling older persons. J Am Geriatr Soc. 2000;48:1279–84.[Medline]
6. Luber M, Meyers B, Williams-Russo PG, Hollenberg JP, DiDomenico TN, Charlson ME, Alexopoulos GS. Depression and service utilization in elderly primary care patients. Am J Geriatr Psychiatry. 2001;9:169–76.[Medline]
7. Wilson RS, Bienias JL, Mendes de Leon CF, Evans DA, Bennett DA. Negative affect and mortality in older persons. Am J Epidemiol. 2003;158:827–35.
8. Himes CL. Obesity, disease, and functional limitation in later life. Demography. 2000;37:73–82.[Medline]
9. Geerlings SW, Beekman AT, Deeg DJ, Twisk JW, Van Tilburg W. The longitudinal effect of depression on functional limitations and disability in older adults: an eight wave-prospective community-based study. Psychol Med. 2001;31:1361–71.[Medline]
10. Beekman AT, Penninx BW, Deeg DJ, de Beurs ED, Geerlings SW, Van Tilburg W. The impact of depression on the well-being disability and use of services in older adults: a longitudinal perspective. Acta Psychiatr Scand. 2002;105:20–7.[Medline]
11. Olson CM. Nutrition and health outcomes associated with food insecurity and hunger. J Nutr. 1999;129:521S–4S.[Medline]
12. Townsend M, Peerson J, Love B, Achterberg C, Murphy S. Food insecurity is positively related to overweight in women. J Nutr. 2001;131:1738–45.
13. Alaimo K, Olson CM, Frongillo EA. Food insufficiency and American school-aged children's cognitive academic and psychosocial development. Pediatrics. 2001;108:44–53.
14. Alaimo K, Olson CM, Frongillo EA. Low family income and food insufficiency in relation to overweight in US children. Arch Pediatr Adolesc Med. 2001;155:1161–7.
15. Klesges LM, Pahor M, Shorr RI, Wan JY, Williamson JD, Guralnik JM. Financial difficulty in acquiring food among elderly disabled women: results from the Women's Health and Aging Study. Am J Public Health. 2001;91:68–75.[Abstract]
16. Siefert K, Heflin CM, Corcoran M. E Williams DR. Food insufficiency and the physical and mental health of low-income women. Women Health. 2001;32:159–77.[Medline]
17. Alaimo K, Olson CM, Frongillo EA. Family food insufficiency but not low family income is positively associated with dysthymia and suicide symptoms in adolescents. J Nutr. 2002;132:719–25.
18. Adams EJ, Grummer-Strawn L, Chavez G. Food insecurity is associated with risk of obesity in California women. J Nutr. 2003;133:1070–4.
19. Vazoris NT, Tarasuk VS. Household food insufficiency is associated with poorer health. J Nutr. 2003;133:120–6.
20. Casey P, Szeto K, Lensing S, Bogle M, Weber J. Children in food insufficient low-income families: prevalence health and nutrition status. Arch Pediatr Adolesc Med. 2001;155:508–14.
21. Bhattacharya J, Currie J, Haider S. Food insecurity or poverty? Measuring need-related dietary adequacy. Cambridge (MA): National Bureau of Economic Research; 2002.
22. Laraia BA, Siega-Riz AM, Evenson KR. Self-reported overweight and obesity are associated with concern about enough food among adults in New York and Louisiana. Prev Med. 2004;38:175–81.[Medline]
23. Ensel WM, Lin N. The life stress paradigm and psychological distress. J Health Soc Behav. 1991;32:321–41.[Medline]
24. Pearlin LI, Aneshensel C. Coping and social supports: their function and applications. In: Aiken LH, Mechanic D, editors. Applications of social science to clinical medicine and health. New Brunswick (NJ): Rutgers University Press; 1986.
25. Gibson D. Food stamp program participation is positively related to obesity in low income women. J Nutr. 2003;133:2225–31.
26. Jones SJ, Jahns L, Laraia BA, Haughton B. Lower risk of overweight in school-aged food insecure girls who participate in food assistance: results from the panel study of income dynamics child development supplement. Arch Pediatr Adolesc Med. 2003;157:780–4.
27. Frongillo EA. Understanding obesity and program participation in the context of poverty and food insecurity. J Nutr. 2003;133:2117–8.
28. Gibson D. Long-term food stamp program participation is differentially related to overweight in young girls and boys. J Nutr. 2004;134:372–9.
29. Juster FT, Suzman R. An overview of the health and retirement study. J Hum Resour. 1995;30:S7–S56.
30. Soldo BJ, Hurd MD, Rodgers WL, Wallace RB. Asset and health dynamics among the oldest old: an overview of the AHEAD study. J Gerontol B Psychol Sci Soc Sci. 1997;52:1–20.[Medline]
31. Nord M, Andrews M, Carlson S. Household food security in the United States, 2004. Economic Research Service. Economic Research Report No. (ERR11). 2005.
32. World Health Organization. Report of a WHO consultation on obesity: preventing and managing the global epidemic. Geneva: World Health Organization; 1998.
33. Steffick DE. Documentation of affective functioning measures in the Health and Retirement Study. HRS/AHEAD Documentation; 2000. Report No.: DR-005.
34. Rose D, Oliveira V. Nutrient intakes of individuals from food-insufficient households in the United States. Am J Public Health. 1997;87:1956–61.
35. Wolfe WS, Olson CM, Kendall A, Frongillo EA. Understanding food insecurity in the elderly: Conceptual framework. J Nutr Educ. 1996;28:92–100.
36. Wolfe WS, Olson CM, Kendall A, Frongillo EA. Hunger and food insecurity in the elderly: Its nature and measurement. J Aging Health. 1998;10:327–50.
37. Quandt SA, Arcury TA, McDonald J, Bell RA, Vitolins MZ. Meaning and management of food security among rural elders. J Appl Gerontol. 2001;20:356–76.
38. Wolfe WS, Frongillo EA, Valois P. Understanding the experience of food insecurity by elders suggests ways to improve its measurement. J Nutr. 2003;133:2762–9.
39. Frongillo EA, Rauschenbach BS, Roe DA, Williamson DF. Characteristics related to elderly persons not eating for 1 or more days: implications for meal programs. Am J Public Health. 1992;82:600–2.
40. Heeringa SG, Connor JH. Technical description of the health and retirement survey sample design. Institute for Social Research, University of Michigan. 1995. Available at http://hrsonline.isr.umich.edu/intro/sho_uinfo.php?hfyle=ref023&xtyp=5.
41. Heeringa SG. Description of the asset and health dynamics (AHEAD) survey sample design. Institute for Social Research, University of Michigan. 1995. Available at http://hrsonline.isr.umich.edu/intro/sho_uinfo.php?hfyle=ref025&xtyp=4.
42. Cawley J. The impact of obesity on wages. J Hum Resour. 2004;39:451–75.
43. Frongillo EA, Rowe EM. Challenges and solutions in using and analyzing longitudinal growth data. In: Johnston FE, Eveleth P, Zemel B, editors. Human growth in context. London: Smith-Gordon; 1999.
44. Brown CD, Higgins M, Donato KA, Rohde FC, Garrison R, Obarzanek E, et al. Body mass index and prevalence of hypertension and dyslipidemia. Obes Res. 2000;8:605–19.[Medline]
45. Flegal KM, Carroll MD, Ogden CL, Johnson CL. Prevalence and trends in obesity among US adults 1999–2000. JAMA. 2002;288:1723–7.
46. Dietz WH. Does hunger cause obesity? Pediatrics. 1995;95:766–7.
47. Centers for Disease Control and Prevention. Self-reported concern about food security associated with obesity–Washington 1995–1999. Morb Mortal Wkly Rep. 2003;52:840–2.[Medline]
48. Drewnowski A, Specter SE. Poverty and obesity: the role of energy density and energy costs. Am J Clin Nutr. 2004;79:6–16.
49. Laitinen J, Ek E, Sovio U. Stress-related eating and drinking behavior and body mass index and predictors of this behavior. Prev Med. 2002;34:29–39.[Medline]
50. Coyne JC. Social factors and psychopathology: Stress social support and coping processes. Annu Rev Psychol. 1991;42:401–25.[Medline]
51. Dohrenwend BP, Levav I, Shrout PE, Schwartz S, Naveh G, Link B, Skodol AE, Stueve A. Socioeconomic status and psychiatric disorders: the causation-selection issue. Science. 1992;255:946–52.
52. Williamson DE, Birmaher B, Anderson BP, al-Shabbout M, Ryan ND. Stressful life events in depressed adolescents: the role of dependent events during the depressive episode. J Am Acad Child Adolesc Psychiatry. 1995;34:591–8.[Medline]
53. Polivy J. Psychological consequences of food restriction. J Am Diet Assoc. 1996;96:589–92.[Medline]
54. Roberts RE, Kaplan GA, Shema SJ, Strawbridge WJ. Prevalence and correlates of depression in an aging cohort: the Alameda County Study. J Gerontol B Psychol Sci Soc Sci. 1997;52:S252–8.[Abstract]
55. Ormel J. Synchrony of change in depression and disability what next? Arch Gen Psychiatry. 2000;57:381–2.
56. Lenze EJ, Rogers JC, Martire LM, Mulsant BH, Rollman BL, Dew MA, Schulz R, Reynolds CF 3rd. The association of late-life depression and anxiety with physical disability. Am J Geriatr Psychiatry. 2001;9:113–35.[Medline]
57. Blazer DG. Depression in late life: review and commentary. J Gerontol A Biol Sci Med Sci. 2003;58:249–65.[Medline]
58. Lee JS, Frongillo EA. Factors associated with food insecurity among US elderly persons: Importance of functional impairments. J Gerontol B Psychol Sci Soc Sci. 2001;56:S94–9.
59. Rodriguez E, Frongillo EA, Chandra P. Do social programmes contribute to mental well-being? The long-term impact of unemployment on depression in the United States. Int J Epidemiol. 2001;30:163–70.
60. Vailas LI, Nitzke SA. Self-reported versus measured weight and height in an older adult meal program population. J Gerontol A Biol Sci Med Sci. 1998;53:M481–3.[Abstract]
61. Kuczmarski MF, Kuczmarski RJ, Najjar M. Effects of age on validity of self-reported height weight and body mass index: findings from the Third National Health and Nutrition Examination Survey 1988–1994. J Am Diet Assoc. 2001;101:28–34.[Medline]
62. Heiat A, Vaccarino V, Krumholz HM. An evidence-based assessment of federal guidelines for overweight and obesity as they apply to elderly persons. Arch Intern Med. 2001;161:1194–203.
This article has been cited by other articles:
![]() |
C. Gundersen, B. J. Lohman, J. C. Eisenmann, S. Garasky, and S. D. Stewart Child-Specific Food Insecurity and Overweight Are Not Associated in a Sample of 10- to 15-Year-Old Low-Income Youth J. Nutr., February 1, 2008; 138(2): 371 - 378. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||