![]() |
|
|

* Department of Nutritional Sciences, Faculty of Medicine, University of Toronto, Toronto, Ontario M5S 3E2 and
Institute for Work & Health, Toronto, Ontario M4W 1E6, Canada
The purpose of this paper is to examine key issues in the interpretation of nutritional epidemiologic study results when the focus is on major chronic degenerative diseases of multifactorial etiology. The estimation of disease risk associated with a particular dietary factor is influenced by the presence of other risk factors within the study population, complicating the interpretation of relative risk and odds ratio estimates in this context. Identifying the precise role(s) that dietary factors play in the onset or progression of chronic diseases is further complicated by the intercorrelation of dietary components and by the correlation of dietary patterns with other behavioral and environmental factors which may also impart or exacerbate risk of disease. Issues of study design and measurement make it difficult to identify relationships in nutritional epidemiology, but also thwart the rejection of hypotheses regarding diet-disease relationships when studies fail to yield significant associations. In drawing causal inferences from epidemiologic findings, it is important to examine evidence from a variety of sources and to look for congruence between epidemiologic, clinical and laboratory research findings.
KEY WORDS: epidemiology · disease · humansAs our attention is increasingly focused on the role of diet in chronic, degenerative diseases, epidemiology is becoming central to the field of nutritional sciences. Through epidemiology, diet-disease relationships first observed or hypothesized in the laboratory can be examined at the level of free-living populations and clinically-defined subgroups. Conversely, observed associations between dietary patterns and disease incidence rates across populations can give rise to biological hypotheses of disease causation to be more fully explored in laboratory or clinical settings. As such, nutritional epidemiology is tightly interwoven with other branches of nutrition research. Its growing prominence highlights the need for nutritional scientists to hone their abilities to critically appraise and accurately interpret epidemiological research.
The purpose of this paper is to examine key issues in the interpretation of findings from epidemiologic studies undertaken to investigate relationships between dietary factors and cardiovascular disease and cancers
the chronic diseases of greatest concern currently. A brief review of epidemiologic study designs and issues specific to their application to nutrition questions is presented. The estimation of risk associated with dietary factors is then examined in more depth, and particular issues which arise in the interpretation of epidemiological research findings in nutrition are discussed.
BASIC RESEARCH DESIGNS IN EPIDEMIOLOGY
Experimental epidemiology
In experimental epidemiology, classic experimental methods are employed to test specifically-defined hypotheses about diet-disease relationships. The primary study design in this area of nutritional epidemiology is the randomized control trial. Study samples may be clinically based or drawn from the free-living population. The control of potentially confounding variables is largely achieved through the random allocation of study subjects to treatment and control groups. After an appropriate period of follow up, indicators of health or disease status are compared between the two groups to identify the effect of treatment on disease outcome, usually expressed as a relative risk (Table 1).|
Table 1. Calculation of relative risk and odds ratio1 |
, Henderson et al. 1990
), to effect the sizable and sustained changes in the food intake behaviour of a free-living adult sample which are required for a controlled intervention study. Attempts to study the effects of more moderate changes have sometimes been compromised by unexpected behavioural changes among members of the control group, owing in part to growing public awareness of diet-disease relationships (Burr et al. 1989
, Multiple Risk Factor Intervention Trial Research Group, 1982). It is perhaps more logistically feasible to apply experimental study designs to contrast the effects of pharmacologic doses of specific nutrient or food components since placebos can be manufactured for these treatments and exposures can be well controlled. Such studies may lack generalizability and applicability to free-living populations, however, insofar as their relationships to dietary intake patterns are not readily apparent.
Descriptive and analytic epidemiology
Observational study designs are commonly employed to describe the distribution and determinants of specific dietary intake patterns and disease outcomes. These include cross-sectional surveys, ecological comparisons, cohort studies, and case-control studies. Cross-sectional surveys and ecologic studies. Perhaps the best example of cross-sectional surveys in nutritional epidemiology are the periodic national population surveys of food consumption patterns and health and nutritional status indicators conducted in the U.S. and some other countries. Cross-sectional data on food and nutrient consumption patterns are also sometimes used in ecological comparisons (also referred to as correlation or international comparison studies). In these studies, population data on dietary patterns and disease incidence or prevalence rates are compared across countries. Ecologic studies may also compare indicators of diet and health or disease within a single population over time to look for secular trends or to compare the disease incidence rates and dietary intake patterns of migrant groups with those of comparable populations in their original country and new country. Such comparisons have been particularly important in differentiating the role of genetic factors in disease etiology from environmental influences. However, ecologic comparisons have often been criticized because an observed relationship between dietary patterns and morbidity or mortality rates measured at the level of a population cannot be assumed to indicate the presence of a similar relationship at the level of the individual. For example, an ecologic correlation may be observed between per capita fat consumption and incidence of breast cancer, but it cannot be inferred that the fat intakes of the individual women with breast cancer are the same as the per capita estimate. A second common criticism of ecologic studies is that the design does not generally allow for consideration of other known individual-level risk factors (e.g., age at menarche, parity, smoking, obesity, etc). Case-control studies. Subjects are identified and recruited into a case-control study on the basis of the presence or absence of the disease or health outcome variable of interest. Ideally, the controls are randomly selected from the same study base as the cases, and identical inclusion/exclusion criteria are applied to each group. The dietary intake patterns of the cases and controls are generally assessed using survey methods. The association between the disease and a specific dietary factor is most commonly calculated as an odds ratio (Table 1). When a disease is not commmon in the population, the odds ratio approximates the relative risk.
likely before it is clinically observable. The insight to be gained from a cross-sectional comparison of dietary exposures between cases and controls is limited by the possibility that individuals' present dietary patterns are not representative of their patterns during the time period when diet was most important in the disease process. Retrospective case-control studies attempt to overcome this limitation by measuring past diet using food frequency or diet history methods. The accuracy with which individuals can recall past intake patterns is questionable, however (Friedenreich et al. 1992
). The presence of disease may also color recollections of past dietary practices by the cases in case-control studies, leading to serious biases in the study results (Coughlin 1990
). The refinement of dietary assessment methods to minimize measurement errors associated with the recall of past dietary patterns is an area of ongoing research.
). As well, such studies can be very expensive, requiring large sample sizes and lengthy follow-up to study the occurrence of disease states which are relatively rare and/or have lengthy time periods between exposure to causal factors and detection of the disease. Both conditions hold for most cancers. Although cancers are a major cause of death, the malignancy rates for most sites are relatively low, and the time lag between initiation and promotion phases and clinical diagnosis of the disease may be several years (Hebert and Miller, 1988
).
THE ESTIMATION OF RISK ASSOCIATED WITH DIETARY FACTORS
Error in the measurement of dietary factors
Individuals' dietary intakes vary markedly from one day to the next. When individuals' food intakes have been measured across several days, coefficients of variation in intake have tended to range from 20 to 25% for energy to more than 150% for Vitamin A (Beaton et al. 1979
and 1997, Freudenheim and Marshall 1988
, Freudenheim et al. 1989
, Liu 1988
, Liu et al. 1978
). Measurement errors can be divided into two general classes: random error and bias or systematic error (Beaton 1994
). Error is considered to be random if it occurs in no predictable direction; i.e., intake is as likely to be overestimated as underestimated. This kind of error may be a function of day-to-day fluctuations in intake, noise in the estimation of true intake, or errors in the analysis of food composition. Random error in the classification of subjects according to their usual intakes will bias risk estimates towards the null and thus lessen the likelihood of detecting a significant association between diet and disease.
). One potential source of bias in reported food intakes is social desirability; those affected report intake practices consistent with popular perceptions of health (Hebert et al. 1995
, Worsley et al. 1984
). A related issue is the apparent tendency of overweight individuals to systematically underreport their food intakes (Bingham et al. 1995
, Black et al. 1993
, Heitmann and Lissner 1995
). As noted earlier, bias in the reporting of dietary practices by individuals who have been diagnosed with cancer or cardiovascular disease is of particular concern in case-control studies (Coughlin 1990
). Bias in dietary data can inflate or deflate the relative risk or odds ratio, depending on the direction of the bias and how widespread the problem is within the data. The problem is compounded when the source of the bias in dietary intake data is also related to the disease outcome variable (e.g., in a situation where fat intake is underreported by overweight subjects and being overweight is thought to be a risk factor for the disease).
, Kushi 1994
). However, our understanding of the sources and nature of errors in the measurement of usual intake and the impact of these errors on statistical analyses of diet-disease associations is becoming increasingly sophisticated. Large dietary studies now often include substudies designed to obtain dietary intake estimates among a representative subsample of the population using more accurate dietary assessment methods (methods which are not logistically feasible to employ with the full sample). For example, if dietary intake is being assessed by means of single 24-hour dietary recalls (e.g., in large, cross-sectional population surveys), then multiple 24-hour recalls may be collected from a representative subsample of the study population. The substudy yields an estimate of day-to-day variation in intake (a primary source of measurement error in the survey) which can be used to statistically adjust estimates of associations derived from the main survey (e.g., Liu 1994
). The use of substudies for calibration purposes is an important development in dietary assessment methodology, but the absence of a "gold standard" for dietary assessment continues to plague the field. The effectiveness of statistical procedures to minimize error is limited by the fact that estimates of dietary intake derived from substudies also contain measurement errors (Wacholder et al. 1993
).
Insufficient variation in intake levels across the study population
The lack of heterogeneity in food consumption patterns within populations presents a major obstacle to the study of their relationships to disease. An association between specific dietary intake patterns or food components and a disease outcome will be imperceptible if insufficient variation exists in the intake practices of interest within the study population. To illustrate this point, consider an example originally offered by Rose (1985). Imagine a society in which everyone smokes heavily. Lung cancer would likely be a major cause of death in such a setting. Yet observational studies conducted within this society would be unlikely to ever identify smoking as a problem. The risk of lung cancer which is attributable to smoking would be uniform across the entire population because everyone smokes. The kinds of risk factors likely to be identified instead would be markers of individual susceptibility to the disease, given a common baseline level of risk associated with smoking. It would not be until an epidemiologist stepped outside the society of smokers and began studying lung cancer rates among groups of nonsmokers as well that she would be able to detect the role of smoking. The current controversy over the interpretation of the largely negative results from recent U.S. and Canadian studies of dietary fat and breast cancer may be another example of this phenomenon (Kushi 1994
). The absence of an observed relationship between diet and disease therefore cannot be construed as evidence of the absence of a relationship until methodologic effects have been ruled out.
THE INTERPRETATION OF EPIDEMIOLOGICAL FINDINGS
Intercorrelation of dietary factors
Intercorrelations between specific foods, nutrients, or food constituents within the diet make it difficult to isolate the effects of any one factor using epidemiologic methods. A dietary factor which appears to be important may simply be acting as a proxy for some other factor which has not been measured but which is also commonly found in the dietary patterns observed. For example, diets high in fat often have relatively low fiber contents; unless both factors are considered, it will be difficult to discern the true dietary effect. Even when several dietary factors are measured, differentiation of the effects of individual factors is complicated because the level of measurement error varies across different dietary variables (Bingham et al. 1994
, Wacholder et al. 1994
), and to differentiate the effect of total energy intake from specific macronutrient effects on disease risk (Sempos et al. 1993
). A number of analytic approaches have been proposed to control for the effect of energy while examining the effect of a specific macronutrient (Beaton et al. 1997
, Howe et al. 1986
, Pike et al. 1989
). However, comparisons of the results of these approaches suggest that they are not simply alternative approaches to analysis; they represent very different assumptions about the biological relationships being examined (Beaton et al. 1997
, Kipnis et al. 1993
, Kushi et al. 1992
).
Correlation between nutrition variables and other risk factors
Dietary patterns are often specific to population subgroups defined by variables such as smoking behaviour, familial disease history, income, region, or ethnicity
variables which may also be associated with disease incidence. If such interrelationships are ignored in studies of diet-disease relationships, they can confound the interpretation of observed associations. For example, if individuals' decisions to consume margarine are driven by their perceptions that they are at heightened risk of coronary heart disease because of a family history of the disease, then the interpretation of observed associations between trans fatty acid intake levels and coronary heart disease may be confounded by genetic factors (Willett and Ascherio 1994DRAWING CONCLUSIONS ABOUT DIET-DISEASE RELATIONSHIPS
; Susser, 1991
). To be considered causal, an association between a specific dietary factor and disease occurrence should be observed consistently across a number of population-based studies, conducted by different research groups in different settings. Conclusions cannot generally be drawn from a single study. Different study designs will have different abilities to contribute to our understanding of causality (Susser, 1991
). Even when a hypothesized association is subject to rigorous testing through randomized controlled trials, consistent findings from more than one trial are generally required to draw definitive conclusions. Only through the recent culmination of evidence from several clinical trials (Greenberg et al. 1990 and 1994, Hennekens et al. 1996
, Omenn et al. 1996
, The Alpha-Tocopherol, 1994), for example, has the hypothesis that beta carotene supplementation lowers risk of cancer and cardiovascular disease been finally dismissed (Greenberg and Sporn, 1996
).
, Smith and Shipley 1991
). In order to infer causality, the association should be biologically plausible and should be supported by experimental research into the disease process. It is also important that exposure to the risk factor clearly precedes the onset or progression of disease. In addition, the argument for causality is strengthened when the associated risk is sizable, the disease outcome is specific to the dietary factor and a biologic gradient (dose-response relationship) is observable.
, Hankin et al. 1992
, Kune et al. 1992
, McGinnis and Foege 1993
, Riboli 1992
, Willett and Ascherio 1994
). Perhaps the most widely cited of these is Doll and Peto's (1981) estimate that 35% of all cancer deaths could be attributed to diet. Most commonly, current estimates are in the form of population attributable risks (PAR), a statistic which combines information about the disease relative risk associated with the factor of interest with an estimate of the prevalence of exposure to that factor within the general population. The term "attributable" conveys the impression of a causal relationship. However, it cannot be assumed that the evidence for a causal relationship has been evaluated and a definitive conclusion reached when a PAR statistic is presented (Brooker et al. 1996
, MacMahon and Trichopoulos, 1996
). Interpretation of the PAR becomes even more complex when this statistic is applied to one risk factor for a disease of multifactorial etiology (Leviton 1995
). The PAR estimate is expressed as a percentage, giving the illusion that the risk attributable to a particular dietary practice is being appraised out of a total of 100%. However, this is not true when the disease in question is multifactorial. It has been shown that the sum of the PAR's for all the known risk factors of a single disease of multifactorial etiology can easily exceed 100% (Brooker et al. 1996
, Rothman 1976
). Thus, even if the PAR for a particular dietary pattern in relation to colon cancer is greater than 50%, diet may still not be the most important risk factor for that disease! Although PAR estimates appear to offer an easily interpretable means to appraise the public health importance of dietary patterns in relation to chronic diseases, their simplicity is seductive
particularly for non-epidemiologists unaware of the interpretational issues. More cautious interpretation and application of attributable risk estimates is warranted.
, Loomis and Wing 1990
, Pearce 1996
, Ruzek 1993
). Such developments would be important in enhancing our understanding of dietary and other risk factors in relation to major chronic diseases.
Manuscript received 12 September 1996. Initial reviews completed 28 January 1997. Revision accepted 12 June 1997.
is it specific or non-specific?
Br. Med. J.
1995;
311:986-989This article has been cited by other articles:
![]() |
S. A. McNaughton, G. C. Marks, and A. C. Green Role of Dietary Factors in the Development of Basal Cell Cancer and Squamous Cell Cancer of the Skin Cancer Epidemiol. Biomarkers Prev., July 1, 2005; 14(7): 1596 - 1607. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. S Gross, L. Li, E. S Ford, and S. Liu Increased consumption of refined carbohydrates and the epidemic of type 2 diabetes in the United States: an ecologic assessment Am. J. Clinical Nutrition, May 1, 2004; 79(5): 774 - 779. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. J Lewis and E. A Yetley Health claims and observational human data: relation between dietary fat and cancer Am. J. Clinical Nutrition, June 1, 1999; 69 (6): 1357S - 1364S. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||