![]() |
|
|
,2






* Laboratory of Biosystems and Cancer, Center Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, MD;
Cancer Prevention Fellowship Program, Division Cancer Prevention, National Cancer Institute, National Institutes of Health, Bethesda MD; ** Department of Social and Preventive Medicine, University at Buffalo, Buffalo, NY;
Department of Statistics, Texas A & M University, College Station, TX; 
Westat, Incorporated, Rockville, MD; 
Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Bethesda, MD; and # Applied Research Program, Division of Cancer Control and Population Sciences, National Cancer Institute, National Institutes of Health, Bethesda, MD
2 To whom correspondence should be addressed. E-mail: cantwelm{at}mail.nih.gov.
| ABSTRACT |
|---|
|
|
|---|
-tocopherol, folic acid, and calcium intake were significantly lower after the debriefing (P < 0.05). The limits of agreement between the food diaries before and after the debriefing were especially large for total fat intake, which could be under- or overestimated by
15 g/d. The debriefing call improved attenuation coefficients associated with measurement error for vitamin C, folic acid, iron,
tocopherol, vitamin A, and calcium estimates. A hypothetical relative risk (RR) = 2.0 could be attenuated to 1.16 for folic acid intake assessed without a debriefing but to only 1.61 with a debriefing. Depending on the nutrients of interest, the inclusion of a debriefing can reduce the potential attenuation of RR in studies evaluating diet disease associations.
KEY WORDS: food diaries dietary assessment attenuation
Epidemiologic studies that have examined dietary intake and disease outcome have been hampered by the substantial measurement error associated with the use of FFQ (1,2). Recent biomarker studies have cast doubt on whether the FFQ has sufficient precision to allow detection of moderate but important diet-disease associations (14). In the Observing Protein and Energy Nutrition (OPEN)3 study (1), using an FFQ, 24-h recalls (24-HR), doubly labeled water, and urinary nitrogen, the authors calculated attenuation factors for absolute energy, absolute protein, and protein density. They concluded that because of severe attenuation, the FFQ could not be recommended as an instrument for evaluating relations between absolute intake of energy or protein and disease (1).
Alternatives to the FFQ must therefore be considered and these include food diaries, 24-HR, and diet history methods. Biró et al. (5) outlined the criteria that should be used to select a dietary assessment method as follows: the food or nutrient of primary interest; the need for group vs. individual data; the need for absolute vs. relative intake estimations; characteristics of the population; the time frame of interest; the level of specificity needed for describing foods; and available resources. The quality of any dietary assessment method depends on 2 types of error, i.e., measurement error or bias, and random error (6). Measurement error depends on the accuracy of the reported intake by the participant, and can be improved by limiting the amount of missing or undefined data. Volatier et al. (6), described how measurement error is related to the description of foods, to procedures used to code and aggregate single food items, and to the statistical analysis. In addition, suitable data checks must be incorporated to link food intake to nutrient composition data (7).
Day et al. (3) suggested the use of a 7-d food diary as a superior dietary assessment method for individual nutrient intake compared with an FFQ based on results of a study in 179 participants who completed 2 FFQ, two 7-d food diaries, and six 24-h urine collections analyzed for potassium, nitrogen, and sodium. The diary was more closely correlated with the biomarker measurements for all 3 nutrients than the FFQ. Further, these investigators showed that dietary fat was related to breast cancer risk using the food diary but not with the FFQ (8), suggesting that perhaps diaries should be incorporated into large studies. Food diaries with weighed portion size are considered one of the best instruments among dietary assessment methods. Nonetheless, food diaries have also raised concerns including the possibility that habitual eating patterns may be influenced or changed by the recording process. Biró et al. (5) outlined the main concerns associated with food diaries. For example, participants may forget to record items immediately after eating, increasing the likelihood of omitting foods when they later record their intake. They may also be imprecise in measuring the amounts of foods eaten, thereby increasing error. Finally, the reliability of food diaries decreases over time due to respondent fatigue because they are associated with a high degree of participation burden.
As with all dietary assessment methods, there are also several advantages to food diaries: a greater amount of detail can be recorded because the food diaries are open ended; the diary method does not rely on the respondents' memory; therefore some errors may be minimized. Portion size can be weighed or estimated using household utensils and food models.
The objectives of the current study were 2-fold: first, to assess whether estimates of macro- and micronutrient intake using two 3-d food diaries are affected by including a debriefing call to the participants from a nutritionist. Second, to estimate the attenuation coefficients for nutrient intake assessed before and after the debriefing call was administered and by extension, the potential attenuation of a hypothetical relative risk (RR) for a nutrient-disease outcome. Dietary intake assessed using six 24-HR was used as the reference method for comparison with the food diaries, in the absence of a true gold standard.
| SUBJECTS AND METHODS |
|---|
|
|
|---|
Dietary assessment. Of the 362 women eligible and recruited to participate in the WISH Diet Validation study, 283 were asked to complete 2 sets of 3-d food diaries (6 d of dietary assessment) and six 24-HR by telephone over a 1-y period. Some or all of the diaries were completed by 248 women and 225 filled out diaries for all 6 d; 18 women were later excluded because the debriefing calls were completed unsuccessfully. This analysis included the remaining 207 women who completed six 24-HR by telephone over 8 mo followed by two 3-d food diaries during the next 4 mo and 2 debriefing calls.
24-Hour recall (24-HR). The Nutrition Data System (NDS), an automated software system developed by the Nutrition Coordinating Center (NCC) at the University of Minnesota (12), was used to administer the 24-HR via telephone by trained interviewers. Interviewers initially compiled a list of all foods and beverages consumed by the participant during the specified 24-h period. Next, the interviewer probed for specific details of each food reported on the list. The NDS screens help interviewers prompt respondents for additions to foods and beverages, recipe ingredients, portion sizes, and food preparation methods. The use of food models to assess portion size was encouraged by the interviewer. Probing was essential for obtaining detailed information on consumption of fats and foods high in fat, the use of fats in preparing food and added at the table, and specification of the type of fats consumed. All six 24-HR were completed before the food diary component of the study was initiated.
Food diaries.
Each woman received a phone call to ensure that she had received a food diary by mail and to provide her with brief instructions on completing the diary. A package of food models which included measuring spoons and cups, a ruler, bowls, drinking glasses, and a ring with various sizes of circles, triangles, rectangles and squares, was mailed to each participant after she was recruited into the validation study to help estimate portion sizes. The participants were encouraged to use the food models at all times to aid in estimating portion sizes, such as using the triangle shapes (wedge) to describe slices of pizza, cake, and fish fillets; circle shapes for fruits, cookies, pancakes, muffins; and square shapes for lasagna, dessert bars, or cheese, for example. The diary was designed to allow participants to keep a list of foods and beverages consumed over the course of 3 consecutive days, and specific dates for recording were printed on the front of the diary to avoid recording during holidays. The first 3-d diary was completed in the month after the final 24-HR, and the second 3-d diary was completed
3 mo later. Several types of reminders were sent to encourage completion and return of the diaries. For example, the dates on which the diary was to be completed were printed on the label on the front of the diary booklet. An instruction phone call was provided 16 d before the first intake day of the diary. A reminder postcard to prompt the subject to mail back the diary was sent out on approximately the first intake day. If the completed diary was not returned within 14 d of the first intake day a "no receipt call" was made to remind the women to return the diaries.
Seven trained coders entered food diaries into the Nutrition Data System (NDS) using a set of rules to standardize the entry of foods with incomplete data. For example, computer prompts elicit responses that enhance completeness and specificity of items in the diary, and out of range quantities are flagged for prompt quality control. The NDS Food Database contains >16,000 food items (and >150,000 variants differing in preparation method), dietary supplements, medications, medications containing caffeine and sodium, and >6000 brand name foods. Foods reported by the respondents that were not found in the NDS Food Database were referred to the NCC for resolution. The NCC provided a key-list of food codes present in the database that would define the missing food and yield its proper nutrient content. The nutrient database also included revised USDA entries (13) and USDA consumption data. These included an expanded number of fish entries according to differences in total fat; a new default for unknown type of milk to 2% fat from whole; revised entries for 9 brand name cereals based on manufacturers' reformulations; and additional generic entries for commercial cookies based on fat, sodium, and cholesterol content. When details were not specified in a diary, the coder chose the "unknown" screen and default values used by the NCC or USDA coding guidelines were automatically entered. For example if a screen requested information on the choice of "Brewed" or "Instant" coffee; choosing "unknown" would default to the most common code used by the NCC for coffee. Default amounts were obtained from the USDA survey database, or a market check was completed. However when details were not specified for foods that varied in fat content, the coder made a note of it and chose the default for portion size or nutrient content. Additional information on portion size and fat content of these foods was collected during the debriefing call (e.g., the percentage fat content of milk used). Because NDS provided immediate nutrient calculations, printouts of nutrient intake were reviewed and exceptionally high or low intakes were verified. An electronic copy of each of the 3-d food diaries was made before a debriefing call was made and will be referred to as the undebriefed diaries.
Food diaries and the debriefing call. After the diary was coded, a reviewer compared the hard copy record reports generated by the NDS with the 3-d food diary. The reviewer was responsible for correcting coding errors in the NDS, completing missing food forms on all uncodeable foods, and preparing the hard copy report for the debriefing call. This included recording specific probes on the hard copy for the interviewer to ask the participant. A debriefing call was conducted within 8 wk of the first intake day, although some exceptions were made to extend the time period beyond this limit. The purpose of the debriefing call was to obtain more detailed information regarding fat intake, including the brand name information, type of fat, and the fat content of foods. Typical fat-related questions in a debriefing call included probing for the fat content such as the percentage of fat, regular, reduced fat, or nonfat for foods such as cheese, yogurt, cakes, or crackers; type of oil (e.g., vegetable, corn, or soybean); form of margarine used (stick, tub, or squeeze); and brand name information. Recipes were also clarified when ingredient amounts did not match the total yield reported by the respondent, when the serving size was not comparable to the recipe yield, or when there were probable missing ingredients (e.g., stir fry for which no cooking fat was reported). Additionally, the reviewer included probes to verify unusual amounts reported by the participant or to obtain more complete descriptions of uncodeable foods. Diaries are referred to as debriefed diaries after the debriefing call was made and changes were incorporated into the food diary.
Statistical analysis.
All statistical analyses were carried out in SAS® (version 8.2). Spearman rank correlation coefficients were calculated for all macro- and micronutrients calculated from the food diaries assessed before and after the debriefing call was administered. The Bland-Altman procedure (14) was implemented as follows: the mean difference in nutrient intake was calculated (undebriefed debriefed) and 95% limits of agreement for individuals were calculated as the mean difference ± 2 SD. A t test was carried out to test for significant differences in nutrient intake assessed before and after the debriefing. The level of significance was set at
= 0.05 and the P-values quoted are two-sided. Nutrient intakes were categorized into quintiles of intake and cross-classification of participants by the undebriefed and debriefed food diaries was calculated. Attenuation coefficients (
) were calculated by regressing the mean nutrient intake assessed by six 24-HR (used as the reference method) on the mean nutrient intake assessed by the 6-d food diaries before and after the debriefing call. Sensitivity analysis was carried out to test for differences in energy and fat intake before and after the debriefing call by quartiles of BMI (
21.9, 21.9124.8, 24.8129.3, >29.3 kg/m2), quartiles of age (
38, 3942, 4347, and >47 y), and for those who were debriefed within 30 d of completing the food records compared with those who were debriefed after 30 d.
| RESULTS |
|---|
|
|
|---|
|
-tocopherol, folic acid, calcium, and iron intake were all lower after the debriefing call (P < 0.05) (Table 2). In addition, as seen from the limits of agreement, there was considerable variability in dietary estimates for individual intake. For example, an individual's protein intake could be overestimated by
16 g/d and underestimated by
13 g/d. In addition, vitamin C intake estimates for an individual could be under- or overestimated by >400 mg/d. The percentage agreement (i.e., the percentage of individuals classified into the exact same quintile of intake before and after the debriefing call), ranged from 48.3% for
-tocopherol to 84.5% for insoluble fiber (Table 2).
|
|
Attenuation coefficients were calculated and the resulting attenuation of a hypothetical RR of 2.0 if food diaries were used alone (undebriefed) or in conjunction with a debriefing call (debriefed) was calculated (Table 4). Clearly, the debriefing did not alter the attenuation coefficient for most nutrients, including macronutrient intake, fiber,
-tocopherol, or ß-carotene intake. However, it dramatically improved attenuation of vitamin A, vitamin C,
-tocopherol, folic acid, calcium, and iron intake. For example, a RR = 2.0 could be attenuated to 1.16 for folic acid intake assessed without a debriefing call, and 1.61 with the inclusion of a debriefing call.
|
| DISCUSSION |
|---|
|
|
|---|
-tocopherol, folic acid, calcium and iron intake were all lower after the debriefing call (P < 0.05). The inclusion of a debriefing call also dramatically improved the attenuation coefficients for micronutrients that play an important role in modulating cancer risk. These included vitamin A, vitamin C,
-tocopherol, folic acid, calcium, and iron. A debriefing call after the completion of a set of food diaries could therefore have important implications for diet-disease associations. Food diaries offer an advantage because intake is recorded in real time. It could be argued, therefore, that alterations made as a result of the debriefing call could actually introduce error. However, the debriefing calls were made within 30 d of completing the food diaries for the most part, and our analysis indicated that there was no difference in energy or fat intake for those who were debriefed within 30 d of completing the food records compared with those who were debriefed after 30 d. Inferences regarding diet-disease associations are limited when data are collected only from case-control studies (15). Therefore, large prospective cohort studies are often utilized to assess nutrition-cancer associations in particular. Historically FFQ were used to assess nutrient exposure in large prospective cohorts and were validated by comparison with other dietary assessment methods or biomarkers of intake (1619). Recent biomarker studies (14), however, have cast doubt on whether the FFQ has sufficient precision to allow detection of moderate but important diet-disease associations, particularly for cancer research. Day et al. (3) and Bingham et al. (2) suggested using 7-d food diaries instead of FFQ and showed that estimates of nitrogen, potassium, and sodium intake from the food diaries were more closely associated with urinary biomarkers compared with estimates from an FFQ. It is therefore important that we try to improve upon existing dietary assessment methods for use in future epidemiologic studies. It was hypothesized that the inclusion of a debriefing could improve dietary estimates using food diaries, an alternative to the FFQ. Results of this study clearly demonstrate the benefits of including a debriefing to improve dietary assessment of many micronutrients even though the debriefing was not targeting micronutrient intake. However, the inclusion of a debriefing did not alter the attenuation coefficients for macronutrient intake in the present study. Similarly, Shattuck Kolar et al. (20) showed only modest differences in nutrient intake assessed using 3-d food records before and after the records were reviewed with participants for completeness. However, it is difficult to make a direct comparison between these 2 studies because they differ in several ways. Their food diary was entirely self-administered, whereas participants in the present study received instructions on completing the diary by phone in advance. In addition, debriefing in their study was completed within 1 wk of receiving the completed food records, whereas our study completed debriefing within 8 wk. Nevertheless, the results of the study of Shattuck-Kolar et al. (20) demonstrated that a self-administered food record has potential for use in large cohort studies.
There are several caveats to the present study, however. The women who participated were volunteers and therefore likely to be highly motivated. It is probable, therefore, that they recorded their dietary intake with greater accuracy compared with those who did not participate. In addition, each woman had completed six 24-HR before completing the food diaries. It is possible that they "learned" to record their dietary intake with more accuracy as a result of completing the 24-HR. The generalizability of the results of this study may be limited because the participants were all women and predominantly white. The analysis was stratified by race and the results did not differ for black study participants (20% of total) compared with white participants. It is difficult to know, however, whether a debriefing call can improve nutrient estimates for other racial/ethnic groups and for men.
The inclusion of a debriefing call with food diaries may not be plausible for large-scale prospective cohort studies due to cost considerations. Depending on the number of food diaries used, the cost can be very high because large mailings of diaries and food models are required. In addition, participants must be trained in advance on how to describe their diets and to include information regarding food type, the amount, and the cooking methods used. Participants must be phoned in advance to remind them to begin recording their dietary intake and to return their completed food diaries on completion. Finally, it requires a team of trained people to review the completed diaries and to abstract the necessary information that was missing from the food diaries before the debriefing call. In some settings, the diary could be reviewed in a clinic setting and debriefed at that time. Because it could be ready for coding at a later time, it would be a viable option for a nested case-control study. The corresponding translation of the food diaries into nutrient intake would have to be completed only for the cases and the selected controls, greatly reducing the overall study costs. The added accuracy and precision of this dietary assessment method might justify the use of diaries in large surveys.
The results of the present study clearly demonstrate how the inclusion of a debriefing call can alter dietary intake estimates. The debriefing call dramatically altered the attenuation coefficients for many important micronutrients. A true RR of 2.0 could be attenuated to 1.39 for calcium without a debriefing call compared with an observed RR of 1.61 with a debriefing call. These attenuated RR certainly approach the limits of detection for observational epidemiologic research. If we are interested in detecting a smaller but potentially important RR of 1.5 for nutrient intake and disease, that RR could be reduced to 1.09 for folic acid intake assessed using undebriefed food diaries. However, inclusion of a debriefing would attenuate the RR only to 1.32. Investigators who choose to use food diaries should therefore consider inclusion of a debriefing especially for hypotheses that include micronutrients, which were shown in the present study to be dramatically altered after the debriefing call.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
3 Abbreviations used: 24-HR: 24 hour recalls; NCC: Nutrition Coordinating Center; NDS, Nutrition Data System; OPEN, Observing Protein and Energy Nutrition; WISH: Women's Health and Interview Survey. ![]()
Manuscript received 31 August 2005. Initial review completed 20 October 2005. Revision accepted 10 November 2005.
| LITERATURE CITED |
|---|
|
|
|---|
1. Schatzkin A, Kipnis V, Carroll RJ, Midthune D, Subar AF, Bingham S, Schoeller DA, Troiano RP, Freedman LS. A comparison of a food frequency questionnaire with a 24-hour recall for use in an epidemiological cohort study: results from the biomarker-based Observing Protein and Energy Nutrition (OPEN) study. Int J Epidemiol. 2003;32:105462.
2. Bingham SA, Gill C, Welch A, Cassidy A, Runswick SA, Oakes S, Lubin R, Thurnham DJ, Key TJ, et al. Validation of dietary assessment methods in the UK arm of EPIC. Int J Epidemiol. 1997;26:S13751.
3. Day NE, McKeown N, Wong MY, Welch A, Bingham S. Epidemiologic assessment of diet: a comparison of a 7-day diary with a food frequency questionnaire using urinary markers of nitrogen, potassium and sodium. Int J Epidemiol. 2001;30:30917.
4. Rothenberg E. Validation of the food frequency questionnaire with the 4-day record method and analysis of 24-h urinary nitrogen. Eur J Clin Nutr. 1994;48:72535.[Medline]
5. Biró G, Hulshof KFAM, Ovesen L, Amorim Cruz JA, for the EFCOSUM Group. Selection methodology to assess food intake. Eur J Clin Nutr. 2002;56:suppl 2:S2532.
6. Volatier JL, Turrini A, Welten D, for the EFCOSUM Group. Some statistical aspects of food intake assessment. Eur J Clin Nutr. 2002;56:Suppl 2:S4652.
7. Slimani N, Valsta L. Perspectives of using the EPIC-SOFT programme in the context of pan European nutritional monitoring surveys: methodological and practical implications. Eur J Clin Nutr. 2002;56:suppl 2:S6374.
8. Bingham SA, Luben R, Welch A, Wareham N, Khaw KT, Day N. Are imprecise methods obscuring a relation between fat and breast cancer? Lancet. 2003;362:21214.[Medline]
9. Brinton LA, Daling JR, Liff JM, Schoenberg JB, Malone KE, Stanford J, Coates RJ, Gammon MD, Hanson L, Hoover RN. Oral contraceptives and breast cancer risk among younger women. J Natl Cancer Inst. 1995;87:82735.
10. Potischman N, Carroll RJ, Iturria SJ, Mittl B, Curtin J, Thompson FE, Brinton LA. Comparison of the 60- and 100-item NCI-block questionnaires with validation data. Nutr Cancer. 1999;34:705.[Medline]
11. Waksberg J. Sampling methods for random digit dialing. J Am Stat Assoc. 1978;73:406.
12. Feskanich D, Sielaff BH, Chong K, Buzzard IM. Computerized collection and analysis of dietary intake information. Comput Methods Programs Biomed. 1989;30:4757.[Medline]
13. U.S. Department of Agriculture, Agricultural Research Service. USDA National Nutrient Database for Standard Reference, Release 17. Nutrient Data Laboratory Home Page, c 2004. Available from: http://www.nal.usda.gov/fnic/foodcomp
14. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:30710.[Medline]
15. Giovannucci E, Stampfer MJ, Colditz GA, Manson JE, Rosner BA, Longnecker M, Speizer FE, Willett WC. A comparison of prospective and retrospective assessments of diet in the study of breast cancer. Am J Epidemiol. 1993;137:50211.
16. Pietinen P, Hartman AM, Haapa E, Rasanen L, Haapakoski J, Palmgren J, Albanes D, Virtamo J, Huttunen JK. Reproducibility and validity of dietary assessment instruments. II. A qualitative food frequency questionnaire. Am J Epidemiol. 1988;128:66776.
17. Willett WC, Sampson L, Stampfer MJ, Rosner B, Bain C, Witschi J, Hennekens CH, Speizer FE. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol. 1985;122:5165.
18. Block G, Hartman AM, Dresser CM, Carroll MD, Gannon J, Gardner L. A data-based approach to diet questionnaire design and testing. Am J Epidemiol. 1986;124:45369.
19. Subar AF, Thompson FE, Kipnis V, Midthune D, Hurwitz P, McNutt S, McIntosh A, Rosenfeld S. Comparative validation of the Block, Willett, and National Cancer Institute food frequency questionnaires: the Eating at America's Table Study. Am J Epidemiol. 2001;154:108999.
20. Kolar AS, Patterson RE, White E, Neuhouser ML, Frank LL, Standley J, Potter JD, Kristal AR. A practical method for collecting 3-day food records in a large cohort. Epidemiology. 2005;16:57983.[Medline]
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||