Comparison of weighed food record procedures for the reference methods in two validation studies of food frequency questionnaires (2024)

. 2017 Mar 13;27(7):331–337. doi: 10.1016/j.je.2016.08.008

Yuri Ishii

a,c, Junko Ishihara

a,c,, Ribeka Takachi

b,i, Yurie Shinozawa

c, Nahomi Imaeda

d, Chiho Goto

e, Kenji Wakai

f, Toshiaki Takahashi

g, Hiroyasu Iso

h, Kazutoshi Nakamura

i, Junta Tanaka

j, Taichi Shimazu

c, Taiki Yamaji

c, Shizuka Sasazuki

c, Norie Sawada

c, Motoki Iwasaki

c, Haruo Mikami

k, Kiyonori Kuriki

l, Mariko Naito

f, Naoko Okamoto

m, Fumi Kondo

m, Satoyo Hosono

n, Naoko Miyagawa

o, Etsuko Ozaki

p, Sakurako Katsuura-Kamano

q, Keizo Ohnaka

r, Hinako Nanri

s, Noriko Tsunematsu-Nakahata

t, Takamasa Kayama

u, Ayako Kurihara

v, Shiomi Kojima

w, Hideo Tanaka

n,x, Shoichiro Tsugane

c

PMCID: PMC5498406PMID: 28302344

Abstract

Background

Although open-ended dietary assessment methods, such as weighed food records (WFRs), are generally considered to be comparable, differences between procedures may influence outcome when WFRs are conducted independently. In this paper, we assess the procedures of WFRs in two studies to describe their dietary assessment procedures and compare the subsequent outcomes.

Methods

WFRs of 12 days (3 days for four seasons) were conducted as reference methods for intake data, in accordance with the study protocol, among a subsample of participants of two large cohort studies. We compared the WFR procedures descriptively. We also compared some dietary intake variables, such as the frequency of foods and dishes and contributing foods, to determine whether there were differences in the portion size distribution and intra- and inter-individual variation in nutrient intakes caused by the difference in procedures.

Results

General procedures of the dietary records were conducted in accordance with the National Health and Nutrition Survey and were the same for both studies. Differences were seen in 1) selection of multiple days (non-consecutive days versus consecutive days); and 2) survey sheet recording method (individual versus family participation). However, the foods contributing to intake of energy and selected nutrients, the portion size distribution, and intra- and inter-individual variation in nutrient intakes were similar between the two studies.

Conclusion

Our comparison of WFR procedures in two independent studies revealed several differences. Notwithstanding these procedural differences, however, the subsequent outcomes were similar.

Keywords: Dietary assessment method, Dietary records, Standardization

Highlights

  • The procedures of weighed food records in two independent studies were compared.

  • General procedures of the dietary records were the mostly same for both studies.

  • Differences were found in the setting of survey days and the survey sheet.

  • Setting of survey days did not influence the intra- and inter-individual variation.

  • Differences in survey sheets did not influence the portion sizes.

Introduction

Pooled analysis of large-scale cohort data from various populations has the advantage of producing more robust evidence for even small effects of diet on disease than a single study can provide.1, 2, 3, 4, 5, 6 Cohort studies commonly evaluate dietary intake exposure in individual subjects using a specific food frequency questionnaire (FFQ).7, 8, 9 However, pooling dietary intake of foods and nutrients estimated using different FFQs needs to be done carefully because absolute intake levels may not be comparable between different FFQs.

The Japan Multi-Institutional Collaborative Cohort Study (J-MICC Study) and the Japan Public Health Center-based Prospective Study for the Next Generation (JPHC-NEXT Study) are large prospective cohort studies that aim to investigate diet-disease associations. Both studies have adopted FFQs that are most suited for their respective study populations. We, the two study groups, are now going to calibrate the dietary intakes estimated using the FFQs between the studies based on the validation studies using weighed food record (WFR) methods as the reference method.

Open-ended dietary assessment methods, which measure what a subject actually ate during a certain period of time, including WFRs, are considered more comparable than FFQs. However, because the WFRs of the two studies were conducted independently, it is necessary to compare procedures and some results to determine whether the estimated intake using WFR of the two studies can be combined for the integrated analysis for calibration.

In this paper, we assessed the procedures of the WFRs used in the two studies to describe the procedures of dietary assessment andcompared the subsequent outcomes. The steps of the procedures were selected based on details that were usually listed in the standard procedures of the research dietitians but were sometimes unwritten. We also described the design of the validation study of the FFQ for thetwo large cohort studies. This study may provide suggestions for the pooling of WFR data derived from two or more surveys.

Methods

Subject areas and study period in the main studies

The J-MICC study is a multicenter cohort study investigating the relation between lifestyle, genetic factors, and diseases, such as cancers. It includes community-based cohorts and medical facility-visitor cohorts (medical checkup and medical consultation). The age of subjects was 35–69 years old at baseline.10

The JPHC-NEXT study is a large-scale cohort study for local residents that aims to investigate the relation between lifestyle/living environment and diseases. Subjects are residents of the study areas (available at http://epi.ncc.go.jp/jphcnext/area/index.html) aged 40–74years at baseline.

Weighed food records

Since the two studies used different FFQs to assess the diet of their cohorts, the comparability of these FFQs needs to be evaluated using the WFR of the validation studies. This methodology is a “common method” in validation studies of questionnaire integration.

For the J-MICC study, we selected 133 people who provided informed consent from five of the main study areas in which data collection was complete as of March 15, 2014 (Aichi Cancer Center [ACC], Shizuoka, Takashima [Shiga Prefecture], Saga, and Tokushima). Of these, 128 people completed the scheduled survey period, whereas five dropped out due to illness or business or housework pressures. Participation was on an individual rather than family basis. The survey period for an individual was basically 1 year. The start of the survey ranged from October 2011 in the Saga area to May 2012 in the Shiga area. All subject replied to questionnaires at the beginning and end of the study. Dietary assessment was conducted using a WFR in accordance with the methods of the National Health and Nutrition Survey11 for a total of 12 days, consisting of 3 days separated by 1-day intervals, and including 1 weekend day, in each of the four seasons. All subjects were given a full explanation of the study, and provided (or loaned) the digital scales required to weigh foods before the study start. Subjects were asked to list all foods and drinks (excluding drinking water) consumed over a certain period of time on the survey sheet. In addition, before intake, the subjects were asked to place foods and drinks on the distributed paper mat (with a checkered pattern to illustrate serving size) and take photos. Recording was based on weight, but serving size recording was also acceptable. After completion of the survey period in each season, the subjects were asked to mail the survey sheet to the regional study director. All contents were confirmed, and additional information was collected from the subjects via telephone or e-mail. Some subjects were given a face-to-face interview at the time of the first survey. Photos were secondarily used at the time of weight estimation, at which time further information was collected. All confirmation of details, weight conversion of recorded serving sizes, food coding, and data input were overseen by trained investigators. Input was performed using an assisted input interface developed in Microsoft Excel (Microsoft Corp, Redmond, WA, USA) which was analogous to the interface of the National Health and Nutrition Survey.11 A processed food/seasoning code and dining-out/prepared food code were used only if no codes were listed in the Standard Tablesof Food Composition in Japan Fifth Revised edition (STFC5rev).12 These codes are used in the National Health and Nutrition Survey11 of the public (available at http://www0.nih.go.jp/eiken/nns/system/data.html). Foods and dishes that did not fall into the above categories were converted into foods listed in the STFC5rev12 by referencing foods or combinations containing similar nutrients. Intake calculation was done using the STFC5rev.12

For the JPHC-NEXT study,13 five of the areas participating in the main and cooperating cohort studies (Yokote [Akita Prefecture], Saku [Nagano Prefecture], Chikusei [Ibaraki Prefecture], and Murakami and Uonuma [Niigata Prefecture]) were designated as subject areas and recruitment was started. A total of 255 subjects aged 35–81 years who provided informed consent were included in the assessment. Participation on a family-unit basis was encouraged, but individual participation was acceptable. Two subjects who moved away from the study area were excluded, leaving 253 subjects who completed the study. The survey period was approximately 1 year, between November 2012 and November 2013. In addition to blood sampling, 24-hurine collection, and questionnaire responses, a diet survey was conducted using WFR in accordance with the methods of National Health and Nutrition Survey11 for a total of 12 days, consisting of 3 consecutive days, including 1 weekend day, in each of the four seasons. The subjects were asked to participate in an orientation before initiation. Manuals and instruments necessary for the survey were provided, and the weighing and entry methods were explained. The subjects were asked to list all foods and drinks consumed over a certain period of time on a survey sheet. Weight was recorded; otherwise, serving size was recorded when food size was fixed, such as with sliced bread and eggs, or when weighing was impossible, such as when dining-out or eating ready-made meals. On the day after the last day, a face-to-face interview was conducted to confirm the list and collect additional information. The subjects were not asked to take food photos, but when they voluntarily did take photos and brought them to the interview, these was used as auxiliary tools to estimate weight. When a subject was unable to visit an office, the original survey sheet was sent via mail or fax, and the confirmation interview was done via telephone. Trained investigators were in charge of face-to-face interviews, weight conversion of recorded serving sizes, food coding, and input. Weight estimation was performed during the interview using auxiliary tools for weight estimation. The software “shokuji-shirabe” (developed by the National Institute of Biomedical Innovation, Health and Nutrition, Tokyo, Japan; available at http://www0.nih.go.jp/eiken/chosa/kenkoeiyo.html) was used in accordance with the National Health and Nutrition Survey11 following approval for “Utilization Other Than for Intended Purposes”. Processed food codes and dining-out/prepared food codes not listed in the Standard Tablesof Food Composition in Japan 2010 (STFC2010)14 and the proportional distribution function for households in the software “shokuji-shirabe” were used. When foods and dishes that did not fall into the above categories were used, these were converted into foods listed in the STFC201014 on the basis of foods or combinations containing similar nutrients. Intake calculation was done using the STFC2010.14

We show the data collection sequence of the two studies described above in Table1.

Table1.

Data collection in validation studies of the J-MICC and JPHC-NEXT studies.

J-MICC
FFQ1aWFR1bWFR2bWFR3bWFR4bFFQ2aJPHC NEXT FFQa
Saga2011, SepOct2012, FebMayAugOctNov
ACC2012, JanFebMayAugNov2013, JanFeb
Tokushima2012, FebMarJuneSeptDec2013, FebMar
Shizuoka 12012, FebMarJuneSeptDec2013, FebMar
Shizuoka 22013, FebMarJuneSeptDec2014, FebMar
Takashima2012, AprMayAugNov2013, FebAprMay
JPHC-NEXT
FFQ1aJ-MICC FFQ1aWFR1bWFR2bWFR3bWFR4bFFQ2aJ-MICC FFQ2a
Yokote2012, NovNovNov, Dec2013, Feb, MarMayAugNovNov
Saku2012, DecDecDec2013, MarJuneOctDecDec
Chikusei2012, NovNovNov2013, FebMaySeptNovNov
Murakami2012, NovNovNov, Dec2013, MarJuneOctDecDec
Uonuma2012, OctNovNov2013, FebMayAugDecDec

Open in a new tab

J-MICC, The Japan Multi-Institutional Collaborative Cohort Study; JPHC-NEXT, The Japan Public Health Center-based Prospective Study for the Next Generation; FFQ, food frequency questionnaire; WFR, weighed food record.

a

FFQ1 or 2: original FFQ of the respective studies at first or second use.

b

WFR1to 4: WFRs for first to fourth use.

To facilitate standardization in the JPHC-NEXT study, staff in charge of dietary assessment in the J-MICC and JPHC-NEXT studies met prior to initiation of the JPHC-NEXT study to discuss dietary assessment standardization. The two studies were planned and performed independently, and reconciliation of some items was difficult. Nevertheless, the method of the J-MICC study was followed wherever possible. With regard to procedures for WFR in the two protocols, details of preparation, general matters, and implementation were described and compared item by item.

For the present study, the protocols of the J-MICC and JPHC-NEXT questionnaire validation studies were approved by the ethical review boards of Aichi Cancer Center, Aichi, Japan, and the National Cancer Center, Tokyo, Japan before the study was started.

Statistical analysis

As basic items, the 12-day data for WFRs collected in each study were analyzed for arithmetic mean values and standard deviation of the number of food items and dishes per person per day. In addition, the cumulative percentages of foods that contributed energy and major nutrients (carbohydrate, protein, lipid, sodium, and potassium) were calculated. For food items common to the two FFQs or major items of meats, vegetables, and seasonings, the portion size distribution of 11 items (three meats, five vegetables, and three seasonings) was investigated separately according to sex to confirm the influence of differences in survey sheet recording method (individual versusfamily participation). The relative contributions of intra-individual and inter-individual variance in nutrient intake were calculated, and intra-individual and inter-individual variance ratios and intra-individual variance ratios between the two studies were derived to confirm the influence of the difference in selection of multiple days (non-consecutive versusconsecutive days). The number of food items and dishes, cumulative percentages of food product contribution for energy and major nutrients, and the portion size distribution of 11 items were also calculated for subjects aged 35–69 years old, the specified age limit of subjects in the J-MICC study. Analysis of variance was performed using SAS software (version 9.3; SAS Institute Inc, Cary, NC, USA).

Results

Percentages of men subjects in the J-MICC and JPHC-NEXT studies were 51.6% and 42.3%, respectively. Mean (standard deviation [SD]) ages of men in the J-MICC and JPHC-NEXT studies at baseline were 52.0 (SD, 8.6) years and 56.9 (SD, 9.9) years, respectively. Mean (SD) energy intakes of men in the two studies were 2259 (SD, 357) kcal and 2297 (SD, 450) kcal, respectively. Mean (SD) ages of women were 52.3 (SD, 7.7) years and 56.0 (SD, 9.1) years, and mean (SD) energy intakes were 1777 (SD, 316) kcal and 1797 (SD, 309) kcal, respectively.

Table2 compares the procedures used in the J-MICC and JPHC-NEXT studies for weighed food records and standardization. Although the procedures used in the dietary assessments were independent, the two methods were almost completely consistent. Specifically, points in common included 1) the surveys were conducted using WFR (with serving size recording in some cases); 2) investigators were trained to improve survey standardization performance; 3) details were confirmed with subjects through face-to-face or telephone interview; 4) food models were used as auxiliary tools to estimate weight (for 11 ingredients; ingredients were similar to those in the J-MICC study); and 5) foods and supplements that did not require recording in the record sheets and the correspondence of these were the same.

Table2.

Comparison of procedures for weighed food records and standardization (J-MICC versus JPHC-NEXT).

ProcedureJ-MICC (as of March 15, 2014, limited to survey subject area)JPHC-NEXT
PreparationTraining to improve investigator performance in survey standardizationSubjects:
  • -

    Registered dieticians (researchers at universities and research institutes, graduate students, and part-timers)

  • -

    Number of investigators and skill level: 17 people: minimum number experienced with intake recording: ≥60%

  • Standardization training:

  • -

    Training of all investigators by the Central Office (except 2 people handled by local offices)

  • -

    Studying the rules of nutrition measurement using uniform manuals and materials, and weight estimation proficiency test by an e-learning control system

  • Standardization test (1–3 for all investigators)

  • Coding-related contents:

  • -

    Coding (particularly seasonings)

  • -

    Weight conversion

Subjects:
  • -

    Registered dieticians, dieticians, students (researchers at universities and research institutes, graduate students, and local part-timers)

  • -

    Number of investigators and skill level: 35 people; minimum number experienced with intake recording: ≥60%

  • Standardization training:

  • -

    Training of all investigators by the Central Office (approximately 1 day in total)

  • -

    Studying the survey procedure based on uniform manuals and materials, and practice role-play using uniform questions and answers

Retraining and standardization test (6 months later, for all investigators)
  • -

    Coding

  • -

    Weight conversion

  • -

    Hearing

GeneralSubjects35- to 69-year-old males and females: 132 people; dropouts: 5 people Individuals35- to 81-year-old males and females: 255 people; dropouts: 2 people
Individuals (proportional distribution by members of family)
Subject areas
(Number of offices)
5 study cohorts:
Aichi Cancer Center (Aichi Prefecture), Shizuoka, Takashima (Shiga Prefecture), Saga, Tokushima
1 central office:
Central Office (Aichi)
5 study cohorts:
Yokote (Akita Prefecture), Saku (Nagano Prefecture), Chikusei (Ibaraki Prefecture), Murakami and Uonuma (Niigata Prefecture)
3 competent offices
Central Office (Yokote and Saku), Niigata Office (Murakami and Uonuma), Chikusei Office
Method of recording the intake and confirming data3 alternating days (every other day, including 1 weekend day)×4 seasons
Details confirmed by phone or e-mail so that the subjects can take notes (in some cases, at interview on the first occasion
3 consecutive days (including 1 weekend day)×4 seasons
Details confirmed by face-to-face interview the day after the last day of intake recording (or in some cases, by phone after mail or faxing of the original sheet)
Process and division of rolesInterview, weight conversion, input, and collation: Investigators or local offices
Data cleaning: Central Office
Interview and weight conversion: Investigators
Input and collation: Local offices
Data cleaning: Central Office
Survey sheetSurvey sheet per person
1 recording form per meal (breakfast, lunch, dinner, others)
Conforms to National Nutrition Survey (proportional distribution by member of family)
1 recording form per meal (breakfast, lunch, dinner, snack)
RecordingAuxiliary tools for weight estimationPortion size recording (in some cases, serving size recording)
  • (1)

    Photo

  • (2)

    Food model: 11 ingredients*

  • (3)

    Containers used as standard tableware

Portion size recording (in some cases, serving size recording)
  • (1)

    Food model: 11 ingredients*

  • (2)

    Booklet showing real-scale foods and dishes

  • (3)

    Cards showing real-scale dishes

  • (4)

    Used containers as standard tableware

*Ingredients of food modelRice (140g, 220g, 250g), sliced bread, carrot, spinach (boiled), horse mackerel (cut open and dried), flatfish (fillet), mackerel (fillet), sliced pork (leg), chicken (leg without skin)
Confirmation manual (items to be confirmed at interview)(1) Weight (serving size) (2) proportion (proportional distribution by member of family) or weight (total and individual) (3) with or without skin, disposal (4) raw, dried, or cooked (at measurement) (5) kinds and parts (6) omitted seasonings (cooking oil, etc.) (7) leftovers (broth, stock, noodle soup, etc.) (8) any incomplete entry
Targets for interview portionSubjects of the survey, in principle (in some cases, persons in charge of cooking)Subjects of the survey, in principle (substituted by person in charge of cooking in cases of subject absence)
Items not to be recorded, exceptions, etc.Supplements: not recorded
Enriched foods and specified health foods: Substituted with common foods
Water content: Broth, stock, noodle soup, and water for dilution to be recorded, drinking water not to be recorded
Supplements: not recorded
Enriched food and specified health foods: substituted with common foods
Water content: recorded
CodingConforms to National Health and Nutrition Survey (using dining-out and prepared food database, processed food database, and guides)
Cases of difficult coding to be shared among all regions (using web message boards and Google Drive)
InputAssisted input interface using MS ExcelConforms to National Health and Nutrition Survey (using the proportional distribution by member of family function of “shokuji-shirabe”)
Data cleaningData accumulated in the input error search database, error extraction, and data cleaning
Intake calculationStandard Tableof Food Composition in Japan, Fifth Revised editionStandard Tableof Food Composition in Japan 2010

Open in a new tab

J-MICC, The Japan Multi-Institutional Collaborative Cohort Study; JPHC-NEXT, The Japan Public Health Center-based Prospective Study for the Next Generation.

In contrast, several differences were identified, including 1) setting of the survey dates; 2) survey sheet recording method (individual versusfamily participation); and 3) method of determining fluid intake. With regard to 1), the J-MICC study used recording on 3 non-consecutive days, with a 1-day period between each recording day, whereas the JPHC-NEXT study used recording on 3 consecutive days (both including 1 weekend day). Regarding 2), the J-MICC study basically followed the individual subject, whereas the JPHC-NEXT study also allowed the recording of subjects as family units (e.g., a couple). In this method, subjects listed family intake in the survey sheet, and individual intakes were determined using proportional distributions reported by the subject. Finally, regarding 3), the J-MICC study recorded broth, stock, noodle soup, and water used for dilution, but not drinking water, whereas the JPHC-NEXT study also recorded drinking water. Accordingly, we excluded data for drinking water from the JPHC-NEXT study to ensure the use of common data for intake calculation.

From the 12-day WFR data, the number of food items and dishes per person per day were calculated. The number of food items in the J-MICC and JPHC-NEXT studies was 56.0 (SD, 13.1) and 58.3 (SD, 14.9), and the number of dishes was 16.6 (SD, 3.4) and 17.8 (SD, 4.4), respectively. Calculated cumulative percentages of food product contributions to energy and major nutrients (carbohydrate, protein, lipid, sodium, and potassium) are shown in eTables1–6. The top five food products contributing energy were matched in the two studies, although their order differed. Of the top five food products for other major nutrients, at least three of five matched, again in random order. In addition, the cumulative percentages of contribution to the top 30 food products for all nutrients other than potassium shown in the tables were slightly higher in the J-MICC than in the JPHC-NEXT study: 57.5% versus 54.5% for energy, 69.5% versus 66.5% for carbohydrate, 51.6% versus 50.6% for protein, 65.5% versus 60.5% for lipid, and 74.2% versus 69.3% for sodium, respectively. In contrast, this variable was higher in the JPHC-NEXT (48.0%) than in the J-MICC study (47.5%) for potassium only.

Among food items common to the two FFQs or major items, Table3 shows the portion size distribution of 11 items by sex. Comparison of medians between the J-MICC and JPHC-NEXT studies indicated percent differences of 2.8%–20.9% (men) and−10.0% to−6.5% (women) for three meat items,−29.6% to 0% (men) and−23.5% to 3.6% (women) for vegetables, and 3.8%–25.0% (men) and 7.4%–25.0% (women) for three seasoning items, respectively.

Table3.

Distribution of portion size according to food group using dietary record for 12 days.

Food groupJ-MICCJPHC-NEXT% Differencea
Frequency of appearance (times/person)25th percentile (g/time)Median (g/time)75th percentile (g/time)Inter quartile range (g/time)Frequency of appearance (times/person)25th percentile (g/time)Median (g/time)75th percentile (g/time)Inter quartile range (g/time)
Menn=66n=107
Beef514.330.56045.738.324.150.842.620.9
Pork11123052.840.81112.929.251.9392.8
Chicken meat716.83561.845518.1346546.92.8
Pumpkin221.54065.744.12254063.938.90
Carrot1751018.913.91551017120
Broccoli314.522.836.421.92152541.626.6−9.9
Cabbage911275039918.3356041.7−29.6
Japanese radish71530533882037.56545−25
Soy-sauce3923.164321.8364.33.8
Salt360.20.40.70.5370.20.30.60.525
Soybean paste115.69126.41558.61274.2
Womenn=62n=146
Beef413.728.248.534.8211.53053.441.9−6.5
Pork812.5254633.6912.727.55037.3−10
Chicken meat619305031517.532.854.637.1−9.3
Pumpkin22035.1624232541.369.744.7−17.6
Carrot155.8102014.31459.615103.6
Broccoli218.22736.418.2318.227.34425.8−1.1
Cabbage815.5305034.581833.96042−12.9
Japanese radish62030553582037.16545−23.5
Soy-sauce3323.464291.6364.412.9
Salt280.20.40.80.6320.10.30.60.525
Soybean paste105.6911.86.21458.311.36.37.4

Open in a new tab

J-MICC, The Japan Multi-Institutional Collaborative Cohort Study; JPHC-NEXT, The Japan Public Health Center-based Prospective Study for the Next Generation.

When calculated within the limits of definition age of the J-MICC study, the results were similar (data not shown).

a

% Difference: (J-MICC median−JPHC-NEXT median)/J-MICC median*100.

When limited to subjects aged 35–69 years, the specified age of subjects in the J-MICC study, the number of food items and dishes, cumulative percentages of food product contribution for energy and major nutrients, and the portion size distribution of 11 items were all closely similar (data not shown).

The relative contributions of intra-individual and inter-individual variance in nutrient intake were calculated, and intra-individual and inter-individual variance ratios were determined. The intra-individual variance ratios between the two studies were also determined (Table4). Percentage contributions of intra-individual variance in the J-MICC and JPHC-NEXT studies ranged from 41.2% and 43.5% (for energy) to 92.7% and 92.0% (for retinol activity equivalents), respectively. A greater contribution of intra-individual variance compared with inter-individual variance was shown for more than 18 of 23 calculated items in both studies. The highest intra-individual and inter-individual variance ratio was seen for retinol activity equivalents (12.75 and 11.47) and the lowest for energy (0.70 and 0.77) in both studies. Energy and major nutrient ratios were 0.70–2.26 and 0.77–1.86, and micronutrient ratios were 0.80–12.75 and 0.81–11.47, respectively. The intra-individual variance ratios for almost all nutrients were near 1.

Table4.

Relative contributions of intra- and inter-individual variance in dietary nutrient intake: comparison between the J-MICC and JPHC-NEXT studies.

J-MICCJPHC-NEXTA/C
Percentage contributions of variance componentsPercentage contributions of variance components
Intra-individual (A)Inter-individual (B)A/BIntra-individual (C)Inter-individual (D)C/D
Energy41.258.80.7043.556.50.770.95
Protein54.745.31.2154.345.71.191.01
Lipid69.330.72.2665.035.01.861.07
Carbohydrate41.458.60.7147.652.40.910.87
Sodium63.736.31.7559.340.71.461.07
Potassium44.455.60.8044.955.10.810.99
Calcium59.340.71.4653.746.31.161.10
Iron57.842.21.3755.144.91.231.05
Beta-carotene equivalents73.126.92.7176.823.23.310.95
Retinol activity equivalents92.77.312.7592.08.011.471.01
Vitamin D87.412.66.9385.015.05.671.03
α-Tocopherols76.623.43.2764.635.41.831.19
Vitamin B170.329.72.3768.831.22.211.02
Vitamin B262.637.41.6762.737.31.681.00
Folate60.639.41.5454.545.51.201.11
Ascorbic acid55.944.11.2751.648.41.061.08
Saturated fatty acid71.528.52.5166.733.32.011.07
Monounsaturated fatty acid71.428.62.5070.829.22.421.01
Polyunsaturated fatty acid72.227.82.6070.429.62.381.03
Cholesterol78.921.13.7474.026.02.851.07
Soluble dietary fiber59.640.41.4752.647.41.111.13
Insoluble dietary fiber49.250.80.9751.448.61.060.96
Total dietary fiber47.452.60.9048.451.60.940.98

Open in a new tab

J-MICC, The Japan Multi-Institutional Collaborative Cohort Study; JPHC-NEXT, The Japan Public Health Center-based Prospective Study for the Next Generation.

Discussion

In this comparison of procedures for WFR, including standardization, under the differing J-MICC and JPHC-NEXT studies, we found that, although the two procedures differed in certain minor respects, they were almost identical. Results suggested that these differences had relatively little impact on study results.

One important factor in improving the quality of WFRs is improving the quality of investigators. Investigators in both studies were trained to a technical level essential for survey standardization. In particular, we emphasize the need to improve methods of estimating weight from serving size and coding. In addition, all investigators were provided repeated training to ensure data quality during the survey.

Differences in WFR procedures included the following. First, survey dates differed with regard to consecutive versus non-consecutive days. Murakami etal.15 suggested that two or more non-consecutive days, including a weekend day, would be appropriate for determining personal habitual intake. This was because when the survey is conducted on consecutive days, dish contents become similar to those of the previous day due to the consumption of leftovers from the previous day or foodstuff recycling. In this way a difference in survey dates (consecutive or non-consecutive) might also influence intra-individual variation (day-to-day variance). Preceding studies16, 17, 18 reported intra-class correlation coefficients and absolute differences but did not directly investigate intra-individual and inter-individual variance. Furthermore, domestic studies of the relative contribution of intra-individual and inter-individual variance indicated that both consecutive day19, 20, 21 and non-consecutive-day surveys22, 23 tended to show that intra-individual variation made a relatively greater contribution for many calculated items than inter-individual variation. Further, intra-individual variation was associated with a mostly lower variation among major nutrients and higher variation among micronutrients. These previous findings are similar to those of our present study. We therefore suggest that the setting of survey dates on either consecutive or non-consecutive days did not significantly influence the results.

We also saw differences between the WFR of individual units and family units (proportional distribution by member of family). Iwaoka etal.24 reported that records using proportional distribution by a family member tended to systematically underestimate results compared to those using individual records. Given that their subjects were students of nutritionist training colleges and their mothers, it is unclear whether these results would be reflected in the general population. On the basis of this preceding study,24 the JPHC-NEXT study also includes proportional distribution by family-unit participation, so the possibility of underestimation among women in the JPHC-NEXT study cannot be excluded. However, as the distribution of portion sizes was similar between men and woman in both studies, we consider that the influence of assessment using individual or per-family recording has no major influence on the evaluation of WFR.

In strict terms, the results of this study have the weakness of not differentiating whether the results were caused by the differences in methods or merely by the difference in study populations. To differentiate, comparison of results for the same person in the same period would be needed, but maintaining the independence of the results of two methods would then become impossible. We therefore compared the outcomes caused by these differences by checking portion sizes (survey sheet recording method) and by assessing intra- and inter-individual variation in nutrient intake (setting of survey days), on the basis that the difference in procedures would influence these items.

Conclusions

Through comparison of the procedures of WFRs planned and conducted separately in two independent studies, we found a few differences, such as in the setting of survey days and the survey sheet recording method. We then compared the effect on subsequent outcomes of these differences by checking portion sizes (survey sheet recording method) and intra- and inter-individual variation in nutrient intake (setting of survey days). We found that subsequent outcomes were similar, regardless of these differences in procedure.

Conflicts of interest

None declared.

Acknowledgements

We thank all members of the validation study group for the J-MICC and the JPHC-NEXT protocol. The validation study group for the JPHC-NEXT protocol is as follows: Shoichiro Tsugane, Shizuka Sasazuki, Motoki Iwasaki, Norie Sawada, Taiki Yamaji, Taichi Shimazu, Charvat Hadrian, Manami Inoue, Ai Noda, Azusa Hara, Izumi Mishiro, Yuri Ishii, Yurie Shinozawa, Yuko Kato, Jun Umezawa, Yingyan Gong (Epidemiology and Prevention Group, Research Center for Cancer Prevention and Screening, National Cancer Center), Junko Ishihara (Department of Nutrition Science, Sagami Women's University), Ribeka Takachi (Department of Food Science and Nutrition, Faculty of Human Life and Environment, Nara Women's University), Kazutoshi Nakamura (Department of Community Preventive Medicine, Niigata University Graduate School of Medical and Dental Sciences), Junta Tanaka (Department of Health Promotion Medicine, Niigata University Graduate School of Medical and Dental Sciences), Hiroyasu Iso (Public Health, Department of Social and Environmental Medicine, Graduate School of Medicine, Osaka University), Toshiaki Takahashi (Department of Cardiology, Hiraka General Hospital), Yokote Public Health Center, Saku Public Health Center, Chikusei City, Chikusei Public Health Center, Yamagata University. This research was supported by the Funds for Integrated Promotion of Social System Reform and Research and Development; and the National Cancer Center Research and Development Fund; and Grants-in-Aid for Scientific Research on Priority Areas (No. 17015018), Innovative Areas (No. 221S0001), and (C) (No. 24501007) from the Japanese Ministry of Education, Culture, Sports, Science, and Technology.

Footnotes

Peer review under responsibility of the Japan Epidemiological Association

Appendix A

Supplementary data related to this article can be found at http://dx.doi.org/10.1016/j.je.2016.08.008.

Appendix A. Supplementary data

The following is the supplementary data related to this article:

eTable1. Cumulative % contribution of the top 30 foods for energy assessed using dietary record for 12 days.

eTable2. Cumulative % contribution of the top 30 foods for carbohydrate assessed using dietary record for 12 days.

eTable3. Cumulative % contribution of the top 30 foods for protein assessed using dietary record for 12 days.

eTable4. Cumulative % contribution of the top 30 foods for lipid assessed using dietary record for 12 days.

eTable5. Cumulative % contribution of the top 30 foods for sodium assessed using dietary record for 12 days.

eTable6. Cumulative % contribution of the top 30 foods for potassium assessed using dietary record for 12 days.

mmc1.pdf (280.7KB, pdf)

References

  • 1.Shimazu T., Wakai K., Tamakoshi A. Association of vegetable and fruit intake with gastric cancer risk among Japanese: a pooled analysis of four cohort studies. Ann Oncol. 2014;25:1228–1233. doi: 10.1093/annonc/mdu115. [DOI] [PubMed] [Google Scholar]
  • 2.Genkinger J.M., Wang M., Li R. Dairy products and pancreatic cancer risk: a pooled analysis of 14 cohort studies. Ann Oncol. 2014;25:1106–1115. doi: 10.1093/annonc/mdu019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Lee J.E., McLerran D.F., Rolland B. Meat intake and cause-specific mortality: a pooled analysis of Asian prospective cohort studies. Am J Clin Nutr. 2013;98:1032–1041. doi: 10.3945/ajcn.113.062638. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Koushik A., Spiegelman D., Albanes D. Intake of fruits and vegetables and risk of pancreatic cancer in a pooled analysis of 14 cohort studies. Am J Epidemiol. 2012;176:373–386. doi: 10.1093/aje/kws027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Wang H., O'Reilly E.J., Weisskopf M.G. Vitamin E intake and risk of amyotrophic lateral sclerosis: a pooled analysis of data from 5 prospective cohort studies. Am J Epidemiol. 2011;173:595–602. doi: 10.1093/aje/kwq416. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kim D.H., Smith-Warner S.A., Spiegelman D. Pooled analyses of 13 prospective cohort studies on folate intake and colon cancer. Cancer Causes Control. 2010;21:1919–1930. doi: 10.1007/s10552-010-9620-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Sawada N., Iwasaki M., Yamaji T. Fiber intake and risk of subsequent prostate cancer in Japanese men. Am J Clin Nutr. 2015;101:118–125. doi: 10.3945/ajcn.114.089581. [DOI] [PubMed] [Google Scholar]
  • 8.Praagman J., Dalmeijer G.W., van der Schouw Y.T. The relationship between fermented food intake and mortality risk in the European Prospective Investigation into Cancer and Nutrition-Netherlands cohort. Br J Nutr. 2015;113:498–506. doi: 10.1017/S0007114514003766. [DOI] [PubMed] [Google Scholar]
  • 9.Hosono S., Matsuo K., Kajiyama H. Association between dietary calcium and vitamin D intake and cervical carcinogenesis among Japanese women. Eur J Clin Nutr. 2010;64:400–409. doi: 10.1038/ejcn.2010.28. [DOI] [PubMed] [Google Scholar]
  • 10.Hamajima N. The Japan Multi-Institutional Collaborative Cohort Study (J-MICC Study) to detect gene-environment interactions for cancer. Asian Pac J Cancer Prev. 2007;8:317–323. [PubMed] [Google Scholar]
  • 11.The National Health and Nutrition survey [homepage on the Internet]. Tokyo [updated 2015 Mar 26; cited 2015 Sep 20]. Available from: http://www0.nih.go.jp/eiken/info/kokucho.html.
  • 12.Report of the Subdivision on Resources the Council for Science and Technology Ministry of Education C, Sports, Science and Technology, JAPAN . 2000. Standard tables of food composition in Japan fifth revise. Official Gazette Cooperation of Japan. [Google Scholar]
  • 13.Yokoyama Y., Takachi R., Ishihara J. Validity of short and long self-administered food frequency questionnaires in ranking dietary intake in middle-aged and elderly Japanese in the Japan Public Health Center-Based Prospective Study for the Next Generation (JPHC-NEXT) protocol area. J Epidemiol. 2016;26:420–432. doi: 10.2188/jea.JE20150064. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Report of the Subdivision on Resources the Council for Science and Technology Ministry of Education C, Sports, Science and Technology, JAPAN . 2010. Standard tables of food composition in Japan 2010. Official Gazette Cooperation of Japan. [Google Scholar]
  • 15.Murakami Y., Oshikata R., Miyamoto N. Validity of 1-, 2-, 3-, and 4-day dietary records in comparison with 7-day weighed dietary records. Health Eval Promot. 2010;37:405–413. (in Japanese) [Google Scholar]
  • 16.Larkin F.A., Metzner H.L., Guire K.E. Comparison of three consecutive-day and three random-day records of dietary intake. JAm Diet Assoc. 1991;91:1538–1542. [PubMed] [Google Scholar]
  • 17.Hartman A.M., Brown C.C., Palmgren J. Variability in nutrient and food intakes among older middle-aged men. Implications for design of epidemiologic and validation studies using food recording. Am J Epidemiol. 1990;132:999–1012. doi: 10.1093/oxfordjournals.aje.a115743. [DOI] [PubMed] [Google Scholar]
  • 18.Morgan K.J., Johnson S.R., Goungetas B. Variability of food intakes. An analysis of a 12-day data series using persistence measures. Am J Epidemiol. 1987;126:326–335. doi: 10.1093/aje/126.2.326. [DOI] [PubMed] [Google Scholar]
  • 19.Tokudome Y., Imaeda N., Nagaya T. Daily, weekly, seasonal, within- and between-individual variation in nutrient intake according to four season consecutive 7 day weighed diet records in Japanese female dietitians. JEpidemiol. 2002;12:85–92. doi: 10.2188/jea.12.85. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Ogawa K., Tsubono Y., Nishino Y. Inter- and intra-individual variation of food and nutrient consumption in a rural Japanese population. Eur J Clin Nutr. 1999;53:781–785. doi: 10.1038/sj.ejcn.1600845. [DOI] [PubMed] [Google Scholar]
  • 21.Tsubono Y., Fahey M.T., Takahashi T. Interpopulation and intrapopulation variability of nutrient intake in five regions of Japan. Eur J Clin Nutr. 1998;52:176–179. doi: 10.1038/sj.ejcn.1600531. [DOI] [PubMed] [Google Scholar]
  • 22.Fukumoto A., Asakura K., Murakami K. Within- and between-individual variation in energy and nutrient intake in Japanese adults: effect of age and sex differences on group size and number of records required for adequate dietary assessment. JEpidemiol. 2013;23:178–186. doi: 10.2188/jea.JE20120106. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Egami I., Wakai K., Kaitoh K. [Intra- and inter-individual variations in diets of the middle-aged and the elderly] Nihon Koshu Eisei Zasshi. 1999;46:828–837. (in Japanese) [PubMed] [Google Scholar]
  • 24.Iwaoka F., Yoshiike N., Date C., Shimada T., Tanaka H. Avalidation study on a method to estimate nutrient intake by family members through a household-based food-weighing survey. JNutr Sci Vitaminol (Tokyo) 2001;47:222–227. doi: 10.3177/jnsv.47.222. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

mmc1.pdf (280.7KB, pdf)

Comparison of weighed food record procedures for the reference methods in two validation studies of food frequency questionnaires (2024)
Top Articles
Latest Posts
Recommended Articles
Article information

Author: Prof. An Powlowski

Last Updated:

Views: 6131

Rating: 4.3 / 5 (44 voted)

Reviews: 83% of readers found this page helpful

Author information

Name: Prof. An Powlowski

Birthday: 1992-09-29

Address: Apt. 994 8891 Orval Hill, Brittnyburgh, AZ 41023-0398

Phone: +26417467956738

Job: District Marketing Strategist

Hobby: Embroidery, Bodybuilding, Motor sports, Amateur radio, Wood carving, Whittling, Air sports

Introduction: My name is Prof. An Powlowski, I am a charming, helpful, attractive, good, graceful, thoughtful, vast person who loves writing and wants to share my knowledge and understanding with you.