Skip to main content

Carotenoids and alkylresorcinols as objective biomarkers of diet quality when assessing the validity of a web-based food record tool and a food frequency questionnaire in a middle-aged population



Recently, two web-based dietary assessment tools were developed; a 4-day food record tool (the Riksmaten method), and a food frequency questionnaire (MiniMeal-Q). The aim of this study was to use objective biomarkers to examine the ability of the two methods to capture habitual dietary intake.


In total, 200 individuals from the pilot study of the Swedish CArdioPulmonary bioImage Study (SCAPIS) participated. Plasma concentration of carotenoids were determined with high-performance liquid chromatography (HPLC) and used as biomarkers of fruit and vegetable intake. A gas chromatography mass spectrometry (GC-MS) method was used to quantify alkylresorcinol homologues, which were used as biomarkers of whole grain wheat and rye intake.


The correlations between energy-adjusted fruit and vegetable intakes and plasma carotenoid concentrations (except lycopene) were stronger amongst women than men (r = 0.46 and r = 0.20 for the Riksmaten method, and r = 0.50 and r = 0.31 for MiniMeal-Q, respectively). For whole grains, the correlations of energy-adjusted intakes and alkylresorcinols were higher using the Riksmaten method (r = 0.30 and r = 0.29 for women and men) than the MiniMeal-Q (r = 0.25 and r = 0.20, respectively). In regression analyses between plasma carotenoids (except lycopene) and reported intake of fruits and vegetables, the R2 were 21.6 % and 5.1 % for women and men by the Riksmaten method, and correspondingly, 18.0 % and 6.6 % by the MiniMeal-Q. In the final full models, adjusted for smoking and BMI, all regression models remained statistically significant. The regression analyses of plasma alkylresorcinols and reported intake of whole grains showed an R2 of 9.4 % and 9.7 % for women and men by the Riksmaten method, and correspondingly, 5.3 % and 8.4 % by the MiniMeal-Q. In the final full models, adjusted for smoking and age, all regression models remained statistically significant, except for women in MiniMeal-Q.


Both dietary assessment methods were able to capture dietary intake based on food groups with a similar precision. Agreements with objective biomarkers ranged from low to moderate, depending on sex and diet quality indicator. While the ability to capture whole grain intake was weak for both methods and sexes, the assessment of vegetable and fruit intake performed in a satisfactory manner for women in both methods.

Peer Review reports


Assessing dietary intake with methods that are both precise and applicable to a heterogeneous population is a major challenge in nutrition research [1]. In westernized countries, the habitual diet of most individuals consist of a large variety of foods, and food selection varies during the day, between the days of the week, and by season [2, 3]. Although the various dietary assessment methodologies are designed to cater for some of these characteristics of dietary habits, there is still no method that can be considered to measure the true habitual intake without considerable limitations. In addition, there is still a high dependence on self-reported dietary intake data. These data have been associated with many cognitive pitfalls, for example failure to recall true habitual intakes, a tendency to alter food choices during the registration period to make it appear more “socially desirable” and the general under-estimation of portion sizes [48].

Validating newly developed dietary assessment methods is essential to gain a thorough understanding of the quality of the collected data. The process often involves comparisons with recovery biomarkers such as the doubly labeled water technique as a marker of energy intake [8, 9], urinary nitrogen of protein intake [10] and urinary sodium and potassium [11, 12]. Although these recovery biomarkers have the advantage of covering total intake they do not capture intake of specific foods or food groups [13].

There is convincing evidence that high intakes of fruit, vegetables and whole grains are associated with a lower risk of several chronic diseases [1416]. Although the available recovery or prediction biomarkers do not capture total intake of these food groups on an absolute scale, it is possible to distinguish between high and low intakes of these food groups using concentration biomarkers. Plasma carotenoids are considered to reflect the intake of fruits and vegetables in a satisfactory manner [17, 18] and are amongst the most commonly used concentration biomarkers in dietary validation studies today. In a “western diet”, approximately 80 to 90 % of the total carotenoid intake derives from fruit and vegetable consumption of which yellow-orange fruits and vegetables and dark green leafy vegetables are particularly rich in carotenoids [17]. Alkylresorcinols (AR), found in the outer parts of wheat and rye grain kernels but not in significant amounts in the refined flour or in other commonly consumed foods, have been suggested as a candidate biomarker of wholegrain wheat and rye intake [1921]. Moreover, the ratio between the alkylresorcinol homologues C17:0/C21:0 is typically 1.0 in rye, 0.1 in common wheat, and 0.01 in durum wheat [22]. This ratio measured in plasma has been suggested as a way to differentiate a diet dominated by whole grain wheat from a diet dominated by whole grain rye. Alkylresorcinols and their metabolites have been used as biomarkers in several recent endpoint studies [2325].

Recently, two innovative dietary assessment tools for use in large-scale studies were developed; the detailed 4-day food record tool called the Riksmaten method [26], and the more rapid food frequency questionnaire called MiniMeal-Q [27, 28]. The aim of this study was to use carotenoids as biomarkers of fruit and vegetable intake and alkylresorcinols as biomarkers of whole grain wheat and rye intake, when examining and comparing the ability of the two self-reported methods to capture habitual dietary intake. The validation on energy intake has previously been carried out [29]. Both methods are web-based and the validation process involves novel biomarkers, which makes this topic of interest for anyone involved in developing and evaluating new dietary assessment methods.


Study population

The Swedish CArdioPulmonary bioImage Study (SCAPIS) is a prospective, multicenter observational study. The study design has previously been described elsewhere [30]. The pilot study was conducted in Gothenburg during 2012, and the Diet sub-study was a part of the pilot study. The SCAPIS pilot study randomly recruited women and men aged 50–64 years from different socioeconomic status (SES) areas in the Gothenburg city region, and in total 1111 individuals (50% women) carried out all examinations. The diet sub-study aimed for recruiting 100 women and 100 men among 575 eligible subjects, among those who had finished all examinations in SCAPIS pilot visit 1 and 2 and were feasible to be enrolled within five weeks from visit 1. After exclusions and drop-outs a total of 190 subjects were available for the carotenoid analyses and 185 subjects were evaluable for the alkylresorcinol analyses (Fig. 1).

Fig. 1

Flow chart of recruitment of participants to SCAPIS Pilot study and SCAPIS Diet sub-study

Study protocol

At visit 1 of the SCAPIS Pilot study, all anthropometrical examinations were undertaken and blood samples were drawn (Fig. 2). After completing all examinations at SCAPIS Pilot visit 1 and 2, participants were invited to a one-hour group meeting with a dietitian. At this visit, the MiniMeal-Q questionnaire was completed and an introduction to the web-platform of the Riksmaten method was given. Participants were instructed to record all foods and drinks consumed for four consecutive days maintaining their “normal” diet during the registration period. For the current analyses, average daily energy and nutrient intakes were calculated. The food record was scheduled to begin either on the next coming Tuesday, Wednesday or Saturday to ensure a more equal distribution among weekdays. Participants were encouraged to enter the food intake continuously via the web, but participants who did not want to do so (n = 15) could report food intake by telephone to the study dietitian. All participants were contacted by a dietitian two days after the food record had started to enhance compliance and to provide an opportunity to ask questions.

Fig. 2

Flow chart of data collection and visits in SCAPIS Pilot study and SCAPIS Diet sub-study

The Riksmaten method

The Riksmaten method is a self-administered web-based 4-day food record, developed by the National Food Agency (NFA) in Sweden [26]. The food list in the web tool consisted of 1909 different food items and mixed dishes and is linked to the Swedish food composition database (Livsmedelsdatabasen, version Riksmaten adults 2010–11). The food record was accessed with a personalized login from a webpage. All foods and drinks in the food list were linked to individual portion size estimates, which were incorporated in the web-based food record. The usual food size references consisted of six different photos illustrating the portion sizes, but for some foods up to eight options were selectable. Dietary supplements taken during the recording days, as well as questions regarding physical activity level, were reported in a separate form on the website. All energy and nutrient intakes were calculated as the average intake of unit/per day.


The web-based food frequency questionnaire MiniMeal-Q used in the study is a short form of Meal-Q [27]. The Meal-Q was developed at Institute of Medical Epidemiology and Biostatistics, Karolinska Institutet, Sweden. The questionnaire is semi-quantitative and five portion size options are included for (1) meat, chicken, fish and vegetarian substitutes (2) potatoes, rice and pasta and (3) vegetables (both raw and cooked). Other foods are calculated by standard portion sizes, and by portion sizes developed by the research group at Karolinska Institutet. The questionnaire covers a time-period of the past few months and includes follow-up questions only on food items and dishes that were consumed at least once a month. Because of its dynamic structure, it includes between 75 to 126 food items. For most questions, frequencies are reported on a nine-grade scale from “five times a day” to “one-to-three times a month”. All energy and nutrient intakes were calculated as the average intake of unit/per day. Energy and nutrient calculations were based on Swedish food composition database from NFA [31].

Food intake categories

In both methods, the food intakes are reported both as single food items and in mixed dishes. Thus, to be able to calculate the total amount of fruits and vegetables consumed, each mixed dish was split into its various ingredients. Thereafter the total intake of fruit and vegetables (fresh, frozen and canned) was calculated per day and subdivided into four different groups; (1) intake of vegetables: salad, spinach, tomatoes, green beans, green peas, peppers, corn, avocado, broccoli, cabbage, cucumber, leek, olives, aubergine, fennel, sugar pea, squash, asparagus, mushrooms, cauliflower, radish, sweet potatoes and carrots; (2) intake of fruits and berries: apple, orange, satsuma, apricot, grapes, peach, pear, pineapple, nectarine, mango, melons, papaya, banana, cherries, Sharon fruit, plums, pomegranate, rhubarb, blueberries, blackberries, lemon, kiwi, lingonberries, gooseberries, currants, raspberries, strawberries; (3) intake of juice: apple juice, orange juice, cranberry juice, grapefruit juice, lemon juice; and finally (4) intake of the sum of vegetables, fruits, berries and juice.


The plasma concentrations of six carotenoids (i.e.; lutein, zeaxanthin, β-cryptoxanthin, lycopene, α-carotene and β-carotene) were used as biomarkers of fruit and vegetable intake [17, 18]. The plasma concentrations were determined with high-performance liquid chromatography (HPLC). Since lutein and its stereo isomer zeaxanthin are almost structurally identical this analysis does not discriminate between them and the sum of the carotenoids is presented as a single value. All chemicals were from Sigma-Aldrich (St. Louis, MO, USA) and the validity of the biochemical analysis method was ensured by including a reference sample that was calibrated against an external standard (SRM 968E) from the National Institute of Standard and Technology (NIST). Briefly, the frozen samples were thawed and 150 ml was mixed with 150 ml water, 300 ml 95% ethanol with 0.1 mg/ml butylated hydroxytoluene and 400 ml n-hexane. The mixture was vortexed vigorously for 5 min before centrifugation at 14 000 rpm for 2 min. The hexane phase (300 ml) was then transferred to new tubes and evaporated under a gentle stream of nitrogen. The residue was dissolved in 50 μl mobile phase consisting of acetonitril:methanol (80:20 v/v) and the mixture was then sonicated in an Ultrasonic bath for 5 min. The samples were centrifuged for another 2 min at 14 000 rpm prior to HPLC analysis. The HPLC analysis was performed with a PU-980 Pump and a UV-975 UV/vis detector both from Jasco Inc. (Japan Spectroscopic Company, Tokyo, Japan). The column was a Grace Smart 100 × 2.1 mm, RP18, 3 μm (Grace Davison Discovery Sciences Deerfield, IL, USA). The flow rate was set to 500 μl/min and 20 μl of the sample was injected. The carotenoids were detected at a wavelength of 450 nm and the concentrations were calculated from a standard curve of carotenoids in reference samples using the software Clarity v. 2.6.5 (DataApex, Prag, Czech Republic). The intra- and inter-assay coefficients of variation were 5.1 % and 7.0 %.


The plasma concentrations of five alkylresorcinol homologues (C:17:0-C:25:0) were used as biomarkers of whole grain (i.e. wholegrain from wheat and rye) intake [20, 25]. A gas chromatography mass spectrometry (GC-MS) method was used to quantify alkylresorcinol homologues C17:0-C25:0 in 0.2 ml plasma samples as described previously [32]. Samples were analyzed in seven batches together with four reference samples included in each batch to allow estimation of analytical variability. The within-batch coefficient of variation (CV) for total alkylresorcinol was <12 % in all seven batches estimated from n = 4 quality control-samples (QC) included in each batch. The between batch CV of total alkylresorcinol was 13 %, based on results from five out of seven batches. Mean total alkylresorcinol concentration of QC-samples in two batches were higher than expected for unknown reason. Between-batch variation was adjusted for by dividing each observed alkylresorcinol concentration with a batch-specific correction factor for each alkylresorcinol homologue. The batch correction factor was defined as: Batch-correction factor = within-batch QC mean/grand QC mean (based on batch 1–5). Between-batch corrected data was used for statistical analysis.

Statistical analysis

Characteristics of the study population are presented as mean ± SD or as median (IQ range) for continuous data and as proportions of categorical data for women and men separately. The ranking ability was examined using Spearman’s correlation analyses of biomarker plasma concentrations and energy-adjusted food variables (g/MJ). The associations of plasma carotenoid concentrations were analyzed both individually (all six carotenoids) and as the sum of total plasma carotenoids with each food group accordingly. Correlation analyses of dietary intake of whole grain and alkylresorcinols were conducted for individual alkylresorcinol homologues and as sum of all five homologues.

The method of triads [33] was applied to estimate the validity coefficients (ρ) between the theoretical true intake (T) and dietary intakes estimated with the Riksmaten method (R), MiniMeal-Q (M), and biomarkers (B). Equations for calculating ρ are as follows;

$$ {\uprho}_{\mathrm{RT}} = \sqrt{\left(\left({r}_{\mathrm{RM}}\mathrm{x}\ {r}_{\mathrm{RB}}\right)/{r}_{\mathrm{MB}}\right),} $$
$$ {\uprho}_{\mathrm{MT}}=\sqrt{\left(\left({r}_{\mathrm{MR}}\mathrm{x}\;{r}_{\mathrm{MB}}\right)/{r}_{\mathrm{RB}}\right)}, $$
$$ {\uprho}_{\mathrm{BT}}=\sqrt{\left(\left({r}_{\mathrm{MB}}\mathrm{x}\;{r}_{\mathrm{RB}}\right)/{r}_{\mathrm{RM}}\right)}, $$

where r is the correlation coefficient. The 95 % confidence intervals (CI) for the estimates of the ρ were obtained using the biased corrected and accelerated percentile CI bootstrap method with 1 000 000 bootstrap samples [34]. This method involves the repeated drawing of samples, with replacements, from the population that has been measured in order to provide an empirical distribution of the three validity coefficients. The method of triads is applicable only under the assumption that none of the measured exposures have correlated random errors. Some correlations between random errors cannot be ruled out and therefore the estimated validity coefficients might be overestimated and may thus be interpreted as the upper limit of the true validity coefficients [33].

Further, multiple linear regression analysis was used to evaluate the associations between food intake data (independent variable) and plasma concentrations of biomarkers (dependent variable). Because biomarker data were non-normally distributed, all biomarker variables were log-transformed to improve normality. Variables evaluated for potential confounding effect included current smoking, age, S-cholesterol, S-triglycerides, dietary fat intake, BMI [30] and use of any dietary supplements (derived from the Riksmaten registration). Based on the % change in the beta coefficient from each potential confounder, a final model was chosen; carotenoid analyses were adjusted for smoking status and BMI, and alkylresorcinol analyses were adjusted for smoking status and age. All statistical analyses were two-sided with a significance level at α < 0.05. Statistical analyses were performed using IBM SPSS Statistics for Windows, Version 20.0. (Armonk, NY: IBM Corp.), and the bootstrap was performed in R [35].


Background characteristics of the study population including plasma concentrations of carotenoids and alkylresorcinol homologues are presented in Table 1. Mean age of the population was 57.7 years and approximately 50 % of women and 80 % of men were classified as overweight (BMI ≥ 25.0–29.9 kg/m2) or obese (BMI ≥ 30.0 kg/m2). Among women, β-carotene was the most abundant carotenoid in plasma (35 %) whereas lycopene was most abundant among men (37 %). The ratio of alkylresorcinol C17:0/C21:0 was 0.32 for women and 0.30 for men.

Table 1 Characteristics of the study population in the SCAPIS Diet sub-study

Absolute intakes of fruit, vegetables, β-carotene and whole grains are shown in Table 2. The total reported intake of fruits and vegetables was generally higher amongst women than men in both dietary assessment methods. Men reported a somewhat higher daily intake with the Riksmaten method compared to MiniMeal-Q, 340 g/day and 317 g/day respectively (P = 0.009), whereas no differences were seen for women.

Table 2 Absolute food intake data (g/day) are presented with mean (SD) and median (25th and 75th percentiles) for women and men separately

For whole grains, women reported a slightly higher intake in MiniMeal-Q compared to the Riksmaten method, 25.6 g/day and 19.3 g/day, respectively (P = 0.021), whereas no differences between the methods were seen for men.

In general, stronger correlations were observed between energy-adjusted intakes of fruit and vegetables and plasma carotenoid concentrations amongst women than men, and the associations were stronger when excluding lycopene from the plasma carotenoid contents; r = 0.46 and r = 0.20 for the Riksmaten method, and r = 0.50 and r = 0.31 for MiniMeal-Q, respectively, Table 3. Reported intakes of β-carotene and plasma concentrations of β-carotene were significantly correlated among women by the Riksmaten method, but not among men (r = 0.33 and r = 0.07), and statistically significant for both women and men by MiniMeal-Q (r = 0.35 and r = 0.29, respectively).

Table 3 Spearman’s correlation between energy adjusted intake (g/MJ) of vegetables, fruits + berries, juice, as sum of vegetables + fruits + berries + juice and β-carotene against plasma carotenoid concentrations

The correlation coefficient between energy-adjusted intake of whole grain and alkylresorcinols was higher by the Riksmaten method (r = 0.30 and r = 0.29 for women and men) than by MiniMeal-Q (r = 0.25 and r = 0.20 for women and men), Table 4. All correlations were statistically significant except for men in MiniMeal-Q.

Table 4 Spearman’s correlation between energy-adjusted intake of whole grain wheat and rye (g/MJ) and plasma alkylresorcinol homologues for women and men separately

The correlation between the two dietary assessment methods and each of the diet biomarkers were used to calculate the validity coefficients using the method of triads. In Table 5, the validity coefficients and their 95 % CI are presented. For the CI bootstrapping, several calculations exceeded the limitations for correlation coefficients, which by definition can only extend between −1 and +1. When this occurred, the limits were set to either maximum −1 or +1. For capturing intake of fruits and vegetables, the Riksmaten method seemed to perform best for women and the MiniMeal-Q for men. The opposite was true for intake of whole grain, where the MiniMeal-Q performed best for women and the Riksmaten method for men.

Table 5 Validity coefficients (95 % confidence intervals) for the Riksmaten method, MiniMeal-Q and total plasma carotenoids and total plasma alkylresorcinols for women and men

A multiple linear regression model was used to study the relation between plasma carotenoid concentrations (sum of plasma carotenoids except lycopene) and reported dietary intake of vegetables, fruits, berries and juice, Table 6. In crude analyses, women had a higher degree of explained variance in carotenoid concentration than men by both methods; 21.6 % for women and 5.1 % for men by the Riksmaten method, and correspondingly, 18.0 % and 6.6 % by MiniMeal-Q. In the final full models, confounders adjusted for were smoking status and BMI. The major confounding factor was current smoking for women and BMI for men. In the fully adjusted models, all regressions remained statistically significant. Highest adjusted R2 was found for women in the Riksmaten method, 29.3 %.

Table 6 Relation between dietary intake of vegetables, fruits, berries and juice and plasma carotenoid concentrationsa

The results from the regression analyses of the relation between plasma alkylresorcinol homologues and reported intake of whole grain are shown in Table 7. In crude analyses, the concentration of alkylresorcinols was to a similar degree explained by the reported dietary intake of whole grains in both methods. In the Riksmaten method, the R2 was 9.4 % and 9.7 % for women and men, and correspondingly, 5.3 % and 8.4 % in the MiniMeal-Q. In the final full models, data were adjusted for smoking status and age and here the adjusted R2 was 8.0 % for women and 14.9 % for men in the Riksmaten method, and 5.7 % and 10.0 % in MiniMeal-Q. After adjusting for possible confounding factors, all regressions remained statistically significant except for women in MiniMeal-Q.

Table 7 Relation between dietary intake of whole grains and plasma total alkylresorcinols


The present study is one of the first validation studies using alkylresorcinols as objective biomarkers of whole grain wheat and rye intake to assess the validity of two web-based dietary assessment methods. In addition, carotenoids were used as markers of vegetable and fruit intake. The study also included a relative comparison of the reported intake of fruits, vegetables and whole grains between the two subjective methods. Both dietary assessment methods have been compared to biomarkers among women as well as among men, and for two different diet quality indicators.

Methodological considerations

A major strength with this study is the large number of participants, as a sample size of at least 50 individuals is considered to be sufficient when using biomarkers in dietary validation studies [36]. As a result of the recruitment procedure, almost half of the study population came from areas classified as having a low SES, which is in contrast to many other studies. Given that the study was population-based, and had a low drop-out rate, findings of this study are likely to be applicable to the general population.

Another strength of the study is that fruits and vegetables from mixed dishes were included in the estimate of total intakes, and that we did not use a proxy of the intake frequency. This increases the quality of the data and the ability to study reported food intake in relation to plasma biomarkers. To assess the ability of the MiniMeal-Q to capture fruit intake, one must take into consideration that one answering frequency (“5–6 times a week”) was missing for assessment of fruit intake, which might have led to inaccurate estimates for some individuals and thus made the associations of plasma carotenoids and reported dietary intake of fruit and vegetables weaker.

A limitation of the study could be that biomarkers and the dietary assessment methods to some extent reflect different time dimensions, and that blood samples used for biomarker analyses were sampled up to 5 weeks from collecting dietary intake data. The relatively short half-life of the biomarkers cause substantial within-person random variation in the biomarker concentrations measured, which will attenuate the observed association between true intake and the biomarker. Ideally, repeated measures of the biomarkers would have been preferable to provide some idea of the within-person variability, and also, a second sampling in conjunction with finishing the food record would have been valuable in order to reflect that same time period. However, we do not expect that this time-period should affect the seasonal variations in consumptions of fruits, vegetables or whole grains, and if these two subjective methods are assumed to be able to measure the habitual dietary intake, the timing of the blood sampling should not play any major role in the outcome of the results.

We applied the triad analyses of associations to estimated validity coefficients. This method builds on the assumption of independent error structure among the three methods. This assumption has however been questioned for all subjective dietary assessment methods [3739]. Still, the results of the validity coefficients were inconsistent; neither of the methods seemed to be superior over the other, but both self-reported methods displayed higher validity coefficients than the biomarkers. Since the Riksmaten method and MiniMeal-Q correlated well against each other on reported intakes based on food groups, this may partly explain why all biomarkers consistently displayed lower validity coefficients than the subjective methods did. Hence, our results from the triad analyses should be interpreted with caution.


We decided not to include lycopene in the total plasma carotenoid content because studies have repeatedly displayed poor results with lycopene as an indicator of fruit and vegetable intake [4043]. This might be due to large individual variations in absorption, metabolism and excretion of lycopene [44, 45]. When evaluating the reported dietary intakes from the two subjective methods against the sum of plasma lutein, zeaxanthin, β-cryptoxanthin, α-carotene and β-carotene, women tended to report dietary intake that could explain a larger part of the variations in plasma biomarker content than did men. This applied for both methods, and the results were satisfying for women. For men, the results were overall poorer although the fruit and vegetable intake was somewhat better captured with the MiniMeal-Q.

The correlation coefficients were somewhat lower than in a validation study assessing fruit and vegetable intake with a food frequency questionnaire against plasma carotenoids (except for lycopene) with a r = 0.59 [40]. Otherwise, validation studies attempting to assess total fruit and vegetable intake with food frequency questionnaires normally range from r = 0.18–0.35 [41, 46, 47] and for repeated 24-h recalls at r = 0.38–0.42 [46, 47] using the sum of carotenoids (except for lycopene) as objective biomarkers.

Only 20 % of all women and 17 % of all men reported a consumption of more than 500 g of vegetables and fruits per day, which is the same amount as in the national food survey in adults, Riksmaten 2010–2011 [26]. We observed that men reported higher intakes of vegetables than women with the Riksmaten method, which is contrary to the Riksmaten survey 2010–11 [26]. It may also be that men have a more irregular intake of fruit and vegetables, and therefore a four-day period of recording might not be sufficient to cover the true habitual intake in males. Biomarkers determined in a single sample will reflect the true biomarker concentration with a higher precision if the habitual intake has low day-to-day variation. A more regular intake of fruit and vegetables among women might thus explain why rankings based on dietary intake versus biomarker data performed better for women than for men. Also, from the multiple regression models it appears that smoking status and BMI accounted for a large degree of the explained variance in plasma carotenoid concentration among men, but not in women. Adjusting for fat intake or cholesterol levels did surprisingly not improve the overall R2 in our study. It is generally acknowledged that intake of fat together with intake of fruits and vegetables improves the absorption of the fat-soluble carotenoids and leads to higher plasma levels [48, 49]. In the blood, carotenoids are associated with lipoprotein particles that also contain cholesterol and subjects with high cholesterol levels might therefor have higher plasma carotenoids. However, in the present study we found no association with cholesterol and carotenoids.


The Spearman rank correlation coefficients between whole grain wheat and rye intake and total plasma alkylresorcinol homologues in this study were generally lower than those observed in most whole grain intervention studies [19, 25, 50, 51]. However, the correlations were similar to those previously reported by a Danish observational study including post-menopausal women, where the correlation coefficient of 0.25 was found between the plasma total alkylresorcinol concentration and rye bread intake assessed with a semi-quantitative food frequency questionnaire [51].

The slightly better ranking capacity of the Riksmaten method compared to the MiniMeal-Q could be explained by the larger variety of whole grain products in the food list of the Riksmaten method, which may have increased the precision, while the MiniMeal-Q lacks specific questions for foods with high whole grain content. The extended version of the same questionnaire, Meal-Q, is designed to better capture whole grain intake by more detailed questions regarding fiber and whole grain content on a selected number of carbohydrate sources [27]. Still, it is difficult for study participants to report their intakes of food products containing whole grains accurately because of the well-known difficulties in distinguishing whole grain from fiber, and to distinguish dark colored bread from whole grain bread.

In summary, both web-based assessment methods validated in this study managed to capture fruit and vegetable intake in a satisfactory manner, especially for women. The performance of wholegrain wheat and rye assessment was in contrast not quite adequate, and we suggest that wholegrain intakes measured with these both methods should be interpreted with caution if used as exposure variable. One should have in mind that we have only examined the validity of these methods to capture a few components of the diet, and there is a need for a greater variety of nutritional biomarkers to be able to reflect different aspects of dietary intakes. Although this validation study was carried out in a similar setting and group of people that these methods were intended to be used in, it is important to recall that the performance of the questionnaire can differ in other populations, particularly among less educated groups or among people of various ages. This limitation should always be taken into consideration while planning to use a validated dietary assessment method.


Both dietary assessment methods captured dietary intake based on food groups with similar precision. Agreements with objective biomarkers ranged from low to moderate, depending on sex and diet quality indicator. While the ability to capture whole grain intake was weak for both methods and sexes, the assessment of vegetable and fruit intake performed in a satisfactory manner for women in both methods. Choice of method should thus be guided by several considerations including research questions, simplicity and time requirement to perform the method and the overall costs for managing of the survey.





Confidence intervals


Coefficcient of variation


Gas chromatography mass spectrometry


High-performance liquid chromatography




National food agency


Quality control


The Riksmaten method


Swedish CArdioPulmonary bioImage Study


Socio-economic status


Theoretical true intake


Validity coefficients


  1. 1.

    Paeratakul S, Popkin BM, Kohlmeier L, Hertz-Picciotto I, Guo X, Edwards LJ. Measurement error in dietary data: implications for the epidemiologic study of the diet-disease relationship. Eur J Clin Nutr. 1998;52:722–7.

    CAS  Article  PubMed  Google Scholar 

  2. 2.

    IH R. Dietary intake measurements. Public Health Nutr. 2005;8:1100–7.

    Google Scholar 

  3. 3.

    AE B, Bingham SA WAF, SA B. Validation of dietary intakes measured by diet history against 24 h urinary nitrogen excretion and energy expenditure measured by the doubly-labelled water method in middle-aged women. Br J Nutr. 2000;83:341–54.

    Article  Google Scholar 

  4. 4.

    Lutomski JE, van den Broeck J, Harrington J, Shiely F, Perry IJ. Sociodemographic, lifestyle, mental health and dietary factors associated with direction of misreporting of energy intake. Public Health Nutr. 2011;14:532–41. 510.1017/S1368980010001801.

    Article  PubMed  Google Scholar 

  5. 5.

    Johansson G, Wikman A, Ahren AM, Hallmans G, Johansson I. Underreporting of energy intake in repeated 24-h recalls related to gender, age, weight status, day of interview, educational level, reported food intake, smoking habits and area of living. Public Health Nutr. 2001;4:919–27.

    CAS  Article  PubMed  Google Scholar 

  6. 6.

    Hill RJ, Davies PS. The validity of self-reported energy intake as determined using the doubly labelled water technique. Br J Nutr. 2001;85:415–30.

    CAS  Article  PubMed  Google Scholar 

  7. 7.

    Schoeller DA. Limitations in the assessment of dietary energy intake by self-report. Metabolism. 1995;44:18–22.

    CAS  Article  PubMed  Google Scholar 

  8. 8.

    Trabulsi J, Schoeller DA. Evaluation of dietary assessment instruments against doubly labeled water, a biomarker of habitual energy intake. Am J Physiol Endocrinol Metab. 2001;281:E891–899.

    CAS  PubMed  Google Scholar 

  9. 9.

    Schoeller DA. Measurement of energy expenditure in free-living humans by using doubly labeled water. J Nutr. 1988;118:1278–89.

    CAS  PubMed  Google Scholar 

  10. 10.

    Isaksson B. Urinary nitrogen output as a validity test in dietary surveys. Am J Clin Nutr. 1980;33:4–5.

    CAS  PubMed  Google Scholar 

  11. 11.

    Holbrook JT, Patterson KY, Bodner JE, Douglas LW, Veillon C, Kelsay JL, Mertz W, Smith Jr JC. Sodium and potassium intake and balance in adults consuming self-selected diets. Am J Clin Nutr. 1984;40:786–93.

    CAS  PubMed  Google Scholar 

  12. 12.

    Tasevska N, Runswick SA, Bingham SA. Urinary potassium is as reliable as urinary nitrogen for use as a recovery biomarker in dietary studies of free living individuals. J Nutr. 2006;136:1334–40.

    PubMed  Google Scholar 

  13. 13.

    Jenab M, Slimani N, Bictash M, Ferrari P, Bingham S. Biomarkers in nutritional epidemiology: applications, needs and new horizons. Hum Genet. 2009;125:507–25.

    Article  PubMed  Google Scholar 

  14. 14.

    Block G, Patterson B, Subar A. Fruit, vegetables, and cancer prevention: a review of the epidemiological evidence. Nutr Cancer. 1992;18:1–29.

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    Norat T, Aune D, Chan D, Romaguera D. Fruits and vegetables: updating the epidemiologic evidence for the WCRF/AICR lifestyle recommendations for cancer prevention. Cancer Treat Res. 2014;159:35–50.

    CAS  Article  PubMed  Google Scholar 

  16. 16.

    Cho SS, Qi L, Fahey Jr GC, Klurfeld DM. Consumption of cereal fiber, mixtures of whole grains and bran, and whole grains and risk reduction in type 2 diabetes, obesity, and cardiovascular disease. Am J Clin Nutr. 2013;98:594–619.

    CAS  Article  PubMed  Google Scholar 

  17. 17.

    Maiani G, Caston MJ, Catasta G, Toti E, Cambrodon IG, Bysted A, Granado-Lorencio F, Olmedilla-Alonso B, Knuthsen P, Valoti M, et al. Carotenoids: actual knowledge on food sources, intakes, stability and bioavailability and their protective role in humans. Mol Nutr Food Res. 2009;53 Suppl 2:S194–218.

    Article  PubMed  Google Scholar 

  18. 18.

    Baldrick FR, Woodside JV, Elborn JS, Young IS, McKinley MC. Biomarkers of fruit and vegetable intake in human intervention studies: a systematic review. Crit Rev Food Sci Nutr. 2011;51:795–815.

    CAS  Article  PubMed  Google Scholar 

  19. 19.

    Landberg R, Kamal-Eldin A, Andersson A, Vessby B, Aman P. Alkylresorcinols as biomarkers of whole-grain wheat and rye intake: plasma concentration and intake estimated from dietary records. Am J Clin Nutr. 2008;87:832–8.

    CAS  PubMed  Google Scholar 

  20. 20.

    Landberg R, Aman P, Friberg LE, Vessby B, Adlercreutz H, Kamal-Eldin A. Dose response of whole-grain biomarkers: alkylresorcinols in human plasma and their metabolites in urine in relation to intake. Am J Clin Nutr. 2009;89:290–6.

    CAS  Article  PubMed  Google Scholar 

  21. 21.

    Ross AB, Kamal-Eldin A, Aman P. Dietary alkylresorcinols: absorption, bioactivities, and possible use as biomarkers of whole-grain wheat- and rye-rich foods. Nutr Rev. 2004;62:81–95.

    Article  PubMed  Google Scholar 

  22. 22.

    Chen Y, Ross AB, Aman P, Kamal-Eldin A. Alkylresorcinols as markers of whole grain wheat and rye in cereal products. J Agric Food Chem. 2004;52:8242–6.

    CAS  Article  PubMed  Google Scholar 

  23. 23

    Knudsen MD, Kyro C, Olsen A, Dragsted LO, Skeie G, Lund E, Aman P, Nilsson LM, Bueno-de-Mesquita HB, Tjonneland A, Landberg R. Self-reported whole-grain intake and plasma alkylresorcinol concentrations in combination in relation to the incidence of colorectal cancer. Am J Epidemiol. 2014;179:1188–96.

  24. 24

    Drake I, Sonestedt E, Gullberg B, Bjartell A, Olsson H, Adlercreutz H, Tikkanen MJ, Wirfalt E, Wallstrom P. Plasma alkylresorcinol metabolites as biomarkers for whole-grain intake and their association with prostate cancer: a Swedish nested case–control study. Cancer Epidemiol Biomarkers Prev. 2014;23:73–83.

    CAS  Article  PubMed  Google Scholar 

  25. 25

    Ross AB, Bourgeois A, Macharia HN, Kochhar S, Jebb SA, Brownlee IA, Seal CJ. Plasma alkylresorcinols as a biomarker of whole-grain food consumption in a large population: results from the WHOLEheart Intervention Study. Am J Clin Nutr. 2012;95:204–11.

    CAS  Article  PubMed  Google Scholar 

  26. 26

    Riksmaten – vuxna 2010–2011. Livsmedels- och näringsintag bland vuxna I Sverige []. Accessed 05 May 2014.

  27. 27

    Christensen SE, Moller E, Bonn SE, Ploner A, Wright A, Sjolander A, Balter O, Lissner L, Balter K. Two new meal- and web-based interactive food frequency questionnaires: validation of energy and macronutrient intake. J Med Internet Res. 2013;15:e109.

    Article  PubMed  PubMed Central  Google Scholar 

  28. 28

    Christensen SE, Moller E, Bonn SE, Ploner A, Balter O, Lissner L, Balter K. Relative validity of micronutrient and fiber intake assessed with two new interactive meal- and Web-based food frequency questionnaires. J Med Internet Res. 2014;16:e59.

    Article  PubMed  PubMed Central  Google Scholar 

  29. 29

    Nybacka S, Forslund HB, Wirfält E, Larsson I, Ericson U, Lemming EW, Bergström G, Hedblad B, Winkvist A, Lindroos AK. Comparison of a web-based food record tool and a food frequency questionnaire and objective validation using the doubly labeled water technique in a Swedish middle-aged population. Journal of Nutritional Science 2016, In Press.

  30. 30

    Bergstrom G, Berglund G, Blomberg A, Brandberg J, Engstrom G, Engvall J, Eriksson M, de Faire U, Flinck A, Hansson MG, et al. The Swedish CArdioPulmonary BioImage Study: objectives and design. J Intern Med. 2015;278(6):645-59. doi:10.1111/joim.12384.

  31. 31

    The food database []. Accessed 19 Aug 2014.

  32. 32

    Landberg R, Man P, Kamal-Eldin A. A rapid gas chromatography–mass spectrometry method for quantification of alkylresorcinols in human plasma. Anal Biochem. 2009;385:7–12.

    CAS  Article  PubMed  Google Scholar 

  33. 33

    Ocke MC, Kaaks RJ. Biochemical markers as additional measurements in dietary validity studies: application of the method of triads with examples from the European Prospective Investigation into Cancer and Nutrition. Am J Clin Nutr. 1997;65:1240s–5s.

    CAS  PubMed  Google Scholar 

  34. 34

    Carpenter J, Bithell J. Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med. 2000;19:1141–64.

    CAS  Article  PubMed  Google Scholar 

  35. 35

    R Development Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. 2008.

  36. 36

    Serra-Majem L, Frost Andersen L, Henrique-Sanchez P, Doreste-Alonso J, Sanchez-Villegas A, Ortiz-Andrelluchi A, Negri E, La Vecchia C. Evaluating the quality of dietary intake validation studies. Br J Nutr. 2009;102 Suppl 1:S3–9.

    CAS  Article  PubMed  Google Scholar 

  37. 37

    Kipnis V, Midthune D, Freedman L, Bingham S, Day NE, Riboli E, Ferrari P, Carroll RJ. Bias in dietary-report instruments and its implications for nutritional epidemiology. Public Health Nutr. 2002;5:915–23.

    Article  PubMed  Google Scholar 

  38. 38

    Kipnis V, Subar AF, Midthune D, Freedman LS, Ballard-Barbash R, Troiano RP, Bingham S, Schoeller DA, Schatzkin A, Carroll RJ. Structure of dietary measurement error: results of the OPEN biomarker study. Am J Epidemiol. 2003;158:14–21. discussion 22–16.

    Article  PubMed  Google Scholar 

  39. 39

    Kaaks R, Ferrari P, Ciampi A, Plummer M, Riboli E. Uses and limitations of statistical accounting for random error correlations, in the validation of dietary questionnaire assessments. Public Health Nutr. 2002;5:969–76.

    Article  PubMed  Google Scholar 

  40. 40

    Campbell DR, Gross MD, Martini MC, Grandits GA, Slavin JL, Potter JD. Plasma carotenoids as biomarkers of vegetable and fruit intake. Cancer Epidemiol Biomarkers Prev. 1994;3:493–500.

    CAS  PubMed  Google Scholar 

  41. 41

    Jansen MC, Van Kappel AL, Ocke MC, Van’t Veer P, Boshuizen HC, Riboli E, Bueno-de-Mesquita HB. Plasma carotenoid levels in Dutch men and women, and the relation with vegetable and fruit consumption. Eur J Clin Nutr. 2004;58:1386–95.

    CAS  Article  PubMed  Google Scholar 

  42. 42

    Burrows TL, Hutchesson MJ, Rollo ME, Boggess MM, Guest M, Collins CE. Fruit and vegetable intake assessed by food frequency questionnaire and plasma carotenoids: a validation study in adults. Nutrients. 2015;7:3240–51.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  43. 43

    Pennant M, Steur M, Moore C, Butterworth A, Johnson L. Comparative validity of vitamin C and carotenoids as indicators of fruit and vegetable intake: a systematic review and meta-analysis of randomised controlled trials. Br J Nutr. 2015;114(9):1331–40. doi:10.1017/S0007114515003165.

  44. 44

    Borel P, Desmarchelier C, Nowicki M, Bott R. Lycopene bioavailability is associated with a combination of genetic variants. Free Radic Biol Med. 2015;83:238–44.

    CAS  Article  PubMed  Google Scholar 

  45. 45

    Moran NE, Erdman Jr JW, Clinton SK. Complex interactions between dietary and genetic factors impact lycopene metabolism and distribution. Arch Biochem Biophys. 2013;539:171–80.

    CAS  Article  PubMed  Google Scholar 

  46. 46

    Resnicow K, Odom E, Wang T, Dudley WN, Mitchell D, Vaughan R, Jackson A, Baranowski T. Validation of Three Food Frequency Questionnaires and 24-h Recalls with Serum Carotenoid Levels in a Sample of African-American Adults. Am J Epidemiol. 2000;152:1072–80.

    CAS  Article  PubMed  Google Scholar 

  47. 47

    Kristal AR, Vizenor NC, Patterson RE, Neuhouser ML, Shattuck AL, McLerran D. Precision and bias of food frequency-based measures of fruit and vegetable intakes. Cancer Epidemiol Biomarkers Prev. 2000;9:939–44.

    CAS  PubMed  Google Scholar 

  48. 48

    Brown MJ, Ferruzzi MG, Nguyen ML, Cooper DA, Eldridge AL, Schwartz SJ, White WS. Carotenoid bioavailability is higher from salads ingested with full-fat than with fat-reduced salad dressings as measured with electrochemical detection. Am J Clin Nutr. 2004;80:396–403.

    CAS  PubMed  Google Scholar 

  49. 49

    Faulks RM, Southon S. Challenges to understanding and measuring carotenoid bioavailability. Biochim Biophys Acta. 2005;1740:95–100.

    CAS  Article  PubMed  Google Scholar 

  50. 50

    Linko AM, Juntunen KS, Mykkanen HM, Adlercreutz H. Whole-grain rye bread consumption by women correlates with plasma alkylresorcinols and increases their concentration compared with low-fiber wheat bread. J Nutr. 2005;135:580–3.

    CAS  PubMed  Google Scholar 

  51. 51

    Landberg R, Kamal-Eldin A, Aman P, Christensen J, Overvad K, Tjonneland A, Olsen A. Determinants of plasma alkylresorcinol concentration in Danish post-menopausal women. Eur J Clin Nutr. 2011;65:94–101.

    CAS  Article  PubMed  Google Scholar 

Download references


We would like to acknowledge Kjell Pettersson at the Health metrics unit, Sahlgrenska Academy, for coding and performing the analyses for the method of triads. We would also like to thank Professor Katarina Bälter and her group at KI for the rapid assistance in managing the MiniMeal-Q data. The main funding body of The Swedish CArdioPulmonary bioImage Study (SCAPIS) is the Swedish Heart and Lung Foundation. The study is also funded by the Knut and Alice Wallenberg Foundation, the Swedish Research Council and VINNOVA (Sweden’s Innovation agency). In addition, the SCAPIS Pilot study received support from the Sahlgrenska Academy at University of Gothenburg and Region Västra Götaland.


The data collection and data analysis was supported by Region Skåne and funds awarded to senior Professor Bo Hedblad. The data collection and analyses were also supported by funds awarded to Professor Elisabet Wirfält from the Påhlsson Research Foundation and from Region Skåne. The biochemical analyses of alkylresorciols and carotenoids were supported by European Research Council awarded to Professor Olle Melander, and by Swedish Heart and Lung Foundation and Swedish Research Council awarded to Professors Olle Melander and Marju Orho-Melander. The National Food Agency has developed the web-based food diary system. The Department of Internal Medicine and Clinical Nutrition, Sahlgrenska Academy at the University of Gothenburg, conducted the study and partly supported staffs costs with funds awarded to Professor Anna Winkvist.

Availability of data and material

The datasets generated during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

AW, EW, AKL, HBF, IL, designed the research; GB and BH provided essential databases; SN conducted research, analyzed data and wrote the manuscript; all authors have been involved in revising the manuscript critically for important intellectual content. All authors read and approved the final manuscript.

Competing interests

The authors declares that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This study was approved by the Gothenburg Regional Ethics Committee (Dnr: 1061–11), and written informed consent was obtained from all study subjects.

Author information



Corresponding author

Correspondence to Sanna Nybacka.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Nybacka, S., Lindroos, A.K., Wirfält, E. et al. Carotenoids and alkylresorcinols as objective biomarkers of diet quality when assessing the validity of a web-based food record tool and a food frequency questionnaire in a middle-aged population. BMC Nutr 2, 53 (2016).

Download citation


  • Dietary assessment
  • Web-based
  • Validation
  • Biomarkers
  • Carotenoids
  • Alkylresorcinols