Skip to main content

Relative validity of a brief dietary survey to assess food intake and adherence to national dietary guidelines among Sri Lankan adults

Abstract

Background

Suboptimal diet is the leading cause of global morbidity and mortality. Addressing this problem requires context-specific solutions informed by context-specific data collected by context-specific tools. This study aimed to assess the relative validity of a newly developed brief dietary survey to estimate food intake and adherence to the Food Based Dietary Guidelines for Sri Lankans.

Methods

Between December 2018 and February 2019, we interviewed 94 Sri Lankan adults living in Colombo (Western Province), Kalutara (Western Province), and Trincomalee (Eastern Province). We assessed the relative validity of the Sri Lankan Brief Dietary Survey (SLBDS) with Wilcoxon rank-sum tests, Spearman’s Rho correlation coefficients, Bland–Altman plots, and Cohen’s kappa tests using a 24-h Dietary Recall (24DR) as reference.

Results

Ninety-four adults (40.7 years ±12.6; 66% female) completed both surveys during the same interview. With the exception of ‘Fish, pulses, meat and eggs’ food group median intake, which was underestimated by the SLBDS compared to the 24DR, there was no strong evidence of difference between median intakes reported by the two methods. Correlation coefficients were highest for ‘Milk and dairy products’ (0.84) at the food group level and for ‘dosa’, ‘hoppers’, ‘milk rice’, and ‘dried fish’ (1.00) among individual food and beverages. Visual exploration of Bland-Altman plots showed acceptable agreement between the SLBDS and 24DR, with the SLBDS tending to overestimate consumption as the number of servings of ‘Rice, bread, other cereals and yams’ and ‘Vegetables’ consumed increased and slightly underestimate consumption as the number of servings of ‘Fish, pulses, meat and eggs’, ‘Milk and dairy products’, and ‘Nuts’ increased. Kappa values ranged from from 0.59 (95% CI: 0.32–0.86) for ‘Vegetables’ to 0.81 (95% CI: 0.66–0.96) for ‘Fruit’ indicating a moderate to strong level of agreement.

Conclusions

Having been developed for and relatively validated with the study population in question, our study shows that the SLBDS can be used as a fit for purpose research tool. Additional research is needed to assess SLBDS test-retest reliability and to validate further the reporting of salt, oil, and coconut intake.

Peer Review reports

Background

Unhealthy diet is the leading modifiable risk factor for the development of noncommunicable diseases (NCDs) [1]. Despite the promising global progress made in preventing and controlling NCDs in the last decades, they remain the world’s leading causes of death. This is in part due to a combination of unsustained and ineffective action mounted against key modifiable risk factors and the many ‘data blind spots’ that result from inadequate and infrequent data collection [2]. Substantial reductions in NCD morbidity and mortality therefore require increased investment in evidence-informed healthy diet promotion [3]. This necessitates accurate and timely dietary data collection to identify trends, develop appropriate solutions, prioritise resource allocation, and evaluate intervention effectiveness. Dietary intake, however, is notoriously difficult to capture accurately in population-based studies, and the complex and burdensome nature of ‘gold standards’ can limit their context suitability and sustainability [4, 5].

While diet may be the single most important risk factor for NCDs, it is by no means the only one. Embedding dietary intake measurements within multi-topic, multi-component national NCD risk factor surveys that collect behavioural, physical, and biochemical measurements in an attempt to avoid survey fatigue is therefore a popular surveillance approach [6]. The WHO STEPwise Surveillance (STEPS) methodology, for example, recommends Member States undertake multi-topic, multi-component STEPS surveys every 3–5 years – a schedule that has proved challenging in resource-constrained settings [6]. Supplementing these hugely important surveillance systems with short and easy to administer surveys that facilitate the periodic collection of good-quality data therefore has appeal – especially in resource-constrained settings where data collectors may receive minimal training [7]. The availability of validated brief dietary assessment tools, however, is limited, with many focussing on few, select food groups (for example, fruit and vegetable intake) [8].

Where data are being collected, linking these data to action – the ultimate goal of dietary surveillance – is not always realised [9]. Context-specific research tools designed to inform context-appropriate interventions may help to close this knowledge to action gap. This, of course, must include an understanding of contextual gender differences in dietary intake informed by self-report methods that are equally valid for collecting dietary intake data from women and men – an area of research that is currently underserved [10].

Country-specific and evidence-informed national dietary guidelines provide a convenient and logical structure to inform the development of a short dietary assessment tool; measuring recommendation compliance generates research outcomes that can be used to assess diet-disease associations and inform and evaluate national nutrition policy and public health interventions [11]. Often developed and endorsed by multiple government sectors (for example, the Ministry of Health, the Ministry of Education, and the Ministry of Agriculture), these documents and the activities born from them also provide a ready-made rallying point for the multisectoral action required to effectively tackle NCDs [3].

Brief dietary survey for Sri Lankan adults

The rise in diet-related NCDs in Sri Lanka increases attention and importance on nutritional surveillance research [12,13,14]; the seven-year gap between the most recent Sri Lankan STEPS surveys (conducted in 2008 and 2015) highlights the need for contextually-validated, efficient, and easy to use dietary surveillance supplements [15]. Other methods currently used in the Sri Lankan NCD research context make important contributions but have practical constraints. The contextually validated Food Frequency Questionnaire for Sri Lankan Adults (SLFFQ) incurs both high memory and analysis burden [16] and the ‘international’ 24-h Dietary Recall (24DR) requires up to one hour to complete and a highly trained interviewer to administer. The Sri Lankan Brief Dietary Survey (SLBDS) (Fig. S1) was therefore developed with the following considerations in mind: 1) context suitability; 2) low administration burden for participants and researchers; 3) rapid and straightforward analysis; 4) suitability for repeat assessments in large-scale follow-up studies; 5) reduced respondent fatigue in multi-risk factor surveys; and 6) ability to provide useful health-related information to inform population-level policy and interventions.

In this study, we aimed to assess the relative validity of this newly developed brief dietary survey to estimate food intake and adherence to the Food Based Dietary Guidelines for Sri Lankans (SLFBDGs), using a 24DR [17] as reference. SLBDS content and structure are based on the SLFBDGs [18]. The core food groups outlined in the SLFBDGs and queried by the SLBDS are (1) ‘Rice, bread, other cereals and yams’; (2) ‘Fruit’; (3) ‘Vegetables’; (4) ‘Fish, pulses, meat and eggs’; (5) ‘Milk or milk products’; and (6) ‘Nuts and oil seeds’. NCD-relevant food/beverage categories and items addressed in the wider SLFBDG document are also included in the survey: (7) ‘Sweetened drinks, sweets and desserts’; (8) ‘Fast food’; (9) ‘Salt’; and (10) ‘Tea and coffee’. Within each of these categories, commonly consumed foods and beverages were defined by consulting the SLFBDGs, SLFFQ, and local nutrition researchers. The SLFBDGs provide numerical daily recommendations in the form of serving sizes for food groups 1 to 6 and salt intake (< 5 g (1 tsp)/day) and general intake advice (non-numerical) for food and beverage categories 7, 8, and 10. This makes it possible for the SLBDS to assess adherence to dietary guideline recommendations. The SLBDS, available in English, Sinhala, and Tamil, is one A4 sheet in size. It asks 37 questions about the amount of food and beverages consumed in prescribed quantities (for example, number of whole eggs); 17 yes/no diet-related questions (for example, ‘did you eat Western fast food yesterday?’); and two open-ended questions that probe for information on special diets (for example, vegetarian diet) and atypical intake pertaining to participant consumption over the past 24-h period. The survey also records respondent age, ethnicity, sex, and place of residence.

We believe that adding this fit for purpose tool to the menu of choices available to researchers will only continue to facilitate the formulation and implementation of effective and responsive healthy diet promotion interventions for Sri Lankan adults.

Methods

Figure 1 provides an overview of the SLBDS relative validation process, from face validation and pre-testing to survey administration and statistical analyses. These steps are outlined in further detail below.

Fig. 1
figure1

Relative validation process

Face validity and pre-testing

Face validity, a process whereby the SLBDS was subjectively viewed as covering what it purported to measure, was assessed by six researchers at the University of Colombo, Sri Jayewardenepura General Hospital and Post Graduate Training Centre, and University of Oxford. This process was conducted in-person and via email and telephone interviews. The feedback and discussion generated through this process focussed on prescribed SLBDS intake units (for example, coconut spoons vs cups vs tablespoons) and how best to measure notoriously difficult to capture oil, salt, and coconut intake, with researchers divided on whether to measure intake frequency (i.e. number of times item consumed in a 24-h period) or intake amount. In the latter case, we decided to record both. Clarity of survey wording and format was further refined through pre-testing with 25 Sri Lankan adults aged 20 to 65 known to our research network.

Criterion validity testing (relative validation)

The face validated and pre-tested version of the SLBDS was subsequently tested against the 24DR to determine criterion-related validity – i.e. how well the new SLBDS estimated 24-h food intake and adherence to the SLFBDGs compared to the reference method (24DR). We selected this reference method because of its use in prior brief instrument validation studies and its statistically significant comparability to the ‘gold standard’ self-report 7-day weighed-intake dietary record (7DWR) in the target population [19]. The 24DR has a similar objective to the SLBDS and measures intake over the same time frame (24 h) whilst differing in its reliance on memory and portion size reporting format. These similarities and differences make the 24DR an appropriate reference method for this study [7, 20].

Study sample

Between December 2018 and February 2019, we administered both the SLBDS and the 24DR to a sample of 94 Sri Lankan adults living in urban Colombo, and urban and rural sectors in Kalutara and Trincomalee. The Trincomalee district is located in the majority Moor and Muslim Eastern Province, whereas both Colombo and Kalutara are majority Sinhalese and Buddhist Western provinces. A sample size calculation was conducted to determine the sample size required to detect a low correlation between results from the test and reference surveys (r = 0.3) with alpha and beta set to 95 and 80% respectively, and accounting for a 10% participant dropout rate. Divisional Secretaries of Colombo, Kalutara, and Trincomalee were contacted to obtain electoral lists for each Grama Niladhari Division (GND) within the district and gain permission to visit individual households for data collection. Adults aged 18 years or older who were willing and able to provide informed consent were eligible for inclusion. Data collection started at a randomly selected location within the district. From that starting point, the nearest house appearing in the relevant electoral list was approached. If a consenting adult was present, the third house to the left was approached for the next interview, and so on. If more than one eligible adult was present in the household, the interviewee was selected by drawing lots. If an eligible adult was not present or did not consent, the house next door was approached. This recruitment method was followed until 56, 29, and nine participants in Colombo, Kalutara, and Trincomalee, respectively, were recruited.

Dietary assessment

Each participant completed two consecutive face-to-face interviewer-administered dietary surveys, the SLBDS (new tool) and a 24DR (reference method), in the participant’s preferred language: Sinhala, Tamil or English. As the surveys were administered one after the other during the same visit, administration order was randomised to avoid response-order effects. Data collection was undertaken in participants’ homes by two experienced female Sri Lankan researchers, with 50% of the study sample randomly allocated to each interviewer (i.e. the same interviewer applied both dietary surveys). Data collectors were consulted during the survey development phase and trained through role play and practice interviews with members of the research team to deliver the surveys uniformly, closely following the provided templates and corresponding instructions.

Both surveys are structured dietary assessment tools that ask participants to recall their food and beverage consumption during the previous 24 h – a short recall period that has proven useful for minimising recall bias [21]. The two surveys differ in length, degree of survey structure, memory requirements, recall process, detail captured, and analysis burden (Table 1). The same standard household utensils were referenced to obtain information on portion sizes in both surveys and each queried whether or not the day being recalled was typical of participants' usual food intake, with interviewers prompting atypical responses for further explanation. Vegetarian status and special diets were also recorded on the paper-based templates provided.

Table 1 Comparison of Sri Lankan Brief Dietary Survey and 24-h Dietary Recall characteristics

Administration of the Sri Lankan Brief Dietary Survey

Using the SLBDS, interviewers asked participants if they had consumed each of the following food groups: (1) ‘Rice, bread, other cereals and yams’; (2) ‘Fruit’; (3) ‘Vegetables’; (4) ‘Fish, pulses, meat and eggs’; (5) ‘Milk or milk products’; (6) ‘Nuts and oil seeds’; as well as (7) ‘Sweetened drinks, sweets and desserts’; (8) ‘Fast food’; (9) ‘Salt’; and (10) ‘Tea and coffee’ in the past 24 h, and if ‘yes’, what portions (in prescribed units) of specific foods (also prescribed) within each group they consumed. After a first pass of the survey, the interviewer revisited unanswered questions.

Administration of the 24-h dietary recall

Detailed food and beverage consumption information was collected from participants using the 24DR method. Uninterrupted and in their own words, participants were asked to list everything they had consumed, including food and drink items and their corresponding quantities, the previous day (from waking to evening). The interviewer then probed this list for additional information: consumption time and location; item brand; further item description; and leftovers. To conclude the interview, respondents were given a further opportunity to provide additional information/detail on their 24-h intake.

Statistical analyses

All 188 surveys were verbatim transcribed, translated into English, and entered into Excel with 24DR data hand coded and summed to reflect SLBDS food groups/categories (1 to 10 listed above). Coding was blinded to the results of the SLBDS to avoid bias. This was achieved by coding the 24DR survey results before the researcher responsible for analysis gained access to SLBDS data. We used a chi-square test to determine whether participant characteristics differed by participant sex. As most of the dietary data were not normally distributed, we calculated the median and interquartile range (IQR) for intake of each food group and food/beverage item (based on serving size where specified in the SLFBDGs and portion size where unspecified) reported in the SLBDS and 24DR. Wilcoxon rank-sum tests were used to assess the statistical differences between medians. Correlation (r) between individual intakes collected by each measure was determined using Spearman’s Rho tests. The use of these non-parametric tests ensures that spikes at ‘zero consumption’ do not invalidate statistical assumptions. To detect differences and bias between the two methods, differences were plotted against means in Bland-Altman plots. We estimated Cohen’s kappa (k) with 95% confidence intervals to measure the inter-rater reliability for comparing achievement of recommended food group intake (where 0 = not achieved and 1 = achieved) based on the SLFBDGs between the new and reference method. For yes/no SLBDS questions: “Did you consume Western or local fast food yesterday?” and “Did you add salt, sauce/ketchup or chutney/chilli paste to your breakfast/lunch/dinner/snack?”, ‘yes’ responses were assigned a score of 1 and ‘no’ a zero. 24DR data were coded similarly: we assigned reporting of fast food (local and Western) and salt intake at specified meal times (breakfast, lunch, dinner, and snack) a score of 1 (if intake was reported) and 0 (if no intake was reported). The unweighted kappa statistic describes the level of agreement over and above chance agreement between the two measures as slight (0–0.20), fair (0.21–0.40), moderate (0.41–0.60), substantial (0.61–0.80), and almost perfect (> 0.81) [22]. To assess whether the SLBDS was an equally valid measure of dietary intake for both female and male participants, we calculated the results for each of these agreement analyses separately in females and males as a secondary analysis. We considered a p value < 0.05 as evidence against the null hypothesis. All statistical analyses were conducted in R version 4.0.1.

Ethical approval

Ethics approval for this study was received from the University of Colombo (Faculty of Medicine) and the University of Oxford (Oxford Tropical Research Ethics Committee). Written informed consent was obtained from each participant prior to data collection. Compensation for participation was not provided.

Results

Ninety-four Sri Lankan adults, including 62 females and 32 males aged 18 to 65 (mean = 40.7, SD = 12.6), agreed to participate in the study. Compared to female participants, male participants were more likely to report their dietary intake over the previous 24 h as atypical. There were no statistically significant differences between females and males with respect to age, ethnicity, place of residence, vegetarian status, and adherence to special diets. All 94 participants completed the two dietary surveys, in varying degrees of detail, and were included in analyses. SLBDS and 24DR administration time ranged from five to 15 min and 30 min to over an hour, respectively. Participant characteristics are described in Table 2.

Table 2 Participant characteristics

Table 3 presents the median and interquartile range (IQR) for the number of servings consumed for each of the six main food groups of the SLFBDGs as recorded by the SLBDS and 24DR. Median (IQR) ‘Fish, pulses, meat and eggs’ intake from the SLBDS (3.3 (2.0–5.0) daily servings) was the only food group that was significantly underestimated (p <  0.05) when compared to corresponding values recorded by the 24DR (4.0 (3.0–5.6) daily servings). For all other SLFBDG food groups (Table 3) and food/beverage items that do not carry a numerical daily intake recommendation in the guidelines (Table 4), there was no evidence of difference between data collected by the SLBDS and 24DR methods.

Table 3 Median (IQR) for the number of servings consumed for six food groups as recorded by the SLBDS and 24DR
Table 4 Median (IQR) for the number of portions consumed for six food and beverage items as recorded by the SLBDS and 24DR

The open-response format of the 24DR meant that participants were able to report the consumption of items that were not included in the SLBDS. These items included buns and bakery products; butter; Milo milk packets; Nestomalt/Viva/Sustagen; savoury biscuits; soya meat; and alcohol. Alcohol was the only example of an item not queried in the SLBDS for which two participants offered consumption data because they thought “it was important for researchers to know this information in the context of health-related research” (Male participant, Colombo).

Spearman’s Rho scores ranged at the food group level from 0.73 (‘Vegetables’) to 0.84 (‘Milk and dairy products’) and from 0.40 (‘curd’) to 1.00 (‘dosa’, ‘hoppers’, ‘milk rice’, ‘dried fish’) for specific food and beverages (Table 5). Eighty-five percent of surveyed food items showed correlations > 0.70, with three of the 34 items showing correlations between 0.56 and 0.69 (‘pasta/noodles’, ‘cooked vegetables’, and ‘cheese’) and two having correlations of 0.40 (‘curd’) and 0.43 (‘yoghurt’), both of which were underreported in the 24DR. These results indicate strong validity at the food group level for the SLBDS and for 85% of individual items, and moderate and low validity for nine and 6 % of items, respectively. Sex-disaggregated results show that correlations for ‘pasta/noodles’ (female: r = 0.38, male: r = 1.00), ‘pieces of large fruit’ (0.68, 0.85), ‘medium size sweets’ (0.60, 0.95), and ‘sweet fizzy drinks’ (0.67, 0.93) were weak or moderate in females compared to strong for males in those same categories. Correlations for ‘cooked vegetables’ (0.74, 0.65), ‘raw vegetables’ (0.83, 0.50), and ‘whole eggs’ (0.97, 0.68) were moderate in males compared to strong correlations reported for females. Only one food group, ‘Vegetables’ (0.82, 0.56), showed a comparatively weaker correlation for male than female participants.

Table 5 Spearman’s Rho between mean daily servings of food groups and specified foods recorded by the SLBDS and 24DR

Visual exploration of agreement between the SLBDS and 24DR using Bland-Altman plots (Fig. 2) showed that for ‘Rice, bread, other cereals and yams’, there is minimal difference between the intake recorded on the tested method compared to the reference method between 0 and 10 servings. At > 10 servings, the SLDBS tended to overestimate recorded intake compared with the reference method. ‘Vegetable’ intake was similarly measured by the two methods, with the SLBDS tending to slightly overestimate intake as the number of servings consumed increased. There was relatively little variation across all levels of intake for ‘Fruit’, showing acceptable agreement between the two methods. ‘Fish, pulses, meat and eggs’, ‘Milk and dairy products’, and ‘Nuts’ all tended to be slightly underestimated by the SLBDS compared to the 24DR as the number of servings consumed increased. For each category, less than 6% of participants fell outside of the limits of agreement (LA).

Fig. 2
figure2

Bland-Altman plots for (a) Rice, bread, other cereals and yams; (b) Fruit; (c) Vegetables; (d) Fish, pulses, meat and eggs; (e) Milk and dairy products; (f) Nuts. The size of data points is proportional to the number of observations at each value. ULA = upper limit of agreement; LLA = lower limit of agreement

Table 6 presents kappa (k) statistics and 95% confidence intervals for agreement between participant achievement of the SLFBDG recommendations calculated from the SLBDS and 24DR. k values range from 0.59 (95% CI: 0.32–0.86) for ‘Vegetables’ to 0.81 (95% CI: 0.66–0.96) for ‘Fruit’ indicating a moderate to strong level of agreement. Sex disaggregated kappa statistics (Table S2) do not indicate statistically significant sex-based differences.

Table 6 Cohen’s kappa for agreement between achievement of the Sri Lankan Food Based Dietary Guideline recommendations calculated from the SLBDS and 24DR

Table 7 presents kappa (k) statistics and 95% confidence intervals for food and beverage items (‘medium size desserts’; ‘medium size sweets’; ‘sweet fizzy drinks’; ‘sugar’; ‘jaggery’; ‘tea/coffee’) surveyed in the SLBDS for which numerical intake recommendations are not outlined in the SLFBDGs. We assigned consumption data in both the SLBDS and 24DR a score of 0 (if an intake of zero portions was reported) or 1 (if reported intake was > 0 portions) and calculated the kappa statistic for each. The calculated k values range from 0.71 (95% CI: 0.56–0.86) for ‘medium size sweets’ to 0.85 for both ‘medium size desserts’ (95% CI: 0.71–0.99) and ‘jaggery’ (95% CI: 0.65–0.92) indicating a strong level of agreement between the number of participants reporting consumption > 0 for the six food items listed above in both the SLBDS and 24DR. Sex-disaggregated kappa statistics (Table S3) show no evidence for sex-based differences in agreement.

Table 7 Cohen’s kappa for agreement between number of participants reporting consumption > 0 in both the SLBDS and 24DR

Table 8 presents kappa (k) statistics and 95% confidence intervals for yes/no SLBDS questions: “Did you consume Western or local fast food yesterday?” and “Did you add salt, sauce/ketchup or chutney/chilli paste to your breakfast/lunch/dinner/snack?”. A strong level of agreement between fast food reporting in the SLBDS and 24DR is indicated by high k values: 0.80 (95% CI: 0.68–0.93) for ‘Fast food’ (any type); 0.81 (95% CI: 0.68–0.95) for ‘local’; and 0.79 (95% CI: 0.64–0.94) for ‘Western’. Sex-disaggregated k values do not suggest statistically significant differences in fast food reporting on the two surveys between females and males (Table S4). K values for reporting of salt at different meal times are low, ranging from 0.03 to 0.09, indicating slight agreement between the number of participants reporting their salt consumption on the SLBDS and the 24DR. There is no evidence for sex-based differences in agreement for the reporting of salt intake (Table S4).

Table 8 Cohen’s kappa for agreement between number of participants reporting consumption of fast food and salt intake in both the SLBDS and 24DR

The SLBDS specifically queried oil (method, reheating, and amount) and coconut (fresh and powder) consumption. For both oil and coconut, no intake information was reported in the 24DR for either amount consumed or whether oil used in cooking was reheated. Conversely, a greater proportion of participants specified method of cooking with oil (for example, fried, deep fried, and tempered) in the 24DR (97%) compared with the SLBDS (71%). All k values for oil and coconut reporting were low, ranging from 0.00 to 0.15 (Table S5). Sex-disaggregated k values do not indicate significant differences in oil and coconut reporting between female and male participants (Table S7).

Discussion

The SLBDS was developed for and relatively validated with the study population in question to assess food intake and adherence to the SLFBDG recommendations for potential use as a dietary surveillance supplement and in multiple risk factor NCD studies. We have demonstrated its relative validity in comparison to a 24DR that has been previously validated against a 7DWR in the target population [19]. At the food group level, the SLBDS performed well. Correlations between intake recorded on the new and reference tool were strong (r > 0.73) and agreement between recommendation adherence calculated by the two tools was moderate to strong. At the food and beverage item level, 85% of surveyed items showed correlations > 0.7, with five of the 34 items showing correlations between 0.40 and 0.69. There was no evidence of difference in agreement between female and male participants.

It was not possible to compare salt and cooking oil intake as well as fresh and powdered coconut consumption between the two methods that were primarily intended to investigate food, and not nutrient, intake. The 24DR failed to capture any data on the amount of coconut, cooking oil, and salt consumed by participants. Difficulties and inconsistences in measuring self-reported added salt and oil intake are not unique to this study and are well documented in the literature [23,24,25]. This is in part due to the fact that salt and fats are often ‘hidden’ in foods; salt, oil, and coconut are not always added in exact amounts during cooking; and participants who are not involved in food preparation cannot be expected to accurately recall meal ingredients in dietary surveys. In the Sri Lankan context, capturing intake is further hindered by the absence of an updated, consensus nutritional composition database for Sri Lankan foods [26, 27]. Given nonoptimal intake of dietary fat and salt are established dietary risk factors for the development of NCDs and self-report measures are widely utilised in diet-disease research, accurate and appropriate measurement of these commonly consumed yet underreported nutrients remains a challenge [28,29,30]. Context-specific qualitative studies that explore how people use and consume coconut, oil, and salt, and importantly, how they report use and consumption in their own words are necessary for tool revision and improvement. Over 95% of participants recorded whether they added salt or salty sauce to meals (breakfast, lunch, dinner, and snack) when prompted by the SLBDS, as compared to 28% (snack) to 52% (breakfast) on the 24DR when asked about meal ingredients. This demonstrates the utility of the SLBDS in prompting reporting of salt intake data akin to that collected by the WHO STEPS instrument which asks participants ‘how often’ salt is added to food and cooking (with possible answers ranging from ‘Never’ to ‘Always’). However, in the absence of objective (for example, a 24-h urinary assessment) or repeat self-report measurements, we are unable to conclude which survey - the SLBDS or 24DR – reported ‘true’ intake. Multiple administrations of the SLBDS at non-consecutive time points would be required to capture daily variability and average consumption patterns – for salt and all other dietary components queried – over time. Prompting participants for information on oil reheating on the SLBDS was another feature of the SLBDS not present in the 24DR.

Study limitations

A key limitation of this study is that it only included participants from three of 25 districts in Sri Lanka, which limits the generalisability of findings. Collecting additional demographic data, including employment status, education, income, and whether or not survey participants are involved in food preparation would provide additional information to support SLBDS validity and subsequent context-specific improvements for different subsets of the population. This study assessed the relative validity of the SLBDS but did not investigate test-retest reliability – a key performance characteristic for the selection of dietary surveillance measures that capture ‘usual intake’. Further research with a larger and more diverse study sample that tests the validity and reliability of the SLBDS against an unbiased criterion measure of true intake or multiple ‘error-prone’ reference measures (convergent validity) is therefore required before the SLBDS can be utilised widely to measure the dietary intake of the Sri Lankan adult population [31, 32]. Study districts were selected to represent a range of Sri Lankan demographics. Participants in this study, however, were low consumers of certain food items. We therefore also recommend that the SLBDS be tested in populations with different patterns of consumption (see Table S7).

Implications of this research

Food consumption surveys provide vital information for the formulation, implementation, and evaluation of appropriate and effective diet-related policies and targeted programmes. A validated research tool that is able to assess the effectiveness of policies and programmes based on the SLFBDGs is therefore necessary to track progress towards national health and nutrition goals [33]. The SLBDS responds to this need, providing a contextually appropriate dietary surveillance measure that has clear public health relevance. Depending on the specific research question or intervention of interest (for example, a national education campaign to promote fruit and vegetable intake), single food groups that demonstrated strong correlation and agreement in the SLBDS can be queried in lieu of administering the SLBDS in its entirety or the more time and resource intensive 24DR, FFQ, and STEPS survey.

The more detailed 24DR captured intake of food/beverages not included on the SLBDS or in the SLFBDGs. This study did not assess the appropriateness or comprehensiveness of the current SLFBDGs that were last updated in 2011 or the health benefits of complying with guideline recommendations. Future research should focus on updating the SLFBDGs to continue to reflect population diets under conditions of nutrition transition and to integrate environmental sustainability considerations that contribute to the achievement of global environmental targets [34]. The health and environmental implications of adopting current and updated guideline recommendations should also be assessed – projects that might be assisted by or contribute to the continual improvement of the SLBDS.

This study supports a shift toward focussing attention on comparable surveillance outcomes (i.e. achievement of recommended daily intake for different food groups) over prioritising the consistent use of ‘off the shelf’ tools – a shift that may have implications for reducing errors associated with self-report dietary measurement methods [35]. The development of consensus portion size conversion guidelines for the Sri Lankan population would further facilitate the ability to compare study outcomes and make the survey innovation process and subsequent validation against existing tools easier for researchers.

Other dimensions of tool validation, including social validity – i.e. whether participants feel the SLBDS is an acceptable and important research tool – need to be explored through qualitative research. We would also like to explore online delivery of the SLBDS to further reduce administration and analysis burden; potential interviewer and social desirability bias; the time and cost associated with administering repeat surveys; and to support real-time translation of data for evidence-informed decision-making.

Conclusion

Addressing the problem of suboptimal diet requires context-specific solutions informed by context-specific data collected by context-specific tools. Our study shows that the SLBDS demonstrates promise as fit for purpose research tool to supplement and support dietary surveillance activities in Sri Lanka. The next step is to assess SLBDS test-retest reliability.

Availability of data and materials

The results of the study are reported in the main text and the supplementary information. Ethical approval for this study does not extend to the sharing of participant data. Please contact the corresponding author for further information.

Abbreviations

LA :

Limits of Agreement

LLA :

Lower Limit of Agreement

SLBDS :

Sri Lankan Brief Dietary Survey

SLFBDGs :

Food Based Dietary Guidelines for Sri Lankans

SLFFQ :

Food Frequency Questionnaire for Sri Lankan Adults

NCD :

Non-communicable disease

ULA :

Upper Limit of Agreement

WHO :

World Health Organization

24DR :

24-h Dietary Recall

References

  1. 1.

    GBD 2015 Risk Factors Collaborators. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1659–724.

    Article  Google Scholar 

  2. 2.

    World Health Organization. World health statistics 2020: monitoring health for the SDGs, sustainable development goals. Geneva: WHO; 2020.

    Google Scholar 

  3. 3.

    World Health Organization. Global action plan for the prevention and control of noncommunicable diseases 2013–2020. Geneva: WHO; 2013.

    Google Scholar 

  4. 4.

    Micha R, Coates J, Leclercq C, Charrondiere UR, Mozaffarian D. Global dietary surveillance: data gaps and challenges. Food Nutr Bull. 2018;39(2):175–205.

    Article  Google Scholar 

  5. 5.

    Willett W. Nutritional epidemiology 3rd ed. New York, NY: Oxford University Press; 2012.

    Book  Google Scholar 

  6. 6.

    Riley L, Guthold R, Cowan M, Savin S, Bhatti L, Armstrong T, et al. The World Health Organization STEPwise approach to noncommunicable disease risk-factor surveillance: methods, challenges, and opportunities. Am J Public Health. 2016;106(1):74–8.

    Article  Google Scholar 

  7. 7.

    Food and Agriculture Organization of the United Nations. Dietary assessment: a resource guide to method selection and application in low resource settings. Rome: FAO; 2018.

    Google Scholar 

  8. 8.

    Kim DJ, Holowaty EJ. Brief, validated survey instruments for the measurement of fruit and vegetable intakes in adults: a review. Prev Med. 2003;36(4):440–7.

    Article  Google Scholar 

  9. 9.

    World Health Organization. Global nutrition policy review: what does it take to scale up nutrition action? Geneva: WHO; 2013.

    Google Scholar 

  10. 10.

    McKenzie BL, Coyle DH, Burrows T, Rosewarne E, Peters SAE, Carcel C, et al. Gender differences in the accuracy of dietary assessment methods to measure energy intake in adults: protocol for a systematic review and meta-analysis. BMJ Open. 2020;10(6):e035611.

    Article  Google Scholar 

  11. 11.

    World Health Organization. Preparation and use of food-based dietary guidelines: report of a joint FAO/WHO consultation. Geneva: WHO; 1998. https://apps.who.int/iris/bitstream/handle/10665/42051/WHO_TRS_880.pdf?sequence=1.

  12. 12.

    Katulanda P, Constantine GR, Mahesh JG, Sheriff R, Seneviratne RD, Wijeratne S, et al. Prevalence and projections of diabetes and pre-diabetes in adults in Sri Lanka--Sri Lanka diabetes, cardiovascular study (SLDCS). Diabet Med. 2008;25(9):1062–9.

    CAS  Article  Google Scholar 

  13. 13.

    Katulanda P, Ranasinghe P, Jayawardana R, Sheriff R, Matthews DR. Metabolic syndrome among Sri Lankan adults: prevalence, patterns and correlates. Diabetol Metab Syndr. 2012;4(1):24.

    Article  Google Scholar 

  14. 14.

    Jayawardena R, Thennakoon S, Byrne N, Soares M, Katulanda P, Hills A. Energy and nutrient intakes among Sri Lankan adults. Int Arch Med. 2014;7:34.

    Article  Google Scholar 

  15. 15.

    World Health Organization. Non Communicable Disease Risk Factor Survey Sri Lanka 2015. 2015 [Available from: https://www.who.int/ncds/surveillance/steps/STEPS-report-2015-Sri-Lanka.pdf.

    Google Scholar 

  16. 16.

    Jayawardena R, Byrne NM, Soares MJ, Katulanda P, Hills AP. Validity of a food frequency questionnaire to assess nutritional intake among Sri Lankan adults. Springer. 2016;5:162.

    Article  Google Scholar 

  17. 17.

    Nelson M, Erens B, Bates B, Church S, Boshier T. 24-hour recall instructions. London: Kings College London.

  18. 18.

    Nutrition Division Ministry of Health. Food-based dietary guidelines for Sri Lankans. 2011.

    Google Scholar 

  19. 19.

    Jayawardena R. Comparison dietary assessment methods in Sri Lankan adults: use of 24-hour dietary recall and 7-day weighed intake. BMC Nutrition. 2016;2(1):18.

    Article  Google Scholar 

  20. 20.

    Gibson RS. Principles of nutritional assessment. 2nd ed. New York: Oxford University Press; 2005.

    Google Scholar 

  21. 21.

    Althubaiti A. Information bias in health research: definition, pitfalls, and adjustment methods. J Multidiscip Healthc. 2016;9:211–7.

    Article  Google Scholar 

  22. 22.

    Landis J, Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    CAS  Article  Google Scholar 

  23. 23.

    McLean RM, Farmer VL, Nettleton A, Cameron CM, Cook NR, Woodward M, et al. Twenty-four-hour diet recall and diet records compared with 24-hour urinary excretion to predict an individual's sodium consumption: a systematic review. J Clin Hypertens (Greenwich). 2018;20(10):1360–76.

    Article  Google Scholar 

  24. 24.

    McLean RM, Farmer VL, Nettleton A, Cameron CM, Cook NR, Campbell NRC. Assessment of dietary sodium intake using a food frequency questionnaire and 24-hour urinary sodium excretion: a systematic literature review. J Clin Hypertens (Greenwich). 2017;19(12):1214–30.

    Article  Google Scholar 

  25. 25.

    Jayawardena R, Byrne NM, Soares MJ, Katulanda P, Hills AP. Food consumption of Sri Lankan adults: an appraisal of serving characteristics. Public Health Nutr. 2013;16(4):653–8.

    Article  Google Scholar 

  26. 26.

    Perera WDA, Thaha SZ. Tables of food composition for use in Sri Lanka. Colombo: Supreme Printers Sri Lanka; 1989.

    Google Scholar 

  27. 27.

    Thamilni J, Silva KDRR, Sirasa MSF, Samarasinghe WLG. Food composition data in Sri Lanka: Past, present and future. 11th International Food Data Conference; Hyderabad, India; 2015.

    Google Scholar 

  28. 28.

    Wang Q, Afshin A, Yakoob MY, Singh GM, Rehm CD, Khatibzadeh S, et al. Impact of nonoptimal intakes of saturated, polyunsaturated, and trans fat on global burdens of coronary heart disease. J Am Heart Assoc. 2016;5(1):e002891.

    PubMed  PubMed Central  Google Scholar 

  29. 29.

    Afshin A, Sur PJ, Fay KA, Cornaby L, Ferrara G, Salama JS, et al. Health effects of dietary risks in 195 countries, 1990–2017: a systematic analysis for the global burden of disease study 2017. Lancet. 2019;393(10184):1958–72.

    Article  Google Scholar 

  30. 30.

    Eyres L, Eyres MF, Chisholm A, Brown RC. Coconut oil consumption and cardiovascular risk factors in humans. Nutr Rev. 2016;74(4):267–80.

    Article  Google Scholar 

  31. 31.

    Gleason PM, Harris J, Sheean PM, Boushey CJ, Bruemmer B. Publishing nutrition research: validity, reliability, and diagnostic test assessment in nutrition-related research. J Am Diet Assoc. 2010;110(3):409–19.

    Article  Google Scholar 

  32. 32.

    Kirkpatrick SI, Baranowski T, Subar AF, Tooze JA, Frongillo EA. Best practices for conducting and interpreting studies to validate self-report dietary assessment methods. J Acad Nutr Diet. 2019;119(11):1801–16.

    Article  Google Scholar 

  33. 33.

    Ministry of Health Nutrition and Indigenous Medicine Sri Lanka. National Multisectoral Action Plan for the Prevention and Control of Noncommunicable Diseases 2016-2020. Colombo; 2016.

    Google Scholar 

  34. 34.

    Springmann M, Spajic L, Clark MA, Poore J, Herforth A, Webb P, et al. The healthiness and sustainability of national and global food based dietary guidelines: modelling study. BMJ. 2020;370:m2322.

    Article  Google Scholar 

  35. 35.

    Dao MC, Subar AF, Warthon-Medina M, Cade JE, Burrows T, Golley RK, et al. Dietary assessment toolkits: an overview. Public Health Nutr. 2019;22(3):404–18.

    Article  Google Scholar 

Download references

Acknowledgements

We thank study participants for generously giving their time. Special thanks to Achini Weerasinghe for her administrative support and Dr. Ranil Jayawardena for sharing his expertise.

Funding

PS is funded by the BHF Intermediate Basic Science Research Fellowship (FS/15/34/31656). JR and MR are supported by the Nuffield Department of Population Health, University of Oxford. SF was supported by the Ministry of Health, Nutrition and Indigenous Medicine, Sri Lanka. NT is supported by the Department of Health, University of Bath.

Author information

Affiliations

Authors

Contributions

The corresponding author attests that all listed authors meet the authorship criteria and that no others meeting the criteria have been omitted. JR conceived and designed the study, analysed data, and drafted the manuscript. KW and PK supported study design. BK and SF collected data. MR, PS, NT, and PK supervised the project. MR, PS, SF, and NT provided manuscript feedback. All authors read and approved the final manuscript.

Corresponding author

Correspondence to J. Renzella.

Ethics declarations

Ethics approval and consent to participate

Written consent was obtained from all participants. Ethical approval was obtained from the ethical review committees of the Faculty of Medicine, University of Colombo (EC-18-111) and the Oxford Tropical Research Ethics Committee (OxTREC), University of Oxford (561–18).

Consent for publication

Consent for the publication of anonymised data for academic purposes was obtained from all participants.

Competing interests

The authors declare that they have no competing interests. The authors alone are responsible for the views expressed in this article and those views do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated. The opinions in this paper do not reflect the position of the World Health Organization.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Fig. S1.

Sri Lankan Brief Dietary Survey. Table S2. Cohen’s kappa for agreement between achievement of the Sri Lankan Food Based Dietary Guideline recommendations calculated from the SLBDS and 24DR, by participant sex. Table S3. Cohen’s kappa for agreement between number of participants reporting consumption > 0 in both the SLBDS and 24DR, by participant sex. Table S4. Cohen’s kappa for agreement between number of participants reporting consumption of fast food and salt intake in both the SLBDS and 24DR, by participant sex. Table S5. Cohen’s kappa for agreement between number of participants reporting cooking oil and coconut consumption data in both the SLBDS and 24DR. Table S6. Cohen’s kappa for agreement between number of participants reporting cooking oil and coconut consumption data in both the SLBDS and 24DR, by participant sex. Table S7. Number of participants that reported zero consumption on the SLBDS and 24DR.

Additional file 2.

Consolidated criteria for reporting qualitative studies (COREQ): 32-item checklist.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Renzella, J., Fernando, S., Kalupahana, B. et al. Relative validity of a brief dietary survey to assess food intake and adherence to national dietary guidelines among Sri Lankan adults. BMC Nutr 6, 68 (2020). https://doi.org/10.1186/s40795-020-00391-2

Download citation

Keywords

  • Diet
  • Survey
  • Validation study
  • Adults
  • Sri Lanka
  • 24-h dietary recall
  • Food based dietary guidelines