Is the adapted Household Food Insecurity Access Scale (HFIAS) developed internationally to measure food insecurity valid in urban and rural households of Ethiopia?

Abstract

Background

The concept of food insecurity encompasses three dimensions. One of these dimensions, the access component of household food insecurity is measured through the use of the Household Food Insecurity Access Scale (HFIAS). Despite its application in Ethiopia and other similar developing countries, its performance is still poorly explored. Our study aims to evaluate the validity of the HFIAS in Ethiopia.

Methods

We conducted repeated cross-sectional studies in urban and rural villages of the Butajera District in southern Ethiopia. The validation was conducted on a pooled sample of 1,516 households, which were selected using a simple random sampling method. The HFIAS was translated into the local Amharic language and tested for face validity. We also evaluated the tool’s internal consistency using Cronbach’s alpha and factor analysis. We tested for parallelism on HFIAS item response curves across wealth status and further evaluated the presence of a dose-response relationship between the food insecurity level and the consumption of food items, as well as between household wealth status and food insecurity. Additionally, we evaluated the reproducibility of the tool through the first and second round of HFIAS scores.

Results

The HFIAS exhibited a good internal consistency (Cronbach’s alpha for the values of rounds 1 and 2 were 0.76 and 0.73, respectively). A factor analysis (varimax rotation) resulted in two main factors: the first factor described a level of mild to moderate food insecurity, while the second factor described severe food insecurity. HFIAS item response curves were parallel across wealth status in the sample households, with a dose-response trend between food insecurity levels and the likelihood of previous day food consumption being observed. The overall HFIAS score did not change over the two rounds of data collection.

Conclusions

The HFIAS is a simple and valid tool to measure the access component of household food insecurity. However, we recommend the adaptation of questions and wordings and adding examples before application, as we found a discrepancy in understanding of some of the nine HFIAS questions.

Background

In its Plan of Action, the 1996 World Food Summit adopted a working definition on food security. This definition was redefined in 2001 by the Food and Agricultural Organization (FAO): “Food security [is] a situation that exists when all people, at all times, have physical, social and economic access to sufficient, safe and nutritious food that meets their dietary needs and food preferences for an active and healthy life” [1]. According to a recent estimate by the FAO, approximately 870 million people worldwide are undernourished, with 27% of these affected people residing in sub-Saharan African countries [2].

Food security is a complex issue with a multi-dimensional concept, which is based on multiple dimensions such as physical, social, and economic access, availability, amount, preferences for certain foods, security, and time [3]. The measurement of food insecurity at any given time captures one if not more of the three dimensions of food security: availability, utilization, and access. The food insecurity assessment based on the availability dimension is widely used and for the most part guides the responses to food insecurity [4]. However, it fails to capture the unequal distribution of food and is also unable to guarantee the utilization of food in a given population. An assessment of food insecurity based on the second dimension, utilization, is well captured through various anthropometric indicators, e.g., underweight, stunting, and wasting. Nonetheless, measurements based on the access dimension of food insecurity are not yet well established.

Food access, which reflects the demand side of food security, has recently been designated as one of the major contributors to food insecurity [5]. In 2006, the USAID-funded Food and Nutrition Technical Assistance Project, through the Academy for Educational Development, published a tool that measures the access component of household food insecurity. The tool was developed to be simple, easy to use, and applicable, with only minor adaptations to different sociocultural contexts. The tool captures three domains: i) anxiety and uncertainty about food access, ii) insufficient quality (variety, preferences, and social acceptability), and iii) insufficient food intake and the physical consequences [6].

The HFIAS has been shown to measure food insecurity with an acceptable standard in a few developing countries [7–10]. Even so, a lot has been done on measurements of the access component of food insecurity in developed countries such as the US [11]. The Core Food Security Module (CFSM), which has a similar structure with that of the HFIAS, is currently being used to measure the access component of food insecurity in the US. The CFSM is based on a set of 18 questions for households with children and 10 questions for households without children, and the frequencies of affirmative responses to these questions are used to discriminate households into three levels of food insecurity [12].

Maes and colleagues have attempted to validate the HFIAS among volunteer AIDS caregivers in Addis Ababa, Ethiopia [9]. The authors reported that the tool performed well in capturing the access component of food insecurity among the study participants, who were special groups of people and may not represent the general population.

However, despite the increasing application of the tool in Ethiopia, its performance remains underexplored. The results of this study will help to strengthen the applicability of the tool and its performance for measuring progress and to monitor and evaluate different programs focusing on household food insecurity.

Methods

Study setting

The study was conducted in the Butajera District of southern Ethiopia, which is located approximately 130 km from Addis Ababa (the capital city of Ethiopia) in the Guraghe Zone in the Southern Nations Nationalities and People’s Region (SNNPR). The district houses a Rural Health Program (BRHP) (owned and operated by Addis Ababa University), which is a health and demographic surveillance system (HDSS) with a continuous registration of vital and migratory events among ten selected villages. The studied district was purposely selected for the benefit of a better sampling frame and research infrastructure.

Study design and period

A community-based, cross-sectional study design was employed between November and December 2013. We administered the survey questionnaire twice to the study participants, and the second survey questionnaire was administered to the study participants after 7 days of the first administration. This repeated survey was used to determine the reproducibility of the household food insecurity assessment tool (HFIAS).

Study population and sampling

The study included a total of ten HDSS villages, of which nine were rural and one was urban, and the study population included households residing in these villages.

The sample size for the study was estimated using the formula for a single population proportion. Assuming an 80% prevalence of household food insecurity [13], a 95% confidence level, a 4% margin of error, and a design effect of 2, the calculated sample size was 768 households. With an expectation of a 5% non-response rate, the final sample size required was approximately 800 households.

The final sample size was allocated to the ten HDSS villages proportionate to the number of households in each village. We then used BRHP data set as a sampling frame and applied a simple random sampling method to select study households within a given village.

Data collection

The HFIAS is composed of nine items, which are asked with a recall period of 1 month. For each item, there was a follow-up of the frequency of the occurrence question. The tool was also translated into the Amharic (local) language by one of the authors (SHG) and initially reviewed with research assistants who were residents in the study area.

Face validity

We discussed all nine questions independently with four urban and four rural households in the neighboring villages, basically aiming at whether the questions were clear, easily understandable, and had a minimal amount of multiple interpretations. We read the nine questions to the women, and the responses were recorded. This was followed by a question about how the women understood each question. For example, we asked: “What do you understand when I ask you the question: In the past four weeks, were you or any household member not able to eat the kinds of foods you preferred because of a lack of resources?” We compared their understanding with that of the primary aim of the questions, and when there was a difference between what they understood and what we were actually looking for, a discussion followed on how that question could best be framed to make it clearer and contextually appropriate. Lastly, together with these women, the nine questions were adapted through modification, rephrasing, and adding examples when necessary.

We collected food groups that a household had consumed over the preceding 24 h [14], with the household food intake structured using the consumption of 12 food groups/item. The food groups included meat, fish, vegetables, fruits, eggs, potatoes, and other roots/tubers, beans, cereals/breads, oil, fat or butter, sugar or honey, as well as other types of foods such as coffee and tea.

Moreover, a range of sociodemographic data about the respondents such as age, education, religion, marital status, and occupation was collected, in addition to household-level data such as ownership and size of land, type of house and construction materials, availability of fixed assets such as radio, television, phone, bed and chair, and other household items, possession of domestic animals, type of water source for drinking and cooking, and availability and type of latrine.

Interviews were conducted by 20 trained and experienced junior nurses who are residents of the local district and had similar data collection experiences. The work was monitored by six supervisors, and interviews were primarily conducted with women in the household, as women are commonly responsible for food preparation in the study area. If women were unavailable, another adult who was present and ate in the household the previous day was asked.

Quality control

Questionnaires were controlled for completeness and logical errors, and where errors were found, the questionnaires were redone. Consistency checks were done to improve the quality of the data, and inconsistent entries and responses were crosschecked with the questionnaires and corrected accordingly.

Ethical clearance

The study protocol was approved by institutional review boards from the Addis Ababa University, College of Health Sciences. The study was also approved by the Regional Committee for Medical and Research Ethics, Western Norway (REK Vest). Information on the research objective was read to the participants, verbal informed consent was received, and the privacy and confidentiality of respondents was also maintained.

Data entry and analysis

We used EpiData Version 3.1 for the data entry, and the data was exported to Stata 11.0 (StataCorp, College Station, TX) for cleaning and further analysis.

Household wealth was constructed through a principal component analysis (PCA) of the household-level data described above. The PCA was done independently for urban and rural samples, and the score was then used to assign sampled households into quintiles that indicate poorest, poor, medium, rich, and richest.

The results from HFIAS delineate households across the four levels of food insecurity, including food secure, mild food insecure, moderate food insecure, and severely food insecure. The procedure and steps used to assign households to one of the levels is described elsewhere [3].

Factor analysis

An exploratory analysis was conducted on the nine items, using a Horn’s parallel analysis (PA) to determine the number of factors to retain. PA is a Monte Carlo-based simulation method that compares observed eigenvalues with that obtained from uncorrelated normal variables.

Validation

We evaluated the validity of the nine-item food insecurity assessment tool based on the following recommended criteria employed by a few similar studies [9, 15, 16].

The first criterion is the value of the Cronbach’s alpha, which is a measure for internal consistency, approaching 0.85 for the two rounds of surveys. Secondly, we tested for parallelism on HFIAS item response curves across wealth status, which was done by comparing the likelihood of affirmative responses to the nine items across households’ wealth quintiles.

Thirdly, we evaluated the presence of a dose-response relationship between food insecurity level and the previous day consumption of certain food items. We also tested for a dose-response relationship between household wealth status and food insecurity levels and used the extended Mantel-Haenszel chi square for linear trend to check for dose-response relationships.

Additionally, the reproducibility between the first and second HFIAS scores (HFIAS overtime) was estimated by means of a paired t-test.

Results

Sample characteristics

A total of 1,516 households (767 in the first round and 749 in the second round) were studied across the two rounds of data collection. The response rate for the first and second round of data collection was 96% and 98%, respectively, and we included 1,056 and 460 households from rural and urban villages, respectively.

The sample characteristic of the study population is shown in Table 1, and the mean age (year) of the respondents was 36.9 years. The age distribution indicated that 33% and 45.2% of respondents were in the age group between 14–29 and 30–45, respectively, and the great majority were Muslims (73.7%), rural residents (69.6%), and married (65.1%). Occupationally, 32.5% were housewives and 31.3% were a combination of a housewife/farm worker.

Table 1 Sample characteristics of households by rounds of data collection, Ethiopia 2013

Responses to the nine HFIAS items

As seen in Table 2, affirmative responses for the items ranged from 2.0% to 76.1% and 0.1% to 80.3% among urban and rural samples, respectively. We found that affirmative responses were highest for items showing mild to moderate forms of food insecurity such as worry about food, unable to eat preferred foods, eating a limited variety of food items, and eating smaller or fewer meals a day. Among urban samples, the item that received the highest affirmative response was item 3: “…Did you or any household member have to eat a limited variety of foods?” For the rural samples, item 2:“Were you or any household member not able to eat the kinds of foods you preferred?” received the highest affirmative response. Affirmative responses for items 7, 8, and 9, which indicates severe forms of food insecurity, were low. Of the nine items, the item: “Eat food that I really did not want to eat” received the lowest affirmative responses in both the urban and rural samples.

Table 2 Affirmative responses to items on the Household Food Insecurity Access Scale (HFIAS) in urban and rural settings, Ethiopia, 2013

Face validity

We conducted a total of eight interviews (four each among rural and urban households), with the main aim of these interviews being to get the wording right for the specific context of the use of the HFIAS. We found that four of the nine questions were not straightforward and needed to be modified in either way for a better understanding. We discussed with these nine women how to best frame these questions to help make them clearer and contextually appropriate without losing the main aim of these questions. The questions that needed modifications, rephrasing, or adding examples were items 2–4 and item 6 (Table 2). The remaining five questions were kept in their original form since they were not difficult to understand and did not have multiple interpretations.

According to these interviews, we found a higher likelihood of affirmative response to the item “unable to eat preferred food.” This item was restructured, and examples were necessary to reflect a preferred food according to the respondent’s own economy, rather than a general preference. Interviewees better understood the item “…limited variety of foods” if the item was translated with a core meaning of “monotonous diet” or “almost the same meal every time.” The item “…eat food that you really don’t want to eat” was also rephrased as food items that are not eaten under normal circumstances, but could be eaten during times of hardship, such as during a severe food crisis or a severe drought. Two to three meals per day were considered as a normal meal frequency in the study district. Hence, the item “…eat fewer meals a day” was modified as “…eat less than two-three meals per day.” In summary, the key adaptations we made included rephrasing, adding local (context-specific) examples, as well as specifying the name of the previous month. Furthermore, the importance of explaining the objective of the study in detail prior to initiating the interview process was found to be vital in obtaining a correct response.

Exploratory analysis

A factor analysis (varimax rotation) of the nine HFIAS questions resulted in two main factors for both urban and rural samples (in fact, the analysis resulted in nine factors, though the PA indicated to retain two factors). The first factor loaded most highly on the first five HFIAS items (except for item 4), while the second factor loaded most highly on the last three items (Table 3). The first factor seems to describe the level of a mild to moderate form of food security, while the second factor seems to describe the level of a severe form of food insecurity. Factors 1 and 2 together explained 56.7% and 54.3% of the nine questions’ combined variance for rural and urban samples, respectively.

Table 3 Factor loadings for rotated component matrix for households’ responses to nine questions by residency, Ethiopia, 2013

Internal consistency

The internal consistency analysis showed that the Cronbach’s alpha values for the overall sample (both rural and urban samples) for rounds 1 and 2 were 0.73 and 0.73, respectively (Table 4), whereas the Cronbach’s alpha values were relatively higher among urban residents compared to those among rural residents in the two rounds of data collection.

Table 4 Internal consistency (Cronbach’s alpha) by rounds of data collection and residency, Ethiopia 2013

Parallelism

Figures 1 and 2 show HFIAS item response curves across household wealth status in the urban and rural villages of the study district. HFIAS item response curves were parallel across wealth status in urban households, and with the exception of HFIAS item 4, we observed that the likelihood of affirmative responses decreased as the household wealth status increased. When compared to the urban sample, a similar but less clear pattern is observed for rural households.

Figure 1

HFIAS item response curves across household wealth quintile strata among 233 urban households. In the town of Butajera, Ethiopia, 2013. Observations across two data collection rounds are pooled (combined n = 460).

Figure 2

HFIAS item response curves across household wealth quintile strata among 534 households. In the rural villages of Butajera, Ethiopia, 2013. Observations across two data collection rounds are pooled (combined n = 1,056).

Food insecurity level and food intake

Among rural sample households, a dose-response trend between the food insecurity level and the likelihood of the previous day’s consumption of food items such as eggs, milk, fish, cereals, and beans was observed. For example, the likelihood of the previous day’s consumption of milk among food-secure households was 39.8% compared with 11.6% for severely food-insecure households. Similarly, the likelihood of the previous day’s consumption of eggs among food-secure households was 10.2% as compared with 2.1% for severely food-insecure households. The observed trend between food-secure and food-insecure households was significant for eggs (p < 0.018), milk (p < 0.01), fish (p < 0.01), cereals (p < 0.01), and pulses (p < 0.01), with the result also indicating that some food items such as vegetables and roots were less sensitive to household food insecurity levels. These food items are common staples in the diet for the rural parts of the studied district.

Among urban sample households, with the exception of the consumption of fish, dose-response trends between food insecurity level and the likelihood of the previous day’s consumption of other food items were observed. Additionally, the observed trends between food-secure and food-insecure households were also significant for all the food items that showed a dose-response trend.

FI severity and household wealth status

We found a significant and positive dose-response trend (p < 0.01) between household wealth status and levels of food security among rural and urban samples. With the exceptions of minor deviations between the two lowest (poorest and poor) strata, an increase in household wealth has been accompanied by an improved household food security.

An inverse but significant dose-response trend between (p < 0.01) household food insecurity level and wealth status was found among the urban samples (Figure 3). In the urban samples, a decrease in household wealth is accompanied by a higher household food insecurity level, though we did not find a significant dose-response trend between the household wealth and food insecurity level among rural households.

Figure 3

Food security and severe FI as a function of wealth quintile strata. Among 534 rural and 233 urban households in the Butajera, Ethiopia, 2013. Observations across two data collection rounds are pooled (combined n = 1,516).

FI over time (reproducibility)

The overall HFIAS score did not change over the two rounds of data collection. The HFIAS scores for the first and second round of data collection were 6.1 ± 4.5 and 6.3 ± 4.2, respectively (Table 1), while the HFIAS score for the urban sample did not show a statistically significant difference across the two rounds of data collection. However, we found an increase in the HFIAS score for rural samples during the second round of data collection, and the difference in HFIAS score between the two rounds was also statistically significant (mean difference: -0.58; 95% CI: -1.07, -0.083).

Discussion

In this study, we validated an adapted version of the HFIAS developed to measure the access component of food insecurity among both rural and urban households of the Butajera District in Ethiopia. We evaluated the tool for its internal consistency, criterion validity, and reproducibility through two rounds of data collection, and our results indicate that the tool had a satisfactory internal consistency and reproducibility and performed well with minor deviations to the set criteria. The HFIAS required minor modifications such as rephrasing words, the use of local ways of expressing the questions, and adding local examples to the nine items. Most importantly, we found that providing information during the consent process on the objectives of the administration of the instruments (surveys) helped modify the respondent’s expectations and get the nearest accurate responses.

A factor analysis of the nine HFIAS items discriminated between two main components, which indicate the degrees of household food insecurity level. Similar to our study, a validation study from Iran [10] reported two components. The main difference was that in our study, the second factor loaded on the last three items, which indicates severe forms of food insecurity, while the study from Iran reported that the second factor loaded on the last four items. Knupeel et al. [8] also reported (i) insufficient food quality and (ii) insufficient food intake as the two main factors that emerged after a rotated principal component factor analysis. Unlike the domain described by Coates et al. [3], our study showed that the first item does not appear to form a separate domain and was loaded to the first principal component. In addition to this, the fourth item does not appear to represent any specific domain.

The items that indicate a moderate food insecurity (FI) are experienced more frequently than those that indicate severe forms of FI on the HFIAS. The nine HFIAS items are sequenced in order of an increasing severity of household food insecurity [6]. In this scale, the first and ninth items are the least and most severe indicator of food insecurity, respectively. However, we found a lack of this sequential pattern on some of the nine items, e.g., for item 1: “Did you worry about having enough food?”, which according to the scale should receive the highest percentage of affirmative response. Even so, the item actually only received the third highest percentage of affirmative responses. Although we cannot totally rule out the possibility of the respondent’s difficulties in understanding the items, households in FI areas could adapt themselves to the existing food shortage, and “worrying” may not be the immediate response to household food shortages. Knupeel et al. [8] similarly documented a reduction in the quality and quantity of food as a first response, rather than expressing a worry about food shortage. The authors suggest that the severity of FI in these areas could alter a household’s response to the item.

Another example is that the percentage of households with an affirmative response on the item “…eating fewer meals?” was higher than that for the item “…eating smaller meals?”, which was documented among rural samples. Households in the rural areas may respond to food insecurity primarily through eating fewer meals, followed by eating smaller meals. This lack of order could indicate the contextual differences in responses to the level of FI in the households [17]. Hence, a further investigation on the order of experience of the nine items in the scale in response to the progression of household FI is warranted.

Cronbach’s alpha values reported by other similar studies were relatively higher (α >0.80) than those by ours [8–10, 16, 18–22]. However, the internal consistency of HFIAS in this study is satisfactory for its application [23], and minor deviations of parallelism on the last three items were observed among the rural samples. We think that these deviations might indicate that the poor and poorest strata may have employed different coping mechanisms than the relatively rich strata. Similar deviations were also reported elsewhere [9], with the authors explaining that income strata may not necessarily translate into access to diet, as there could be less significant practical differences across the income strata.

The mean HFIAS score did not change over the two rounds of data collection for the overall sample, which shows in part that the HFIAS has a very good reproducibility to measure and capture household FI. Nevertheless, we observed a lack of reproducibility among rural samples. We do not think that changes in the HFIAS could be a real phenomenon since the interval between the administration of the first and second questionnaire was shorter (7 days), and changes related to FI are not expected. Moreover, we did not observe a significant change in household dietary diversity scores between the two rounds. Households’ expectations of support after the survey and respondent’s change during the second survey might be possible explanations for the lack of reproducibility among the rural samples.

Limitations and strengths of the study

Our study has some limitations that warrant consideration. The study was done in one of the nine regions of Ethiopia where the applicability of the findings may be limited to similar groups in southern Ethiopia. Respondent understanding of the nine items and expectations of possible support may have also influenced the results, and respondents could lean towards affirmative responses. Furthermore, in the absence of an established gold standard for household food insecurity, it becomes difficult to discuss the external validity of the HFIAS.

Among the main strengths of this study are the inclusion of urban and rural residents, the employment of a relatively larger sample size, and the application of a simple random sampling method to recruit households. These could help strengthen the generalizability of the findings and its application to similar contexts. We also administered two rounds of surveys in the same households to evaluate the repeatability of the HFIAS. However, this validation study was done at the household level, so further work might be needed to evaluate whether the tool can perform well if applied at the individual level (e.g., with adolescents) to help measure FI.

Conclusions

We conclude that the HFIAS is a simple and valid tool to measure the access component of household FI in urban and rural settings. However, we recommend a modification of the questions before application because we found a discrepancy in understanding on some of the nine HFIAS questions. We recommend further studies in other parts of the country, as variations in sociocultural settings could influence the successful application and validity of the tool. Moreover, we recommend that further works should also focus on identifying the correct sequence of the nine items in response to the severity of household FI. The order of progression of the nine items in the HFIAS (in the context of the level of household food insecurity) will have its own implications for the assignment of households to the different categories of food insecurity.