Annex A: Food and You 2: Wave 4

Background

In 2018 the Advisory Committee for Social Science (ACSS) established a new Food and You Working Group to review the methodology, scope and focus of the Food and You survey. The Food and You Working Group provided a series of recommendations on the future direction of the Food and You survey to the FSA and ACSS in April 2019. Food and You 2 was developed from the recommendations.

The Food and You 2 survey has replaced the biennial Food and You survey (2010-2018), biannual Public Attitudes Tracker (2010-2019) and annual Food Hygiene Rating Scheme (FHRS) Consumer Attitudes Tracker (2014-2019). The Food and You survey has been an Official Statistic since 2014.

Previous publications in this series include:

• Food and You 2: Wave 1 Key Findings (March 2021)
• Food and You 2: Wave 2 Key Findings (July 2021) 
• Food and You 2: Wave 3 Key Findings (January 2022) 

Methodology

The Food and You 2 survey is commissioned by the Food Standards Agency (FSA). The fieldwork is conducted by Ipsos. Food and You 2 is a biannual survey. Fieldwork for Wave 4 was conducted from 18th October 2021 and 10th January 2022. 

Food and You 2 is a sequential mixed-mode ‘push-to-web’ survey. A random sample of addresses (selected from the Royal Mail’s Postcode Address File) received a letter inviting up to two adults (aged 16 or over) in the household to complete the online survey. A first reminder letter was sent to households that had not responded to the initial invitation. A postal version of the survey accompanied the second reminder letter for those who did not have access to the internet or preferred to complete a postal version of the survey. This helps to reduce the response bias that otherwise occurs with online-only surveys. This method is accepted for government surveys and national statistics, including the 2021 Census and 2019/2020 Community Life Survey. A third and final reminder was sent to households if the survey had not been completed. Respondents were given a gift voucher for completing the survey. Further details about the methodology are available in the Technical Report . Due to the difference in methodology between the Public Attitudes Tracker, FHRS Consumer Attitudes Tracker and Food and You survey (2010-2018) it is not possible to compare the data collected in Food and You 2 (2020 onward) with these earlier data. Comparisons can be made between the different waves of Food and You 2.

The sample of main and reserve addresses^(footnote) was stratified by region (with Wales and Northern Ireland being treated as separate regions), and within region (or country) by local authority (district in Northern Ireland) to ensure that the issued sample was spread proportionately across the local authorities. National deprivation scores were used as the final level of stratification within the local authorities - in England the Index of Multiple Deprivation (IMD), in Wales the Welsh Index of Multiple Deprivation (WIMD) and in Northern Ireland, the Northern Ireland Multiple Deprivation Measure (NIMDM).

Due to the length and complexity of the online questionnaire it was not possible to include all questions in the postal version of the questionnaire. The postal version of the questionnaire needed to be shorter and less complex to encourage a high response rate. To make the postal version of the questionnaire shorter and less complex, two versions were produced. The two versions of the postal survey are referred to as the ‘Eating Out’ and ‘Eating at Home’ postal questionnaires. All data collected by Food and You 2 are self-reported. The data are the respondents own reported attitudes, knowledge and behaviour relating to food safety and food issues. As a social research survey, Food and You 2 cannot report observed behaviours. Observed behaviour in kitchens has been reported in Kitchen Life, an ethnographic study which used a combination of observation, video observation and interviews to gain insight into domestic kitchen practices. This study will be updated through Kitchen Life 2, which is in progress now and due to report in 2023.
The minimum target sample size for the survey is 4,000 households (2,000 in England, 1,000 in Wales, 1,000 in Northern Ireland), with up to two adults in each household invited to take part as mentioned above. For Wave 4 a total of 5,796 adults from 4,026 households across England (2,940 adults), Northern Ireland (1,575 adults), and Wales (1,281 adults), completed the survey. An overall response rate of 28.5% was achieved (England 29.8%, Wales 29.1%, Northern Ireland 25.9%). Sixty-five per cent of respondents completed the survey online and 28.5% completed the postal version of the survey. The postal responses from 51 respondents were removed from the data set as the respondent had completed both the online and postal survey. Further details about the response rates are available in the Technical Report.

Weighting was applied to ensure the data are as close as possible to being representative of the socio-demographic and sub-groups in the population, as is usual practice in government surveys. The weighting applied to the Food and You 2 data helps to compensate for variations in within-household individual selection, for response bias, and for the fact that some questions were only asked in one of the postal surveys. Further details about weighting approach used and the weights applied to the Food and You 2: Wave 4 data are available in the Technical Report. 

The data have been checked and verified by six members of Ipsos and two members of the FSA Statistics branch. Descriptive analysis and statistical tests have been performed by Ipsos. Quantum (statistical software) was used by Ipsos to calculate the descriptive analysis and statistical tests (t-tests). 

The p-values that test for statistical significance are based on t-tests comparing the weighted proportions for a given response within that socio-demographic and sub-group breakdown. An adjustment has been made for the effective sample size after weighting, but no correction is made for multiple comparisons.

Reported differences between socio-demographic and sub-groups typically have a minimum difference of 10 percentage points between groups and are statistically significant at the 5% level (p<0.05). However, some differences between respondent groups are included where the difference is fewer than 10 percentage points when the finding is notable or of interest. Percentage calculations are based only on respondents who provided a response. Reported values and calculations are based on weighted totals. 

Technical terms and definitions

1. Statistical significance is indicated at the 5% level (p<0.05). This means that where a significant difference is reported, there is reasonable confidence that the reported difference is reflective of a real difference at the population level. 
2. Food security means that all people always have access to enough food for a healthy and active lifestyle (World Food Summit, 1996). The United States Department of Agriculture (USDA) has created a series of questions which indicate a respondent’s level of food security. Food and You 2 incorporates the 10 item U.S. Adult Food Security Survey Module and uses a 12 month time reference period. Respondents are referred to as being food secure if they are classified as having high food security (no reported indications of food-access problems or limitations), or marginal food security (one or two reported indications—typically of anxiety over food sufficiency or shortage of food in the house. Little or no indication of changes in diets or food intake). Respondents are referred to as being food insecure if they are classified is having low food security (reports of reduced quality, variety, or desirability of diet. Little or no indication of reduced food intake) or very low food security (reports of multiple indications of disrupted eating patterns and reduced food intake). 
3. NS-SEC (The National Statistics Socio-economic classification) is a classification system which provides an indication of socio-economic position based on occupation and employment status.
4. Index of Multiple Deprivation (IMD)/ Welsh Index of Multiple Deprivation (WIMD) / Northern Ireland Multiple Deprivation Measure (NIMDM) is the official measure of relative deprivation of a geographical area. IMD/WIMD/NIMDM classification is assigned by postcode or place name. IMD/WIMD/NIMDM is a multidimensional calculation which is intended to represent the living conditions in the area, including income, employment, health, education, access to services, housing, community safety and physical environment. Small areas are ranked by IMD/WIMD/NIMDM; this is done separately for England, Wales and Northern Ireland.

References

• Advisory Committee for Social Science (ACSS)
• Census 2011. Office of National Statistics 
• Duffy, B., Smith, K., Terhanian, G., & Bremer, J. (2005). Comparing data from online and face-to-face surveys. International Journal of Market Research, 47(6), 615-639. https://doi.org/10.1177/147078530504700602
• Food and You (2010-2019) 
• Food Standards Agency. Introducing Food and You 2. (March, 2020).
• Gaskell, G. (2019). Review of FSA’s Food and You Survey. 2 April 2019 ACSS Meeting – Food and You Review Report (Paper 3.5). 
• United States Department of Agriculture (USDA). Food security. 
• Wills, W., Meah, A., Dickinson, A., & Short, F. (2013). Domestic kitchen practices: Findings from the ‘Kitchen Life’ study. University of Hertfordshire Report for the Food Standards Agency 
• World Food Summit 1996, Rome Declaration on World Food Security.