Neidio i’r prif gynnwys
English Cymraeg
Food Hygiene Rating Scheme Audit of Display and Business Survey 2021: Technical report

FHRS Audit 2021 Technical report: Telephone fieldwork

Information on the telephone fieldwork conducted for the Food Hygiene Rating Scheme Audit of Display 2021 report.

Diweddarwyd ddiwethaf: 12 September 2023
Diweddarwyd ddiwethaf: 12 September 2023

Cognitive testing

Between 14 September and 27 September, 2021, 10 cognitive interviews were conducted with food businesses to test the first draft of the questionnaire. These interviews involved running through the survey as it would be delivered during mainstage fieldwork, with follow-up discussions at the end of the survey to check the respondents’ understanding of terminology and the extent to which it was easy or difficult to answer questions. 

The survey performed well during cognitive interviews. Participating food businesses typically understood the questions asked and were able to answer them with relative ease. However, there were some questions where potential issues were identified and/or where improvements were recommended by participants. Small changes were therefore made to the questionnaire ahead of pilot fieldwork.   

Pilot fieldwork

Between 20 October and 22 October, 2021, IFF Research piloted the ECS with 50 businesses. Table 4.1 presents the number of interviews completed by county, sector and FHRS rating. 

Table 4.1 Profile of pilot interviews with food businesses

Country

Country Completed interviews
England 21
Northern Ireland 11
Wales 18

Sector

Sector Completed interviews
Accommodation 5
Pubs, bars and nightclubs 7
Restaurants, cafes and canteens 19
Retail 12
Takeaways and sandwich shops 5
Other catering premises 2

FHRS Rating

 

FHRS rating Completed interviews
0 to 1 1
2 1
3 3
4 8
5 37

Prior to the commencement of pilot fieldwork all interviewers received a briefing on the survey and were issued with written instructions, providing them with an understanding of the background to the research, the questionnaire design, the screening criteria and the sample design.

The pilot survey involved administering the survey exactly as it would be during mainstage fieldwork. As well as allowing for further checks on comprehension of questions and survey flow, the pilot provided an opportunity to monitor response patterns and the overall interview length. 

The results of the pilot were positive in that: the average duration was in line with the target duration; there were no issues with the screening process; there was limited feedback from interviewers regarding issues with participant comprehension; and businesses were generally willing to participate.

Following the completion of pilot fieldwork, minor refinements were made to the questionnaire to improve the clarity of questions asked and to add pre-coded responses that were not previously included. The final version of the questionnaire used in mainstage fieldwork can be found in Appendix B of this report.

Mainstage fieldwork

Mainstage fieldwork was carried out between November 15th and December 14th ,2021. A total of 1,500 food businesses were interviewed. Table 4.2 presents the number of interviews completed by county, sector and FHRS rating.

Table 4.2 Profile of mainstage interviews with food businesses

Country

 

Country Completed interviews
England 500
Northern Ireland 500
Wales 500

Sector

 

Sector Completed interviews
Accommodation 113
Pubs, bars and nightclubs 179
Restaurants, cafes and canteens 531
Retail 399
Takeaways and sandwich shops 197
Other catering premises 81

FHRS Rating

 

FHRS rating Completed interviews
0 to 1 18
2 25
3 111
4 292
5 1,054

As with the pilot, prior to commencement of mainstage fieldwork all interviewers received a briefing on the survey and were issued with written instructions. This ensured that interviewers understood the background to the research, the questionnaire design, the screening criteria and the sample design.

Checks were conducted on the final 1,500 interviews to ensure the data was robust before the beginning of analysis. This involved conducting data validation checks and identifying outlier responses.   

Response rate

A total of 11,518 records, acquired from the FSA’s FHRS database, were used over the course of the survey with food businesses. Of these, 419 records were ineligible, as the business reported that they did not sell, serve or prepare food for the public (361) or because the business was closed (58). 

Of the remaining 11,099 businesses, a further 9,082 records were in scope of the study, but not in the scope of fieldwork. For example, 6,374 records could not be reached during the fieldwork period and a further 1,401 records had an appointment set that could not be achieved in the fieldwork period (see table 4.3). 

Table 4.3 Survey outcome for sample in scope of the study 

Survey outcome Total Population in scope of study
Total in scope of study 11,099 100%
Businesses called 1 to 10 times but unable to reach target possible 6,374 57%
Appointment made but not achieved during fieldwork period 1,401 13%
Out of quota sector/size/country 577 5%
Not available in fieldwork period/nobody at site available 422 4%
Unobtainable numbers 308 3%
In scope of study but not in scope of fieldwork 9,082 82%
In scope of fieldwork 2017 18%

Response rate calculations do not include records that were outside of the scope of the fieldwork, given that no firm contact was made with these food businesses. This means that 2,017 records were in scope of fieldwork. Of these, 1,500 completed an interview. This equates to a response rate of 74% (see Table 4.4).

Table 4.4 Survey outcome for sample in scope of the fieldwork

Survey outcome Total Population in scope of study Population in scope of fieldwork
Total in scope of fieldwork

2,017

18% 100%
Achieved interviews 1,500 14% 74%
Refusals 444 4% 22%
Breakdown during interview 73 1% 4%

Overlap between the audit and telephone survey of food businesses

Of the 1,522 food businesses covertly audited, 272 also participated in the telephone survey. Table 4.5 presents the profile of these food businesses in terms of country, sector and FHRS rating. 

Table 4.5 Profile of food businesses both audited and surveyed

Country

Country Completed interviews
England 102
Northern Ireland 88
Wales 82

Sector

Sector Completed interviews
Accommodation 13
Pubs, bars and nightclubs 36
Restaurants, cafes and canteens 106
Retail 86
Takeaways and sandwich shops 25
Other catering premises 6

FHRS Rating

 

FHRS rating Completed interviews
0 to 1 0
2 5
3 17
4 57
5 193

The profile of the businesses that were both audited and surveyed broadly reflects the profile of the underlying population of businesses in terms of sector and FHRS rating. However, owing to the purposeful oversampling of Northern Irish and Welsh food businesses to ensure that robust base sizes were achieved for each country, the split between England, Northern Ireland and Wales differs from the underlying population.