Ystadegau twristiaeth ddomestig: datganiad ar adolygiad methodolegol
Mae'r datganiad hwn yn disgrifio adolygiad o'r fethodoleg ar gyfer ystadegau twristiaeth ddomestig dros nos a gynhaliwyd yn ystod gwanwyn/haf 2024. Saesneg yn unig.
Efallai na fydd y ffeil hon yn gyfan gwbl hygyrch.
Ar y dudalen hon
Introduction
The Great Britain Tourism Survey provides monthly estimates of the volume and monetary value of domestic overnight tourism, including the number of nights spent on overnight tourism. The results are produced monthly, quarterly and annually and are split by geography; therefore, consistent trend and regional data are essential. However, smaller sample sizes at nation (Scotland and Wales) or regional level make this challenging. Additionally, outliers can distort reported trip numbers, impacting trend analysis, as well as the reliability and accuracy of estimates.
In 2024, a thorough methodological review was conducted. The core aim was to reduce the volatility that was distorting estimates, while also maintaining accuracy. The review was completed in August 2024.
The review and subsequent methodological changes consisted of 7 phases.
Summary of review phases
Phase 1: review of data processing methodologies
Reviewing the current processing approach and examining the effectiveness of the following aspects in producing consistent and accurate data.
Phase 2: review of date allocation
The existing approach allocated trips and visits to specific reporting periods; and although these are reported as ‘months’ they do differ to ‘actual’ calendar months (due to 4-week and 5-week reporting periods). The possibility of moving to ‘whole-month’ reporting periods – where each month contains all trips that ended in that month, regardless of which days of the week they contained - was assessed.
Phase 3: test runs and data checking
BMG and the National Tourism Authorities (NTAs) had agreed that in the first instance the weights and the number of children associated with each adult on a trip needed to be capped. Caps were also applied or adjusted for the trip correction factor, the nights per trip and per adult per night spend.
Phase 4: recommendations
A number of recommendations were agreed and trialled, with the new approach being applied to Q4 data for 2022 and 2023. The results were very encouraging, with much of the volatility in the data being reduced.
Phase 5: full data re-runs
Final agreement of the new methodology and running of all 24 months data (January to December 2022 and 2023) with monthly and annual data files using the new rules and approaches. The new approach will be applied to all future data.
Below are the agreed methodological changes.
Category no. 1: weighting
Details of change
Age x gender and region updated to Census 2021 and 2022.
Reasoning
These are the most recent population statistics.
Category no. 2: weight capping
Details of change
Respondent level weights capped at 4.
Reasoning
Some respondents previously had a much higher weight than others, even reaching a weight of 12 on rare occasions.
Category no. 3: Seasonal Smoothing Factor (SSF)
Details of change
Set to 1.
Reasoning
No longer required due to the change in reporting dates to calendar month.
Category no. 4: Partial Reporting Factor (PRF)
Details of change
Adjusted by month to 2 or 2.25 as per the revised specifications. Further PRF analysis was conducted following the final run of the data, see PRF section for details.
Reasoning
The Partial Reporting factor needs to remain as the fieldwork approach has not changed, only the reporting approach (changed to full calendar month reporting). The new PRFs were calculated by month and will be applied in the data processing.
Category no. 5: nights
Details of change
Capped at 21 (reduced from 30).
Reasoning
The length of a trip in the last 4 weeks is capped to 21 days. The proportion of trips longer than 21 days is very small, but they can have a significant impact on Scotland and Wales monthly data.
Category no. 6: new fieldwork dates/reference periods
Details of change
Reporting on calendar month.
Reasoning
This helps prevent variance due to some reporting months being longer than others i.e. following the review, estimates for December 2022 and 2023 are now both based on 31 calendar days of December.
Category no. 7: cap on the CTCF (child trip correction factor; divides trip party children by trip party adults)
Details of change
Set to 4 for an average trip and 6 for a trip that's part of a larger group.
Reasoning
Trips with large groups of children have been found to consistently and significantly impact the stability of the statistics.
Category no. 8: cap on the CSCF (Child spend correction factor)
Details of change
Set to 2. (CSCF assumes a child costs 0.5 of an adult and then divides children among adults on the trip)
Reasoning
This is a future proofing measure as there was no significant impact in 2022 and 2023. However, there is potential for a large group spend to cause volatility in the data at the month level in Scotland and Wales.
Category no. 9: global caps for trips and spend. (bednights calculation remains the same)
Details of change
Set for England 1% for trips and 2% spend. For Scotland and Wales 2% for trips and 4% spend.
Reasoning
The programme already applies global caps to the data, however, following detailed analysis and discussion it was found that the caps needed to be tightened to create more stability at the monthly data level and for Local Authority level estimates.
Category no. 10: cap on spend per trip
Details of change
Added and set at £3,000 per record spend.
Reasoning
This ensured trip spend data was stabilised. Only a small proportion of trips in each nation each year are capped.
Category no. 11: category spend caps - per adult per night
Details of change
Updated to the values below
- Package, greater than £1,500
- Accommodation, greater than £700
- Travel, greater than £550
- Services (Services or advice, e.g. travel guides, tourist information), greater than £200
- Eating and drinking out, greater than £500
- Eating and drinking in accommodation, greater than £500
- Other shopping, greater than £600
- Entertainment, greater than £500
- Anything else, greater than £300
Reasoning
There were a number of spend caps on different spend categories that were deemed too low considering the rising cost of living since the inception of the programme.
Category no. 12: inflation
Details of change
Applied above spend caps to 2022. Increased the caps in 2023 by 9.2% (annual rate of inflation in 2022 according to CPIH (ONS))
Reasoning
This ensured trip spend data was stabilised. Only a small proportion of trips in each nation each year are capped.
Category no. 13: Trip Correction Factor (TCF)
Details of change
Set to 1, i.e., removed TCF.
Reasoning
This factor accounted for occasions when a respondent took more than 3 trips in the reporting period. Reviewing the data, the conclusion was made that these occasions were extremely rare and random, and consequently had an undesirable impact on volatility of data.
Phase 6: calibration
Following the data re-run, the impact on the key measures (trips, nights and spend) was assessed. The changes applied helped manage the volatility of the data. However, capping the data inevitably caused a loss of reported trips/nights/spend. To account for this loss of volume, and maintain accuracy, calibration was applied.
Phase 7: Partial Reporting Factor
The original methodology relating to the Partial Reporting Factor (PRF) assumes that the number of weekly fieldwork interviews completed are similar. However, at certain periods there were some unusual fluctuations in weekly completed interview numbers, with some weeks being lower than average. Revised PRFs were calculated, which account for these fluctuations using a weighted monthly average. Revised PRFs were applied to the months where the original PRFs differed the most from the revised PRFs.
Impact
An analysis of the data post methodological changes has demonstrated that the new approach addressed the objectives of the methodological review by improving stability, quality and trend analysis.
Contact details
Os oes gennych unrhyw gwestiynau, cysylltwch â'r corff perthnasol isod.
VisitEngland
Richard Nicholls
Head of Research and Forecasting
VisitEngland
3 Grosvenor Gardens
London
SW1W 0BD
E-bost: Richard.Nicholls@visitengland.org
Rhif ffôn: +44 207 578 1416
VisitScotland
Lesley Whitehill
Senior Tourism Insights Manager
VisitScotland
Insight Department
Ocean Point One
94 Ocean Drive
Edinburgh
EH6 6JH
E-bost: research@visitscotland.com
Rhif ffôn: +44 131 472 2222
Visit Wales
Joanne Starkey
Head of Tourism Research
Visit Wales
Welsh Government
Cathays Park
Cardiff
CF10 3NQ
E-bost: tourismresearch@gov.wales
Rhif ffôn: +44 300 061 6110