By Steve Matthews, Kyle Virgin and Ramdane Djoudad—Statistics Canada
This special-edition article provides nontechnical answers to questions related to the production, use and interpretation of advance indicators for Statistics Canada's Monthly Survey of Manufacturing, Monthly Wholesale Trade Survey and Monthly Retail Trade Survey. Organized as a set of frequently asked questions, this reference document complements the technical documentation on definitions, data sources and methods available for individual programs. It is composed of two sections. Section 1 reviews concepts and definitions that are central to the production of advance indicators, while Section 2 relates to the analysis and interpretation of these special statistical products.
Section 1: Context, definitions and terminology
1 What is an advance indicator?
Advance indicators are statistical estimates designed to provide early information on economic activities for a given reference period. For the surveys listed above, advance indicators are generated when information for a portion of respondents has been received but data collection is still underway. Advance indicators for monthly manufacturing, wholesale trade and retail trade are typically published 21 to 25 days after the end of a reference month, while preliminary indicators are published approximately one month later. For example, the monthly retail advance indicator for the January reference month would be published in February (21 to 25 days after), while the preliminary indicator for January would be published in March (one month later). Therefore, a February publication would showcase a preliminary indicator for December, as well as an advance indicator for January.
Chart 1 shows the average number of days to publish advance, preliminary and revised indicators for the three programs following the end of the reference month.
Chart 1 - Average day of publication, by program
Description - Average day of publication, by program
Program | Advance | Preliminary | Revised |
---|---|---|---|
Manufacturing | 25 | 45 | 76 |
Wholesale | 25 | 46 | 77 |
Retail | 21 | 52 | 82 |
2 What led Statistics Canada to publish advance indicators?
Statistics Canada first published advance indicators in 2020. This work was done primarily to provide users with more timely information, given the economic uncertainty that arose from the COVID-19 pandemic. Demand was high for advance indicators to monitor the economic impacts of COVID-19 in different areas of the Canadian economy and to provide early signals and information about the direction of trends. By using early respondent data, Statistics Canada was able to compile timely and reliable economic signals based on observed data.
Program | Reference month of first release of advance indicator |
---|---|
Monthly Retail Trade Survey | April 2020 |
Monthly Survey of Manufacturing | May 2020 |
Monthly Wholesale Trade Survey | August 2020 |
3 How does Statistics Canada produce advance indicators?
Statistics Canada uses a technique called flash estimation to produce advance indicators for selected survey programs. Flash estimation refers to a type of advance indicator that uses the same methods used to produce preliminary indicators, but these methods are applied to a more limited dataset, at an earlier point in time. For example, to produce the advance retail trade indicator, only responses that have been received by a predetermined point in the collection period are used. Once collection is complete, the same non-response treatments and weighting methods are used on the full set of received data, which is then used to produce the preliminary indicator.
The amount of collected data incorporated into an advance indicator varies from month to month and across surveys. Table 1 shows that in 2023, the average response rates for advance indicators (rounded to the nearest percentage point) were 68% for the Monthly Survey of Manufacturing, 59% for the Monthly Wholesale Trade Survey and 45% for the Monthly Retail Trade Survey. These response rates are typically published along with each advance indicator to provide users with information on the quality of that month's figure.
Program | Advance indicator | Preliminary indicator | Revised indicator |
---|---|---|---|
Manufacturing | 68% | 87% | 94% |
Wholesale trade | 59% | 69% | 75% |
Retail trade | 45% | 83% | 88% |
The monthly gross domestic product (GDP) by industry program uses the advance indicators discussed in this article to compile its own advance indicators of GDP. More information on estimates of monthly GDP can be found in Revisions to Canada's GDP.
Figure 1 illustrates the published month-to-month movements for sales in manufacturing, wholesale trade and retail trade throughout the 2023 reference year. The advance, preliminary and revised indicators are highly coherent, in terms of both the direction (increase or decrease) and the magnitude of the month-to-month change in sales.
Figure 1 - Comparison of month-to-month movements from advance, preliminary and revised indicatorsFootnote 1
Description - Month-to-Month Movements for Sales in Manufacturing, 2023
Advanced indicator | Preliminary indicator | Revised indicator | |
---|---|---|---|
January | 3.9 | 4.1 | 4.5 |
February | -2.8 | -3.6 | -3.6 |
March | 0.7 | 0.7 | 0.8 |
April | -0.2 | 0.3 | -0.1 |
May | 0.8 | 1.2 | 1.2 |
June | -2.1 | -1.7 | -2.0 |
July | 0.7 | 1.6 | 1.6 |
August | 1.0 | 0.7 | 1.0 |
September | -0.1 | 0.4 | 0.7 |
October | -2.7 | -2.8 | -2.9 |
November | 1.2 | 1.2 | 1.5 |
December | -0.6 | -0.7 | -1.1 |
Description - Month-to-Month Movements for Sales in Wholesale, 2023
Advanced indicator | Preliminary indicator | Revised indicator | |
---|---|---|---|
January | 3.0 | 2.4 | 2.6 |
February | -1.6 | -1.7 | -1.4 |
March | -0.4 | -0.1 | -1.1 |
April | 1.6 | -1.4 | -1.4 |
May | 3.5 | 3.3 | 2.5 |
June | -4.4 | -2.8 | -1.4 |
July | 1.4 | 0.2 | 0.0 |
August | 2.6 | 2.3 | 1.8 |
September | 0.0 | 0.4 | -0.6 |
October | -1.1 | -0.5 | -0.3 |
November | 0.8 | 0.9 | 0.9 |
December | 0.8 | 0.3 | -0.3 |
Description - Month-to-Month Movements for Sales in Retail, 2023
Advanced indicator | Preliminary indicator | Revised indicator | |
---|---|---|---|
January | 0.7 | 1.4 | 1.6 |
February | -0.6 | -0.2 | -0.2 |
March | -1.4 | -1.4 | -1.5 |
April | 0.2 | 1.1 | 1.0 |
May | 0.5 | 0.2 | 0.1 |
June | 0.0 | 0.1 | 0.1 |
July | 0.4 | 0.3 | 0.4 |
August | -0.3 | -0.1 | -0.1 |
September | 0.0 | 0.6 | 0.5 |
October | 0.8 | 0.7 | 0.5 |
November | 0.0 | -0.2 | -0.0 |
December | 0.8 | 0.9 | 0.9 |
4 Are there other approaches that can produce advance indicators?
Besides flash estimation, nowcasting is another method that can be used to produce advance indicators. In contrast to flash estimation, nowcasting encompasses more types of advance indicators that use either different input data or different compilation methods than preliminary indicators. For example, a nowcast may include estimators based entirely on models that use information from alternative sources available at the time when the model is applied to generate the nowcast. Similar to flash estimation, nowcasting models typically yield advance indicators that are less precise than preliminary indicators.
An important distinction exists between advance indicators produced at Statistics Canada and what are commonly referred to as forecasts. Typically, forecasting models are used to project data forward to describe future reference periods and as a consequence no information is available on the reference period of interest. The absence of observed data in forecasts increases the risk of inaccurate results because models rely on the assumption that historical trends and patterns will continue. In contrast, Statistics Canada incorporates some form of observed data in the production of advance indicators. Advance indicators released by Statistics Canada use direct observations as much as possible, such as data received from respondents or administrative data for a reference period of interest. The appropriate use of these data reduces the risk of large differences between advance indicators and preliminary indicators.
Section 2: Issues related to analysis and interpretation
1 What are the strengths and weaknesses of advance indicators?
Advance indicators provide timelier information to users; however, they are less precise than preliminary and revised indicators produced at a later date. Statistics Canada follows a multidimensional framework to assess data quality (Statistics Canada, 2019), including the dimensions of accuracy and timeliness. Statistical products typically aim to strike a balance between these dimensions to best meet the needs of data users. In this particular framework, advance indicators are intended to be timelier, with some compromise in accuracy. Because of this compromise in accuracy, the advance indicators are published at more aggregated levels of detail, such as the national level rather than the provincial level, compared with preliminary and revised indicators. They are also not released through the official Statistics Canada data repository but are only disseminated as part of articles in Statistics Canada's official release bulletin, The Daily.
2 How is the quality of advance indicators monitored?
Before this initiative, studies demonstrated that publishing advance indicators would provide a desirable balance of data timeliness and accuracy for users. In particular, the criteria used for accuracy accounted for the direction and the magnitude of relative month-to-month movements. This element is particularly important because it identifies turning points in a time series; the magnitude of movements is a key consideration because it estimates the pace of economic change. The historical performance of advance indicators produced with flash estimation was assessed, and these indicators outperformed forecasting and nowcasting methods with comparable timeliness. Furthermore, advance indicators can be generated approximately one month earlier than preliminary indicators.
Each month, Statistics Canada compares advance indicators with the preliminary indicators that follow for the same reference period to monitor the size of the differences between them, as well as their coherence in terms of the direction of the month-to-month movement.
Additionally, a comprehensive review of advance indicators and their past performance is conducted periodically. This review includes analysis of descriptive statistics over time, as well as any noteworthy differences observed for individual reference periods.
3 Why are advance indicators and preliminary indicators different?
Since advance indicators are derived using the same methods as preliminary indicators, they are subject to the same types of sampling and non-sampling errors, but with different sensitivities to these sources of error. The differences between advance and preliminary indicators can be attributed to the following sources:
- Responses received after the production of advance indicators: Imputation, designed to produce unbiased and accurate aggregate estimates, is used to estimate values for each non-responding unit when advance indicators are produced. If an individual unit does not respond in time for the advance indicator but provides a response before the preliminary indicator is produced, this causes a difference between the advance and preliminary indicators. Large differences can occur when individual units have notable differences, or when relatively small differences accumulate from many units.
- Improvements to imputation from additional responses received: Even for units that do respond in time for the advance indicator, the imputed values themselves can differ between advance and preliminary indicators. Since imputation for the preliminary indicator is based on more complete information, this indicator should be viewed as an improved estimate for non-responding units versus the advance indicator. While these differences are typically small, they can accumulate to yield notable differences between the advance and preliminary indicators.
- Updates made to data after the advance indicator: When advance indicators are produced, respondent data are subjected to a further revision and are updated as part of the data validation process, which can result in differences between the advance and preliminary indicators.
4 Are other approaches being considered to produce advance indicators?
Statistics Canada continually seeks to adopt leading-edge methods to maximize data quality. To support these efforts, Statistics Canada collaborates regularly with other national statistical offices, other statistical organizations and academia to identify, develop and evaluate methods that would assist in producing advance indicators. In particular, nowcasting approaches hold promise to further improve timeliness, if statistical models with suitable accuracy relying only on the information available can be developed.
5 Where can I find more information?
Eurostat (2017), Handbook on Rapid Estimates, 2017 Edition (PDF).
Statistics Canada (2019), Statistics Canada Quality Guidelines – Sixth Edition.