The LifePaths Microsimulation Model: An Overview

Archived information

Archived information is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please "contact us" to request a format other than those available.

Abstract

This document gives an overview of LifePaths, a dynamic microsimulation model of Canadian society developed and maintained in Statistics Canada's Modeling Division. By simulating detailed individual life histories for millions of virtual Canadian residents, LifePaths reproduces the socio-economic and demographic features of the past half-century and enables detailed projections into the future under alternative assumptions and scenarios. LifePaths is used to analyse government policies having an essentially longitudinal component, like the sustainability of social insurance systems or long-term effects of investments in education. Based on individuals in their family context, it supports distributional analysis in all its dimensions: cross-sectional, over individual lives, between cohorts and over generations.

Table of contents

1. Introduction

LifePaths is a dynamic microsimulation model of Canadian society. It is designed to simulate a large sample of detailed individual life courses that together represent the Canadian population in its diversity, both on the national and the provincial level. Building on the individual life histories of millions of virtual Canadian residents, it reproduces the socio-economic and demographic features of the past half-century and allows for detailed projections into the future under alternative assumptions and scenarios.

LifePaths is mostly based on statistical event-history models estimated from a wide variety of Canadian micro-data combined with detailed accounting models mirroring the Canadian tax-benefit and social insurance system. Individual actors attend school and make educational choices, form families, migrate, become parents, work, have earnings, take parental leave, lose and find jobs, acquire homes, pay taxes, contribute to mandatory and voluntary pension schemes, receive benefits and pensions, and eventually die.

LifePaths is used to analyse government policies having an essentially longitudinal component and whose nature requires evaluation at the individual or family level, such as postsecondary education costs and benefits or public pension sustainability. It can be used to explore a variety of societal issues of a longitudinal nature, such as intergenerational equity or time allocation over entire lifetimes. Based on individual histories, it supports distributional analysis in all its dimensions: cross-sectional, over individual lives, between cohorts and over generations.

LifePaths is implemented in the Modgen microsimulation language developed and maintained at Statistics Canada. Like all Modgen applications, it provides a graphical user interface and runs very efficiently on standard PCs or distributed on computer networks. LifePaths is highly modular; it is an evolving model with new components added on demand.

This document is organized in two main sections. The first provides an overall picture on model design, its technical implementation, data sources, the target audience and ways of model use. The second part—LifePaths components—sketches the content of LifePaths by describing each of the social processes and policies that are simulated and the underlying data.

2. LifePaths structure

2.1 Overview

At the very core of LifePaths lies the detailed simulation of individual life histories. LifePaths creates synthetic life histories from birth to death that are representative of the history of Canada's population. Individual actors are simulated in their family context, with spouses and children explicitly simulated and linked together to families. Individual life courses comprise a multitude of parallel aspects of life, which can be structured as follows:

  • Basic demographics: Birth, mortality, internal and international migration.
  • Family demographics: Partnership formation, generation of spouses, pregnancy and childbirth, children leaving home.
  • Education: Educational transitions, levels and fields of study.
  • Health: Health Utilities Index, disability and institutionalization.
  • Employment: Type of employment, unemployment, hours worked, maternity leave and retirement.
  • Income and earning histories: Students' and career earnings, retirement income.
  • Owner-occupied housing: Buying, selling and upgrading and downgrading decisions; house prices.

A second component of LifePaths is a detailed representation of Canada's tax benefit and social insurance system as it evolves and changes over time. Simulated individuals thus live in a concrete and dynamic policy with context—they pay taxes, receive transfers, contribute to pension plans and receive benefits. These features, listed below, make LifePaths suitable for the detailed analysis of distributional aspects and long-term sustainability issues of government policies in the context of fast socio-demographic change:

  • Employment/unemployment insurance contributions and benefits.
  • Family, maternity and parental benefits.
  • Federal taxes and transfers.
  • Payroll taxes.
  • Public pension plans, pension contributions and benefits.
  • Senior benefits (Old Age Security, Allowance for the Survivor, Guaranteed Income Supplement).
  • Registered Pension Plan, Registered Retirement Savings Plan.

Note: Implementing most economic components involves individual behavioural choices (e.g., saving decisions), incorporating past and a projection of future indices (e.g., interest rates), economic growth, and the ‘mechanical' coding of the Canadian tax-benefit system.

2.2 Model design

LifePaths can be classified as a continuous time competing risk model following an open population approach. It is a case-based model with interactions between individuals limited to such between family members. All lives are simulated from birth, thus all lives are fully synthetic and do not correspond to real individuals from a single micro-data set.

Simulated life courses consist of various parallel and interacting careers, each defined by a set of possible states and events that lead to changes in those states. The life course of an individual is thus simulated as a series of events. These events are contingent on the previous history of the individual and usually have a stochastic component as well. The state of an individual changes when an event occurs. This in turn changes the likelihood of subsequent events.

By adding a stochastic component to the decision, the translation of a likelihood into a simulated event becomes a random process. For example, an individual who is currently employed is at some risk of a job loss event. The risk of job loss depends on factors such as the length of time that the individual has held their current job. In the event of job loss, the individual's state changes—they enter the state ‘not employed.' This new state may influence other events; for example, it may diminish the likelihood that this individual will subsequently become married or increase the likelihood that an existing marriage will break-up.

LifePaths simulations take place in continuous time. Events can occur at any arbitrary moment and are not artificially restricted to annual intervals. Events that occur in continuous time are unlikely to occur simultaneously unless specifically defined as a joint event. Consequently, there is no need for the tie-breaking rules that are often necessary in discrete time simulations. For example, there is never ambiguity about whether a birth that is simulated as occurring in the same year as a marriage occurred before or after the marriage.

Over the course of a simulation, LifePaths keeps updating its list of pending events to ensure that the next scheduled event is the one that currently has the shortest waiting time. This provides a straightforward way of dealing with competing events. Waiting times provide a unifying framework for representing decision-making. Probabilistic decisions can be implemented so that the choice among alternatives is determined by comparing two or more waiting times. For example, a never-married person's decision to either marry or enter a common-law union can be implemented by generating waiting times for both events. Such decisions are generally influenced by other variables—for instance, current educational status and employment history—and the decision is always re-assessed each time the influential variables change. If the marital status waiting times are both long relative to the waiting times for changes in employment or education status, then neither marriage nor a common-law union will become the next event to occur. Otherwise, if the marriage waiting time is shorter than the common-law union waiting time, then the choice is to marry.

A LifePaths simulation consists of a set of mutually independent cases. Each case contains exactly one dominant individual in the first generation. The spouse and children of the dominant individual are simulated as part of the case. They are created to satisfy the union formation and fertility equations. Furthermore, their behaviour is determined by the same equations that govern the dominant individual's behaviour. Non-dominant individuals are excluded from most tables to avoid double counting. Nevertheless, non-dominant individuals contribute to tables by defining the family context in which the dominant individual lives. The family context may be as simple as children being present in the home or a complex function of the spouse's employment history.

LifePaths is an open model in that a non-dominant spouse will be created whenever it is decided that a union formation will occur. Moreover, LifePaths simulates the completion of one case before going on to another. These properties contrast with closed, discrete time models, which simulate all the members of a population in one time period before proceeding to the next time period. Those models maintain a list of currently single individuals and permit union formation only between individuals on the list. Closed models typically start from an observed cross-section—perhaps a demographic survey. Thus, closed model simulations can never be more accurate than that allowed by the sampling variability of the initial cross-section. In addition, they often begin with a limited history with which to inform the behavioural equations. In contrast, LifePaths generates a complete history for each individual starting from birth, which allows greater flexibility in specifying behavioural equations.

The oldest birth cohort that is represented in LifePaths was born in 1872. This year was chosen so that, in the year 1971, LifePaths could simulate a complete range of ages from newborn to elderly. This means that starting in 1971, LifePaths can produce cross-sectional annual tabulations that can be directly compared with historical cross-sectional data. The year 1971 is the first year for which high quality socio-demographic data was available from a census with a contemporary, self-enumeration design.

2.3 Technical implementation and model output

LifePaths is implemented in Modgen, a generic microsimulation programming language that supports creating, maintaining and documenting dynamic models. Modgen was created with the goal of automating as many aspects of the microsimulation model implementation as possible. Common to all Modgen applications is the graphical, bilingual user-interface with well-organized and fully labelled multi-dimensional input and output tables.

One of the most important concepts in the class of simulation models to which LifePaths belongs is Monte Carlo variation. A LifePaths run creates a sample of individuals and families using waiting times that incorporate a stochastic component. This stochastic component is a key element in the ability of LifePaths to generate life histories that match the diversity observed in actual populations. On the other hand, this variability affects the reliability of aggregate tabular results in the same way that a small sample drawn from a larger population has limited accuracy. In the context of simulation modeling, this statistical variability is called Monte Carlo variation. It can vary from cell to cell within the same table and depends on the number of observations in the cell, the model's equations and the nature of the aggregate quantity being tabulated.

Modgen automatically estimates the Monte Carlo variability of each cell of every table and reports it in the form of a standard error. This feature substantially increases the information content of all model output, as, before drawing conclusions based on tabular results, it enables examination of these measures of variation. If the standard error is too large, the number of cases in the simulation may need to be increased in order to achieve the desired level of accuracy. Alternatively, an increase in number of cases that contribute to a given table might also be accomplished by more carefully targeting the simulation. For instance, appropriate targeting might be achieved by simulating only people born in a certain narrow range of years. LifePaths allows the sample size to increase virtually without limit. (A typical LifePaths simulation run creates from 4 million to 30 million cases, which themselves consist of the dominant actor and a multitude of related family actors: spouses, children and grandchildren.)

Because it is based in individual life courses, LifePaths produces very rich output. On the aggregate level, model output is organized in a hierarchical list of tables. Because tables are assembled during a model run, LifePaths does not require massive output files—thus, that there is virtually no limit to the size of a simulated population. LifePaths makes use of the powerful table generating language provided by the Modgen programming technology. The Modgen table generating language is especially powerful for output of durations, in addition to cross-sectional ‘point in time' output. Modgen also allows table outputs to be easily added, organized and customized.

The second form of output is a database that tracks the life histories of simulated individuals as represented through the values and timing of changes to user-selected state variables. A tracking database will usually contain a small number of carefully selected simulated individuals (hundreds rather than thousands) that can be inspected one-by-one. The tracking database serves as input to a secondary program named BioBrowser, which graphically displays values of specified variables for simulated individuals over their lifetimes—a BioBrowser biography.

2.4 Data

The content of simulation models is largely embodied in their behavioural equations. In LifePaths, these equations—together with their stochastic components—determine the distributions of waiting times to events. These equations represent behaviour by depending on a simulated individual's past. For example, the timing of births is determined in relation to the timing of marriage and of previous births, rather than solely on a mother's current age. (Age-specific fertility rates are common elements of demographic projection models that are not designed to generate individual life histories that seem realistic.)

The behavioural equations represent choices as well as contingent events such as death. Estimating these equations places particularly heavy demands on data because the required data must directly reflect individual events and the specific history that led to them. LifePaths makes use of a multitude of data sources with longitudinal components—for example, by constructing a database of Labour Force Survey data linked together over time and by using retrospective event history data collected in the General Social Survey, and in panel surveys, like the Youth in Transition Survey.

One of the biggest challenges of LifePaths is to be simultaneously consistent cross-sectionally and longitudinally—individual careers have to make sense and be representative for the real life-course diversity observed in Canadian society over time. It is one of the design goals of LifePaths that the distribution of characteristics in the simulated population closely reproduces data from censuses over all its waves. In this respect, the construction of LifePaths can be viewed as a data integration exercise, which, by detecting inconsistencies and data gaps, can improve data quality and collection in the long term.

2.5 Use and users

The largest user group consists of Canadian federal policy departments and provincial ministries involved in policy development. Other target audiences are non-governmental organizations that have a stake in long-term government policy, banks, demographers, economists and other researchers. Those to whom model results or analyses based on model results are presented comprise the second audience. This can include the press, political parties and, of course, decision makers in government.

Early versions of the model focused on the young population and were used by federal and provincial departments to assess the viability of major reforms in postsecondary education funding. More recently, the LifePaths team has successfully developed longitudinal behavioural equations that accurately track major features in the evolution of Canadian society (demography, education, migration, labour market and earnings) over the 20th century. This establishes a high level of credibility for the model and provides a firm foundation for those in the policy community to perform projections with respect to current and proposed government policies. Most recently, it has been used by federal departments in a project to analyse various aspects of retirement.

LifePaths has also been used in a variety of research papers. Topics have included time use, generational accounting, active life expectancy, maternity leave, the returns to education, and changes in pension policy. LifePaths also provided the demographic foundation for the Population Health Model (POHEM) developed at Statistics Canada, which enables competing health intervention alternatives to be rationally compared in a framework that captures the effects of disease interactions.

LifePaths is a very complex model with a development history going back more than a decade. Getting familiar with LifePaths for any non-trivial analysis requires a considerable investment of time and hardware resources, and most users seek some kind of support from the LifePaths team. Statistics Canada is flexible in providing various forms of support ranging from carrying out the projects themselves as defined by clients to providing training to clients so that they can use the existing model, develop their own modules and perform their analysis independently outside Statistics Canada. The first option might be preferable for a single analysis of an issue using LifePaths, as it may be more cost-effective to pay to have Statistics Canada staff do the work than face a large upfront investment in learning and computer resources. The latter option, which centres on training, has proven successful, especially in cases of university-based research that uses the existing LifePaths model as a base and adds new modules without modifying the existing LifePaths base.

For large-scale projects that go beyond the use of LifePaths as a black-box model, the greatest difficulty in mastering LifePaths is understanding its structure and complexity. LifePaths has hundreds of variables that interact with each other in complex ways. Users as well as new members of the LifePaths team have found that it takes months to begin to understand the relationships, and can take years to become an expert in being able to use LifePaths productively in complex policy analysis. Thus, not surprisingly, most complex policy analysis using LifePaths is performed by or in close relationship with the LifePaths team. In addition, the LifePaths project has the unique advantage of being located in Statistics Canada. This allows the development team ready access to the many data sources required to estimate the distributions of characteristics and equations used to model the behaviour of individuals and families.

From the technical side, learning to use LifePaths involves learning the Modgen programming language in which LifePaths is implemented. When not intending to modify LifePaths itself, learning how to create output tables is typically the first step involving programming. While a new LifePaths user does not have to be a programmer, they need to understand the code in Modgen to make adjustments to the model.

Hardware resources for a large number of cases—typically from 4 million to 32 million—need to be run to get good results on the distribution of variables being studied in LifePaths. Simulating such large samples typically requires hardware investments. LifePaths makes use of multiple-cores in single and multiple networked computers; a computer or network with eight cores is recommended and sufficient for most purposes.

3. LifePaths components

3.1 Basic demographics: Birth, migration and death

The population in each province at any moment in time is determined by three factors: births, deaths and migration flows either within Canada or internationally. An adequate representation of Canadian population dynamics by its key demographic characteristics (age, sex and province of residence) is a core requirement for all simulation output.

LifePaths aims at exactly replicating historic and administrative population data, official population estimates and the three (low, medium and high) projection scenarios periodically published by Statistics Canada. In this sense, LifePaths does not produce its own demographic projections, but reproduces given macro projections. This makes the simulation results comparable with those obtained from other models using similar population assumptions.

The modeled demographic behaviours interact with other life course characteristics. For example, migration depends on the family type, while mortality depends on health (in addition to age, time period and sex). The calibration of the micro models in order to reproduce given macro data is one of the challenges to be faced in further developing LifePaths. An additional challenge consists of data integration issues arising from the enormous historical depth of the simulations that go back to 1872.

LifePaths has a synthetic starting population, meaning that all people are simulated from birth. Like in real life, LifePaths actors become residents either by birth or immigration and can leave Canada temporarily or permanently through emigration. Technically, we can distinguish between characteristics assigned at birth and such modeled over the life course. Those assigned at birth (the creation of an actor) are sex, year of birth and province of birth as well as the year and province of immigration for people born outside of Canada. All other individual characteristics and changes over the lives of the people are modeled; no simulated life has a direct real-life correspondent and thus avoids all confidentiality issues.

3.2 Becoming a Canadian resident

Compared with 1872, the population of today's Canada has increased more than seven-fold, with immigration being a key driver of this increase. Canada is a nation of immigrants. At the peak of immigration, in the decade from 1901 to 1911, the total number of immigrant arrivals amounted to about 25% of the average population. Immigration continues to make a crucial contribution to Canada's continued population growth.

The characteristics of immigrants differ from those of native-born Canadians. For example, recent immigrants are likely to be more highly educated than the Canadian average. For those reasons, special attention must be given to the immigrant population, beginning with a determination of the age and time at which they arrive.

Concerning births and immigration, LifePaths is based on population censuses going back to 1911, birth and immigration records, population estimates and population projections. Most administrative data are available since 1921. For the period before 1921, the 1921 Census of Population was ‘reverse survived': the number of births that would have had to occur to produce the observed number of survivors in 1921 was determined using mortality probability estimates. By integrating these data sources, distributional tables were constructed that allow a set of key characteristics to be randomly assigned to each of the simulated actors: sex, year of birth, province of birth, and—for those foreign born—the year and province of immigration.

Immigrants become Canadian citizens after three years in LifePaths. The population represented does not include non-permanent residents, a large number of whom are foreign students.

Note: The way LifePaths creates a population as described above only refers to the so-called dominant actors of generation zero. These are the actors from which LifePaths constructs most table outputs and which together are representative of the Canadian population. Each of these actors can have a series of spouses and various generations of children and grandchildren—the generational depth is set by the user. The generational depth of LifePaths—besides creating context for the dominant actor—can be exploited for the study of intergenerational mechanisms and effects.

3.3 Emigration and back migration

All individuals in the model who are currently living in Canada have a probability that they might emigrate. Factors that influence emigration include age, sex, province of residence, calendar year, immigrant status and the year of immigration (for immigrants).

Canadian citizens who emigrate can also return to Canada. This means that immigrants who leave the country after having lived in Canada for three years or more as well as individuals born in Canada can emigrate and then return to Canada. However, immigrants who leave Canada before becoming Canadian citizens are not eligible to return to Canada. Factors that influence a return to Canada include age, sex, year, last province of residence, immigration status and year of immigration (for immigrants).

All migration is modeled at the family level: if one family member migrates, their spouse and dependent children also migrate.

3.4 Internal migration

As well as moving in to and out of Canada, people in the model and their families can move from one province to another. A base probability of moving between each pair of provinces serves as the benchmark for estimating family migration probabilities for each of five family types: husband and wife couples, common-law couples, lone parents, other single males and other single females. These probabilities incorporate the influence of factors such as age, education and whether or not a person would be moving from or back to their province of birth. Two additional factors are the current province of residence and the province of birth. Return migration to the province of birth proved to be among the strongest of the migration patterns uncovered in the analysis of migration data. Within a simulation, the base probability of moving between each pair of provinces varies from year to year.

Data for the earliest years are limited; in some cases, all that are available are census data comparing province of birth with province of residence, which is indicative of lifetime migration. Currently, more direct and timelier data are available from administrative files. Historical lifetime internal migration data was based on decennial census data from 1911 to 1971. Base probabilities of individuals moving between each pair of provinces were derived using the family allowance and child tax credit data (1972 to 1996). Estimates of family-level migration probabilities were obtained (using the base probabilities as benchmarks) from census data on place of residence one year prior to the census.

3.5 Mortality

Mortality in the LifePaths model is determined by re-assessing the chance and timing of death at each birthday. The process of re-assessing mortality continues until death or until the individual reaches the maximum allowed age of 119 years. The chance of dying is based on the age-specific mortality rate of Canadian residents sharing the sex and year of birth of the simulated individual as well as (user-selectable) sets of relative mortality risks. The cohort mortality data were derived from death registration statistics. Concerning future mortality, model users can parameterize—and choose between—a low-, medium- and high-mortality scenario.

While the model reproduces the life-tables based on administrative data and official population projections on the aggregated level, it also implements various types of relative risks, of which different sets can be selected by the user:

  • institutionalization only or health status (including institutionalization)
  • Health Utilities Index (on/off)
  • education and marital status (on/off).

Relative risks by marital status and education level were estimated from the census mortality follow-up study. Accounting for the difference of life expectancy by education and marital status can be of importance—e.g., in pension modeling, the remaining life expectancy of a 60 year old varies by two years between high school non-completers and university graduates and the combined effect with marital status can lead to a difference in life expectancy of up to three years for males 60 years of age. Similarly, accounting for mortality differentials by health status and institutionalization can be of importance when modeling—e.g., formal and informal care needs. Health status and the Health Utilities Index are explained in separate chapters on the according behaviours.

Individuals who are destined to immigrate to Canada are not exposed to a risk of death until they arrive. This avoids simulating individuals who then die before reaching Canada and who would, therefore, make no contribution to the simulation reports.

3.6 Family demographics: Fertility, partnership formation and dissolution, leaving home

3.6.1 Fertility

Women born in the 1880s had an average of nearly four children in their lifetimes—a level never reached again even in the baby boom of the 1960s. Currently, like in most developed countries, the fertility level is well below the replacement rate, thus population growth is driven by immigration and decreasing mortality only.

LifePaths assigns women a fertility status that depends on age and whether any fertility events have occurred in their immediate past. At 15 years of age, women are at risk of pregnancy for the first time. At age 50, women have no further risk of pregnancy. Between those two ages, births are simulated as a sequence of fertility decisions. Each fertility decision has two parts: first, the decision whether to have a child is made and only then is a waiting time to conception generated. All pregnancies result in a live birth unless the mother dies first. Twin births are simulated using an appropriate incidence rate.

The main factor influencing the decision to have an additional child is the number of children already born in the family. Secondary factors include the mother's year of birth, province of birth, marital status, age at marriage and educational attainment. For most women, fertility decisions are delayed until schooling is completed. Women in common-law unions sometimes have reduced fertility compared with their married counterparts. The latter is important because marriage and fertility are linked to each other in LifePaths. If a child is conceived, the waiting times to marriage or common-law union are re-assessed and if a marriage or common-law union occurs, the chance of an additional birth increases.

The normal sequence and timing of fertility related events are: (1) each birth occurs nine months after conception, (2) a spell of infertility lasting three months follows each birth and (3) a new fertile spell begins immediately after that. The careful attention given to the timing of these events makes possible straightforward models of maternity leave from employment and marriage following pregnancy.

The decision probabilities were derived from pooled census data from 1971 onward using the distribution of children ever born from women with completed or nearly completed fertility. Intervals between births are based on census responses of women in their thirties for whom all children were still at home. Birth intervals were then calculated using the age differences among the children.

3.6.2 Marriage, common-law unions and divorce

In the past, only a small proportion of people never married in their lifetimes and people rarely divorced or entered a common-law union. Currently, one-third of marriages is expected to end in divorce and non-marital cohabitation became a wide-spread phenomenon both as alternative to marriage and as an option preceding marriage. Institutional change reflects societal changes—e.g., the first changes to the Divorce Acts of 1968 and 1985 to simplify divorce procedures led to peaks in observed divorce rates.

The growing acceptability of common-law unions is a more recent phenomenon than increased divorce incidence. In the 1981 Census, just over 6% of couples indicated that they were in a common-law relationship; meanwhile, marriage is no longer the universal norm, with Quebec leading this de-institutionalization trend.

Societal change is also reflected in the changing age of marriage and childbirth. Historically, the trends of steadily declining marriage and childbirth ages were reversed following the baby boom. Since then, life course patterns have started to diversify again, with higher degrees of childlessness and a steady increase of age at marriage and childbirth. Careful modeling of these trends is important, as partnership status and parenthood have a considerable influence on other events—e.g., they play an important role in migration and labour market events. Increasing inequality concerning family size is also a factor in the general increase of economic inequality.

Marital status transitions can be very complex. One example could involve the events leading to an individual who is separated, but still legally married, being simultaneously in a common-law union. LifePaths deliberately limits the complexity of marital status transitions. The earliest age at which an individual can enter a common-law union or marriage is 15. For the never married, common-law unions and marriage are competing events—either one may occur. Factors that influence the timing of common-law unions and marriage include sex, age, pregnancy, employment status, education, year of birth, place of birth (born in Quebec, born elsewhere in Canada or born outside of Canada), age at first job and time employed since first job.

When a marriage or common-law union occurs, LifePaths creates a suitable spouse. Such spouses have an age and education following observed statistical patterns between spouses' characteristics. There are two methods in LifePaths for creating a spouse. For large runs, a spouse market is created before the simulation of the cases. When a spouse is needed, he or she is selected from this spouse market with an age and education close to target levels. The second method involves creating a series of individuals with appropriate age and sex until one with the appropriate level of education is found. This individual then becomes the spouse or common-law partner.

Once an individual enters a common-law union, there are three possible outcomes: death of one of the common-law partners, dissolution of the common-law union and marriage of the common-law partners. Factors influencing the outcomes include number of previous common-law unions, duration of the union, age, sex, pregnancy, year of birth, place of birth, and measures of employment experience.

Once an individual marries for the first time, there are two possible outcomes: death of one of the spouses or permanent separation. Factors influencing these outcomes include year of birth, age at marriage, duration of the common-law union that became the marriage (if applicable), duration of the marriage without children, duration of the marriage with children, age of the youngest child, education, measures of employment history and historical period. The historical periods represent, respectively, the period before the divorce legislation reform (before 1968), the period before the second change to divorce legislation (from 1968 to 1984) and the present (after 1984).

When a permanent separation occurs, a waiting time until a possible divorce is calculated. The factors that influence the waiting time include child status at separation, duration of the separation, year of birth, place of birth, having a common-law union prior to marriage, education and the historical periods related to divorce legislation reform.

Following the end of a first marriage by divorce or the death of a partner, a waiting time for a possible second marriage is calculated. Age, sex, province of residence and previous marital history are factors that influence this waiting time.

The primary sources of data used to calculate the probabilities of union formation and dissolution—prior to the first marriage—were the 1984 Family History Survey and the 1995 General Social Survey. Census data from 1981 onward were used to augment survey data. Probabilities of second marriages were based on marriage registration data. Data representing the distributions of age differences between spouses came from marriage registrations. The census provided data on the relationship between spouse education levels.

3.6.3 Leaving the parental home

There can be some ambiguity regarding what leaving home means. Postsecondary students, for example, may study in a different province for most of the year, yet maintain a legal residence in their parents' home. In fact, several movements in and out of the parental home might not be unusual over the course of an educational career. LifePaths focuses on reproducing distributions of non-students living with their parents by age, sex and year, in order to approximate the final move out of the parental home. Even in this non-student population, recent trends indicate that young people may be leaving home later in life.

In the LifePaths model, leaving home is determined by an annual re-assessment of the chance and timing of the event. This event happens at most once in a lifetime. An individual maintains their permanent residence with their parents while attending school. If an individual is still living at home at age 35, then they stay at home for the remainder of their life. However, if a marriage occurs, then all other considerations are over-ridden and the individual leaves their parental home immediately. One outcome of leaving home is that the individual who left will no longer migrate with their parents.

Probabilities of leaving home were derived that would reproduce observed proportions of non-student children living with their parents, grandparents or foster-parents by child's age, sex and province of residence and by year. The annual average proportions of non-student children living at home were taken from waves of the Labour Force Survey from 1976 onward.

The mobility of postsecondary students who have not left home yet is treated separately by assigning a province of study, which might be different from the parent's province of residence.

3.7 Education: Primary, secondary and postsecondary education choices

Soon after Confederation, school attendance in Canada became compulsory and free schooling in tax-supported public schools, at least for young children, became widely available. Since then, Canada, like all developed societies, has experienced a tremendous educational expansion: while before the First World War half the population did not go beyond Grade 8, more than two-thirds of 30-year-olds today attained postsecondary education.

Educational attainment, while interesting by itself, also plays an important role in many processes modeled in LifePaths. It is a key variable for demographic events influencing fertility, family formation, migration decisions and mortality. Regarding the timing of life events, most other life careers (i.e., household formation, marriage and parenting) usually start after leaving school, while in economic modeling, education is a key determinant of human capital and therefore of income and job careers.

LifePaths models school attendance distinguishing elementary school, secondary school, community colleges, trade and vocational training, and the various levels of university education up to PhD studies. Study careers can consist of a series of full-time, part-time and out-of-school spells mirroring the variety of observed study patterns. LifePaths also distinguishes 100 fields of study and calculates tuition, thus supporting a wide range of policy analysis.

3.7.1 Primary and secondary education

The modeling of school entry and primary education is quite simple—individuals enter in September of the year of their 6th birthday. Students are assumed to stay in school full-time at least until June of the year of their 15th birthday. At this date, it is determined if Grade 8 was passed and at least some secondary education was started. If Grade 8 was not passed, students are assumed to drop out permanently; if it was, they move on to the secondary education module. This date also marks the earliest entry date into the formal labour market. For more recent cohorts, progression to secondary education has become virtually universal.

Starting from the year of the 15th birthday onward, secondary education patterns are modeled in more detail, allowing for temporary or permanent dropout and part-time studies. LifePaths models graduation at any age, but restricts the detailed modeling of education careers to graduations up to the 25th birthday. Later adult graduation is implemented by a graduation event without tracking study enrolment statuses.

3.7.2 Postsecondary education

Universities provide the clearest picture of the growth of postsecondary education in Canada, where university graduation rates (a bachelor's degree or higher) have quadrupled from below 8% to 30% over the 50 year birth cohorts from 1926 to 1976 as observed in the 2006 Census. For other components of the postsecondary system, the picture is not so clear-cut. This is because provincially organized systems of community colleges did not come into existence until the 1960s and because the boundaries between university and other postsecondary institutions have changed over the years, two examples being nursing and education.

In LifePaths, a person's postsecondary education fate is determined immediately upon graduation from secondary school. These fates represent the person's lifetime postsecondary attainment and include the following possibilities: remaining a secondary school graduate, various combinations of trade vocational school certificates, other types of non-university certificates and university degrees. The fates also include dropping out of either university or college. In all, 30 distinct fates are represented.

Once a person's postsecondary fate is decided, a variety of decisions remain to be made. People fated to attend more than one type of institution choose the type of institution they will attend first. Then, for people who are going on to university, the province of study is chosen. The sex of the individual, as well as their province of residence, influences the choice of province of study. Individuals studying in non-university institutions always study in their province of residence.

Once the province of study is known, the waiting time to the start of the next program is calculated. This waiting time depends on the province of study, the postsecondary fate and the sex of the individual. People going to college or university choose one of 100 fields of study appropriate to their institution. They also choose, based on the field of study, an appropriate pattern of study. This pattern of study represents the total length of the program, as well as the split between full time, part time and out of school years.

People attending a trade vocational institution choose one of six program types. Those who choose the registered apprenticeship program are employed full-time as part of their program and their program lasts longer than other trade vocational programs. Once the type of trade vocational program is chosen or if they are entering a private institution, then the length of the program is chosen immediately.

The 1996 Census was used to derive the probabilities of the 30 possible postsecondary education fates as well as probabilities of the 100 possible fields of study for each sex, year of birth and place of birth. The university and college student administrative information system was used to derive probabilities of province of study as well as the probabilities of patterns of study within each field of study. The Labour Force Survey and National Graduates Survey were used to derive waiting times to the next study program. The 1995 Census of Students—conducted by the National Association of Career Colleges—was used to derive the distribution of lengths of private institution programs.

3.8 Employment and employment/unemployment insurance

In LifePaths, employment activity is partitioned into various modules. Employment for full-time students is dealt with separately because its transitions are determined, in part, by the school year cycle. Career employment refers to the mainstream labour market that has its own autonomous dynamics. Once employment status is determined, LifePaths models the actual hours worked per week.

The current release contains an expanded UI/EI subsystem that calculates premiums and benefits under all the UI/EI Acts up to 1997.  The LifePaths model focuses on regular UI/EI benefits as well as maternity and parental benefits.  There are no provisions for other special benefits such as sickness or compassion.  The UI/EI model also has no provisions for individuals who may also work while on UI/EI.  UI/EI premiums are calculated for those eligible to make such contributions.  The UI/EI model keeps work and earnings histories in order to calculate benefits.

3.8.1 Student employment

Given that an increasing proportion of young people go on to postsecondary education, it has become important to identify their possible sources of financial support. In that regard, the sensitivity of student employment to the business cycle is significant. Trends in student employment are, in part, explained by growth in postsecondary education. Nevertheless, there has been an increasing trend toward part-time work, even among secondary school students. Most employment undertaken by full-time students occurs during the summer break. As a result, the distinguishing features of the employment patterns of full-time students are short employment spells and the concentration of events at times determined by phases of the school year.

LifePaths classifies full-time student employment status as not employed, self-employed or as a paid employee. Self-employment is distinguished from paid-employment for students, even though only 10% or less of employed students report themselves as self-employed. However, only two transitions—not employed to employed and employed to not employed—are modeled. When a transition from not employed to employed occurs, LifePaths then makes the decision whether to assign the self-employed or paid employee status.

The chances and timing of either transition are assessed monthly. Variables influencing transition probabilities include sex, province, status in the parental home, variables representing seasonal employment patterns and time trends. Given that the timing and length of summer breaks vary by school type, the transition probabilities were estimated for each of four types: secondary, college, university and other schools. The transition from not employed to employed was estimated separately for students with and without prior work experience.

The modeling is based on the results from analyses of student work, using longitudinal data constructed from hundreds of waves of the LFS from 1976 onward.

3.8.2 Career employment

As the nature of the labour force has changed over time, so too have the concepts used in employment data—for example, until 1941, the census used the concept ‘gainfully occupied.' The concept was suitable for the time period, when farmers and farm workers represented a significant proportion of all workers and when unpaid family workers, often children younger than 15 years of age, were a significant proportion of agricultural workers. The importance of agriculture gradually declined from representing about 33% of all workers in 1921 to 16% in 1951. Starting from that point, it becomes possible to track annual changes in the labour market. Among the most striking trends of the whole period were the declines in the participation of males aged 65 and older and the increased participation of females aged 25 to 44.

Annual participation rates, whether displayed as trends over time or as age profiles, may give a misleading sense of stability. Underlying these patterns are high rates of job turnover. From the mid-1970s to the mid-1990s, an annual average of 21% of jobs terminated with a permanent lay-off and another 15% were interrupted with a temporary lay-off. Correspondingly, 22% of jobs were newly acquired each year. Some individuals hang on to jobs for decades, whereas others move between jobs with great frequency. In some cases, the jobs involved are seasonal or part time, but many individuals change jobs frequently for other reasons. An adequate model of labour market activity needs to reproduce features of the real market that combine gradual changes in behaviour associated with age, cyclic changes associated with annual variations in business conditions and sub-annual seasonality or volatility.

Certain demographic groups, such as children younger than 15 years of age and institutionalized people, do not participate in the labour market. Consequently, the first step that LifePaths takes in modeling employment is to determine whether an individual is eligible at all for an employment status transition. There are two special cases of ineligibility: retirement, which is treated as a permanent state, and certain people who never work throughout their lifetime. Women with primary-only education or who were born before 1930 make up a large proportion of this latter group, as do people with a lifelong disability. Women on maternity leave experience no risk of job loss for the duration of their leave.

If LifePaths determines that a person can participate in the labour market, their employment status can change from day to day. LifePaths uses a three-category classification of employment status: not employed, employed as a paid employee and self-employed. Based on this classification, seven transitions are distinguished:

  • a person who is not employed becomes a paid employee
  • a person who is not employed becomes self-employed
  • a paid employee becomes not employed
  • a paid employee becomes self-employed
  • a paid employee changes jobs with no interruption
  • a self-employed person becomes a paid employee
  • a self-employed person becomes not employed.

The chances and timing of each transition are re-assessed monthly or whenever a transition occurs. The variables influencing employment transition probabilities include duration of current job, duration not working, age, sex, province of residence, education level, the presence and ages of children, the presence of a spouse and the spouse's employment status. Also included are variables representing time trends and monthly seasonal patterns of employment.

Each year after an individual reaches 60 years of age, an independent process determines whether the individual will permanently retire. The chances and timing of retirement are influenced by age, sex, year, region of residence and education level. A forced retirement also occurs when an individual is institutionalized. After retirement, no further labour market transitions can occur.

In the same manner as student employment, employment transition probabilities were estimated from Labour Force Survey data collected from 1976 onward.

3.8.3 Hours worked per week

Once employment status is determined, LifePaths models the actual hours worked per week. Hours worked are dependent on a variety of individual characteristics, including sex, level of education, age, earnings rank, province of residence, family characteristics, student status, job tenure and the month of the year.

3.8.4 Maternity leave and benefits

Income support during maternity leave is a special benefit of the Employment Insurance Program that was first introduced in the 1972 Unemployment Insurance Reform. More recently, the benefit was extended to apply equally to adoption and to cover fathers as well as mothers. Nevertheless, conventional maternity leave remains the most commonly used form. When the maternity benefits program was first enacted, a mother could receive a maximum of 15 weeks of benefits. The introduction of parental leave in 1990 provided an additional 10 weeks, which could be shared between mother and spouse. Examining how maternity leave durations are distributed shows that the peak frequency shifted abruptly from four months duration during the years from 1976 to 1989, to six months duration during the years from 1991 to 1995. This strongly suggests a behavioural change, with some women who would formerly have returned to their job after 15 weeks of maternity leave taking an additional 10 weeks of parental leave. In contrast, a substantial proportion of women—15% to 20%—take essentially no leave regardless of legislation.

In LifePaths, a pregnant woman makes decisions concerning her labour market activities four months before she gives birth. Different decision-making mechanisms apply depending on employment status. Women who are not employed withdraw from the labour market until after the birth. At that point, the transitions to work (becoming a paid employee or self-employed) are determined by the career employment component. An employed woman makes three decisions in sequence: whether to take maternity leave or quit her job, when to start maternity leave or when to quit, and when to return from maternity leave. Nevertheless, unless she has chosen to quit, she remains employed throughout the duration of her maternity leave.

The probabilities determining maternity leave choices and leave durations were based on an analysis of data from Labour Force Surveys (LFS) and the Survey of Labour and Income Dynamics (SLID). SLID data were used to obtain initial patterns of maternity leave, while the LFS data were used to benchmark these initial patterns to the LFS levels for years not covered by SLID—especially the years before 1993.

LifePaths has not yet implemented the changes to parental leave introduced in 2001 (increasing parental leave to 35 weeks) nor has it introduced the 2006 change in Quebec where employment insurance maternity and parental benefits were replaced by the Quebec Parental Insurance Plan.

3.9 Earnings

Annual earnings can be decomposed into weekly earnings rates and weeks worked per year. There is a distinct age profile to annual earnings. They grow fastest at young ages, plateau and then start declining. The peak age of average earnings has been increasing in the past few decades. In 1970, the peak was reached at the age of 40 whereas in 1995 it was reached at 51. During the same decades, the growth in average annual earnings for people younger than 25 years of age decreased. In 1995, people aged 24 and younger had real average earnings that were smaller than those of their counterparts in 1990. This may be because of a variety of factors, such as people staying in school longer.

In LifePaths, each person is assigned a potential weekly earnings rate whether or not they are employed. This potential weekly earnings rate is then combined with employment status and hours worked information to produce actual earnings. Once a person starts a job, whether in paid work or in self-employment, LifePaths assigns weekly earnings in current dollars. Earnings are derived differently for student work as opposed to career work.

Weekly earnings for non-students are derived using three separate sets of equations: wages and salaries, positive self-employment earnings and negative self-employment earnings. For the self-employed, the first step is to decide whether or not this person is going to have positive or negative earnings. Variables influencing earnings include, age, education level, field of study, sex, province of residence and immigration status. These variables can each independently influence the general level, dispersion and degree of asymmetry in simulated earnings distributions.

Weekly earnings are recalculated at the start of a new job as well as on job anniversaries. They will also be recalculated whenever the variables influencing earnings change. A correlation was calculated between a person's rank in the earnings distribution from one year to the next.

Student earnings are treated differently than career earnings. The earnings equations are much simpler and depend on level of schooling and the time of year (summer or school year). They are recalculated each September and at the beginning of the summer. For now, only postsecondary students are eligible to receive student earnings in LifePaths.

Weekly earnings rates and the logit equation that decides whether a self-employed person will receive positive or negative earnings were derived from census data. For the years before 1980, the earnings rate was deflated using a factor derived from a consistent historical series of average weekly wage rates (industrial aggregate). The correlation in the person's year to year ranking in the earnings distribution was derived using the Longitudinal Administrative Databank. Student earnings were derived from the Labour Market Activity Survey and the Labour Force Survey.

3.10 Taxes and family benefits

LifePaths implements the Canadian tax-benefit system and its changes over time at a high level of detail. Personal income taxes in Canada began in 1917. LifePaths models a number of historical tax programs that have since been eliminated (e.g., Old Age Security Tax, National Defence Tax, Graduated Income Tax and various surtaxes throughout the ensuing years) and the various deduction/credit programs that have come and gone since the inception of income tax.

At the end of each year, the federal tax form is completed. This involves the calculation of total income, net income, child care expenses, personal exemptions, taxable income, non-refundable tax credits, the child tax credit, the federal sales tax credit and federal income tax as well as any applicable surtax. Also at year-end and when applicable, the Goods and Services Tax credit is calculated. On a quarterly basis, the Goods and Services Tax credit is assigned to eligible recipients. The federal taxes are also calculated at the time of death.

Along with personal income taxes calculated at year-end, each month payroll taxes such as employment and unemployment insurance premiums, as well as pension plan contributions, are calculated.

On the benefits side, family allowances are calculated each month. These include the federal family allowance, including the Alberta and Quebec configurations, as well as Quebec's Allowance for Newborn Children. Other benefits calculated on a monthly basis are the Canada Child Tax Benefit, which is additionally recalculated at any changes in family structure, and the Universal Child Care Benefit.

3.11 Pensions and retirement savings

LifePaths simulates the Canadian retirement income system with its various public and private components and senior benefit programs in a high degree of detail, reflecting its historic evolvement and changes in legislation, plan designs and plan participation. Public components are the Canada and Quebec Pension Plans, Old Age Security, the Spouse's Allowance and the Guaranteed Income Supplement. The corresponding LifePaths modules are largely rule-based for the determination of eligibility and benefit calculation, and full take-up is assumed. Private pension programs modeled in LifePaths consist of two tax-assisted retirement savings plans: the employer-sponsored Registered Pension Plans (RPPs) and the individual's Registered Retirement Savings Plans (RRSPs).

3.11.1 The Canada and Quebec Pension Plans retirement pensions

The Canada Pension Plan (CPP) is a contributory, earnings-related social insurance program that ensures a measure of income protection to a contributor and their family against the loss of income because of retirement, disability or death. The plan operates throughout Canada except in the province of Quebec, where a similar program—the Quebec Pension Plan (QPP)—is in effect.

The Canada Pension Plan was enacted in 1965 and came into force on January 1, 1966. Contribution collection began on January 1, 1966, retirement pensions became payable in January 1967, survivors' benefits in February 1968 and disability benefits in February 1970.

The CPP covers virtually all employed and self-employed people in Canada (excluding Quebec, which operates the QPP) who are from 18 to 70 years of age and who earn more than a prescribed minimum level of earnings in a calendar year. This minimum level, which changes annually, is known as the Year's Basic Exemption (YBE).

CPP is financed through contributions from employees, employers and self-employed people. Contributions are required on the portion of an individual's annual earnings above the YBE and up to a prescribed ceiling known as the Year's Maximum Pensionable Earnings, which is linked directly with the average wage. The QPP is closely associated with the CPP and both plans are operated and coordinated through a series of agreements between the federal and Quebec governments. Benefits from either plan are based on pension credits accumulated under both, as if only one plan exists.

Retirement pensions are available to individuals any time from the month following their 60th birthday, providing they have made at least one valid contribution to the CPP. To receive a retirement pension before age 65, individuals must have wholly or substantially ceased pensionable employment at the time the benefit commences. Starting in September 1987, CPP flexible retirement is available at age 60 (70% of pension) through age 70 (130% of pension). Starting in September 1984, QPP flexible retirement is available at ages 60 to 70. Once an age adjustment is established, it is permanent and applied to each month benefits are received, regardless of the age of the beneficiary. The amount of the retirement pension before 1976 reflects the legislation, which states that any retirement pension is calculated on the basis of a minimum of 10 years of contributions. The pension is designed to replace about 25% of the earnings on which contributions have been paid. Once qualified for a pension, CPP benefits can continue to be collected even if the pensioner has returned to work; however, no further contributions to CPP are deducted.

LifePaths keeps track of the full working history and contribution career, thus being able to implement the complex system rules and to support analysis of future policy options. Besides the mechanics of calculating contributions and benefits, LifePaths also models the timing of pension take-up, as—beginning in 1986—individuals can opt to collect benefits before age 65—i.e., starting at age 60. The detailed modeling of family demographics enables LifePaths to implement survivor, combined and death benefits.

3.11.2 The Canada and Quebec Pension Plans survivor benefits

Spouses of deceased contributors may be eligible for a survivor's pension if the deceased contributor made contributions for a sufficient number of years. Surviving spouses with dependent children, surviving spouses with a disability and those aged 45 and older are eligible for survivor benefits. For surviving spouses who are younger than age 45 at the time of the contributor's death and who are neither disabled nor caring for the contributor's dependent children, benefits are reduced by 1/120th for each month the survivor is younger than age 45.

Since January 1987, the CPP survivor's pension continues to be payable on remarriage and benefits are reinstated for people who remarried prior to this provision coming into effect. However, no retroactive payments are paid for any time before January 1987. Since January 1984, recipients of a surviving spouse's QPP pension continue to receive their pension if they remarry. There are various conditions that determine when the survivor's pension will cease. If the survivor is older than 35 years of age at the time of the contributor's death, the pension will end at the survivor's death. If the survivor was younger than 35 at the time of the contributor's death, the pension will end when the survivor is no longer disabled, no longer raising the deceased contributor's dependent child or upon the survivor's death.

A person who is receiving a surviving spouse's pension may also have contributed to the CPP on the basis of their own earnings and may thus be entitled to a retirement or disability pension. There is a limit on the combined benefit based on the maximum retirement pension, which one would receive if they were 65. Depending on the retirement pension, the survivor benefit could be reduced.

3.11.3 Canada Pension Plan pension options

Various CPP pension options have been incorporated into the LifePaths model. These options allow users to model various changes to the CPP program such as changing the starting point of earnings at which contributions begin, the upper level of pensionable earnings, the contribution rates for income ranges, benefit rates for pensionable earnings ranges, and options for drop-out provisions in the calculation of pensionable years of earnings.

3.11.4 Old Age Security

An Old Age Security (OAS) pension is a flat-rate benefit payable to people who fulfill certain residence requirements. The age of eligibility was originally 70, but it was lowered to 69 in 1966 and progressively by one year in each succeeding year to 65 in 1970. The pension amount is based on length of residence in Canada currently subject to a minimum of 10 years of residence. The pension amount is reduced for people with higher incomes—LifePaths implements this clawback through the income tax system. OAS pensions are considered as taxable income.

From 1952 to 1967, benefit rates have been periodically adjusted. From 1968 to 1970, the OAS pension amount was adjusted annually in January in line with changes in the Pension Index, with its 2% ceiling, which had been developed for the CPP. (The Pension Index is defined for any given year as the average of the Consumer Price Index for a 12-month period ending June 30 of the preceding year, with an upper limit of 2%.)

Presently, benefits paid under the Old Age Security Act increase in January, April, July and October of each year, when there is an increase in the cost of living as measured by the Consumer Price Index. If the Consumer Price Index declines, there is no reduction in payment.

3.11.5 Guaranteed Income Supplement

A Guaranteed Income Supplement (GIS) may be added to the OAS pension of a pensioner who has no or limited other income. Entitlement is normally based on income in the preceding calendar year, calculated in accordance with the Income Tax Act but excluding OAS payments and certain other sources of income. In determining entitlement for a married applicant, the incomes of both spouses are taken into account.

If a person is receiving a partial OAS pension (because of residency requirements), the maximum GIS is increased by the difference between the partial pension and the full OAS pension. GISs are not considered as taxable income.

3.11.6 Allowance for the Survivor

Spouse's Allowance dates back to 1975. The program was designed to provide benefits equivalent to the OAS pension and the GIS. The initial target group was people in need aged 60 to 64 who were married to GIS recipients.

Individuals who received Spouse's Allowance used to lose all their benefits when their pensioner spouses died; however, that inequity was eliminated in 1979 under legislation that allows recipients to continue receiving benefits to age 65, when they become eligible for the OAS pension and GIS.

A Spouse's Allowance may be paid to the spouse of an OAS pensioner if the spouse is from 60 to 64 years of age. A spouse may be entitled to receive the allowance if he or she has a minimum of 10 years of residence in Canada after the age of 18. The spouse must be a Canadian citizen or legal resident in Canada when the application is approved, and the combined income of the couple must not exceed the maximum permitted by the law. Widows and widowers 60 to 64 years of age are also eligible to receive Spouse's Allowance benefits provided they meet the residence requirements and have limited income. The Widowed Spouse's Allowance stops if a widow or widower remarries. Spouse's Allowances are not considered as taxable income.

Allowance stops when the recipient becomes eligible for an OAS pension at age 65. The benefit also ceases to be payable if the pensioner spouse becomes ineligible for GIS or the couple becomes separated or divorced.

The maximum full monthly Spouse's Allowance is equal to the full basic OAS pension plus maximum GIS at the married rate. The maximum amount for a Widowed Spouse's Allowance is somewhat higher.

3.11.7 Registered Pension Plans

Registered Pension Plans (RPPs) are retirement benefit programs provided voluntarily by employers or by unions in both the public and private sectors of the economy and are funded both by employees' and employers' contributions. There are two basic types of RPPs: defined contribution (DC) and defined benefit (DB). Under the DC plan, the employer and employee are committed to a specific contribution rate. Under the DB plan, benefits are determined by a formula that is stipulated in the plan text.

The first step LifePaths takes in modeling RPPs is to determine whether a person will be a new RPP member. To be considered at all, a person must first be a non-student, a paid worker, without any current RPP plan, and from 15 to 55 years of age. The chances and timing of becoming a new member are re-assessed each year or whenever a transition to employment occurs. The variables influencing the probability of becoming a member include the sector of the job (public or private), age, sex, year, year of birth, earnings, and, for the private sector only, occupation group, education, previous year of labour force attachment, age at immigration and province of residence.

If the person is determined to become a new member, he or she will be assigned one specific plan in all its detail, including the type of the plan (DB or DC) and plan provisions (e.g., contribution rate, benefit rate, integration and indexation). The variables influencing the type of plan include the sector of the job, year of birth, and, for the private sector only, sex, education, province of residence, occupation group and wage placement in earnings distribution. The portability of the plan is also determined at this time. A portable plan is one that assumes the continuity of the plan membership—i.e., allowing accumulation of years of service from job to job.

A new member's starting RPP status is always ‘Current Active.' With this status, along with the plan's portability setting, the member enters cycles of RPP plan status changes that are tightly interlaced with their labour force status and transitions (modeled in the career employment module). The RPP module uses the following five categories of RPP status, taking into account the portability of a plan:

  • Current Active: Member currently employed.
  • Current Inactive: Member not employed, plan portable.
  • Deferred: Member not employed, plan not portable, years of service are less than or equal to two.
  • Closed: Member not employed, plan not portable, years of service are greater than two.
  • In-pay: Member or survivor receiving benefits.

These status changes occur whenever there are labour force transitions from employed to non-employed or from non-employed to employed, when retired, and in the event of a person's death. All other maintenance activities for the plan, such as updating years of service and other information about the member, making contributions, calculating pension adjustment amount, determining DC asset accrual, checking if it is time to take-up benefits and calculating benefits are performed at the end of every month for each given plan status and type. Scores of detailed assumptions have to be made along the way in accomplishing these activities.
New membership probabilities and probabilities of obtaining a specific type of plan were initially estimated from the Survey of Financial Security. Pension adjustment (PA) and Registered Retirement Savings Plan (RRSP) data (tax data) were then used as a first step adjustment to the new member (PA) probability for the dimensions sex, age, year and earnings. The final adjustment used total member counts by sex and sector from the Pension Plans in Canada Survey.

3.11.8 Registered Retirement Savings Plans

RRSPs began in 1957. In that year, an amendment to the Income Tax Act permitted individuals to make deposits into personal savings plans for future retirement income and receive tax savings not only through deducting the tax of contributions, but also through exempting the tax of investment income earned within RRSPs. RRSP savings are accessible anytime. However, if withdrawals are made, the amount withdrawn will be taxed the same as one's income. Accumulated savings must be converted into annuity income or registered retirement income funds (RRIFs) before the end of the year in which the beneficiary reaches a specified age (currently 71 years).

The RRSP module in LifePaths consists of four components:

  • contributors and contributions
  • asset growth
  • cash withdrawals
  • conversions of RRSP assets to RRIFs or annuities.

LifePaths places all RRSP activities at the end of each year. First of all, a person's new RRSP room is calculated according to the legislated rules, taking into account whether a person has a PA. This new room is to be used for RRSP purposes for the coming year (year+1). To be eligible to make an RRSP contribution, a person's total RRSP room at this time must be positive—i.e., a positive sum of new room from the previous year (year-1) plus all accumulated room that was previously unused, if applicable. If this requirement is met and the person is from 15 to 69 years of age, then they will go through a process that determines whether they will contribute to an RRSP this year, and if yes, the contribution amount. This amount is then deducted from the total room this year.

People with positive RRSP assets can withdraw cash. There is no information available, however, to determine whether a person is withdrawing their assets down to zero; this behavioural detail is absent in LifePaths for people younger than age 65. For people from 65 to 69/71 (of conversion age), LifePaths has a withdrawal plan. Variables influencing the probabilities and size of contributions and withdrawals are sex, age, marital status, earnings, whether that person is an RPP member with a PA, lagged contributions and withdrawals, province of residence, an individual specific random component with zero mean, and status change variables such as whether the person was just married last year; just separated, divorced or widowed last year; and whether they moved from another province last year.

Conversions from RRSP assets to either an RRIF or an annuity take place from age 65 to the mandatory conversion age of 69/71. The decision to convert is according to a set of proportions cross-classified by couple or single status, sex, tax year and age (65 to 69/71). If a conversion is determined, then the annual pension amount is calculated according to the type of conversion (RRIF, annuity or both). For an annuity, a fixed factor is applied to the assets to determine the annual pension. For an RRIF, the minimum percentage required at each age is applied upon the remaining assets to obtain the annual pension.

The asset growth component posed challenges for LifePaths. Using a set of historical rates of returns for some financial instruments such as treasury bills, GICs, bonds and Canadian and U.S. stock indices, almost all other aspects of investments are implemented according to some reasonable assumptions. LifePaths classifies the financial instruments into high-risk (e.g. stocks), medium-risk (e.g., corporate bonds) and low-risk (e.g., GIC) groups. LifePaths then assumes varied risk tolerance scores among people in different sex, age and earnings groups, and translates these scores into a varied mix of high-, medium- and low-risk investment portfolios. The historical rates of returns are the net of Management Expense Ratios and an additional penalty rate that compensates for the inefficiencies in the individual retail investment market. For future rates of returns, options are made for either using historical average rates of returns by risk class or a random pick of intervals of years within historical data series.

PA and RRSP longitudinal tax files (1990 onward) were used to estimate the probabilities and amounts of RRSP contributions and withdrawals. Greenbook Tax Files were used both for inferring the proportions to have a withdrawal plan within ages 65 to 69/71, and the proportions to convert RRSP assets to RRIFs or annuities. Historical patterns of contributors and contributions before 1990 are adjusted using information from Statistics Canada's publication "RRSPs: Tax-assisted retirement savings."Data on historical rates of returns for various financial instruments are from Canadian Socioeconomic Information Management System (CANSIM) tables and the "Report on Canadian Economic Statistics 1924-2002" of the Canadian Institute of Actuaries.

3.12 Saving and wealth

The inclusion of (non-pension) saving and wealth is a new area of module development, currently focusing on income adequacy at retirement. At this time, models are available for home ownership and non-registered assets and debts. LifePaths does not model the ownership of businesses. An important component still missing are intergenerational and family transfers and bequests.

3.12.1 Housing

The LifePaths housing module models home ownership, house value (changes) and house equity. The model operates in yearly steps and is cross-sectionally consistent with census distributions of house values by income and household type. Longitudinal consistency is enforced by two main simplifying assumptions: First, individuals usually stay in ownership. Second, besides the general change of house values observed in census data, house value changes over the life course are driven by changes in household type (e.g., marriage) and change in income (5% income quantile). Distributions of house values are parameterized by constructing 5% house value quantiles within each income quantile and household type. People are assumed to stay within the same house value quantile over their life course. Thus we allow upward and downward mobility because of changes in income and household type, but assume that the (unobserved) factors (e.g., taste and regional factors) placing a person into a house value quantile within a given income quantile are age invariant.

Updates are on a yearly basis and are processed in five steps:

  1. Mortgage payments are made, if applicable. Payments depend on historic and projected interest rates and the duration of the mortgage, which is assumed to be 25 years for the initial mortgage taken up at home purchase, and 10 years for additional mortgages taken up for upgrades.
  2. It is decided if a house is being sold. This only occurs in the case of union formation or dissolution. In the case of dissolution, the equity is divided between partners. Cashed out equity is used the next time each person purchases a house.
  3. It is decided if a house is purchased. For those who never owned a house, we use the increments observed in census data. Those who sold a house alongside a union formation event immediately buy a new home according to the updated household characteristics. In the case of union dissolution, the probability to buy a new house is the age-specific probability of a single person to own a house. The algorithm accounts for different probabilities of former renters and owners to enter ownership after a divorce.
  4. The house value is assigned or updated. House values are drawn from distribution tables by 5% income quantiles and 5% house value quantiles within each income quantile, by calendar year and family status.
  5. Finance decisions are made. For a first purchase, a down payment is sampled by age and household type. For following purchases, the cashed out equity is used as a down payment. Upgrades are financed by a second mortgage. Whenever an upgrade occurs, the duration of the second mortgage is re-initialized to 10 years. Equity cashed out because of downsizing is used to pay off first the second, then the first mortgage.

Ownership rates and their increments as well as the distribution of house values by income quantile are based on census data. The distribution of down payments (as a proportion of the house value) for first-time buyers by family characteristic and age at purchase is based on the 2005 Survey of Financial Security. We assume that all changes in house price values outside the range of +/-5% of the Consumer Price Index are because of investment or downsizing and that a fixed proportion of investments is financed by a second mortgage.

3.12.2 Residual (non-registered) assets and debts

The module for non-registered assets is built on top of the existing LifePaths model. The modeled assets are comprised of financial assets (other than pension savings) and properties (excluding primary homes). Both stocks and annual flows are modeled. The module closes a gap in the modeling of savings in LifePaths which was previously restricted to various vehicles of registered pension savings (RRSPs and RPPs) as well as equity in housing. Saving behaviours are modeled conditionally on choices concerning registered pension savings (RRSPs), as well as home ownership and equity.

The three main data sources available and used for the modeling of non-registered assets are (1) the Survey of Financial Security (SFS) and its predecessor Asset and Debt Surveys for stocks of wealth, (2) the Survey of Household Spending (SHS) and Family Expenditure Survey (FAMEX) for information on the annual flows of saving and dissaving, and (3) Longitudinal Administrative Databank (LAD) for data on longitudinal investment income.

Concerning data, serious challenges had to be faced:

  • The absence of longitudinal data (except for dividends, interest, rental income and capital gains in LAD).
  • Separate datasets for stocks and flows.
  • The incomplete collection of data in the case of mortgages, where there's no distinction made between principal and interest payments.
  • Some potential saving components are not well defined, for instance personal insurance which can contain pension saving components.
  • Possible issues with the quality of some of the data due to small sample sizes and the possibility of larger than average non-sampling error for some data.

The most important consequence for the development of the Non-Registered Assets module is that a statistical approach in the way it is done in many other LifePaths components cannot be followed. Specifically, observed saving rates and their distribution can only provide calibration targets, while theoretical assumptions are needed to produce individual level saving rates. SHS data reveal a very wide range of saving rates with almost 50% of people age 20-64 not saving at all or having negative saving. Such snapshot pictures contain no information how saving rates change over time for individuals. The variance in savings rates stems from several factors which are unobservable in cross-sectional data. For example, it might be reasonable to assume that observed negative saving rates are an effect of consumption smoothing (e.g. are produced by individuals who experience a temporary income loss due to unemployment) or result from purchases of consumer durables like vehicles which typically do not occur every year.
Saving decisions are modeled as yearly events for persons up to age 64.  The following describes the basic algorithm;

  1. Calculate a "statistical" saving rate. This rate can be interpreted as the expected saving rate in absence of income change and irregular purchases of vehicles. Individual level characteristics taken into account are age, calendar year, sex, family characteristics, RRSP savings, home ownership and income quantile. The calculation is based on regression models estimated from SHS data.
  2. Apply a "taste factor". We assume, that people are different in "taste", thus some always save more while other always save less in otherwise identical circumstances. 
  3. Consumption smoothing: We assume that people make additional savings in case of increased income and make withdrawals in the case of income loss. Withdrawals are subject to budget constraints.
  4. Account for vehicle purchases. Vehicle purchases follow a statistical model based on SFS data and can occur at any time of the year.
  5. Calculate resulting savings or withdrawals. Finalize the saving decision (if saving is positive, make a final decision taking into account a probability of additional expenditures).
  6. Make portfolio choices.

Assets savings and debts are implemented by a system of individual level accounts. For instance, each individual has an account for financial assets (and debts) and for properties. Accounts are linked to individualized rates of return and costs of borrowing. Positive returns are subject to taxation. All models are parameterized separately for single males, single females, and couples. In the case of couples, income is split and both partners save the same amount holding separate accounts. Besides the regular yearly saving events, deposits and withdrawals are made by various events, e.g. when purchasing a vehicle; when purchasing, upgrading, or selling a home; when taking out RRSP savings for home purchases; and or for the financing of post-secondary studies (student loans).

While highly stylized and operating on the national level only, the module very well reproduces the wealth distributions observed in data especially of people in the age-range 60-64. Detailed documentation and validation results are available.

3.13 Health

LifePaths models health status in two ways: the first based on a five-level scale of disability; the second on the Health Utilities Index (HUI), which is a continuous measure of health.

3.13.1 Disability

LifePaths models transitions between five levels of disability—the most severe being permanent institutionalization, an event that depends on the level of a person's disability as well as their age and sex and the current year. Disability is defined in terms of the characteristics most likely to be associated with the need for assistance in performing everyday activities, concentrating on four activities: everyday housework, grocery shopping, meal preparation and personal care. In turn, these activities were posited to depend primarily on the following kinds of disabilities or impairments: mobility, dexterity, cognitive capacity and pain. In effect, the disability indicator has been tailored to reflect aspects of the assistance that may be required to maintain independent living.

Reasonable disability data are available mainly starting from the 1990s. In particular, the National Population Health Survey (NPHS) provides longitudinal data from 1994 to 2000, as well as cross-sectional prevalence. The NPHS covers both the household population and those in institutions, and the survey included several measures of disability. As a result, the NPHS has provided the basis for both prevalence distributions of disability by level of severity, and microlevel estimates of transition dynamics.

Transition probabilities for movements between each possible combination of these disability states were estimated using longitudinal NPHS data spanning the 1994, 1996, 1998 and 2000 cycles of the survey. To allow for transition probabilities varying not only with the current disability state but also with the individual's prior disability trajectory, the estimation draws on both lagged and current disability status.

3.13.2 Health Utilities Index

The other health indicator modeled in LifePaths is the HUI. This index provides a description of an individual's overall functional health using eight attributes: vision, hearing, speech, mobility (ability to get around), dexterity (use of fingers and hands), cognition (memory and thinking), emotion (feelings) and pain. Based on responses to a standard set of questions, the HUI provides a summary functional health score that lies between -0.360 and 1.000. For instance, an individual who is nearsighted, yet fully healthy in the other seven attributes, receives a score of 0.973. The most preferred health level on the HUI scale (perfect health) is rated 1.000 and death is rated 0.000, while negative scores reflect health states that are considered worse than death. The HUI score is derived using a weight that has been assigned to each level of the eight attributes. The weights embody the views of society concerning health status. These views are termed ‘societal preferences,' and are based on preferences about various health states as elicited from a representative sample of individuals.

As such, the HUI measure may be useful in a broader range of applications than would the disability measure. Nevertheless, neither the disability measure nor the HUI measure would be completely satisfactory as an indicator of disability for the purposes of the Canada and Quebec Pension Plans. For those purposes, it would be necessary to have an indicator that embodies a medical doctor's judgements of health in combination with a respondent's self-reported health.

As with the disability measure, the LifePaths model of HUI dynamics draws on NPHS data: using longitudinal data spanning the 1994, 1996, 1998, 2000, 2002 and 2004 cycles of the survey. To initialize each simulated health trajectory, it is assumed that each newborn is in perfect health (HUI equals 1.000). Thereafter, functional health status is updated on each birthday in two steps:

  1. First, it is determined whether or not any change is to be made to the HUI score for the current age. This determination is based on probabilities that depend on the individual's current age, current and lagged HUI score, immigration status, student or employment status, presence of a spouse and broad education level. In addition to direct influences on the likelihood of change, there are random influences representing the degree of variability among otherwise identical individuals and reflecting differences in variance by immigrant and education statuses. This random term is imputed at birth and remains fixed over an individual's lifetime: in effect, it represents an individual's intrinsic susceptibility to change.
  2. Then, if it is determined that a change is to be made to the HUI score, the magnitude of the change is imputed using an equation influenced by the same set of characteristics (e.g., age) as in the first step. In addition, there is another random influence that reflects unexplained differences between individuals that represent a person's intrinsic frailty, but with differing variance by immigrant and education statuses. Finally, there is a random influence (with constant variance) that represents the unexplained year-to-year variability experienced within an individual's life.

As a consequence of imputed HUI, a simulated individual's mortality risk is changed: those with a lower HUI are more at risk than those with a higher HUI. For that purpose, relative risks that depend on the simulated HUI score and age have been estimated from NPHS data. These relative risks are unlikely to be accurate for historical simulations (i.e., for periods prior to the NPHS), but are likely to be useful for projections into the future. Similarly, there is a risk of ‘double counting' the effects of education and marital status, if those risk factors are directly applied to mortality with HUI turned on.

4. Summary

LifePaths aims to create the best possible empirical picture of the past and future Canadian population's socio-economic status from a life course perspective. The simulation of detailed life histories placed into the evolving tax-benefit and social insurance policy context makes LifePaths a generalized, policy-oriented simulation model capable of framing and answering "what if" questions in many policy domains. While LifePaths has ongoing utility, its greatest importance lies perhaps in its ready availability to analyse proposals that find their way onto the policy agenda with little prior warning. The potential impact of such proposals is often large and is frequently in the multi-billion dollar range. On the other hand, the political time frame of the proposals is often short. This means that the analytical capability to develop or evaluate the proposals needs either to be created quickly or be already in place. The complexity of longitudinal modeling means that there is typically not enough time to develop from scratch the tools necessary to adequately and credibly analyse policy for specific proposals. The LifePaths project fills this gap by providing a foundation on which to build specific, specialized models designed to evaluate new policy proposals.

 
 
Date modified:

Archived - LifePaths

Archived information

Archived information is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please "contact us" to request a format other than those available.

The LifePaths project is now discontinued and is no longer supported.

LifePaths is a dynamic longitudinal microsimulation model of individuals and families. Using behavioural equations estimated using a variety of historical micro-data sources, LifePaths creates statistically representative samples consisting of complete lifetimes of individuals. The model's behavioural equations generate, at sub-annual resolution, the discrete events that together constitute an individual's life history. In addition to its longitudinal capabilities, a complete set of overlapping cohorts allow LifePaths to produce accurate and representative cross-sectional results from the year 1971 onwards.

LifePaths is used to analyze, develop, and cost government programs that have an essential longitudinal component, in particular those whose nature requires evaluation at the individual or family level. It can also be used to analyze a variety of societal issues of a longitudinal nature such as intergenerational equity or time allocation over entire lifetimes.

Overview

HTML Document (PDF, 228.23 KB)

This overview contains information on the current release of LifePaths, including a brief exposition of selected key concepts.

LifePaths Model

If you are have questions about LifePaths or dynamic socio-economic microsimulation, please email statcan.microsimulation-microsimulation.statcan@canada.ca

Date modified:

Some methodological changes made to the Natural Resource Stock Accounts as of reference year 2012

As of reference year 2012, data for the Natural Resource Stock Accounts program have been revised to reflect a number of methodological changes. Changes apply to the entire time series, from 1961 onwards for energy resources, mineral resources and timber. Details are presented below.

Firstly, in order to align with the new international standard for environmental accounting, the System of Environmental Economic Accounting 2012 (SEEA 2012), Monetary Natural Resource Stock Accounts estimates published in CANSIM now incorporate a positive return to the produced capitalNote1 employed in the extraction of resourcesNote2. The return to produced capital is estimated using a variable rate of return derived from real (inflation adjusted) rates of return on long-term Government of Canada bonds; the rate of return is applied to the value of produced capital employed in the extraction of resources net of depreciation.

Secondly, a geometric method of depreciationNote3 of capital employed in extraction of resources (rather than a linear method) is now used in the calculation of the depreciation component of the cost of produced capital associated with the extraction of natural resourcesNote2. This change is required to reflect a similar change introduced in 2012 in the National Balance Sheet Accounts.

Thirdly, estimates of the value of timber assets are no longer published as a 5-year moving average. While this change leads to greater volatility of timber asset values, it brings greater coherence between timber asset values and the value of subsoil assets (i.e., mineral and energy resources), which are not based on moving averages.

Notes:

  1. For example, machinery and equipment or buildings used in the process of extracting resources.
  2. Return to produced capital and depreciation of produced capital are components of the cost of the capital employed in the extraction of natural resources. For more information on the calculation of natural resource asset values, please see chapter 3 of 16_505_g1997001_eng.pdf (PDF, 0 bytes)
  3. Depreciation valued at replacement cost.

The Consumer Price Index and the CPI Enhancement Initiative 2008-2009 to 2012-2013

Evaluation Report

May 2013

  • Executive summary
  • 1. Introduction
  • 2. The Consumer Price Index
    • 2.1 Background and context
    • 2.2 Objectives and outcomes
    • 2.3 Program management, governance and key stakeholders
  • 3. Evaluation methodology
    • 3.1 Evaluation scope, timing and quality control
    • 3.2 Evaluation questions by issue area
    • 3.3 Methods
  • 4. Findings — relevance
    • 4.1 Core issue 1: continued need for the program
    • 4.2 Core issue 2: alignment with government priorities
    • 4.3 Core issue 3: consistency with federal roles and responsibilities
  • 5. Findings — design and implementation of the CPI-EI
    • 5.1 CPI-EI design decisions
    • 5.2 CPI-EI implementation
    • 5.3 CPI-EI governance
    • 5.4 Implementation challenges
  • 6. Findings — performance
    • 6.1 Core issue 4: achievement of expected outcomes
    • 6.2 CPI information available in public domains
    • 6.3 Stakeholder engagement
    • 6.4 Core issue 5: demonstration of efficiency and economy
  • 7. Conclusion and recommendations
    • 7.1 Conclusion
    • 7.2 Recommendations
  • 8. Management response and action plan
  • Appendices
    • Appendix A — CPI and CPI-EI logic models
    • Appendix B — Governance and project management structure
    • Appendix C — Detailed evaluation matrix
    • Appendix D — Summary of key activities and outputs of CPI-EI
    • Appendix E — Examples of relevant management practices
    • Appendix F — IMF data quality assessment framework, Canada
    • Appendix G — Literature and documents reviewed

Executive summary

This report presents the findings and recommendations from the 2012/2013 evaluation of the Consumer Price Index (CPI), including the CPI Enhancement Initiative (CPI-EI).

The evaluation was designed and conducted in accordance with Treasury Board (TB) Policies and Guidelines as outlined in the TB's Policy on Evaluation (April 2009). The evaluation objective is to provide credible and neutral information on the ongoing relevance and performance of the CPI. The evaluation focuses on program performance from 2008/2009 to 2012/2013.

Overview of the CPI

The CPI, produced by Consumer Prices Division (CPD), is a key Statistics Canada product. The CPI is a targeted measure used by key stakeholders to assess changes in consumer prices over time and to determine inflation rates.

In 2009/2010, the Government of Canada introduced a five-year, $45-million initiative to enhance the CPI, based on economic theory and best practices, to estimate price changes more accurately and to use its available resources more cost effectively. The initiative is focused on changes to the sample size and design, as well as basket updates and quality adjustments, in order to address known biases that are a normal characteristic of fixed basket CPIs such as commodity substitution and representative estimates. These changes are supported by IT infrastructure projects, which are critical enablers to the CPI-EI, and by an HR strategy.

Evaluation methodology

This evaluation was led by the Evaluation and Professional Practices Division with the support of Intergage Consulting Group Inc., an Ottawa-based consulting firm. Field work was conducted from August 2012 to March 2013. Data for this evaluation were collected from four lines of evidence: a literature review, a document review, a jurisdictional review, and interviews with key informants. Logical and statistical analyses were used. Findings were correlated to identify trends and patterns.

This evaluation has these limitations:

  • program size and complexity in relation to the evaluation budget
  • heavy focus on the enhancement initiative
  • high diversity of key informant interview groups
  • inherent biases of key stakeholders.

Findings

Relevance

The CPI is an important measurement used by the Government of Canada and other key stakeholders to inform economic and monetary policy. It is used in the development of the GDP measure. The Bank of Canada uses the CPI to measure rates of inflation; Finance Canada uses it to help determine transfer payments to the provinces and territories. Internationally, the CPI is one of the most widely-used statistics for measuring price changes and economic performance; it is the most visible and credible measure to anchor inflation expectations. Consequently, there is a continued need for the CPI; it remains highly relevant.

The CPI is aligned with federal and provincial government priorities, and is used by all levels of government. The production of the CPI is an ongoing priority for Statistics Canada. The Government of Canada has a legitimate role and responsibility to produce the CPI. Statistics Canada, given its ability to provide objective and non-partisan statistics, should be the agency to do so.

Design and Implementation of the CPI-EI

The evaluation found evidence that the CPI-EI was necessary to address known weaknesses of the CPI, and to ensure that the CPI continues to be a high-quality, reliable index. Evidence suggests that the design of the CPI-EI is sound, and that the initiatives underway are the right ones to improve the CPI. Furthermore, there is evidence that the CPI-EI is being implemented as planned; some elements are being implemented ahead of schedule.

The evaluation found CPI-EI governance arrangements to be appropriate and sufficient to support the initiative and the ongoing management of associated risks. However, there is some concern about the clarity of roles and responsibilities within CPD, and about governance arrangements and mechanisms understanding for managing cross-cutting issues at lower levels in the division. Another concern is the potential erosion of subject-matter expertise — either through turnover or retirement — and the potential risks and impacts on the CPI.

Achieving Expected Outcomes

Good progress has been made toward realizing CPI and CPI-EI outcomes at the immediate and intermediate level. CPI is timely, relevant and, despite some weaknesses in availability of information and limitations of the index, credible. The CPI is an excellent index when used for its intended purposes. The evaluation's findings confirm that, as a result of the CPI-EI, biases in the CPI will be reduced, leading to a more reliable and credible price index with greater internal capacity. As for the ultimate outcome, that "Canadians have accurate, timely, relevant set of consumer price indexes meant to support a variety of key policy programs," the CPI program is well positioned. More specifically:

Data production

Canada's CPI meets international standards and is an index that is trusted, credible, relevant and timely. Evidence also revealed that the changes ushered in under the CPI-EI are consistent with the approach found in other countries and that the CPI-EI is needed to maintain continued and possibly increase the overall confidence in the CPI.

Dissemination and communication

Statistics Canada's CPI data, research, publications and methodology are made available to the public in an open manner via Statistics Canada's website. However, at times, stakeholders have had difficulty finding information and a Statistics Canada contact person to respond to questions about the CPI.

CPD appears to have well established relations with their primary clients, but has invested less time in engaging a broader range of stakeholders in the CPI and CPI-EI. Stakeholders desire improved communications and dissemination of more detailed information and data, as well as more frequent updates.

Research and development

There is evidence that the CPI-EI is well positioned to achieve its intermediate outcome and the CPI data and index withstand public and expert scrutiny. However, the evaluation found a need for continual research and development to ensure that the CPI remains highly relevant and credible.

Information technology

The IT enablers introduced to support the CPI-EI are meeting CPI requirements and are improving CPI data collection methods. The CPI-EI has led to the enhancement of the IT infrastructure, by introducing improvements, greater efficiencies and modernization of CPI computer systems and tools. However, there is a potential risk that future resource constraints may limit CPI's IT evergreen strategy to renew key IT systems over rolling five-year cycles.

Economy and Efficiency

A review of program financial data indicates that, from a financial perspective, the CPI-EI project is being implemented according to plan. Expenditures on the CPI and the CPI-EI appear to be in accordance with the original budget. The CPI seems to use an efficiency-based approach in its practices. Some evidence shows that the CPI has efficient administrative and operational procedures.

There is room to improve efficiency by implementing a performance measurement system, including harmonizing processes used in the CPI with those used in the System of National Accounts and the Survey of Household Spending Household Survey. Some alternative approaches and considerations for the CPI were identified, such as moving the CPI to a one-year update cycle; making use of alternative data sources and data collection methods; examining the benefits of introducing a superlative index and allowing for revisions; and using seasonal adjustments.

Recommendations emerge from the evaluation findings that advocate strategic planning for sustainability after CPI-EI complete implementation, enhanced governance at the sub-project level, improved communication with stakeholders, accessibility of CPI products, and strengthened capacity for systematic performance measurement to demonstrate the achievement of results.

1. Introduction

1.1 Purpose

This report presents the findings and recommendations from the 2012/2013 evaluation of the Consumer Price Index (CPI), including the CPI Enhancement Initiative (CPI-EI). The evaluation report provides information on the program, the methodology used, the findings and conclusions for each of the evaluation questions, and overall conclusions and recommendations. This evaluation was conducted as prescribed by the Departmental Risk-based Audit and Evaluation Plan for 2012/2013 to 2016/2017, approved by the Departmental Evaluation Committee on March 27, 2012. The project was managed and carried out by the Evaluation and Professional Practices Division in Audit and Evaluation Branch.

2. The Consumer Price Index

This section briefly describes the CPI and the CPI Enhancement Initiative (CPI-EI), including the program's objectives, governance and resources.

2.1 Background and Context

Produced by Consumer Prices Division (CPD), the CPI is a key Statistics Canada product. It is the target measure used by the Bank of Canada to set interest rates. It is also used to adjust public- and private-sector arrangements and contracts such as pensions, collective agreements, rental agreements and tax brackets, so that price changes are factored into payments and transfers. In addition, the CPI is used to deflate 'nominal' values relating to consumer incomes and expenditures to produce 'real' measures, where price changes are eliminated—this helps reveal underlying changes in the economy or individual well-being. The CPI is also used for many ancillary analytical purposes, such as understanding the business cycle, making investment decisions or forecasting economic trends.

When it was first introduced in the early 1900s, the CPI was based on 29 food items, 5 fuel and lighting items, and the cost of rent in some 60 cities. Today, the CPI reflects prices for virtually every category of good and service Canadians can buy, right across the country. It is constructed by collecting some 72,000 price observations monthly, tracking about 600 goods and services in the Canadian economy and covering 1200 representative products. The CPI measures the average change in retail prices seen by all consumers in Canada. Items are weighted to account for typical spending patterns and how often consumers buy certain items (for example, appliances are replaced only rarely). The CPI is continually updated to be as comprehensive and representative as possible.

The CPI currently uses 2002 as its base year, the point in time when the index equals 100. The CPI is based on the overall cost of a fixed basket of goods and services bought by a typical consumer relative to price of the same basket in the weight reference year. Because it includes such a broad range of goods and services, the CPI is often used to estimate changes in the cost of living.

The CPI has become the primary tool for measuring inflation given the central role of these data in the management of Canada's economy. The CPI is not a dollar value, like gross domestic product (GDP): it represents an index number, a percentage of measured price change from the base year. As the prices of different goods and services do not all change at the same rate, a price index is designed to reflect their average movements.

2.1.1 The CPI-EI

In 2009/2010, the Government of Canada introduced this five-year, $45-million initiative to improve the CPI based on economic theory and best practices, in order to estimate price changes most accurately and to use the CPI's resources most cost-effectively. Statistics Canada received new funding to permit improvement to Canada's CPI in these areas:

  • Sample size activity aims to increase the number of prices collected. The number of observations taken relative to the size or characteristics of a population can affect the quality of the inferences made about the population being measured. As the sample sizes of some products in Canada's CPI are considered too small to be representative, the CPI-EI aims to increase the number of prices collected of goods and services purchased by Canadians. The objective is to double the number of prices collected (from 60,000 to 120,000) within the next five years — approximately 5,000 additional price quotes in each of the first three years, and 15,000 in the fourth year and 30,000 in the fifth.
  • Sample design activityaims toimprovethe selection of stores and products to be sampled. These changes should better reflect what Canadians are actually purchasing, as well as shifts in consumer product and store preferences. They should improve timeliness in the introduction of new outlets and products, as well as avoidance of oversampling of less significant products and/or undersampling of popular items. The CPI-EI objective is to improve the sample design by using more scientific sampling methodologies and better targeted, more efficient collection. These changes should be fully operational by year 5.
  • Basket updates activity aims to ensurethat the weights of the products in the CPI basket are updated more frequently and processed more quickly. Prior to the CPI-EI, the CPI basket was updated every four years: each update was based on data 18 months previous to the year the expenditure data were gathered. This led to the basket becoming gradually outdated and not being reflective of the recent changes in consumers' buying patterns. CPI-EI committed to providing a biannual update of CPI basket weight by 2013/2014 and to reducing the time to incorporate a new basket into the CPI to 12 months to make updates a better and earlier reflection of consumer spending.
  • Quality adjustment activity aims to develop new methodologies to better distinguish pure price movement from that resulting from changes in product quality or product characteristics. Currently, about one-quarter of products in the CPI are quality adjusted. The CPI-EI targeted the development of better methodologies for an additional 75 products by 2014/2015, bringing the total number of adjustment to 225 products. Coverage will be extended to appliances, furniture and electronics.

These areas are supported by two key IT infrastructure projects that are critical enablers to the CPI-EI.

  • Data collection infrastructure improvements aim to increase management capabilities to control collection activities in the field. This will better align collection activities to the CPI's data needs. The intention is to ensure that products and stores are better targeted and that more information is collected for improved quality assurance. Hand-held devices used in the field for data collection will be replaced and their software upgraded.
  • Data processing changes aim to improve the CPI's data processing and index estimation infrastructure. The index estimation system (MPS), which constructs indexes from the raw data, is built on technology and systems design principles that are over 20 years old. It is also a complex system not designed to efficiently accept frequent changes to basket methodology. The objective is to modernize the technology used in the index estimation and improve its documentation, resulting in a system that is easier to use and maintain.

To support these four key activities and two IT infrastructure initiatives, Statistics Canada developed a recruitment strategy to hire new employees and a dedicated training program to shorten learning curves.

In 2010/2011, Statistics Canada started to receive funding to undertake the CPI-EI. In 2012/2013, the CPI-EI began its third year of implementation. In this fiscal year, the initiative has focused on developing, piloting and implementing new business processes, IT systems and sample changes.

2.2 Objectives and Outcomes

2.2.1 The CPI

The CPI's objective is to reflect changes in consumer prices experienced by Canadians. This could be achieved through a diverse set of activities, such as collecting prices, applying stringent quality control measures to produce error-free and quality adjusted prices, providing representative weights at timely intervals, periodically re-evaluating and improving methods in line with international standards, as well as analyzing and disseminating data.

The immediate outcomes from these activities are to produce trusted data, put information products in the public domain and ensure that released data rest on a robust IT infrastructure. The intermediate outcomes include supporting key programs; providing high quality service to users; enhancing the design of the program (i.e., concepts, methods and data sources) and its IT infrastructure. The long-term outcomes are to ensure that Canadians have access to accurate, timely and relevant set of consumer price indexes meant to support a variety of key policy programs (monetary, fiscal and social), as well as meeting System of National Accounts (SNA) requirements.

2.2.2 The CPI-EI

The CPI-EI's objective is to produce a better measure of price movement in Canada based on sound and internationally respected methodologies and supported by a more efficient and stable technical infrastructure.

Through the four key activities and two support initiatives mentioned in the section above, the anticipated CPI outcomes include: more accurate (representative) product prices (averages); better reflection of what Canadians are buying, leading to a more representative CPI; better understanding of changing habits of Canadians; and better estimates of pure price change (removing noise in the movement of prices arising from changes in product characteristics). Like the CPI, the CPI-EI supports the long-term outcome: "improved quality of policy decision making from using an enhanced CPI."

The enhancement initiative is embedded in the CPI. CPI-EI's activities are meant to improve the CPI's ability to achieve stated outcomes. For further details, Appendix A presents logic models related to the CPI- and the CPI-EI.

2.3 Program Management, Governance and Key Stakeholders

2.3.1 Program Management

CPD, a member of the Business and Trade Statistics Field at Statistics Canada, is responsible for the overall management of the CPI and the CPI-EI. The division's mandate is to produce the CPI based on timely and relevant data and analysis of consumer price change temporally (over time) or spatially (geographically).

CPD comprises the production sub-division and the development sub-division, which are involved in the CPI and CPI-EI.

Production sub-division is responsible for producing a wide range of temporal (base funded) and spatial (cost recovery funded) price indexes monthly. It is also responsible for coordinating releases, responding to information requests and developing and integrating a divisional information management framework.

Development sub-division is chiefly concerned with developing methodologically and conceptually sound processes to ensure ongoing and sustainable CPI relevance and quality. It also produces purchasing power parities and spatial program outputs. This work is conducted as part of sectional operations and projects that are part of the CPI-EI. This sub-division hosts the Cygnus development section. This group is responsible for redesigning the index estimation system, and for building subject-matter expertise on price index estimation.

2.3.2 Governance and Project Management Structure

A number of organizational changes were made to the CPI to support the introduction of the CPI-EI and the Departmental Project Management Framework Guidelines in April, 2012. CPD distinguishes the governance structure from the project management structure. The CPI-EI governance consists of two tiers of steering committees (decision-making bodies): a director general-level steering committee for the CPI-EI, responsible for oversight of the whole CPI-EI; and three director-level steering committees, chaired by the director of CPD, which oversee components of the CPI-EI.

The project management structure consists of boards and committees that are responsible for the strategic aspect of the program, including the management board, the CPI-EI Management group and the sub-project groups.

More details on governance and the CPI structure are presented in the project governance organization structure chart in Appendix B.

2.3.3 CPI Key Stakeholders

CPD has several internal and external key stakeholders that provide inputs, such as raw data or services, or who benefit from or use the outputs, such as price indexes.

Internal stakeholders

Data providers

Within Statistics Canada, the Consumer Prices Program has a close relationship with several divisions that collect/provide price or expenditure data. Collection Planning and Management Division (CPMD) manages the collection infrastructure and the interviewers who gather much of the consumer price data in the field.

The other major group of data suppliers is from Statistics Canada's Social Statistics Field. Income Statistics Division is the primary data provider for the construction of the CPI basket's weights; Labour Statistics Division collects information on residential rents on behalf of CPD; Income Statistics Division collects information for the CPI in the Survey of Household Spending; and the Centre for Education Statistics collects data on tuition fees.

The third data supplier group is Producer Prices Division (PPD). It provides not only raw data, such as motor vehicle discounts, but also indexes such as the New Housing Price Index and the Computer Price Index, which are used by CPD in calculating the CPI.

Data users

CPD's main internal client is the SNA, which uses the CPI in constructing data series for personal expenditures at constant prices. SNA also uses CPI prices for a basket of goods and services specified by the Organization for Economic Co-operation and Development (OECD) for the construction of Purchasing Power Parities.

External stakeholders

CPD works with a wide variety of external stakeholders that comprise partners, data users and the Price Measurement Advisory Committee (PMAC). The PMAC provides advice on concepts, methods, and priorities to CPD and PPD on all aspects of price measurement. The committee meets annually and each major Prices Program component is covered at a PMAC meeting over time, about every five years.

External and Internal Partners that Provide Input to CPD

The international community, represented by the Ottawa Group, the International Working Group on Price Statistics and the joint United Nations Economic Commission for Europe–International Labour Organization meeting on consumer price indexes – is key to contributing to the advancement of price measurement and learning from other countries' experiences with their national CPI programs.

Provincial and territorial representatives, or 'focal points', meet under the auspices of the Secretariat of Federal-Provincial-Territorial Relations. At their meetings, they ask questions about the concepts, methods and data used in the CPI and provide feedback on the provinces' satisfaction as users of the program.

Data users

CPI data are used by a wide range of external stakeholders, such as

  • Canadians, since the purchasing power of money is affected by changes in prices, the CPI is useful to virtually all Canadians
  • federal departments and entities including the Bank of Canada, Finance Canada, the Canada Revenue Agency and social policy departments such as Human Resources and Skills Development Canada
  • provincial and territorial governments
  • the private sector, for indexing contracts and pensions
  • national associations that represent the interests of various stakeholder groups
  • other such as the International Monetary Fund, the Bureau of Labour Statistics and the Organization for Economic Co-operation and Development.

Figure 1. Consumer Prices Division and its stakeholders

 Divisions of Consumer Prices and placement of stakeholders

Notes
BSMD Business Survey Methods Division
CTCES Culture, Tourism and the Centre for Education Statistics
CPMD Collection, Planning and Management Division
HRSDC Human Resources and Skills Development Canada
ISD Income Statistics Division
LSD Labour Statistics Division
LHSAD Labour and Household Surveys Analysis Division
PMAC Price Measurement Advisory Committee
PPD Producer Prices Division
SNA System of National Accounts
Source: Adapted from Consumer Prices Division's 2010 Quadrennial Program Review

Description for Figure 1. Consumer Prices Division and its stakeholders

This figure depicts the Consumer Prices Division and its stakeholders. It is divided into quadrants: internal stakeholders that are providers of input, internal stakeholders that are users of output, external stakeholders that are providers of input, and external stakeholders that are users of output.

The internal stakeholders that are providers of input for the Consumer Prices Division are:

  • Business Survey Methods Division (BSMD)
  • Culture, Tourism and the Centre for Education Statistics (CTCES)
  • Collection, Planning and Management Division (CPMD)
  • Income Statistics Division (ISD)
  • Labour Statistics Division (LSD)
  • Labour and Household Surveys Analysis Division (LHSAD)
  • Producer Prices Division (PPD)
  • Other

The internal stakeholders that are users of output of the Consumer Prices Division are:

  • Producer Prices Division (PPD)
  • System of National Accounts (SNA)

The external stakeholders that are providers of input for the Consumer Prices Division are:

  • Price Measurement Advisory Committee (PMAC)
  • Focal Points
  • International Community

The external stakeholders that are users of output of the Consumer Prices Division are:

  • Bank of Canada
  • Finance Canada
  • Human Resources and Skills Development Canada (HRSDC)
  • Provincial governments
  • Canadians
  • Other

2.3.4 CPI Program Resources

While Statistics Canada receives ongoing funding for the Consumer Price Index, since fiscal year 2010/2011 the CPI program has also received supplemental A-base funding to implement the CPI-EI for a total of $17,238,157 in 2012/2013 (Table 1). According to internal data, this new funding was allocated to all activities related to the CPI to support new activities. Total funding for the CPI and the CPI-EI is detailed in Table 2.

Table 1. Summary of New A-base Funding – Budgeted Expenditures, 2010/2011 to 2012/2013
New funding for CPI-E Fiscal year
2010/2011 2011/2012 2012/2013 Total
Vote 105, program expenditures ($)
Personnel 2,550,967 4,369,115 6,975,278 13,895,360
O&M 901,213 890,078 2,052,881 3,844,172
Subtotal 3,452,180 5,259,193 9,028,159 17,739,532
EBP @ 20% 510,194 873,823 1,395,055 2,779,072
Accomodation 331,626 567,984 906,786 1,806,396
Total, excluding GST/HST 4,294,000 6,701,000 11,330,000 22,325,000
Table 2. Summary of CPI and CPI-EI Budgeted Expenditures, 2008/2009 to 2012/2013 by CPD (Total)
Budgeted expenditures, CPI and CPI-EI Fiscal year
2008/2009 2009/2010 2010/2011 2011/2012 2012/2013 Total
($)
Consumer Price Index 7,262,397 7,489,525 11,393,319 12,944,270 13,524,767 52,614,278
Salary 5,973,222 6,428,145 9,316,130 11,226,958 12,158,993 45,103,448
Non-salary 1,289,174 1,061,380 2,077,189 1,717,312 1,365,774 7,510,829

3. Evaluation Methodology

3.1 Evaluation Scope, Timing and Quality Control

This evaluation looked at the impacts of the CPI and the CPI-EI. The evaluation objective is to provide credible and neutral information on the ongoing relevance and performance of the CPI. The evaluation focuses on program performance from 2008/2009 to 2012/2013 for the CPI and the CPI-EI, which accounts for a total budgeted expenditure of $52,595,279.

The approach was to review and confirm the conditions before the CPI-EI was approved, in December 2010, and assess whether the key risks and weaknesses identified in relation to CPI are being addressed through the CPI-EI and whether the CPI is on track to achieve its expected outcomes. The evaluation is based on a quasi-experimental design: assessment is focused on both a retrospective and future view. The evaluation risks, availability of performance measures, evaluation funding and timing were all factors that helped calibrate the scope of this evaluation. The evaluation scope was defined accordingly to ensure an appropriate balance between level of effort and evaluation context.

The evaluation was designed and conducted in accordance with Treasury Board (TB) Policies and Guidelines as outlined in the TB's Policy on Evaluation (April 2009) and the other components of the Treasury Board Secretariat Policy Suite. The evaluation will serve Statistics Canada's accountability requirements in relation to its Treasury Board submission: it will also provide analysis and recommendations to inform future decision-making.

The evaluation was conducted from late August 2012 to March 2013. Intergage Consulting Group Inc., an Ottawa-based consulting firm, was contracted to perform the research. Intergage worked collaboratively with Evaluation and Professional Practices Division at Statistics Canada.

In addition, selected experts from the current Price Measurement Advisory Committee reviewed and provided feedback on the evaluation work plan and the final evaluation report.

Finally, validation and approval sessions for the final evaluation report took place with program representatives and Statistics Canada's Departmental Evaluation Committee.

3.2 Evaluation Questions by Issue Area

The questions for this evaluation were selected based on CPD and CPI-EI logic models. The questions and indicators by core issue are set out in the evaluation evidence matrix, and are outlined in Table 3. A more detailed table with sub-questions and indicators is in Appendix C.

Table 3. Overview of Evaluation Issues/Questions and Indicators
Issues Questions
Continued need for the program
  • Does the program continue to address a demonstrable need?
Alignement with government priorities
  • How well is CPI aligned with Statistics Canada outcomes and Government of Canada priorities?
Consistency with federal roles and responsibilities
  • Are the program activities aligned/congruent with Statistics Canada's jurisdictional, mandated and/or legislated role?
Design and implementation
  • Are the design decisions made under the CPI-EI relevant to the CPI and the context?
  • Is the CPI-EI being implemented as planned?
  • Are the right governance mechanisms/arrangements (including CPI and EI project governance) in place to support oversight and risk mitigation?
Achievement of outcomes
  • To what extent did the program achieve its expected immediate outcomes?
  • To what extent did CPI achieve its expected final outcome?
  • Are there any unexpected impacts/outcomes from the CPI-EI?
Demonstration of efficiency and economy
  • Is the program managed cost-effectively?
  • Is there a more effective approach to achieving CPI outcomes?
  • Is the CPI Program duplicating or complementing existing programs/initiatives?

3.3 Methods

3.3.1 Preliminary Consultation

Prior to undertaking the evaluation, preliminary interview consultations were done with CPI leaders. This led to the validation of the logic model and the development of an evaluation work plan, including the methodological approach.

3.3.2 Lines of Evidence

Data for this evaluation were collected from multiple sources incorporating four lines of evidence: a literature review, document and jurisdictional reviews and interviews with key informants. Logical and statistical analysis was used and findings were correlated to identify trends and patterns. The evaluation team synthesized and analyzed the preliminary findings related to each line of evidence into a summary matrix.

Literature review: The review covered 21 pieces of literature, and examined national and international academic sources, as well as studies produced by stakeholder organizations. This review explored the need for a CPI; some of the key issues and challenges for CPIs; and general trends and recommendations for addressing key CPI challenges and weaknesses.

Documentation review: This review included two categories of documents: broader government-wide documents, including appropriate acts; and Statistics Canada's program-specific documents. The review of the program-specific documents provided information on the rationale and continued need for the CPI and CPI-EI and alignment with overriding government priorities and Statistics Canada's legislative mandate; basic financial information on the CPI and the CPI-EI; as well monitoring and reporting documents in relation to the overall CPI-EI plan. The review of these documents informed evaluation issues concerning overall performance of the CPI-EI.

Jurisdictional and benchmarking review: As part of this review, a high-level comparison of the CPI approaches of six other countries—Australia, the United States, France, Netherlands, New Zealand, and the United Kingdom—to that of Canada was done pre- and post-CPI-EI. This review included comparison of different CPI baskets (e.g., number of stores, frequency of updates), sample size, distribution of sample, quality adjustments and revision approach.

Key informant interviews: 28 stakeholders from various key informant groups were interviewed. They were:

  • program representatives involved with CPI production and release, including senior leaders, chiefs and subject-matter experts from CPD, those leading system upgrades, methodology and collection changes, as well as representatives from Statistical Information Systems Division and the Survey of Household Spending — 15 individuals were interviewed in 12 meetings
  • end users of the CPI, including representatives of the Bank of Canada, Finance Canada and other interested federal departments; representatives from provincial finance ministries (eight including one internal end user); and a national association with an interest in the CPI
  • five Canadian and non-Canadian internationally recognized experts.

3.3.3 Methodological Limitations

Below are some of the key challenges and limitations in relation to the evaluation of the CPI.

Program size and complexity in relation to the evaluation budget (calibration)

The CPI-EI is a large transformational initiative that involves large budgets and diverse stakeholders. Ensuring appropriate coverage throughout this evaluation was a challenge — particularly given the budget. In particular, the number of interview consultations was relatively small given the size of the program and the complexity of stakeholders involved in the program. In some cases, it was a challenge to draw conclusions from the interviews given the low number of interviews from stakeholder groups.

Mitigation strategy: To mitigate this limitation, the evaluation team carefully selected the key informant interviewee sample to ensure it represented a balance of stakeholders who could provide informed feedback. Additional resources were freed up to support a more extensive jurisdictional review.

Focus between the program and the enhancement initiative

While the evaluation is on the CPI and the CPI-EI components, the evidence relies heavily on the CPI-EI component. This could be explained by program's high focus on the integration of the CPI-EI components since 2010/2011.

Mitigation strategy: While two logic models were developed for CPI and CPI-EI, the evaluation team decided to assess the program according to the CPI logic model. The team used the CPI-EI logic model, which is mainly output oriented, as an input for the CPI stated outcomes. This integrative approach helped assess the extent to which the program addresses needs and is helping to achieve CPI's expected outcomes.

Diversity of key informant interviews

Interviewing a variety of key informants posed a challenge: often there were only one or two interviewees from each key informant group. Each group indicated a range of opinions and needs that were sometimes quite different from others in the evaluation. Thus, reporting findings was often difficult because, in a number of areas, the feedback of key informants did not coalesce around common views. This is a fundamental challenge of the CPI: some needs of key stakeholders are mutually exclusive.

Mitigation strategy: The evaluation team corroborated key stakeholders' feedback with findings from the literature review to ensure broader support for the suggestion being made. In addition, this final evaluation report includes the key informant findings at the broader level and not at an individual level.

Potential biases of key stakeholders

Given that this is a highly specialized area, the key stakeholders consulted likely have inherent biases.

Mitigation strategy: The evaluation team used an independent quality assurance process for the project findings to ensure that no individual perspective would drive the findings of the evaluation, but that the findings were based on multiple lines of evidence. Regular internal review meetings were held to ensure that the data were captured in the evidence matrix and that there was no bias from the views of any one interviewee or member of the evaluation team.

4. Findings — Relevance

This section looks at the overall relevance of the CPI and the CPI-EI, and considers three core issues: the need for the CPI and CPI-EI, alignment with government and departmental priorities, and the congruency with role of the federal government.

4.1 Core Issue 1: Continued Need for the Program

Question 1: Is there a continued need for the program?

Does the program continue to address a demonstrable need?

Key Findings

A continued need for the CPI

The evaluation found evidence of continued need for the CPI. The index is a critical measurement of price changes used by government and other key stakeholders to inform economic and monetary policy, including development of the GDP and informing the Bank of Canada in measuring rates of inflation. Moreover, internationally the CPI is one of the most widely-used statistics for measuring price changes and economic performance.

Area of unmet needs

Although they were not consistently identified by all groups, some areas of unmet needs were identified such as sub-indexes (e.g., basic necessities index), deeper level of data (e.g., core CPI for provinces) and, post-publication revisions to the index.

4.1.1 A Continued Need for the CPI

A review of program documents and the literature, as well as consultations with key informants, showed that the CPI continues to address a demonstrable need. The CPI is a critical index that is used around the world to track and measure price changes.

The CPI is widely used as an indicator of the change in the general level of consumer prices or the rate of inflation. It is used in three ways in Canada:

  • SNA deflation—to transform nominal variables into real variables, for example, to distinguish real changes in GDP from those due to inflation
  • indexation—to compensate individuals for price changes, for example, to adjust the value of government transfers to individuals
  • inflation target—to inform monetary policy made by the Bank of Canada, the CPI feeds into the calculation of inflation and interest rate.Footnote 1

Internal key informants and documents attested to the fact that the price-level information in the CPI is vital to a wide range of personal, government, and business decision makers.

Within Statistics Canada, the CPI is important, even central to other agency activities. For instance, the CPI is a key input for macro-economic programs to monitor current economic conditions, such as a deflator for the GDP index for the System of National Accounts.

Externally, the CPI is an important index used by the Bank of Canada to help set interest rates. The Bank also uses a Core CPI published by Statistics Canada.Footnote 2 The Bank monitors core inflation to help inform inflation targeting, not as a replacement for the CPI.Footnote 3 The Bank of Canada also maintains an inflation calculator, which presents the impact of inflation on purchasing power, based on monthly CPI figures dating back to 1914.Footnote 4 As a Bank of Canada report mentions, the CPI is used extensively for these purposes because it is available on a monthly basis, it has a short publication lag, and it relies heavily on retail transaction prices rather than imputed prices.Footnote 5

The CPI is also used by Finance Canada to determine transfer payments to provinces and territories and by other government departments as an escalator for federal programs. Key informants also noted that the CPI is used by government representatives as a good reading on the pace of inflation in Canada and to inform various policy and budget decision-making advice and recommendations related to tax policy, labour market decisions as well as structural efficiency and inefficiency. The CPI is also used by governments and other sectors to adjust pensions, income taxes and contracts, such as wages, rents, and leases, as well as by universities for research.

The uses of the CPI affect all Canadians at some point in their life. For example, the CPI is used to index the Old Age Security, which impacts more than 4 million people every three months and the Canada Pension Plan, which impacts more than 5 million people every 12 months.

Internationally, the CPI is one of the most widely-used statistics for measuring price changes and economic performance. For example, the International Monetary Fund (IMF), of which Canada is a member, uses the CPI as a tool to assess countries' economic and financial development and to ensure that countries pursue policies that are conducive to orderly economic growth and reasonable price stability. According to internal key informant interviewees, CPI is also used by the OECD, in spatial indexes, and by the United Nations.

Areas of unmet needs

According to evidence found in the document review and comments from organizational end users, criticism from the general population about the CPI comes from consumers and those on fixed incomes, particularly seniors, who compare movements in the CPI to changes in their personal income to monitor and evaluate changes in their financial situation.Footnote 6 This is one of the fundamental challenges of the CPI. Criticism may result from a misunderstanding of the CPI. It is not a cost-of-living index: for example, it does not adjust to changing consumption patterns in such a manner as to leave consumer utility constant. Furthermore, given that it is a basket of average prices, it may not always be reflective of the realities of individual Canadians, depending on their demographic and geographical location. In fact, some compelling academic research concludes that the CPI is not, and can never be, a perfect index.Footnote 7,Footnote 8,Footnote 9

While those consulted understand the limitations and support the primary areas of change under the CPI-EI, there continues to be areas of unmet needs.

Organizational end users indicated an interest in developing and issuing sub-indexes to the CPI, particularly in the areas of seniors and those living close to the poverty line (e.g., a basic necessities index). In fact, the need to better reflect the actual cost of living for some age cohorts was also raised in a number of academic publications.Footnote 10 CPD has recognized that a single CPI cannot serve all uses equally well, and has been examining publishing 'families' of indices.

Furthermore, consultation with internal key informants did not yield consensus on the extent to which CPI is supporting the critical needs of key stakeholders. While some noted that the CPI is meeting stakeholders' critical needs, particularly in relation to improved basket, sample and quality assurance, others noted that stakeholders are often interested in a deeper level of data than Statistics Canada is releasing (i.e., a core CPI for provinces).

CPD has identified some of the following unmet needs in relation to the CPI:Footnote 11

  • the extent to which series are seasonally adjusted
  • the treatment of owned accommodation
  • whether a resale house price index should be included
  • whether a domestic or national perspective is adopted
  • whether there should be a superlative index
  • whether the CPI should be revised after it is published.

Experts and end user key informants also mentioned these areas of unmet needs, although they were not consistently identified by all groups. The experts were the only key informants to identify the need for a superlative index and the possibility of post-publication revisions to the index; however, the high costs associated with these changes were also noted as a challenge.

4.2 Core Issue 2: Alignment with Government Priorities

Question 2: Does the program align with Government of Canada priorities and departmental strategic outcomes?

How well is CPI aligned with Statistics Canada outcomes and Government of Canada priorities?

Key Findings

The CPI is aligned with Statistics Canada outcomes and Government of Canada priorities.

The evaluation found evidence that the production of the CPI is one of the ongoing priorities of Statistics Canada and is aligned with the federal government's priorities. The federal government requires a measure of price changes in order to inform economic and monetary policy and it is used by all levels of government.

The CPI is aligned with departmental outcomes and priorities. According to the 2012/2013 Program Alignment Activity, the program resides within the sub-activity Economy-wide Statistics of the Economic Statistics program activity. The CPI's objective is to reflect changes in consumer prices experienced by Canadians in an accurate, timely and relevant manner with the intent to support a variety of key policy programs (monetary, fiscal and social), as well as SNA requirements. The CPI objective is aligned with Statistics Canada's ongoing strategic outcome, outlined in its 2012-13 Report on Plans and Priorities:

Canadians have access to objective, high quality, non-partisan statistics, statistical products, services and analyses on Canada's economy and society which fulfill legal requirements, are relevant to policy formulation and decision makers and are responsive to emerging issues.Footnote 12

The 2012-13 Report on Plans and Priorities also mentions that "producing a comprehensive program of macroeconomic statistics to support fiscal and monetary policy is one of Statistics Canada's fundamental responsibilities." The CPI, as a main program to support fiscal and monetary policy, is considered part of Statistics Canada's priority.

The evaluation found that the CPI is aligned with Government of Canada priorities. While speeches from the throne do not specifically refer to the CPI, since 1999 they have stressed the importance of improving Canadians' quality of life and strengthening the economy. A review of federal budgets since 2006 supports the evidence of the throne speeches, demonstrating the use of the CPI to measure inflation and provide evidence to support government-wide financial decisions.

As stated in the 2012/2013 whole-of-government priorities, the federal government is committed to evidence-based decisions-making to support Canadians and other key stakeholders in various sectors of the economy:

  • A transparent, accountable and responsive federal government: "Program activities aim to safeguard public trust in government and strengthen the interaction between the government and Canadian citizens. This is done through the delivery of services that are responsive to citizens' needs, and through public accountability, compliance and recourse measures."
  • Strong economic growth: "Programs aim to create an environment conducive to economic growth and to promote the development of all sectors of the economy and in all regions of Canada."

The CPI supports federal government priorities for an accurate and timely index to inform government decisions by providing relevant pricing information, either in its original form or transformed through economic modeling to estimate future price movements. It also responds to the priority of transparency by providing objective and non-partisan statistics.

According to evidence from the key informant interviews, the jurisdictional review, and the literature review, the CPI is the most visible and credible measure to anchor inflation expectations, and it should be the basis for the measurement of core inflation. Greater accuracy in the CPI is well aligned with the priorities of Statistics Canada and the federal government overall, including the importance of having an accurate price index to inform the Bank of Canada and overall government policy.

4.3 Core Issue 3: Consistency with Federal Roles and Responsibilities

Question 3: Is the program aligned with federal roles and responsibilities?

Are the program's activities aligned/congruent with Statistics Canada's jurisdictional, mandated and/or legislated role?

Key Findings

There is a legitimate role and responsibility of the Government of Canada in producing a CPI, and for it to be produced by Statistics Canada.

There is evidence that CPI activities are congruent with Statistics Canada's legislated role and the federal government's jurisdictional role. The evaluation has found that Statistics Canada is the only organization in Canada that can produce the CPI, given its status as an independent agency, as well as its expertise and capacity.

All data collected and published by Statistics Canada is done under the authority of the Statistics Act. Even if the CPI is not stated specifically in this Act, Statistics Canada, as an agency, has the duty under sections 3a, 3b, and 3e to

  • a) collect, compile, analyze, abstract and publish statistical information relating to the commercial, industrial, financial, social, economic and general activities and condition of the people;
  • b) collaborate with departments of government in the collection, compilation and publication of statistical information, including statistics derived from the activities of those departments;
  • e) generally, promote and develop integrated social and economic statistics pertaining to the whole of Canada and to each of the provinces thereof and to coordinate plans for the integration of those statistics.Footnote 13

Other acts and regulations make reference to Statistics Canada and the Consumer Price Index. If those references do not legally require that Statistics Canada produce statistics, they assume that Statistics Canada does in fact produce such statistics as part of its regular program and require that such statistics be used for specific purposes:

  • Under section 5 of the Bretton Woods and Related Agreements Act,Footnote 14 Canada, as a member of the IMF, is required to provide statistics on price indexes and follow the Special Data Dissemination Standards (SDDS) agreement.Footnote 15 The SDDS identifies four dimensions of data dissemination. One of them, integrity of disseminated data, requires that, "official statistics must have the confidence of their users. In turn, confidence in the statistics ultimately becomes a matter of confidence in the objectivity and professionalism of the agency producing the statistics. Transparency of its practices and procedures is a key factor in creating this confidence."Footnote 16
  • The CPI is mandated under the Old Age Security Act.Footnote 17Under different sections (e.g., sections 2, 7, 22), the act requires that pensions are adjusted quarterly based on the CPI for Canada, as published by Statistics Canada under the authority of the Statistics Act.

Evidence from the jurisdictional review and key informant interviews shows that Statistics Canada is the only organization in Canada that can produce the CPI based on its status as an independent agency and its expertise and capacity. In all the jurisdictions reviewed for this evaluation, the CPI is produced monthly by the national, independent statistical agency or, in the United States, by the Bureau of Labor Statistics. All internal and end users interviewed agreed that Statistics Canada is the only organization in Canada that can produce the CPI. Statistics Canada is seen as an independent government agency with a high level of credibility, neutrality and trustworthiness. Statistics Canada also has a significant statistical and analytical infrastructure in place and, therefore, the capacity to produce the index.

5. Findings — Design and Implementation of the CPI-EI

This evaluation issue was included in the study because senior management wishes to examine critical design and implementation areas of the CPI-EI project three years after its initiation. Their reason for this examination is the critical significance of the CPI and the magnitude of resources invested in the CPI-EI.

Specifically, the evaluation study assessed the following aspects of the project implementation:

  • CPI-EI design decisions and their relevance to CPI
  • whether the implementation of the CPI-EI is advancing according to plan
  • whether the CPI-EI has appropriate governance structures.

This section presents the key findings of each of these areas of examination. Challenges applicable to the CPI-EI implementation that were identified by the evaluation are summarized at the end of the section.

5.1 CPI-EI Design Decisions

Question 4: Is the CPI Enhancement Initiative being implemented as expected?

Are the design decisions made under the CPI-EI relevant to the CPI and the context?

Key Findings

The CPI-EI was necessary to address known weaknesses of the CPI and to ensure that the index continues to be a high quality and reliable index. Evidence demonstrates that the design of the CPI-EI is sound and the activities underway are the right ones to improve the CPI.

The CPI is a highly complex economic and monetary measure. The changes to the CPI-EI — specifically more frequent basket updates, more monthly price quotes collected and quality adjustments— are appropriate measures to reduce the three critical biases observed in CPIs (e.g., substitution, new goods and outlets and quality).

The CPI-EI planned improvements are well aligned with international practices. In particular, moving to a two-year cycle for updating the basket brings Canada in closer alignment with leading jurisdictions.

Evidence from the documents reviewed, as well as all internal interviewees consulted, shows that, over the past few decades, several emerging factors necessitated renewing and improving the CPI, such as

  • More knowledgeable end users with increasing demands for a CPI that evolves, better reflects price movements and remains current with international best practices.
  • Federal downsizing in the 1990s, which led to funding and program cuts, including cuts to the CPI's sample size and increased risk of errors — for instance, an error in the Traveler Accommodation sub-index became public knowledge in 2006. This error increased public and stakeholder perception of the possibility of further errors in the calculations of the CPI.
  • Increasing criticism that Canada's CPI (as well as those of other nations) overstates inflation due to a measurement biasFootnote 18 and does not adequately reflect factors such as new emerging items, substitutions and quality measures. Concern has also been heard that Canada's CPI may not be keeping pace with those of international partners.

To reinforce the CPI and address known weaknesses, CPD undertook extensive research and consultation to find the best approach to produce a better measure of price movement: this led to the CPI-EI project. The intended goal of CPI-EI is to modernize, consolidate and streamline the CPI's processing systems to make them more efficient, coherent, consistent, secure and robust. This would prepare these systems to support planned program changes related to sample size, sample design, basket updates and overall quality, including quality adjustment (detailed in Section 2.2).

Criticism of Canada's CPI was consistent with the findings of the US Boskin Commission Report,Footnote 19 a special inquiry into the use of the CPI as a measure of the cost of living in the US. The Boskin Commission found that the overstatement of the CPI was due to biases: the important unintended consequences include over-indexing government outlays and tax brackets as well as increasing the federal deficit and debt. In Canada, the total CPI measurement bias is estimated by the Bank of Canada to be approximately 0.5 percentage points per year over the 2005-to-2011 period; similar with earlier findings estimated this bias at 0.6 percentage points.Footnote 20,Footnote 21 Slightly less than half of this bias was seen to be caused by the fixed nature of the CPI basket of goods and services (i.e. which is related to the frequency of basket updates).

A review of the literature and research provides details on the changes that were required to the CPI. First, the US Boskin Commission ReportFootnote 22 confirms that, in many countries, the approach to the CPI must improve for it to be useful as a measure of changes in the cost of living. Further, the literature contains an empirical rationale for Statistics Canada's decision to undertake the CPI-EI: in particular, it shows the importance of reducing measurement bias from traditional sources. For instance, research undertaken for the US Bureau of Labor Statistics (BLS) affirms the importance and direction of the changes proposed and under way with the CPI-EI.Footnote 23 Evidence from the literature review shows that the general policy direction of Statistics Canada's CPI-EI is in line with the Boskin report recommendations and is consistent with international trends. Updating the basket more frequently and improving the mix of products and services in the basket to better reflect what consumers are buying (all key elements of the CPI-EI) are some of the most effective approaches to addressing the upward bias in the CPI and to addressing issues of quality and speedier changes to the composition of baskets.Footnote 24,Footnote 25,Footnote 26

The jurisdictional review and consultations with internal representatives and experts found further evidence that the CPI-EI planned improvements are well aligned with international practices. In particular, moving to a two-year cycle for updating the basket aligns Canada more closely with leading jurisdictions such as France, the Netherlands, the United Kingdom, the United States and New Zealand. The first three countries update their baskets every year; the United States, every two years; and New Zealand, every three years. This further supports a conclusion that the design decisions under the CPI-EI are highly relevant.

Along with these findings, key informants agreed that the CPI-EI project seems to address the most urgent needs of improvement for the CPI and addresses the potential risks of delays and future mistakes. According to some interviewees, the CPI-EI will bring Canada back to the leading edge, internationally, in terms of these types of price indexes. Many respondents shared their expectation that the CPI-EI is only the first step and that more initiatives will need to be put in place by Statistics Canada to improve the CPI and sustain the capacity and knowledge developed during this project.

5.2 CPI-EI Implementation

Question 4: Is the CPI Enhancement Initiative being implemented as expected?

Is the CPI-EI being implemented as planned?
  • What are the key challenges related to implementation and have mitigation strategies been put into place?

Key Findings

There is evidence that the CPI-EI is being implemented as planned and is progressing well.

Evaluation evidence indicates that the CPI-EI is being implemented as planned with some areas being implemented ahead of schedule (such as increasing the timelines for basket updates and price quotas).

Evidence found in the various CPD progress reports and briefings show that the CPI-EI is being implemented as planned. The evaluation found that the progress reports are consistent with initial planning and schedule for implementation. For example, the September 2012 CPD briefing to the Chief Statistician notes that the scope of the CPI-EI remains unchanged; that deliverables are on time or advanced; and that spending is on target. Appendix D summarizes the key activities and outputs of the CPI –EI, along with the targets and details about the actual levels for the first three years of the initiative.

Some accomplishments are worth highlighting.Footnote 27

Increased sample size

  • The number of monthly price quotes reached 9,837 in Year 3, ahead of the expected 6,000.
  • In Year 3, the total price quotes in the sample were 72,000 (the baseline was 60,000 in 2009). The program is on track for its goal and will probably doubling the size of the sample to 120,000 by 2014/2015.

Improved sample designFootnote 28

  • In 2012, the program created a geographical and outlet frame for outlet selection, using information from Census, the Business Register, and the Quarterly Retail Commodity Survey.
  • The CPI sample was linked to the Business Register (the matching rate for CPI outlets was 95%).
  • The number of new outlets used in data collection for the CPI has increased from 88 in Year 1 to 584 in Year 3.

Basket updates

  • Frequency has moved from four to two years, one year ahead of schedule. In June 2011, the program successfully introduced the 2009 reference year basket update, which is the first biannual update of basket weights in the history of the program and ahead of the 2012 schedule for biannual updates. In March 2013, the program introduced the 2011 reference year basket updated.
  • Quality was improved by applying new quality adjustment methods to over 100 products ahead of the target of 75 products.
  • Progress was made to improve the timeliness of the basket updates.

The improvement of IT enablers is also progressing on track.

  • The Field data collection device was replaced in April 2011.
  • The program has streamlined field data processing and sample management system interfaces.
  • Paper forms reliance was reduced in the fall of 2012.
  • A representative product module was introduced.
  • Outlet acceptance/rejection functionality was introduced.
  • The Index Aggregation System development (Cygnus), a three-part project, completed the alpha release of its first part on July 6, 2012, and is on schedule to be completed by the target date of September 2014.

5.3 CPI-EI Governance

Question 4: Is the CPI Enhancement Initiative being implemented as expected?

Are the right governance mechanisms and arrangements (including CPI and CPI-EI project governance) in place to support oversight and risk mitigation?

Key Findings: CPI-EI Governance

The governance arrangements are viewed as appropriate and sufficient to support the CPI-EI and the ongoing management of associated risks.

CPD senior management demonstrated ability to address emerging issues with overall project management, system integration and governance by enhancing human resource capacity, implementing relevant organizational changes and improving governance structures.

Evaluation evidence revealed that structures and processes are in place to monitor implementation progress of the CPI-EI. The Price Measurement Advisory Committee (PMAC) permits Statistics Canada officials to benefit from external, independent advice regarding important statistical matters.

However, a few challenges related to governance, capacity building and continuity planning were identified, such as horizontal discussion of cross cutting issues.

5.3.1 Governance

A CPI-EI governance documentFootnote 29 details the governance structure that supports the CPI-EI (Appendix B). Documentation provided and consultations with internal key informants show that the CPI-EI governance arrangements are reasonable: they are also adequate to support the implementation of CPI-EI and to manage associated risks. Interviews with key internal informants and selected external experts confirmed that the CPI-EI governance structures are in place and working well.

In addition to its governance structures, CPD has an advisory body, the PMAC. At its annual meetings, PMAC plays the critical role of bringing international expertise and best practices to inform Statistics Canada's approach to the CPI; acting as a sounding board for new ideas; and performing a challenge function. According to some key informants, however, there is room for the PMAC to improve, "by focusing on the setting of the agenda, asking the right questions, and narrowing down priorities and trade-offs."

5.3.2 Project Management

"To instill more project management rigor is a project in itself in CPI. It is becoming a dynamic program and will change over time. We are building capacity for this in the CPI. This is taking time. From my perspective, it is working and we are on target. Theory is now backed up by practice."

Internal informant

Being a highly specialized division, CPD had significant statistical expertise but needed "more planning expertise to deliver on time and budget." At the beginning of the CPI-EI, the practice in the division was more reactive than strategic (e.g., "to do more acting than planning.") CPD invested in project management training, in particular the Project Management Body of Knowledge (PMBOK) principles for CPD managers. This investment was viewed as taking time to develop capacity, but most internal informants believe that it is working and that the program management practices have improved: the PMBOK principles provide rigor and objective measures for monitoring project status, focusing on effort expended (time, budget, and resources).Footnote 30 This, internal informants attest, has helped build a strong project management capacity and culture. Examples of relevant management practices are presented in Appendix E.

Program documents show that, as of 2012, CPD has adopted the Departmental Project Management Framework (DPMF) and has developed several tools to facilitate the planning process and to provide inputs into the DPMF templates.

5.4 Implementation Challenges

The evaluation study identified a few governance and implementation challenges.

5.4.1 Governance Challenges

Interviews with internal key informants provided evidence of some challenges in setting up the CPI-EI governance structure and ongoing project management. The primary reason raised was that, operationally, the CPI-EI was set up and funded as a single project; however, the project actually consists of six inter-related yet independent sub-project groups.Footnote 31 Further challenges were noted:

  • Governance arrangements do not seem to be well understood by all CPD staff, particularly those at lower levels. This is also related to the need to further clarify areas of responsibilities and hand-offs in areas such as sample design, QA and basket updates.
  • A few internal informants noted that there were no effective mechanisms for bringing cross-cutting issues to the table for discussion at lower levels in the organization. They made reference to the previously existing Issues Committee, composed of economists, where areas of interest to the CPI such as research, and findings and recommendations used to be presented to management. These informants suggested that there continues to be a need within CPD for a horizontal mechanism at the chief, director, senior researcher and economist levels to discuss cross-cutting issues. This may have been addressed with the recently established practice of weekly integration meetings.

5.4.2 Capacity-building and Continuity-planning Challenges

Given the level of complexity of the CPI and the CPI-EI, internal key informants noted that CPD requires an expanded body of professional expertise in the theory and practice of price index numbers. This skill set is relatively scarce; few universities have graduate programs to address it. At the launch of the initiative, CPD needed to recruit additional personnel from within and outside Statistics Canada, and then develop these resources to meet the project needs. The hiring process and subsequent learning and development initiatives took investment of time and effort during the first two years: this investment is expected to yield substantial returns in subsequent year of the project. Program progress reports indicate that these activities have succeeded in building capacity and have not slowed project implementation.

However, several internal informants indicated concern that the CPD has lost significant subject-matter expertise, primarily at the chief level and above, as a result of retirement and organizational turnover. There is concern that an erosion of subject-matter expertise could put CPI-EI implementation and CPI modernization at risk, especially with respect to succession and continuity planning.

6. Findings — Performance

6.1 Core Issue 4: Achievement of Expected Outcomes

This section details findings related to the four streams of expectedresults that the CPI is expected to achieve: data production, information dissemination, research and development and information technology.

Immediate and intermediate outcomes were assessed separately. However, given the close relationships between immediate and intermediate outcomes in each area, it was determined that the best approach would be to report them together for a more integrated view and better understanding of each stream of outcomes.

In the case of data production, only the findings for the immediate outcome are reported in the achievement of outcome section. This decision was taken to avoid duplication: findings for the intermediate outcome, "provide information that supports the needs of key programs and stakeholders" were very similar to the findings for Core Issue 1, "continued need for program."

Finally, findings for the final outcome "Canadians have an accurate, timely, relevant set of consumer price indexes meant to support a variety of key policy programs" will be presented in Section 7.

Question 5: Is the program achieving the expected outcomes outlined in the logic model?

Data production
  • Produce trusted and relevant data in a timely manner (immediate)

Key Findings

Canada's CPI meets international standards and is an index that is trusted, credible, relevant and timely.

Evidence indicated that Canada's CPI is trusted, timely (i.e., CPD has never missed a release) and is meeting international quality standards. Evidence also revealed that the changes ushered in under the CPI-EI are consistent with the approach found in other countries, and that the CPI-EI is needed to maintain continued confidence in the CPI.

Recent changes introduced with the CPI-EI enable production of more trusted and relevant data

Early results of the CPI-EI show that the level of confidence in CPI data and its representation of consumer spending is being reinforced through a better quality assurance process and a more frequent and timely update of its basket weights. CPI-EI was needed to address some weaknesses of the CPI and to ensure continued confidence of users in the CPI.

Data production encompasses processing price quotes, calculating price indexes, analyzing data as part of the quality assurance processes, and liaising and co-ordinating with partners who collect statistical information. CPD produces temporal and spatial consumer price indexes. Production of each of those product lines involves collecting, processing and assessing the information. The documentation review and key informant consultations indicated that Canada's CPI data is trusted and timely.

Almost all key end users and experts indicated that the CPI is a trusted and credible price index. Some respondents affirmed that this trust comes from Statistics Canada's strong reputation in the area of price indexes, the Agency's access to good information on best practices (through advisory committees, and participation at international meetings) and its implementation of leading edge practices through the CPI-EI. A few end users expressed reservations due to known biases evident in the CPI and known past errors in the calculations of the CPI. Key informants reported that, while the trust in the index could be higher they highly trust the index because they are aware of its limitations. Consultations with key informants further revealed that CPD has never missed a release, and that the CPI cannot be produced more frequently than monthly.

There is a grey area regarding the level of trust. So we put our answer at "between medium and high" level of confidence. We know the weaknesses, and we use the CPI with knowledge of these weaknesses.

End user

This finding is reinforced by international studies. According to the literature reviewed, the CPI is considered a trusted and timely index that met international quality standards for statistical agencies and for national CPIs. As far back as 2003, all IMF reports concluded that CPI produces data that are generally trusted based on proven quality assurance practices. For instance, the 2003 IMFFootnote 32 conclusions were restated in the 2011 IMF Annual Observance Report, which concluded that the Canadian CPI meets the entire SDDS requirement under the Data dimensionFootnote 33 (Table 4), the Access dimension,Footnote 34 the Integrity dimensionsFootnote 35 and the Data Quality dimension.Footnote 36 In fact, IMF reports since 2008 conclude that, "The quality, coverage, periodicity, and timeliness of Canada's economic data are considered to be excellent both in the context of the Article IV consultation and for purposes of ongoing surveillance." (IMF, 2008, 2009, 2010, 2011).

Table 4. CPI Timeliness against SDDS Requirement, 2008 to 2011
Price Index: Consumer prices
(real sector)
National Periodicity
(Canada)
Prescribed Release Lag (SDDS) Reference Period
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
2008 to 2011 Monthly 1 month X X X X X X X X X X X X

All key informants agreed that the CPI-EI was needed to address weaknesses in the CPI and to ensure continued confidence in the CPI. According to experts consulted, the CPI-EI is expected to further improve an already good price index. Most respondents concluded that the CPI-EI is still in early stages of implementation: while these changes make sense in theory and should address weaknesses identified, more time is needed to see results of the change and IT upgrades. Nonetheless, the early findings suggest the CPI-EI is leading to the production of more trusted and relevant data and a more trusted CPI.

Question 5: Is the program achieving the expected outcomes outlined in the logic model?

Dissemination and Communication
  • Put information products into public domains (immediate)
  • Provide high quality service to users (intermediate)

Key Findings

Information about the CPI is made available in various public domains

Evidence indicated that Statistics Canada's CPI data, research, publications and methodology are made public in an open manner through Statistics Canada website even if, at times, they are difficult to find. Social media and a free data strategy recently implemented made information more accessible.

CPD appears to have well established relations with their primary clients, but have invested less time engaging other stakeholders in the CPI and CPI-EI. Informants desire better communications and dissemination of more detailed information and data and more frequent updates.

Improvements can be made in communicating information about the CPI, particularly about the CPI-EI, by providing more information and detail to the general public and by providing more frequent updates on the methods described in the CPI reference paper.

Users face challenges in finding someone in CPD to discuss complex issues and questions related to the CPI.

Statistics Canada staff are competent and have the knowledge needed to respond to specific requests. However, it can be difficult to identify the most appropriate expert at CPD who can respond to a given request or discuss CPI questions and issues.

6.2 CPI Information Available in Public Domains

6.2.1 Web-based Accessibility

The documentation reviewed showed that Statistics Canada's CPI products, research and publications are made public in an open and regular manner on its website. Table 5 shows that users with Internet access could choose from a number of products since fiscal year 1997/1998.Footnote 37 However, between fiscal years 2008/2009 and 2012/2013, only two new publications and four information documents for analysts and researchers were publicly released. This confirms some key informants' perceptions that Statistics Canada was not releasing enough updates and recent publications on the CPI.

Table 5. Related Consumer Price Index Products on Statistics Canada's Website Footnote 38
Product Number
of CPI products published and/or updated,
1997/1998 to 2012/2013
Number
of CPI products published and/or updated,
2008/2009 to 2012/2013
Articles and reports
Publications1 31 2
Information for analysts and researchers 19 4
The Daily2 174 62
Data tables
Summary tables 35 35
CANSIM 28 13
Definitions and Documentation
Definitions, data sources and methods 40 21
Questionnaires 4 4
Surveys 2 2

The main tool to disseminate and inform Canadians on the CPI is The Daily. This document is a record of the first official release of new datasets and products, and is also used to inform the public of the significant and noteworthy findings contained in the released CPI datasets and analytical products. To date, The Daily is the most efficient way to meet IMF standards for data releases. Published in conjunction with The Daily, the Consumer Price Index module is amonthly publication, geared toward educated laypeople and expert users on CPI data. It offers a more detailed monthly analysis for each CPI component, with accompanying charts, tables and briefing notes.

According to internal data, during fiscal year 2011/2012 the CPI module in the Daily was the most viewed part of the Statistics Canada site, with a total of 515,958 viewers.Footnote 39 End users consulted indicated that more information could be made available through The Daily such as monthly variation and rolling averages across different time periods.

Users can also access detailed CPI data from Summary tables, CANSIM and ESTAT. CPI data are loaded on CANSIM, a database that is updated daily. Until 2012, E-STAT was largely used to access CPI data. However, since February 1, 2012, all Statistics Canada's self-serve standard products, including CANSIM data, became available free of charge in its website, rendering E-STAT no longer relevant. E-STAT is no longer updated and will be discontinued July 1, 2013.

The availability of free data and the dissemination strategy of Statistics Canada's communications and dissemination group increased the access and availability to statistical data. Table 6 shows that publication views grew 215 percent and the viewed Summary tables grew 36 percent over the period 2006/2007 to 2011/2012. CANSIM information has accounted for more traffic since it became freely available in February 2012. The CPI data are the most popular table downloaded by CANSIM distributors for their clients.

Table 6. Views of CPI-related Pages on Statistics Canada's Website
CPI product Number of page views
2006/2007 2007/2008 2008/2009 2009/2010 2010/2011 2011/2012 2012/20131
Publications 115,916 221,625 347,642 338,791 405,413 365,614  n/a
Summary tables 215,205 210,275 294,515 318,688 337,723 294,264  419,420
CANSIM Not applicable2 12,9473 77,634

A few external end users raised issues about the accessibility of information because of the user interface of Statistics Canada's website. To find the right information, the user has to know their way around the Statistics Canada website in relation to the CPI. Some of the external end users consulted found searching for CPI-related information to be time-consuming. But the general view of all the experts and most end users consulted was that basic CPI information and products are well disseminated and communicated by Statistics Canada through its website.

Social media are also used to disseminate information on CPI. Registered followers can receive updates on CPI from Twitter (since January 2010), RSS feeds and mobile web (since March 2011), as well as Facebook (since February 2012). One user indicated that the RSS feeds increase the timeliness of the CPI data release.

The Statistics Canada CPI publications are frequently reported in the national media. According to an internal reporting document, the print, television, Internet and radio media use CPI data extensively — so extensively that it is difficult to fully assess media usage. In 2008/2009 fiscal year, there were 340 media mentions of the CPI in the 45 main news sources monitored in Newsbriefs. For fiscal year 2011/2012, the number of media mentions rose to 485 and as of March 26, 2013, the number of mention in the media for fiscal year 2012/2013 was 332 for fiscal year 2012/2013.Footnote 40

6.3 Stakeholder engagement

Consultations with senior internal key informants indicated that CPD has well defined and positive relations with their primary clients — the Bank of Canada, Finance Canada and the System of National Accounts (SNA). Interview consultations revealed that CPD meets regularly with representatives of the National Accounts. CPD representatives also meet with the Bank of Canada through high-level bilateral meetings at least twice a year, and with Finance Canada as needed. Beyond these primary clients, CPD's relations with other stakeholder groups such as other federal departments, provincial and territorial governments and interested national associations (e.g., pensioners) appear to be less frequent. Although Statistics Canada meets annually with provincial and territorial representatives, it does so on a broad consultative agenda: the CPI is one of the topics usually covered.

End users generally recognize that the CPD is attempting to improve how it presents CPI issues and changes to key stakeholders; however, most end users indicated that more could be done to increase knowledge exchange between CPI and key stakeholders.

Internal key informants recognize a gap in CPD's approach to stakeholder engagement and consultations. However some internal key informants caution that the division needs to balance expectations of Statistics Canada's neutrality and independence and the expectation to engage key stakeholders more broadly in determining the composition of the CPI.

6.3.1 More detailed information expected

For particular needs, end users consulted expressed appreciation that Statistics Canada now offers greater access to the CPI microdata:Footnote 41 this access enables them to run a deeper level of analysis. Internal key informants noted that if CPI information related to the above-mentioned access is released to the public, the underlying confidential data are not made public.

Key informants consulted indicated that the CPD could do a better job of communicating CPI information. External informants indicated a need for Statistics Canada to explain the CPI in simpler language that the average person would understand and, ultimately, for end users to explain the CPI to various stakeholder groups. The educational approach of the Bank of Canada website was raised by an expert as a good example to follow. Specific areas identified include, what does the CPI measure; how is it developed; what does it mean to Canadians; and how does Canada's CPI compare to CPIs of other jurisdictions. Better, simpler information on the CPI would generate efficiencies by reducing or eliminating the need for CPD and other government end users to spend time explaining the CPI to those who enquire.

More frequent updates on the CPI and the CPI-EI are also needed. According to key informants, little is known publicly about the CPI-EI to the point that other than CPD's primary clients — other end users knew little about the CPI-EI or its progress. Most users interviewed suggested that updates on CPI-EI should be shared via the website. The CPI reference paper and updates on the methodology used is also an issue for end users. A few key informants noted that the reference paper is dated and would require frequent updates to ensure it reflects changes in calculations and current practices at Statistics Canada.

Informants suggested that more open communication between CPD and the public may help reduce mixed messages and misinterpretation on the validity of the methodological approach, and may help key stakeholders defend Statistics Canada data and methodology.

6.3.2 Quality of Service Support

"Good information is provided but, often, it is difficult to get in contact with analysts if you have questions about data. It takes time to find the right person at StatCan who can answer the question. There can be delays, and we face short timeframes when we have to brief our minister on the data."

End user

External end users reported that Statistics Canada staff is competent and have the knowledge needed to respond to specific requests. However, it can be difficult to identify the most appropriate expert at CPD who can respond to a given request or discuss CPI questions and issues. While calls to request help on the CPI are responded to, end users indicated that it can take up to two days for Statistics Canada to follow up. These timelines are not helpful to federal representatives or officials in provincial/territorial finance departments trying to answer an urgent question about a CPI release (e.g. minister's briefing notes).

Experts and end users indicated that it would be advantageous for Statistics Canada to publish a list of officials to contact for more information about specific technical topics such as basket composition, how the CPI is calculated, or sub-index composition and weighting. They suggested that such a list of officials who are expert in specific areas would facilitate getting CPI questions answered more promptly.

Question 5: Is the program achieving the expected outcomes outlined in the logic model?

Research and Development
  • Ensure that released data stand the test of scrutiny (CPI - Immediate)

Key Findings

There is evidence that the CPI data and index withstands public and expert scrutiny. However, there is a desire for the CPI to evolve further.

Evidence from the document review shows that Canada's CPI is consistent with internationally accepted standards, guidelines and good practices, which suggest that it can withstand independent scrutiny.

In addition, the open approach of Statistics Canada to make information available allows the public and independent parties to review and challenge the CPI, which increases its credibility. PMAC helps maintain the credibility and reputation of CPI data by providing valuable advice and a challenge function.

Suggestions were offered to keep evolving and improving the CPI to ensure that CPD keeps abreast of emerging theories and practices in some areas such as continuous evaluation of price changes and owner-occupied housing.

According to a 2003 IMF report,Footnote 42 Statistics Canada's CPI has generally followed internationally accepted guidelines and good practices, and has met the international standardsFootnote 43 (see Table 7) for several elements: prerequisites to quality, integrity, methodological soundness, accuracy and reliability, serviceability, as well as accessibility. Of these, the elements that directly pertain to research and development are methodological soundness and accuracy and reliability.Footnote 44,Footnote 45

Table 7. Canada: Data Quality Assessment Framework – Summary of Results for Price Statistics Footnote 46
Element
Methodological soundness
Concepts and definitions Scope Classification/sectorization Basis for recording
X X X X
Accuracy and reliability
Source data Statistical techniques Assessment and validation of source data Assessment and validation of intermediate data and statistical outputs Revision studies
X X X X Not available

A wealth of detailed information regarding the CPI is available in the public domain. The CPI reference paper, various research documents on the CPI, and the CPI sub-indexes are public. CPI data are public, as well as the CPI basket, basket updates, and the weighting of the elements in the basket. This open approach of Statistics Canada enables public and independent parties to review and challenge the CPI, if need be: thus, it adds to CPI credibility.

According to internal key informants, research and publications on various topics related to the production of the CPI are published periodically. In addition, Statistics Canada officials participate regularly in international expert meetings with their counterparts in other countries. This exchange of information among international experts is seen by the some of the key informants as an opportunity to advance thinking and enable different jurisdictions to exchange views on statistical matters: this, in turn, makes it possible for CPD to benefit from practices in other jurisdictions. Along those lines, key informants acknowledge PMAC's role in providing independent expert advice and a challenge function. This demonstrates Statistics Canada's openness to outside scrutiny and dedication to meeting high quality standards, thus, contributing to the reputation of Canada's CPI.

Overall, key informants agree that the CPI can withstand the test of expert and public scrutiny. Nevertheless, they feel that there is always room for improvement, and recommend continual research and development effort to ensure that CPD keeps abreast of emerging theories and practices. Experts and end users identified areas that could benefit from further research such as continuous evaluation of price changes and their impact. Examples also include owner-occupied housing, price movements of rents, seasonal sales and automobiles. However, there was no consensus among external interviewees on which areas are of greatest priority.

Question 5: Is the program achieving the expected outcomes outlined in the logic model?

Research and Development
  • Enhance the design of the program — concepts, methods and data sources (intermediate)
    • Including CPI-EI expected outcomes

Key Findings

There is evidence that the CPI-EI is enhancing the quality of the CPI and that four areas of renewal address the key sources of bias and primary weaknesses in the CPI.

The program is well positioned to achieve its intermediate outcome, and it is progressing toward this.

The CPI-EI is achieving its outcomes: a broader range of price quotes; a more representative sample of products and stores for sampling, including more timely introduction of new products and stores to the sample, and more timely reflection of changing consumer spending patterns, as well as advanced techniques to implement quality adjustment.

Evaluation findings previously presented indirectly support the observation that CPD's research and development in recent years, particularly in relation to the CPI-EI, has led to improvements in the CPI.

More specifically,

  • Issue 4, Design and Implementation of the CPI-EI: evidence was presented that the design of the CPI-EI is sound, the initiatives underway are the right ones to improve the CPI, and the CPI-EI is being implemented as planned and is progressing well.
  • Evidence that recent changes introduced with the CPI-EI are well aligned to produce more trusted and relevant data were found regarding data production (Section 6.1)

Recent program reports confirm that, under the CPI-EI, the program focuses its research and development capacity in assuring that the CPI is accurate (e.g., represents what it seeks to measure), coherent (its component parts are integrated harmoniously), and renewable (e.g., it can perpetuate and reinvent itself over time).

For example, to increase the representativeness of the sample, the CPI-EI improved the program's 'bricks and mortar'Footnote 47 frame, to ensure the sample is "not probabilistic but rather a result of a judgmental sampling, applied in a much more sophisticated way than before." The improvements support the use of alternative inputs (such as Census, Business Register, Quarterly Retail Commodity Survey, other surveys, and third-party outlet or product databases); the use of different collection modes (including scanner data, web scraping, and internet) and the introduction of some pure Internet elements.

The coherence of the CPI has been improved as a result of reviews of key methodologies; alignments applied to CPI classifications and the aggregates' formulas; and coordinated or simultaneous updates of upper- and lower-level indexes. In the same vein, the program documents testify about stronger links and better communication with the analysis unit and the field collection staff, and about increased capacity and know-how on processing larger volumes of price quotes.

Internal interviewees specifically mentioned the research conducted to assess the impact of changing the sample size in order to broaden the sample to account for rural areas. Those consulted also describe the benefits of Cygnus, the new powerful price index estimation system, for research. The advanced IT tools of Cygnus will allow internal users and researchers to run simulations, which will help improve understanding, inform future improvements and quality adjustments. Internal key informants believe that Cygnus will open up research and analysis and will increase the accuracy of the CPI.

All categories of key informants agree that CPI-EI is on the right track to achieve its outcomes, including: broader range of prices selected, a more representative sample, more timely reflection of changing consumer spending patterns and advanced techniques to implement quality adjustment.

Expert informants acknowledge the contribution of Statistics Canada's CPI research and publications related to CPI, and suggest some areas of additional research that could generate future benefits:

  • Mini-reviews of the basket every year would allow CPD to tweak it, and are needed because the rapid change in consumer experience could not be accurately predicted;
  • Use of scanner data and web-scraping data. In this regard, experts clarify that the use of scanner data for improving the sampling is different from the use of scanner data as a data source to compile CPI, thus, different research goals and challenges are associated with each;
  • A comprehensive owner-occupied housing index;
  • Alternative data sources. In this regard, the experts reported that other countries (not only Canada) struggle with many challenges linked to the use of alternative data sources (such as issues, expenses, and problems of cleaning the data), and that so far no simple and affordable solution exists.

Question 5: Is the program achieving the expected outcomes outlined in the logic model?

Information technology
  • Ensure that released data rest on a robust IT infrastructure (immediate)
  • Enhance the IT infrastructure of the program (intermediate)

Key Findings

There is evidence that the CPI-EI has led to the enhancement of the IT infrastructure with the introduction of improvements, greater efficiencies and modernization of the CPI computer systems and tools used for collecting and analyzing the data and calculating the index.

Evidence indicated that the CPI's IT and technical systems were insufficient to meet the evolving needs of the CPI. A key focus of the CPI-EI is to improve the CPI's IT infrastructure.

Currently, it is meeting CPI requirements and is improving CPI data collection methods.

At the time of the evaluation, major progress had been made towards implementing the enhanced modules and systems, which suggests that the program is advancing in the right direction and is expected to achieve its predicted outcomes when the changes are completed.

There is some concern about the long-term sustainability of CPI's IT infrastructure and a belief that the coordination and integration of IT systems are important.

Background

The CPI is a large statistical program dependent on large, complex IT systems to execute its work. These systems cover:

  • collection: the transfer of sample specifications to data collectors in the field and the receipt of price and characteristics data and information (using in-house and corporate collection service resources);
  • processing: the statistical processing, editing and cleaning of microdata (using the Phoenix system);
  • index aggregation: the creation of indices from cleaned data and consumer expenditure weights (using the Matrix Processing System);
  • analysis and dissemination: the production of reports, custom and special tabulations and datasets.
Findings

Internal program documents provide evidence that CPI's IT and technical systems were insufficient to meet the evolving needs of the CPI. Data processing systems in CPD had not been renewed frequently enough to keep up with the evolving demands for Canada's CPI. Consultations with internal key informants provided clear evidence that significant thought was given to updating CPI's IT infrastructure to enable faster and more effective data collection, processing and dissemination.

The largest of the IT initiatives within CPI-EI is to develop a modernized price index estimation system on a stand-alone application – Cygnus, which will replace the Matrix Processing System (MPS).Footnote 48 Enhancing the collection IT systems is also critical to supporting the sample modifications and increases that are central to the CPI-EI. The other systems supporting processing, analysis and dissemination are being upgraded as needed to support CPI-EI. Although these systems are not a focus of the CPI-EI, the interconnectedness between the CPI systems necessitates that these also be considered together with other system changes.

The 2012 Progress Report briefing to the Chief Statistician provides evidence that significant progress has been made in developing and implementing the new IT enablers:

  • in collection, CPD has replaced field collection devices, streamlined field data processing and sample management systems interfaces and eliminated paper forms;
  • in data processing, CPD introduced representative product module and outlet acceptance/rejection functionality;
  • for Cygnus, the execution phase is in progress and on time; CPD released the first working functionalities in July 2012.

"Changes to IT are still very much ongoing and so difficult to assess what impact they will ultimately have on CPI. From a sampling perspective, the minimum is in place to increase sampling but changes to IT have only had a minimal impact so far."

Internal informant

As evident at the time of this report, several new or improved components are at various stages (gates) of completion. Some are fully implemented and integrated, thus it is difficult to assess progress toward achieving the CPI outcome.

Nevertheless, evidence from interviews with internal key informants suggests causal links between features of the new enabling systems and significant contributions to the functionality and other specific aspects of the production and interpretation of the CPI. For example:

  • Improvements in collection (e.g., the replaced field collection device, and elimination of paper forms) enable a more representative sample. These improvements also supported the development of the geographical and outlet frameworks.
  • Integrating the multiple and fragmented Excel and SAS software modules into the new system improves data processing functionality and the handling of some applications. The redesign of Phoenix, which is to start in 2015, is expected to improve further the consistency and integrity of the data processing.
  • The complete implementation of Cygnus enables better data navigation and analysis, as well as improved reporting capabilities: it is a huge improvement compared to the MPS.
  • The Cygnus interface, which is more user-friendly than that of MPS, reduces human error, especially on the editing side.
  • Cygnus's ability to support simulations is seen as extremely valuable, internal key informants attested. Specifically, visualization and usability tools would enable more powerful analysis. This, in turn, would build expertise and capacity in this area.

"We now know what grocery store we are collecting information from and ensure that it is in the top 20 stores."

Internal informant

Internal key informants generally agreed that the enhancements to the IT enablers in the CPI-EI support, or will support when they are fully implemented, production of a better CPI. "Better" includes more frequent basket updates, better and more efficient quality adjustments, better analysis and interpretation, better aggregation and dissemination. In the same vein, internal key informants stressed better coordination and integration of the systems across data collection, processing aggregation and dissemination.

Consultations with internal key informants and a review of planning documents indicated that CPD, as part of its evergreen strategy for the CPI, plan to renew its key systems (i.e., Cygnus and Phoenix) over a rolling five-year cycle. CPD is now focused on fully developing Cygnus; in 2015, it will shift resources to renew Phoenix. Some internal key informants expressed concern about the sustainability of CPI's IT systems and processes to support CPI, and questioned CPD's ability to systematically renew it. There is a worry that, during times of future resource constraint, the program may once again be at risk of resource reductions and operational cuts.

Question 5: Is the program achieving the expected outcomes outlined in the logic model?

  • Unexpected impacts/outcomes from the CPI-EI

Key Findings: Unexpected Outcomes

Very few unexpected impacts or outcomes were identified.

A key unexpected outcome from the CPI-EI was the increase in internal project management expertise and capacity, which is viewed as a lasting positive impact of the initiative.

A review of the documents related to the CPI-EI and key informant interviews indicated very little evidence of unexpected outcomes from the CPI-EI.

The major unexpected outcomes arise from implementing the CPI-EI outcomes. Key internal informants noted the increase in internal project management expertise and capacity, and that this will be a lasting benefit of the initiative.

6.4 Core Issue 5: Demonstration of Efficiency and Economy

In assessing the efficiency and economy of the CPI program, the evaluation team found some challenges: it required a more focused quantitative analysis, including a comparison with other similar statistics programs. Notwithstanding the limitation, resource utilization according expenditures could be assessed and alternatives to improve efficiency were identified.

Question 6: Does the program demonstrate efficient and economical decision-making and implementation?

Is the program managed in a cost-effective manner?
  • Are the resources dedicated to this program being used effectively and efficiently to maximize the achievement of outputs and outcomes?

Key Findings

The expenditures on the CPI and the CPI-EI appear to be fully in accordance with the original budget.

A review of program financial data shows that, from a financial perspective, the project is being implemented according to plan.

There is some evidence that the CPI program has efficient administrative and operational procedures. There is some opportunity to improve efficiency with internal stakeholders and by implementing a performance measurement system.

Based on the limited efficiency and economy assessment, the program seems to use an efficiency-based approach in its practices. Some improvements were suggested to better harmonize the processes between CPI and SNA/SHS.

The expenditure data for the CPI and CPI-EI revealed that spending is within budget. Overall program spending per fiscal year has remained close to budgeted expenditure, except in fiscal year 2008/2009. As mentioned by the program in their quadrennial program review, the statements reported a deficit of 10% due to overspending in salary to boost internal capacity for implementing the redesign of the processing infrastructure (Table 8).

With new funding introduced in fiscal year 2010/2011 for CPI-EI, the program was able to remain in accordance with authorities and the planned utilization rate (a range of 5%). According to internal documents, the CPI-EI faced some challenges spending its salary budget during the first two years. The challenges were the need to develop and operationalize price index expertise, and the time involved in staffing the many positions required to support the CPI-EI in a time of government downsizing.

Internal documentation highlights:

  • 33% of CPI-EI spending is IT-related in 2011/2012
  • 52% of the CPI-EI spending is directly program related to three CPI-EI drivers: basket updates, sample design and quality adjustment in 2011/2012.
Table 8. Summary of Planned versus Actual CPI Expenditures
Fiscal
year
2008/2009 2009/2010 2010/2011 2011/2012 2012/20131 Subtotal Total
2008/2009 to
2011/2012
2008/2009 to
2012/2013
$ % $ % $ % $ % $ % $ % $ %
Planned
Salary 5,973,222 82 6,428,145 86 9,316,130 82 11,226,958 87 12,139,995 90 32,944,455 84 45,084,450 86
Non-salary 1,289,174 18 1,061,380 14 2,077,189 18 1,717,312 13 1,365,774 10 6,145,055 16 7,510,829 14
Total 7,262,397 100 7,489,525 100 11,393,319 100 12,944,270 100 13,505,769 100 39,098,511 100 52,595,279 100
Actuals
Salary 6,898,279 86 6,337,765 85 8,866,273 82 11,541,278 85 8,871,188 94 33,643,595 84 42,514,783 86
Non-salary 1,119,474 14 1,074,854 15 1,947,532 18 2,054,226 15 557,088 6 6,196,086 16 6,753,174 14
Total 8,017,753 100 7,412,619 100 10,813,805 100 13,595,504 100 9,428,277 100 39,839,681 100 49,267,958 100
Variation2 (%)
Salary   -15   1   5   -3       -2    
Non-salary   13   -1   6   -20       -1    
Total   -10   1   5   -5       -2    

Review of program documents and interviews with internal key informants revealed that, prior to the implementation of CPI-EI, CPD examined various alternatives to improve weaknesses found in the CPI, including approaches followed in other countries. CPD established a working group to recommend ways to improve the CPI. The working group came up with 70 business requirements for Cygnus. This drove the option analysis and decision making to ensure that all recommendations met the working requirements and introduced the greatest efficiencies.

Internal documents show that CPD was able to meet planned deliverables for the CPI-EI: in some cases CPD exceeded targets (e.g., basket updates). Efficiency seems to be a priority for CPI management. As mentioned in an update report to the CPI-EI Steering Committee, for quality adjustment group "A cost-conscious philosophy prevails: methods are only as sophisticated and expensive as they need to be," reported an update to the CPI-EI Steering Committee.

To assess the efficiency of program administration, overhead cost is usually a good indicator. According to internal documents for 2011/2012, administration overhead was in the commonly observed range of 16% of total project spending, which includes project administration and governance, 7.2%; training, 2.3%; and production support, 6.5%.

While no inefficiencies in the operation of the CPI were found, two areas requiring further attention were identified, both concerning internal collaboration:

  • The SHS update cycle is different from CPI's update cycle. This past year, the SHS program had challenges providing data by CPD deadlines. Better integration of these cycles could improve efficiency.
  • Better aligning methodology between CPI and the SNA could yield benefits. Of interest is the integration of the product classification standard used between CPD and the SNA. CPD uses its own expenditure classification; the SNA uses the international COICOP standard. If both used the same classification, this would make data integration between the two groups easier and more efficient. A review of internal documents indicated that the concepts and methods used in CPI and SNA should ideally be as similar as possible so that early price signals provided by the CPI can be better integrated into GDP figures.Footnote 49

Performance measurement

The program has in place an accountability system through its governance structure (i.e. committee reporting). However, information is mainly technical and little information is available about the program's impact and effectiveness. Better outcome need to be defined and a performance measurement system should be set up to monitor efficiency and assess progress towards expected outcomes.

Question 6: Does the program demonstrate efficient and economical decision-making and implementation?

Is there a more effective approach to achieving CPI outcomes?

Key Findings

There is limited evidence of more effective approaches to addressing the biases in the CPI other than what has been already identified.

Alternative approaches and considerations were raised and supported by the jurisdictional review, including moving the CPI to a one-year update cycle; making use of alternative data sources and data collection methods; examining the benefits of introducing a superlative index and allowing for revisions; and using seasonal adjustments.

The jurisdictional review and consultations with internal key informants did yield evidence that the cost of data collection is a factor affecting the frequency of basket updates, sample size and restricting of samples to urban areas. Some alternatives and considerations were suggested to improve the efficiency and the quality of the CPI index.

  1. Geographic distribution of the sample — Australia, France, New Zealand and the United States draw their basket prices primarily from urban areas. Every country has unique facets of its population distribution and geography. Statistics Canada's approach to the CPI is focused on ensuring the sample adequately captures Canada's geographic diversity: this includes balancing prices taken from urban and rural areas. This is a more costly approach, but internal key informants reported that this a cost Canada is willing to incur to ensure the CPI adequately reflects prices in all parts of Canada, including rural and remote/northern areas of Canada.
  2. Moving the CPI to an annual update cycle — Experts and end users indicated satisfaction that the CPI is now being updated on a two-year cycle. However, most felt that, budgets permitting, Canada's CPI should eventually move to a one-year basket update cycle to further reduce sample bias. Most of the jurisdictions reviewed update their CPI baskets annually. Four internal informants reported that CPD envisions a one-year basket-update cycle in the future. However, when the CPI-EI was designed, a two-year update was deemed a more appropriate target.
  3. Using alternative data sources — Key informants wished to see the CPI make greater use of alternative sources of data, and alternative data-collection methods, as a way to realize program efficiencies and leverage limited program resources. For instance, Statistics Canada already buys and uses alternative data sources and is considering others, such the Internet and large insurance databases for some prices. However, internal and end user informants suggested going further with web scrapings or extractions from the Google Price Index, EBay or Yahoo, where real time price and quantity data for transactions are published. External experts indicated that using alternative data sources comes with technical difficulties and risks, and recommended that Statistics Canada carefully consider and manage the risks associated with using alternative data sources.
  4. Alternative data-collection methods Expert informants and the jurisdictional review revealed that the United Kingdom and Switzerland have outsourced the entire handheld data collection component of the CPI. There is some support from end users for Statistics Canada to research and use alternative data collection methods in CPI development.
  5. Superlative index A few of the experts and end users consulted for the CPI supported using an additional index as a complement to the CPI: a superlative, or chained, index such as the one used in the United States. The US uses a chained index but there are drawbacks from using more than one CPI including the higher costs of production and a need to effectively communicate the differences and the purpose of the additional index.Footnote 50 It was suggested that going with this approach could be an experimental index. It is believed that this could help address the issues related to substitution bias that impacts all CPIs. However, the CPI-EI is expected to make improvements in this regard by updating the CPI basket every two years rather than every four years.
  6. Measuring housing prices — It is argued that the way housing data are produced, and the weighting of some specific data, make the current CPI a less-than-best measure for determining housing price changes.Footnote 51 Because of the importance of housing price changes, expert informants argued that an additional housing prices indicator in the CPI could be used by the Bank of Canada to make monetary policy decisions.

Question 6: Does the program demonstrate efficient and economical decision-making and implementation?

Is the CPI program duplicating or complementing existing programs/initiatives?
  • Could certain aspects or components of the program be transferred to other levels of government or other organizations (private or public sector)?

Key Findings

There was no evidence that CPI is duplicating existing programs or initiatives.

There was no evidence to suggest that the CPI is duplicating existing programs or initiatives. None of the key informants consulted could identify overlap or duplication among the CPI and similar programs and initiatives.

All those consulted indicated that the CPI should not be transferred to another organization or level of government. There are some alternative indexes, such as the Google Price Index (which is purely based on online purchases), and sub-indexes such as the Canadian Real Estate Association shelter index, but these are not seen as being as credible, comprehensive, complex or representative — nor could these replace the CPI in terms of its use.

7. Conclusion and Recommendations

7.1 Conclusion

7.1.1 Relevance

The CPI is an important measurement used by the Canadian government and other key stakeholders to inform economic and monetary policy, such as developing the GDP, measuring rates of inflation for the Bank of Canada and determining transfer payments to provinces and territories by Finance Canada. Internationally, the CPI is one of the most widely used statistics for measuring price changes and economic performance; it is the most visible and credible measure to anchor inflation expectations. Consequently, the need for the CPI continues, and the CPI remains highly relevant.

The CPI is aligned with federal and provincial government priorities. The production of the CPI is one of the ongoing priorities of Statistics Canada. It is used by all levels of government. It also responds to the priority of transparency by providing objective and non-partisan statistics.

The Government of Canada has a legitimate role and responsibility in producing a CPI, and a responsibility for it to be produced by Statistics Canada. Strong evidence shows that CPI activities are congruent with Statistics Canada's legislated role and the federal government's jurisdiction. As a member of the International Monetary Fund, the federal government must produce a CPI to meet legislative and international reporting requirements. Evaluation evidence indicates that Statistics Canada is best positioned to produce Canada's CPI, given its status as an independent agency and its expertise and capacity. This is in line with the international practice — in all jurisdictions reviewed, the CPI is produced on a monthly basis by a national independent statistical agency.

Although evidence showed that the CPI is relevant, it also revealed unmet needs, and an interest in a deeper level of data than what is now released by Statistics Canada. Consultations with end users indicated an interest in the CPD developing and issuing CPI sub-indexes — particularly in the areas of seniors and those living close to the poverty line (a basic necessities index). In fact, the need to better reflect the actual cost of living for some age cohorts was also raised in several academic publications.Footnote 52 CPD has recognized that a single CPI cannot serve all users equally well and has been examining publishing 'families' of indices.

7.1.2 Design and Implementation of CPI-EI

The CPI-EI was necessary to address known weaknesses of the CPI and ensure that the index continues to be high quality and reliable. Evidence suggests that the design of the CPI-EI is sound, and that the initiatives underway are the right ones to improve the CPI. Furthermore, evidence showed that the CPI-EI is being implemented as planned; some facets are being implemented ahead of schedule.

The CPI-EI governance arrangements are viewed as appropriate and sufficient to support the initiative and the ongoing management of associated risks. Senior CPD management showed an ability to address emerging issues and challenges by strengthening overall project management and governance, by enhancing CPD human resource capacity, and by making other organizational changes. The evaluation revealed that structures and processes are in place to monitor implementation progress of the CPI-EI, and that the initiative has contributed to building a project management capacity and culture. Some challenges related to implementation were identified, mainly: better clarification of roles and responsibilities, conveying governance arrangements more clearly to the lower levels in CPD, and more horizontal discussions of cross-cutting issues. A concern was also raised with respect to the significant subject-matter expertise lost recently in the division. Regardless of some successful capacity-building initiatives in CPD, a potential erosion of subject-matter expertise is a risk factor for the implementation of CPI-EI, particularly in relation to succession and continuity planning.

7.1.3 Performance — Achieving Expected Outcomes

Data production

Canada's CPI meets international standards and is an index that is trusted, credible, relevant and timely. Evidence also revealed that the changes ushered in under the CPI-EI are consistent with the approach found in other countries, and that the CPI-EI is needed to maintain and possibly raise confidence in the CPI. Early results of the CPI-EI show that the level of confidence in CPI data and its representation of consumer spending is being reinforced through a better quality assurance process and a more frequent and timely basket.

Dissemination and communication

Statistics Canada's CPI data, research, publications and methodology are made public in an open manner on Statistics Canada's website — even if, at times, finding some of these can be difficult. CPD appears to have well established relations with their primary clients, but have invested less time engaging broader stakeholders in the CPI and CPI-EI. The evaluation found a desire for improved communications and dissemination of more detailed information and data as well as more frequent updates. It is recognized, however, that CPD needs to balance its independence and neutrality in determining the composition of the CPI with the expectation to engage key stakeholders more broadly.

The evaluation revealed that, in terms of service quality, Statistics Canada staff is competent and have the appropriate knowledge to respond to specific demand. However, it can be difficult to identify the most appropriate expert at CPD to contact for help, or to answer CPI-related questions and issues.

Research and development

Evidence showed that the CPI data and index withstands public and expert scrutiny; however, it also showed a need for continual research and development to ensure that the CPI remains highly relevant and credible. The CPI-EI is achieving its short-term outcomes: more frequent and timely basket updates; a broader range of price quotes; a more representative sample of products and stores for sampling, including faster introduction of new products and stores to the sample, and faster reflection of changing consumer spending patterns; and advanced techniques to implement quality adjustment. The program is making progress towards enhanced design of its concepts, methods and data sources.

Information technology

Evidence indicated that, until recently, the CPI's IT and technical systems were not sufficient to meet its evolving needs. Currently, the IT enabling systems and processes introduced to support the CPI-EI are meeting CPI needs and are improving CPI data collection methods. The CPI-EI has led to general improvement of the IT infrastructure — greater efficiencies and modernization of the CPI computer systems and tools. The evaluation found some continuing challenges, including the need for better integration of IT systems for data collection, processing aggregation and dissemination. The long-term sustainability of CPI's IT infrastructure is also a concern: specifically, that in future times of resource constraints the program might not be able to maintain the implementation of its evergreen strategy for renewal of key IT systems over rolling five-year cycles.

Evidence generally indicates good progress toward the realization of CPI and CPI-EI outcomes at the immediate and intermediate level: these help achieve the final outcome, "Canadians will have accurate, timely, relevant set of consumer price indexes meant to support a variety of key policy programs." Furthermore, the relevance section demonstrated that the CPI is an excellent index when used for its intended purposes and contributes to a variety of policy programs. However, there is inherent complexity in using the same index to provide information for different uses and needs. Evaluation findings confirmed as well that the CPI-EI responds to many concerns and biases in the CPI, which will make for a more reliable and credible price index with greater internal capacity.

Performance — economy and efficiency

A review of program financial data indicates that from a financial perspective, the CPI-EI project is being implemented according to plan. The expenditures on the CPI and the CPI-EI appear to track with the original budget.

Based on the limited efficiency and economy assessment, CPI seems to use an efficiency-based approach in its practices. Some evidence showed that the CPI is efficient in its administrative and operational procedures.

There is some room to improve efficiency by implementing a performance measurement system. While no specific inefficiencies at the CPI level were revealed, some improvements in the relationships with SNA and the Survey of Household Spending were suggested to better harmonize their process. Some alternative approaches and considerations were raised and supported by the jurisdictional review, namely: moving the CPI to a one-year update cycle; making use of alternative data sources and data collection methods; examining the benefits of a superlative index and allowing for revisions; and using more seasonal adjustments.

7.2 Recommendations

Recommendations emerge from the evaluation findings that advocate strategic planning for sustainability after CPI-EI complete implementation, enhanced governance at the sub-project level, improved communication with stakeholders and accessibility of CPI products, and strengthened systematic performance measurement to demonstrate the achievement of results.

Relevance and efficiency

Recommendation 1

That CPD examines alternatives to make the program potentially more efficient and responsive to end user needs (i.e., alternative data collection sources and methods; harmonized update cycles of the Survey of Household Spending and the CPI; better alignment with System of National Accounts methodology, and additional indicators to the CPI such as housing prices, etc.).


Governance and implementation

Recommendation 2

That CPD strengthens its governance processes by:

  • improving its performance measurement system to ensure performance information is available and timely to
    • demonstrate the program's effectiveness in achieving its expected outcomes
    • support decision-making
  • ensuring there is an integrated strategic planning process in place to sustain the CPI during and after the CPI-EI covering human resources, IT and research and development
  • reinforcing governance at the sub-project level by putting in place effective mechanisms to inform and discuss cross-cutting issues at the division's lower levels.

Performance — Effectiveness

Recommendation 3

That CPI management, in partnership with Communications Division, develops a dissemination and communications strategy to ensure that up-to-date and easily accessible information is made available to the general public and to key stakeholders through:

  • up-to-date reference documents and publications
  • a user-friendly website to ensure accessibility
  • a list of official contacts available to key stakeholders
  • ongoing communications to key stakeholders, especially updates on the CPI-EI.

8. Management Response and Action Plan

Recommendation 1

Relevance and efficiency

It is recommended that CPD examine alternatives that could potentially increase the program's efficiency and be responsive to end-user needs (i.e., alternative data collection sources and methods; harmonized update cycles of SHS and CPI; better alignment with the SNA methodology, additional indicators to the CPI such as housing prices, etc.).

Statement of Agreement / Disagreement

Management agrees with this recommendation. Agency-wide solution will be implemented to address recommendations where applicable.

Management Response

The items noted above are longstanding demands from various users that are known to CPD's management.

The PMAC agreed at its October, 2011 meeting that these additional items could be given lower priority, and that CPD should focus on the top priority challenges explicitly promised by the CPI-EI: improving (1) Basket Updates, the (2) Price Sample, (3) Quality Adjustments and the (4) IT infrastructure.

However, given recent successes in year 3 of the project in making progress in each of the above, the CPI-EI Steering Committee, on November 22, 2012, agreed to expand the scope and change the name of "(3) Quality Adjustments" to "(3) Quality Improvements". This expanded project, in addition to including the mandate to improve quality adjustment methods, now includes alternate measures of shelter (including an improved NHPI and attempts to cover resale housing prices – projects being conducted by PPD with CPD support), closer alignment to SHS and SNA nomenclatures and methods, and recommendation on a standard basket classification among STC stakeholders (CPD, ISD, SNA). A project to explore and implement Alternate Data Sources (ADS) has also been added to the "(2) Price Sample" portfolio.

Table 9. Schedule
Timeline Deliverable(s) Responsible Party
September, 2013 Options and recommendations on creating a more comprehensive Residential House Price Index, introducing Condominiums in the New Housing Price Index (NHPI), upgrading the NHPI with better quality adjustment methods PPD
December, 2013 Analytical study on estimates of alternate measures of shelter in the CPI CPD
March, 2014 Final report on recommendations for ADS CPD
December, 2014 Alternate measures of shelter published monthly in CANSIM CPD
March, 2015 Recommendation on a standard basket classification among STC stakeholders (CPD, ISD, SNA) CPD

Recommendation 2

Governance and implementation

It is recommended that CPD strengthen its governance processes by:

  • Improving its performance measurement system to ensure performance information is available and timely to :
    • demonstrate the effectiveness of the program in achieving its expected outcomes
    • support on-going decision making.
  • Ensuring there is an integrated strategic planning process in place to sustain the CPI during and after the CPI-EI which includes human resources, information technology and research & development;
  • Reinforcing governance at the sub-project level by putting in place effective mechanisms to inform and discuss cross-cutting issues at the lower levels in the organization.

Statement of Agreement /Disagreement

Management agrees with these recommendations. Agency-wide solution will be implemented to address recommendations where applicable.

Management Response

Recommendation 2a)

CPD already has established key high level project indicators (e.g., frequency and timeliness of basket updates, number of price quotes to add, number of quality adjustment methods to improve) related to project outputs. However, CPD agrees that more measures of expected outcomes expressed under CPI as well as CPI-EI logic models are needed to demonstrate the effectiveness of the program in achieving its expected outcomes and will work with sub-project leaders to identify them.

Recommendation 2b)

About two-thirds of the headquarters staff (of about 150) engaged in working on the CPI are actively engaged in enhancing it, working on 6 project portfolios covering more than 50 sub-projects and 170 separate deliverables. CPD has already recognized the complexity of managing such a considerable amount of change in an environment that is cost-conscious and that will not tolerate errors or delays. It has therefore developed and very recently implemented the CPD Planning Tool, a dedicated Access database that allows managers to spell out clearly project costs, deliverables, human and IT resource needs. It also integrates all activities in the Division, including research and development and regular monthly production of the CPI. The CPD Planning Tool is greatly facilitating decision-making and has helped CPD management make key strategic decisions regarding staffing and deliverables for FY 2013-14 and 2014-15, including identifying shortfalls in some key competencies at a divisional level. It is garnering attention as a best practice at Statistics Canada.

CPD management will prepare a plan that outlines a Post CPI-EI Strategy. The CPD aims to deliver results that can reliably be maintained indefinitely after the end of the CPI-EI. Moreover, it is expected that the CPI program no longer be the recipient of LTP funds, but instead be financially "self-sufficient". To do this, the program has plans to self-fund the redesign of important systems at regular intervals, thus ensuring that they are "evergreen". The program also desires to remain flexible and evolve with changing needs and/or opportunities (e.g., incorporating alternate data sources and cutting back on price collection).

Recommendation 2c)

A well-developed project governance already exists, one that incorporates all employees internal and external to CPD. The CPI-EI Project Secretariat will work to enhance it further, notably by disseminating and sharing CPD Planning Tool reports. They will be used in various forums (such as Divisional Meetings, Project Meetings, sub-project and working group meetings) to inform staff of plans and priorities relating to projects relevant to them. Future planning cycles will also endeavor to involve staff below the Chief level more directly in the planning activity.

CPD is also planning a special one-day all-staff meeting, where the theme will be "Improving Communication". Communication around cross-cutting project issues, and how to improve it, will be addressed directly at this meeting and employee –driven suggestions considered for implementation.

Table 10. Schedule
Timeline Deliverable(s) Responsible Party
March, 2013 (Done) 2b) Delivery and implementation of CPD Planning Tool CPD
August, 2013 2c) All-staff meeting on "Improving Communication" will be held CPD
September, 2013 2c) Incorporation of CPD Planning Tool feedback in existing governance structure CPD
December, 2013 2a) Develop indicators to better measure program and project outcomes CPD
March, 2014 2b) Post CPI-EI Strategy document CPD

Recommendation 3

Performance - Effectiveness

It is recommended that CPI Management, in partnership with Communication Branch, develop a Dissemination & Communication Strategy to ensure that up-to-date and easily accessible information is made available to the general public and to key stakeholders through:

  • Up-to-date reference documents and publications;
  • User-friendly website to ensure accessibility;
  • List of official contacts available to key stakeholders; and
  • Ongoing communications to key stakeholders particularly in providing updates on the CPI-EI.

Statement of Agreement /Disagreement

Management agrees with this recommendation. Agency-wide solution will be implemented to address recommendations where applicable.

Management Response

CPI:

CPD has already recognized the need for more and better communication with its external stakeholders. To this end, it began in July, 2012 the task of updating the CPI Reference Paper, a detailed sources and methods document that had not been updated in almost 20 years. Work is advancing well, with many major changes, and it will be published in the Winter of 2014.

CPD will make available a list of official contacts to key stakeholders.

CPD also developed a report summarizing the two first years of the project. This has not yet been made available to external stakeholders, but should. A report summarizing accomplishments from the third year of the project is also planned. The report will also have a new forward-looking component that outlines plans for the coming year. This will form the basis of what will become a semi-annual report that details achievements and plans, suitable for external and internal distribution. The idea of developing a Quarterly Bulletin will also be explored.

CPD will task additional resources from its Project Secretariat, Concepts & Research and various project teams with generating more content about past, current and future CPI-EI project activities and results, and publishing it.

Table 11. Schedule
Timeline Deliverable(s) Responsible Party
September, 2013 Dissemination of Year 1-2 Report on CPI-EI Accomplishments CPD
December, 2013 Dissemination of Year 3 Report on CPI-EI Accomplishments CPD
January, 2014 List of official contacts available to key stakeholders CPD
February, 2014 Publication of revised CPI Reference Paper CPD
March, 2014 Produce semi-annual report CPD

Communication Branch Action Plan:

Communications Branch will develop a communications strategy to increase the visibility and understanding of the CPI and CPI-EI and broaden their reach with stakeholders.

The plan will make provisions for ongoing communications with the public and stakeholders through appropriate channels.

Improved presentation and accessibility of CPI information will be achieved through the deployment of Statistics Canada's New Dissemination Model.

Table 12. Schedule
Timeline Deliverable(s) Responsible Party
October, 2013 Development of CPI-EI communications strategy CPD, Communications
ongoing Generation of communications content CPD

Appendices

  • Appendix A — CPI and CPI-EI logic models
  • Appendix B — Governance and Project Management Structure
  • Appendix C — Detailed Evaluation Matrix
  • Appendix D — Summary of Key Activities and Outputs of CPI-EI
  • Appendix E — Examples of Relevant Management Practices
  • Appendix F — IMF Data Quality Assessment Framework, Canada
  • Appendix G — Literature and documents reviewed

All appendices are available upon request. Please contact AEB-Professional-Practices@statcan.gc.ca

Notes:

Footnote 1

Philippe Bergevin. "Housing Bubbles and the Consumer Price Index: A Proposal for a Better Inflation Indicator." C.D. Howe Institute Commentary no. 362. September, 2012. 20 pp.

Return to footnote 1 referrer

Footnote 2

The core CPI excludes eight of the most volatile components in the CPI: fruit, vegetables, gasoline, fuel oil, natural gas, mortgage interest, intercity transportation, and tobacco products.

Return to footnote 2 referrer

Footnote 3

Bank of Canada. The Consumer Price Index. Backgrounders. October 2013.

Return to footnote 3 referrer

Footnote 4

Ibid.

Return to footnote 4 referrer

Footnote 5

Sabourin, Patrick. 2012. "Measurement Bias in the Canadian Consumer Price Index: An Update," Bank of Canada Review, Summer 2012, pp. 1–11.

Return to footnote 5 referrer

Footnote 6

Statistics Canada. Consumer Price Index (CPI). Definitions, data source and methods.

Return to footnote 6 referrer

Footnote 7

Ibid.

Return to footnote 7 referrer

Footnote 8

Greenless, J. and McClelland, R. "Addressing misconceptions about the Consumer Price Index" in Monthly Labor Review (August 2008, pp. 3–19)

Return to footnote 8 referrer

Footnote 9

The Boskin Commission Report and Its Aftermath (NBER Working Paper No. 7759 - Robert J. Gordon (2000). Digest by Lester A. Picker

Return to footnote 9 referrer

Footnote 10

Ibid.

Return to footnote 10 referrer

Footnote 11

Statistics Canada, Refining the Blueprint to Improve the Canadian CPI. Presentation to the Price Measurement Advisory Committee, September 30, 2012.

Return to footnote 11 referrer

Footnote 12

Statistics Canada, 2011/2012 Report on Plans and Priorities.

Return to footnote 12 referrer

Footnote 13

Statistics Act (R.S.C., 1985, c. S-19)

Return to footnote 13 referrer

Footnote 14

Bretton Woods and Related Agreements Act (R.S.C., 1985, c. B-7)

Return to footnote 14 referrer

Footnote 15

The IMF's Special Data Dissemination Standard was established to guide Fund members that have access to international capital markets, in the provision of their economic and financial data to the public.

Return to footnote 15 referrer

Footnote 16

International Monetary Fund, 2007. The Special Data Dissemination System: guide for subscribers and users.
Washington, D.C.

Return to footnote 16 referrer

Footnote 17

Old Age Security Act (R.S.C., 1985, c. O-9)

Return to footnote 17 referrer

Footnote 18

Rossiter, J., "Measurement Bias In the Canadian Consumer Price Index" Bank of Canada Working Paper 2005-39.

Return to footnote 18 referrer

Footnote 19

The US Boskin Commission is recognized as the most detailed review of the CPI ever to be undertaken. Its findings and recommendations would become the benchmark for which many countries, including Canada, would use to reform their CPI.

Return to footnote 19 referrer

Footnote 20

Beatty, T. and Erling Roed Larsen, E.R., Using Engel Curves to Estimate Bias in the Canadian CPI as a Cost of Living Index, Working Paper number 2004-05, January 2004 In Food and Resource Economics, University of British Columbia

Return to footnote 20 referrer

Footnote 21

Final Report to the Senate Finance Committee from the Advisory Commission To Study The Consumer Price Index, December 4, 1996 ("The Boskin Commission")

Return to footnote 21 referrer

Footnote 22

Final Report to the Senate Finance Committee from the Advisory Commission To Study The Consumer Price Index, December 4, 1996 ("The Boskin Commission")

Return to footnote 22 referrer

Footnote 23

Ibid.

Return to footnote 23 referrer

Footnote 24

Sabourin, P., "Measurement Bias in the Canadian Consumer Price Index: An Update" in Bank of Canada Review (Summer 2012 , pp. 1-11)

Return to footnote 24 referrer

Footnote 25

Johnson, D., Reed, S. and Stewart, K. "Price measurement in the United States: a decade after the Boskin Report." In Monthly Labor Review, May 2006, pp. 10-19.

Return to footnote 25 referrer

Footnote 26

Ragan, C. Fixing Canada's CPI: A Simple and Sensible Policy Change for Minister Flaherty. C.D. Howe Institute. March 8, 2011 (3 pages e-brief)

Return to footnote 26 referrer

Footnote 27

2011-12 Progress report

Return to footnote 27 referrer

Footnote 28

'Sample design' refers to creating sampling strategies that produce representative estimates of a population. The quality of the CPI can be affected by over- or under-sampling of key products, outlets or geographies, potentially introducing bias into the estimates. Prior to the CPI-EI, sample change was primarily triggered by signals from direct field observations, and lacked the systematic basis needed to optimize the sample selection and ensure maximum representativeness. The foundation of a representative sample selection is a sound identification of the target population being studied (i.e., the key products, the outlets, geographical representation), typically called the 'frame'. An important part of the improvement of the sample design under CPI-EI is to build a sampling frame that is flexible, allowing changes to sample composition to be made in a timely manner. Statistics Canada's statistical infrastructure (the Business Registr and other surveys) are used in developing of the frame.

Return to footnote 28 referrer

Footnote 29

Governance matrix 2012-02-27.

Return to footnote 29 referrer

Footnote 30

"Governance and Management in the CPI-EI2." CPD internal document,August 2012.

Return to footnote 30 referrer

Footnote 31

As outlined in the Program Background and Objectives sections.

Return to footnote 31 referrer

Footnote 32

International Monetary Fund. October 2003. IMF Country Report No. 03/328. "Canada: Report on the Observance of Standards and Codes—Data Module, Response by the Authorities, and Detailed Assessments Using Data Quality Assessment Framework." 176 pp.

Return to footnote 32 referrer

Footnote 33

Data dimension includes criteria around prescribed coverage, periodicity and timeliness.

Return to footnote 33 referrer

Footnote 34

Access dimension relates to the advance release calendar, where subscribers (i.e., statistical agencies) must disseminate an ARC for all prescribed components of all prescribed data categories.

Return to footnote 34 referrer

Footnote 35

Integrity dimension relates to metadata certification where subscribers (i.e., statistical agencies) are required to certify, on an annual basis, the accuracy of the metadata posted on the DSBB.

Return to footnote 35 referrer

Footnote 36

Data Quality dimension refers to available information on the methodology, sources, and reconciliation of data categories in Data Quality Assessment Framework that would facilitate users to assess the quality of the data.

Return to footnote 36 referrer

Footnote 37

Users could access documents on the web earlier that fiscal year 1997/1998. However, most of them are archived in the system. The web scan conducted for this evaluation cover only Internet publications released from fiscal year 1997/1998 to 2012/2013, as of March 26, from the CPI web page.

Return to footnote 37 referrer

Footnote 38

The web scan looked at publications and data that referred to the CPI only. Particular indexes such as service price indexes and the Construction Price Index are not captured.

Return to footnote 38 referrer

Footnote 39

According to Daily 2011/2012 Webtrends Analytics Reports (from April 1, 2011 to March 31, 2012)

Return to footnote 39 referrer

Footnote 40

Data provided by Communications Division, March 26, 2013. March 2013 is not included in the total, as the release of CPI data was planned for March 27, 2013.

Return to footnote 40 referrer

Footnote 41

Microdata consist of the data directly observed or collected from a specific unit of observation (individual cases, answers from one individual, from one respondent)

Return to footnote 41 referrer

Footnote 42

2003 IMF report.

Return to footnote 42 referrer

Footnote 43

As defined by the International Monetary Fund's Data Quality Assessment Framework.

Return to footnote 43 referrer

Footnote 44

The other four aspects are covered in more detail in Section 6.1 Production on Data, and Section 6.2 Dissemination and communication of data.

Return to footnote 44 referrer

Footnote 45

Methodological soundness is defined as "[CPI is] generally following internationally accepted guidelines on concepts and definitions, scope, classification and sectorization, basis of recording, and valuation."
Accuracy and reliability isdefined by this measure: "All macroeconomic datasets get high marks for accuracy and reliability. Source data are adequate, statistical techniques are sound, and assessment and validation of source data and outputs are thorough. In several datasets, some fine tuning could be done by conducting more regular and/or thorough studies of revisions and using them to improve the statistical output."

Return to footnote 45 referrer

Footnote 46

Adapted from 2003 IMF report, p.63.

Return to footnote 46 referrer

Footnote 47

'Bricks and mortar' describes a company or portion of a company with a physical presence, as opposed to one that exists only on the Internet; 'clicks and mortar' describes a combination of traditional (brick and mortar) and online establishments, such as a store or a bank with a website. Transactions can be initiated and finalized at either the website or the physical site. Source: BusinessDictionary.com

Return to footnote 47 referrer

Footnote 48

The Consumer Price Index Enhancement Initiative 2011/2012 Retrospective Report. Consumer Prices Division, June 2012.

Return to footnote 48 referrer

Footnote 49

PMAC, Refining the Blueprint for the CPI - FINAL on 2011-09-28.

Return to footnote 49 referrer

Footnote 50

There is an ongoing debate in the literature and among economists about the proper choice among alternative estimators of price to address bias in the CPI. While it is agreed that certain superlative index will closely approximate an exact cost of living this could be done only under ideal condition and with a lag, unless correction based on the observed dispersion of price movement are done (see Diewert, 1996). It is agreed among experts consulted that a superlative index should be constructed as more up to date expenditure information is obtained and inexpensive way to correct the superlative index are developed.

Return to footnote 50 referrer

Footnote 51

More specifically, it is argued that the central bank may need a broader indicator of inflation which gives prominence to house prices rather than the cost of housing services in its conduct of monetary policy. While the actual indicator is fine for the purpose of estimating the cost of living, a broader indicator of inflation which gives prominence to house price rather than the cost of housing services in its conduct of monetary policy would be useful.

Return to footnote 51 referrer

Footnote 52

Ibid.

Return to footnote 52 referrer

Public and private school data as well as home-schooling data were collected on separate templates, spanning years 2008/2009 to 2012/2013.

Reporting period:

  • From: 2014-02-15
  • To: 2014-09-30

1. Expenditures, 2008/2009 to 2012/2013 (Public)

School Boards and Districts

Educator remuneration:

  • row 1 Salaries/wages and allowances
  • row 2 Fringe benefits (except employer's contribution to pension plans)

Educator pension plans:

  • row 3 Employer's contributions to Canada and Quebec pension plans
  • row 4 Other pension plans
  • row 5 Periodic contributions to rectify actuarial deficiencies

Other operating expenditures:

  • row 6 Other operating expenditures
  • row 7 Total operating expenses (rows 1 to 6)

Capital expenditures:

  • row 8 Capital annual expenditures
  • row 9 Interest on debt services
  • row 10 Total capital expenditures (rows 8 and 9)
  • row 11 Total expenditures school boards and districts (rows 7 and 10)

Ministry of Education

Educator remuneration:

  • row 12 Salaries/wages and allowances
  • row 13 Fringe benefits (except employer's contribution to pension plan)

Educator pension plans:

  • row 14 Employer's contributions to Canada and Quebec pension plans
  • row 15 Other pension plans
  • row 16 Periodic contributions to rectify actuarial deficiencies

Other operating expenditures:

  • row 17 Other operating expenditures
  • row 18 General administration
  • row 19 Total operating expenses (rows 12 to 18)

Capital expenditures

  • row 20 Capital annual expenditures
  • row 21 Interest on debt services
  • row 22 Total capital expenditures (rows 20 and 21)
  • row 23 Total expenditures Ministry of Education (rows 19 and 22)

Other Provincial Departments or Agencies

Educator remuneration:

  • row 24 Salaries/wages and allowances
  • row 25 Fringe benefits (except employer's contribution to pension plans)

Educator pension plans:

  • row 26 Employer's contributions to Canada and Quebec pension plans
  • row 27 Other pension plans
  • row 28 Periodic contributions to rectify actuarial deficiencies

Other operating expenditures:

  • row 29 Other operating expenditures
  • row 30 Total operating expenses (rows 24 to 29)

Capital expenditures:

  • row 31 Capital expenditures
  • row 32 Interest on debt services
  • row 33 Total capital expenditures (rows 31 and 32)
  • row 34 Total expenditures other provincial departments and agencies (rows 30 and 33)
  • row 35 Total Education Expenditures (rows 11 , 23 and 34)

2. Enrolments by Type of Program, Grade and Sex, School Boards and Districts (Headcounts), 2008/2009 to 2012/2013 (Public, Private and Home Schooling)

2.1 Regular Programs for Youth for Male, Female and Total

  • Junior Kindergarten;
  • Kindergarten
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

2.2 Full-time Equivalent (FTE) Rate - Regular Programs for Youth for Male, Female and Total

  • Junior Kindergarten
  • Kindergarten

2.3 Upgrading programs1 for adults for Male, Female and Total

  • less than 8
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

2.4 Vocational Programs2 for Youth and Adults for Male, Female and Total

  • Youth
  • Adults
  • Total

2B. Enrolments by Type of Program, Age and Sex, School Boards and Districts (Headcount), 2008/2009 to 2012/2013 (Public, Private and Home Schooling)

2B.1 Regular Programs for Youth for Male, Female and Total

Age

  • Under 3
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

2B.2 Full-time Equivalent (FTE) Rate - Regular Programs for Youth for Male, Female and Total

  • Junior Kindergarten
  • Senior Kindergarten

2B.3 Upgrading programs1 for adults for Male, Female and Total

Age

  • Under 10
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

2B.4 Vocational Programs2 for Youth and Adults for Male, Female and Total

Age

  • Under 10
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

3. Enrolments by Type of Minority and Second Language Programs, Youth Sector by Grade, School Boards and Districts (Headcounts), 2008/2009 to 2012/2013 (Public and Private)

3.1 Regular Second Language Programs3 for Male, Female and Total

  • Junior Kindergarten
  • Kindergarten
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

3.2 Second Language Immersion Programs4 for Male, Female and Total

  • Junior Kindergarten
  • Kindergarten
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

3.3 Minority language programs5 for Male, Female and Total

  • Junior Kindergarten
  • Kindergarten
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

4. Enrolments by type of Aboriginal Language Programs by Grade, School Boards and Districts (Headcounts), 2008/2009 to 2012/2013 (Public)

4.1 Aboriginal Language as a subject6

  • Junior Kindergarten
  • Kindergarten
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

4.2 Aboriginal Language as Language of Instruction7

  • Junior Kindergarten
  • Kindergarten
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • 7
  • 8
  • 9
  • 10
  • 11
  • 12
  • 13
  • Ungraded
  • Total

5. Enrolments in Special Needs Education8 by Type of Disability, Type of Class, School Boards and Districts (Headcounts), 2008/2009 to 2012/2013 (Public)

5.1 Number of students identified and receiving additional program and service supports for Type of Class, Male, Female and Total

A. For sensory, physical and intellectual disabilities - Low incidence disabilities

  • Regular
  • Special

B. For learning disabilities and behavioural disabilities - High incidence disabilities

  • Regular
  • Special

C. To compensate for Socio-Economic Status or other disadvantages

  • Regular
  • Special

Total

  • Regular
  • Special

Grand Total

6. Number of Graduates9 by Type of Program, Age and Sex, School Boards and Districts, 2008/2009 to 2012/2013 (Public and Private)

6.1 Regular Programs for Youth for Male, Female and Total

  • Under 10
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

6.2 Adult Upgrading Programs10 for Male, Female and Total

  • Under 10
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

6.3a Vocational11 Programs for Youth for Male, Female and Total

  • Under 10
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

6.3b Vocational11 Programs for Adults for Male, Female and Total

  • Under 10
  • 10
  • 11
  • 12
  • 13
  • 14
  • 15
  • 16
  • 17
  • 18
  • 19
  • 20
  • 21
  • 22
  • 23
  • 24
  • 25
  • 26
  • 27
  • 28
  • 29
  • 30 to 34
  • 35 to 39
  • 40 and over
  • Unknown
  • Total

7.1 Educators headcounts reported as Full-time or Part-time Educators12 by Age Group and Sex, 2008/2009 to 2012/2013 (Public and Private)

Headcounts Educator

Full-time

  • Less than 25 years
  • 25 to 29 years
  • 30 to 34 years
  • 35 to 39 years
  • 40 to 44 years
  • 45 to 49 years
  • 50 to 54 years
  • 55 to 59 years
  • 60 to 64 years
  • 65 and over
  • Unknown
  • Sub-Total

Part-time

  • Less than 25 years
  • 25 to 29 years
  • 30 to 34 years
  • 35 to 39 years
  • 40 to 44 years
  • 45 to 49 years
  • 50 to 54 years
  • 55 to 59 years
  • 60 to 64 years
  • 65 and over
  • Unknown
  • Sub-Total
  • Total

7.2 Number of Educators12 in Full-time Equivalent (FTE) by Categories, 2008/2009 to 2012/2013

Full-time Equivalent (FTE) Educators

  • Teachers
  • School Administrators
  • Pedagogical Support
  • Total

Notes:

1. Include enrolments in General Education Development (GED), Adult Basic Education (ABE) and other equivalency programs.  Exclude any enrolments in upgrading programs offered at the postsecondary level.

2. Include enrolments in all professional and technical training programs offered in public schools operated by school boards or the province, in private schools and as home schooling.  Exclude any enrolments in vocational programs offered at the postsecondary level.

3. Regular Second Language Programs (or Core Language programs) Enrolments in programs where French is taught to Anglophone students or English is taught to Francophone students as a “subject” in the regular course offerings.  One or more additional subjects can also be taught in the student’s second official language but second language instruction must total less than 25% of all instruction time.

4. Second Language Immersion Programs: Enrolments in programs where French is the language of instruction for Anglophone students or English is the language of instruction for Francophone students. Instruction time in the student’s second official language is more than 25% of all instruction time.

5. Minority language as Language of Instruction: Enrolments in programs for students from the official language linguistic minority in the relevant province or territory (French outside Québec, English in Québec). These programs allow children in the linguistic minority to pursue their education in their first official language.

6. Aboriginal language instruction (a.k.a. Aboriginal second language program or Core Aboriginal): Enrolments in programs where an Aboriginal language is taught as a subject as part of regular course offerings.  One or more additional subjects can also be taught in an Aboriginal language up to less than 25% of the week.

7. Aboriginal language as language of instruction (a.k.a. Aboriginal first language program): enrolments in schools where all classroom instruction is in an Aboriginal language for Aboriginal children.

8. Students with special educational needs are those for whom additional public and/or private resources are provided to support their education.  Additional resources are made available over and above those generally available to regular students.  They are resources provided to support students who have difficulties following the regular curriculum.  They can be personnel resources (a more favourable teacher/student ratio, additional teachers, assistants or other personnel), material resources (aids or supports of various types, modification or adaptation to classroom, specialized teaching materials) or financial resources (modified funding formulae, money set aside within the regular budget allocation or additional payments).

Following the OECD and recommendations from the Special Education and Student Services Directors of the Western and Northern Canada Protocol, they are broken into three sub-categories:

Category A refers to students whose disabilities have clear biological causes – such as physical disabilities, visual impairment/blind, hearing impairment/deaf, moderate to severe/profound intellectual disability, chronic health problem, multiple disabilities, autism and foetal alcoholic syndrome (FAS).

Category B refers to students who are experiencing learning and/or behavioural difficulties.

Category C refers to students whose difficulties are considered to arise primarily from socio-economic, cultural and/or linguistic disadvantages for which the education system seeks to compensate.

9. Include first time graduates only: count late graduates but do not count the same graduate twice.

10. Include graduates in General Education Development (GED), Adult Basic Education (ABE) and other equivalency programs. Exclude any graduates of upgrading programs offered at the postsecondary level

11. Include graduates in all professional and technical training programs. Exclude any graduates of vocational programs offered at the postsecondary level.

12. Educators include all employees in the public and private school system who belong to one of the three following categories: teachers, school administrators and pedagogical support. While the definition excludes teacher aides, student teachers and other personnel who do not get paid for their employment, it includes educational assistants, paid teacher’s aides, guidance counselors and librarians. Personnel temporarily not at work (e.g. for reasons of illness or injury, maternity or parental leave, holiday or vacation) are included.

Headcount educators are defined as the number of educators on September the 30th (or as close as possible thereafter) of the school year who are responsible for providing services to the students.

It includes all educators in regular public and private schools, provincial reformatory or custodial schools. Exclude correspondence or distance programs, or independent schools financed by federal departments ( e.g. the Department of National Defense and the Department of Indian and Northern Affairs).

This category also includes all educators in all professional and technical training programs offered in public schools operated by school boards or the province and private schools. Exclude, vocational programs offered at the postsecondary level, distance education programs, and schools financed by federal departments ( e.g. the Department of National Defence and the Department of Indian and Northern Affairs).

Full-time Equivalent (FTE) Educator is defined as the number of full-time educators on September the 30th (or as close as possible thereafter) of the school year, plus the sum of part-time educators according to their percentage of a full-time employment allocation (determined by the province or territory).