AgZero: Using alternative data and advanced technologies to reduce response burden on farmers

Like other data users, farmers want timely, accurate and detailed data, while completing the least number of traditional surveys. That is why in April 2019, Statistics Canada set a goal to move beyond a survey-first approach by replacing survey data with data from administrative sources.

This project, dubbed AgZero, is using alternative data sources and advanced technologies, such as Earth Observation data and machine learning, to reduce the response burden on farmers to as close to zero as possible by 2026. Through this process, Statistics Canada will continue to provide the same high-quality information, while applying the same rigorous privacy and confidentiality standards that Canadians expect and deserve.

By 2026, farmers will spend less time answering survey questions.

Early milestones include:

  • In July 2019 and March 2020, Statistics Canada produced estimates on the number of temporary foreign workers in the agriculture sector in Canada using administrative data. The estimates were produced with zero direct contact with farmers, saving them valuable time.
  • The agency implemented a new crop yield model for the July 2019 Field Crop Survey in Manitoba using satellite imagery and administrative data. This resulted in fewer survey questions for respondents in that province. The goal is to expand this model to as many provinces as possible by 2022, depending on the availability of administrative data.
  • In April 2020, Statistics Canada used administrative data to produce annual estimates of the total number of employees in the agriculture sector without having to ask farmers to complete questionnaires.

A history of trusted agriculture statistics

Since the time of the first census in 1921, Canada's national statistical office has collected, analyzed and reported on agriculture in Canada so that – together – we can better understand ourselves and our country. As the agency continues to modernize and chart new methods of collecting data, we are committed to protecting the rightful privacy of Canadians' information. It is our duty by law.

How AgZero keeps your information safe and private

Our AgZero project follows the same rigorous privacy and confidentiality standards as all other statistical programs at Statistics Canada. All collected information is anonymized: this means that data that is made public can never be connected to you, your household or business.

The project also applies innovative methods to preserve security, privacy and confidentiality, including the agency's Necessity and Proportionality Framework. It helps ensure that the agency's need for data is well-defined, and that we work to balance the volume and sources of data with the need to reduce the response burden on Canadians—all while maintaining the protection of their privacy. For more, check out Statistics Canada's Trust Centre.

Learn more about AgZero

As part of our commitment to engagement and transparency, Statistics Canada's Agriculture Statistics Program provides regular updates on the AgZero initiative to key stakeholders. These include Agriculture and Agri-Food Canada, provincial and territorial ministries of agriculture, and key industry groups.

Stay up-to-date on the latest news by following Statistics Canada's social media channels, or by registering for My StatCan agriculture updates.

You can read more about AgZero in the StatCan Blog: Reducing the response burden imposed on farmers and business.

Do you have any questions about our AgZero project? If so, contact: AgZero.

The road to AgZero

The road to Agzero

Modernization projects

Statistics Canada fosters a culture of innovation—it is at the heart of everything we do. Our modernization initiative is based on five key pillars, which were developed in collaboration with our stakeholders in a series of consultations to better understand their information needs. These consultations, coupled with the lessons learned from our four pathfinder projects, are helping transform Canada’s national statistical agency into one that is even more modern and responsive to our data-driven world.

Today, we know that traditional statistics-gathering methods are no longer sufficient to accurately measure Canada’s economic and societal changes. That is why Statistics Canada’s focus has shifted toward leveraging administrative data, using advanced technologies and developing new, cost-effective methods to link and integrate data from a variety of sources.

As we experiment with new methods, we will continue to apply the same rigorous privacy and confidentiality standards to protect Canadians’ information. It is our responsibility by law.

Our modernization projects

Learn about some of our latest initiatives that are driving our modernization forward.

Audit of Acquisition of Data from Alternative Sources

Audit Report

November 2019
Project Number: 80590-112

Executive summary

Statistics Canada works with all levels of government and private sector organizations in the collection and compilation of statistical information. Although the agency has been acquiring data from alternative sources for decades, Statistics Canada data collection has traditionally been rooted in the administration of surveys. The agency has acknowledged that the traditional method of collecting data presents a series of unique challenges for meeting new and ongoing data needs and reducing response burden.

As part of the agency's modernization initiative that was launched in 2017, the agency is moving towards an "administrative data first agenda." This agenda seeks to use the acquisition of data from alternative sources as the primary method to collect statistical information in order to improve the balance between data quality, response burden and costs.

For the purpose of this audit, "data from alternative sources" are defined as all data other than survey data, which includes, but is not limited to administrative data (data obtained under the Statistics ActFootnote 1) as well as data available to the public.

Why is this important?

As the national statistical office, Statistics Canada must ensure it delivers relevant statistical information in an efficient and transparent manner. In today's environment, Statistics Canada like many other public sector organizations is faced with continuous change and has had to innovate and discover new ways to acquire data in order to continue to serve Canadians and fulfill its mandate.

Against this backdrop, the agency has implemented an administrative data first agenda that is aligned with its modernization initiative. Within this administrative data first paradigm, the agency seeks to respond to statistical demands and ensure that data from alternative sources are acquired in a strategic, timely and transparent manner. The audit determined the extent to which the agency has implemented effective processes and controls to support these objectives, while ensuring the stewardship of agency interests.

Key audit findings

The Data Acquisition Committee provides support on a wide-range of topics, including: strategic advice on potential partnerships, data strategies and new initiatives proposed by statistical program divisions. Interviews with committee members indicated that there is some concern regarding the committee's expanding roles and responsibilities.

Although the agency has broadly identified some of the risks to acquiring data from alternative sources through various corporate mechanisms, no full risk assessment has been completed for the acquisition of data from alternative sources. The restructuring of the agency's Tier 2 governance committees offers the agency a real opportunity to strengthen oversight on risk management activities.

The Statistics Canada Data Strategy was developed to provide a roadmap for how the agency, as part of its modernization agenda, will continue to govern data assets and key strategic data capacities. The Statistics Canada Data Strategy identifies a series of short, medium and long term business objectives for acquiring access to alternative sources of data but these objectives have not yet been aligned to specific performance indicators.

Roles and responsibilities for acquiring data from alternative sources are clearly outlined and defined within Statistics Canada's policy instruments. However, the policy instruments need to be updated to reflect some recent changes to legislative requirements under section 8(2) and 8(3) of the Statistics Act and the updated role of the Data Stewardship Division (DSD) and statistical program areas in the acquisition process.

Two training courses have been offered to assist agency employees in carrying out their responsibilities for acquiring data from alternative sources. Both courses could benefit from providing guidance on the implications of the new legislative requirements under the Statistics Act and further explaining how program managers can leverage DSD and the Office of Privacy Management and Information Coordination (OPMIC) during the acquisition process.

Data acquisition agreements are used to acquire administrative data. Publicly available data do not need to be obtained under the Statistics Act and, generally speaking, are not subject to the same requirements as administrative data.

Legal oversight is provided by the OPMIC during the data acquisition process. When a data acquisition agreement is drafted, OPMIC is contacted to perform a review of the terms and conditions within the proposed agreement prior to obtaining signatures.

When the agency incurs a financial fee for acquiring data from alternative sources, a cost proposal is submitted to the agency by the provider that identifies the total cost along with supporting financial information. However, there is limited evidence to demonstrate how management reviews these costs to determine whether they are reasonable and represent value for money.

Statistical program managers were generally not using the standard evaluation questionnaire or any other suitable tool to assess data quality and fit for use. In collaboration with the Modern Statistical Methods and Data Science Branch, DSD is coordinating a more user friendly version of the quality evaluation questionnaire.

Overall conclusion

Management has implemented a governance framework to provide oversight and advance the agency's administrative data first agenda, with corporate tools in place that support this agenda and identify some of the risks to acquiring data from alternative sources. The proposed restructuring of the agency's governance committees offers an opportunity to strengthen risk management activities for the acquisition of data from alternative sources. The aim is to provide Statistics Canada with a more effective governance structure to support the acquisition of data from alternative sources. The agency has also identified business objectives for acquiring data from alternative sources although the absence of key performance indicators could hinder the agency's ability to measure progress against its business objectives.

Internal controls are in place and functioning with some minor deficiencies, which are attributed to recent legislative changes and an internal transformation of responsibilities related to the acquisition process. Through training programs and internal communication, management has taken positive steps to inform employees but should ensure this is consistently communicated across the agency.

Conformance with professional standards

The audit was conducted in accordance with the Mandatory Procedures for Internal Auditing in the Government of Canada, which include the Institute of Internal Auditors' International Standards for the Professional Practice of Internal Auditing.

Sufficient and appropriate audit procedures have been conducted, and evidence has been gathered to support the accuracy of the findings and conclusions in this report, and to provide an audit level of assurance. The findings and conclusions are based on a comparison of the conditions, as they existed at the time, against pre-established audit criteria. The findings and conclusions are applicable to the entity examined, and for the scope and period covered by the audit.

Steven McRoberts
Chief Audit and Evaluation Executive

Introduction

Background

The world is constantly changing, with new technologies regularly emerging, only to become obsolete and outdated almost overnight. With this ever-changing environment comes increased pressure for governments to have 'real-time' data to inform public policy as data are the lifeblood of decision-making in the public sector.

In the public sector, data help direct and inform decision-making by providing valuable information such as how many live in poverty; whether greenhouse gas emissions are increasing; or how public money is being spent. The success of the Canadian economy, and the prosperity of its communities depends in part on advancing programs that focus on strengthening public sector decision-making in key areas such as the financial, environmental and the social fields.

Statistics Canada plays an integral role in in this endeavour, as a foundational part of the agency's mandate is to collect and compile statistical information. For decades, the agency's business has been rooted in the administration of surveys, with data from alternative sources being used to complement its data collection. Recently, the agency acknowledged that traditional surveying of Canadians and businesses has struggled, because of increasing costs and response burden.

For the purpose of this audit, "data from alternative sources" has been defined as all data other than survey data, this includes, but is not limited to, administrative data (data obtained under the Statistics Act) as well as data available to the public. Data available to the public do not need to be obtained under the Statistics Act and are not subject to the requirements of the Statistics Act.

Administrative data first agenda

As a part of the agency's modernization initiative that focuses on user-centric service delivery and leading edge data integration, Statistics Canada has committed to an administrative data first agenda. This agenda is aimed at positioning the agency to better respond to statistical demands in the ever-changing and ever-evolving modern data world. In an administrative-first paradigm, administrative data are considered first before a survey is conducted, in order to complement or replace data acquired from a survey or to evaluate its quality.

Statistics Canada has taken steps towards realizing its administrative data first agenda by formalizing broad business objectives in a number of corporate initiatives. These objectives include:

  • identifying, and gaining timely access to data from alternative sources for statistical purposes;
  • communicating to the public in a proactive and transparent manner why the agency seeks to acquire data from alternative sources; and
  • strategically managing the acquisition of data through the effective implementation of governance and stewardship.

A period of transition

When acquiring data from alternative sources, there are a number of processes, procedures and key stakeholders that play an integrated role. The Data Stewardship Division (DSD) is responsible for the creation and implementation of sound data stewardship protocols to ensure all data assets are well managed, secure, and fit for use. The Office of Privacy Management and Information Coordination (OPMIC) provides legal oversight and is responsible for reviewing data acquisition agreements for legal implications.

The process by which the agency acquires data from alternative sources is in a period of transition as a result of shifting internal roles and responsibilities, new legal interpretations to the Statistics Act and updates to internal governance structures. In the future, these changes will impact how the agency manages its risks for acquiring data from alternative sources.

Audit objective

The objective of the audit was to provide reasonable assurance to the Chief Statistician (CS) and the Departmental Audit Committee that management has adequate processes and controls in place to support the strategic, transparent and timely acquisition of data from alternative sources while ensuring the sound stewardship of public assets and agency interests.

Scope

The audit scope included an examination of acquisitions of data from alternative sources from private sector organizations where negotiations to acquire data from alternative sources began or were completed during fiscal years 2017/2018 to 2018/2019, including acquisitions that were underway or not yet completed as at May 31, 2019. The audit focused on three key controls areas, namely: governance, tools and training and internal controls.

Statistics Canada also acquires data from alternative sources from provinces, territories and federal departments and agencies. It was determined during the planning phase of the audit that acquiring data from the public sector poses less risk to the agency and for this reason, public sector data acquisitions were excluded from the scope of the audit.

Approach and methodology

This audit was conducted in accordance with the Mandatory Procedures for Internal Auditing in the Government of Canada, which include the Institute of Internal Auditors' International Standards for the Professional Practice of Internal Auditing. Field work consisted of a review of applicable processes, activities and tools to ensure compliance with Statistics Canada legislative and policy requirements.

Authority

The audit was conducted under the authority of the approved Statistics Canada Integrated Risk-based Audit and Evaluation Plan 2019/2020 to 2023/2024.

Audit findings, recommendations and management response

The data acquisition process

The Data Acquisition Committee (DAC) provides support on a wide-range of topics, including: strategic advice on potential partnerships, data strategies and new initiatives proposed by statistical program divisions. Interviews with committee members indicated that there is some concern regarding the committee's expanding roles and responsibilities.

Although the agency has broadly identified some of the risks to acquiring data from alternative sources through various corporate mechanisms, there has not been a full risk assessment completed for the acquisition of data from alternative sources. The restructuring of the agency's Tier 2 governance committees offers the agency a real opportunity to strengthen oversight on risk management activities.

The Statistics Canada Data Strategy (SCDS) was developed to provide a roadmap for how the agency, as part of its modernization agenda, will continue to govern data assets and key strategic data capacities. The SCDS identifies a series of short, medium and long term business objectives for acquiring access to alternative sources of data but these objectives have not yet been aligned to specific performance indicators.

Roles and responsibilities for acquiring data from alternative sources are clearly outlined and defined within Statistics Canada's policy instruments. However, the policy instruments need to be updated to reflect some recent changes to legislative requirements under Section 8(2) and 8(3) of the Statistics Act and the updated role of the DSD and statistical program areas in the acquisition process.

Two training courses have been offered to assist agency employees in carrying out their responsibilities for acquiring data from alternative sources. Both courses would benefit from providing guidance on the implications of the new legislative requirements under the Statistics Act and further explaining how program managers can leverage DSD and OPMIC during the acquisition process.

As the national statistics office, Statistics Canada is constantly exploring ways to acquire alternative sources of data to better support its statistical programs and provide Canadians with valuable information. Statistics Canada can acquire data from alternative sources from both the public and the private sectors and has acknowledged their importance in supplementing its statistical programs through the agency's modernization initiative. The DSD is responsible for developing sound data stewardship protocols to ensure all data assets are well managed, secure, and fit for use. DSD has developed an acquisition process that identifies the steps to acquire new sources of data from alternative sources. This process ensures that all proposed data acquisitions are consistently performed using a common approach.

Data acquisitions are contingent upon a number of key factors, including: the complexity of the acquisition, the sensitivity of the data and the pre-existing relationship with the data provider. Normally, the process begins with statistical program managers identifying data from alternative sources collected and held by other organizations that can support the legal mandate of Statistics Canada. Once a need has been identified, a request is sent to DSD to determine whether the data will be for broad use or localized use.

Once the request is complete and the type of data is determined, DSD and OPMIC provide guidance to the program areas on how to proceed with the acquisition. With support from DSD, program managers establish a strategy to reach out to the data provider and initiate early discussions with key stakeholders. The next step is to begin negotiations with the data provider. This is a key point in the process when Statistics Canada meets with representatives from the data provider to discuss the data being requested, legal and privacy expectations and any associated costs. It should be noted that Statistics Canada does not pay for data but rather for the time and effort required to compile the intended data sources.

When acquiring data from alternative sources with an associated cost, it can be obtained under the Statistics Act (data sharing agreement). Data can also be acquired without the use of the Statistics Act through a contract or written communication. When the data are obtained under the Statistics Act, the statistical program area is responsible for initiating expenditure initiation under section 32 of the Financial Administration Act and performing a financial review process with support provided by the OPMIC and DSD. For data acquisitions that do not fall under the authority of the Statistics Act, Corporate Support Services Division (CSSD) is responsible for reviewing the proposed costs and determining whether the proposal should be accepted for payment. Through interviews, the audit found that CSSD's departmental delegation of financial authorities for services is $100,000 and any contract above that threshold would be sent to Public Services and Procurement Canada.

An agreement is formalized through a data acquisition agreement, contract or written communication once all aspects of the negotiations have been finalized, including any potential cost. Typically, the agency begins receiving synthetic or test data from the provider and quality assessments must be completed to determine whether the data are usable within the agency's existing data environment. If the data are deemed fit for use, statistical program managers finalize and sign the data acquisition agreement with the data provider. The OPMIC plays a key role in this step as they are responsible for ensuring that the agreement contains terms and conditions that protect the legal interests of the agency.

Through consultation with DSD, the audit found that DSD's role in the acquisition process is expected to change. The intent is for program divisions to carry out their own data acquisitions and DSD to act as an intermediary on all matters related to data acquisitions. DSD's intent is to communicate these changes and make this process visible but at the time of audit, no timeline had been established.

The data acquisition process described above is supported through a series of controls including governance committees, training courses and internal policy instruments. All play an important role in identifying, and gaining timely access to data and communicating to the public why the agency seeks to acquire for statistical purposes. The audit determined the extent to which these controls were operating and comes at a time when the agency is undergoing significant changes as it looks to advance its administrative data first agenda.

Governance mechanisms are undergoing changes that are expected to strengthen risk management.

The DAC was created in February 2018 as a result of consolidating the Administrative Data Management Committee, Collection Planning Committee and Business Response Management Committee. The DAC's mandate is to provide leadership and direction for data acquisitions with the objective of implementing and maintaining an "administrative data first agenda," The DAC is made up of 18 members that include senior managers, directors and director generals from multiple fields across the agency. The committee meets approximately once per month and provides support on a wide-range of topics, including: strategic advice on potential partnerships, data strategies and new initiatives proposed by statistical program divisions.

Interviews with committee members indicated that there is some concern regarding the committee's expanding roles and responsibilities. DAC was originally intended to be a strategic-level oversight body to provide high-level guidance on activities directly linked to acquiring data from alternative sources. However, the audit found that some of the DAC's activities are more ad-hoc in nature and not always within its intended mandate. For example, the committee was tasked with determining whether certain surveys should be made mandatory or voluntary. It is important that the DAC operate within its intended mandate to ensure that there is adequate time and resources to address key activities related specifically to the acquisition of data from alternative sources.

Moving forward, the agency has an opportunity to strengthen its governance with the proposed changes to the existing Tier-2Footnote2 governance structure. These modifications are designed to consolidate the 10 existing Tier-2 governance committees into 5 new committees. The proposed 'Data in: Data Acquisition and Management' is one of the five new committees and will aim to provide Statistics Canada with a more effective governance structure to support the acquisition of data from alternative sources. The committee will be responsible for identifying risks and issues related to acquiring data from alternative sources and implementing mitigation strategies to ensure the agency is able to respond proactively to change and uncertainty. The new responsibilities of the proposed committee are needed as risk management oversight for acquiring data from alternative sources needs to be strengthened to enable more effective decision-making throughout the agency.

The audit confirmed that no risk assessment has been completed for the acquisition of data from alternative sources, although the agency has broadly identified some of the risks to acquiring data from alternative sources through various corporate mechanisms.

Through interviews, agency employees indicated that there might be some merit to undertaking a risk assessment. The restructuring of the agency's Tier 2 governance committees offers the agency a real opportunity to strengthen risk management activities for acquiring data from alternative sources as it will improve decision-making in governance, strategy and objective setting. However, at the time of the audit this restructuring had not yet been fully implemented.

Work is required to ensure that key performance measures are in place.

The CS has stated the importance of continuing to modernize each step of the statistical process, by modernizing and embracing an administrative data first agenda. To achieve this, Statistics Canada has embedded performance measures in corporate initiatives like the SCDS. The SCDS was developed to provide a roadmap for how the agency, as part of its modernization agenda, will continue to govern data assets and key strategic data capacities. The SCDS is organized into two main pillars: data governance and data stewardship. Under data stewardship, there are a series of 7 'strategic data capacities' that are intended to have performance measurement criteria that would track progress against specific targets.

One of the 7 strategic data capacities is: 'data discovery'. This area links directly to the administrative data first agenda and identifies a series of short, medium and long term business objectives for acquiring access to alternative sources of data. These include: outlining why the agency seeks to acquire data from alternative sources, establishing mechanisms to include community engagement and implementing processes to support the acquisition of data from multiple access points across the agency.

However, the SCDS does not contain any objectives or performance measures related to the 'timeliness' and 'speed' with which the agency acquires data from alternative sources even though through interviews, agency employees stressed the importance of gaining access to data from alternative sources in a timely manner.

Overall, although the SCDS provides short, medium and long term business objectives for acquiring data from alternative sources, these objectives have not been aligned to performance indicators. Without these indicators, the agency cannot fully track its progress against key objectives that include timeliness and transparency in order to determine whether objectives for acquiring data from alternative sources are being achieved. In discussion with DSD, measurement criteria for the acquisition of data from alternative sources, as outlined in the SCDS, will be developed with program areas and in consultation with Corporate Strategy and Management Field. It was indicated by DSD that the indicators related to the short term business objectives will be developed by early 2020.

Updates are required to policy instruments to ensure they are aligned with new legislative requirements and DSD's new role.

The Policy on the Use of Administrative Data Obtained under the Statistics Act and the Directive on Obtaining Administrative Data under the Statistics Act are the supporting internal policy instruments that provide direction on the acquisition and use of data from alternative sources. Overall, they effectively outline the roles and responsibilities of key stakeholders across the agency and define the operational steps involved in acquiring data from alternative sources.

DSD has played a significant role in the acquisition of data from new alternative sources. Its responsibilities included: acquiring administrative data sources that had a broad scope and supporting statistical programs in their acquisition of administrative data. As previously stated, DSD's role in the acquisition process is expected to change. Program divisions will be expected to carry out their own data acquisitions and DSD will act as an intermediary on all matters related to data acquisitions. DSD indicated that they intend to make this new process visible and update the policy instruments by the end of fiscal year 2019-2020.

The policy instruments have not yet been updated to reflect the new legal interpretation. Under the new legal interpretation (provided to the agency in February 2018) there are two modifications. Specifically, under section 8(2), the CS must now publish any mandatory request for information before a request is submitted to a data provider. Under section 8(3), the CS must notify the Minister of any new mandatory request for information at least 30 days before it is published.

Without these updates in the policy instruments, the agency increases the risk that employees may not be aware of, or fully understand these requirements. This could hinder the agency's ability to acquire data in an efficient and effective manner. Although work is underway to update the policy instruments, it has not yet been finalized.

Training courses cover key components of the data acquisition process, but there are opportunities for improvement.

Providing effective training to agency employees presents a unique opportunity to expand their knowledge base and allows them to strengthen skills unique to their job responsibilities. Agency employees who understand how to leverage interpersonal skills within the negotiation process will assist the agency in acquiring data from alternative sources in a more expedient manner. However, for this to occur employees must be aware of and have adequate access to training opportunities so that they can develop the requisite knowledge and skills for acquiring data from alternative sources.

Since 2017-18, two training courses have been offered to employees at the agency to assist them in carrying out their responsibilities for acquiring data from alternative sources. However, both courses contain areas that could be improved. 'Obtaining Administrative Data under the Statistics Act' was a course developed under the direction of DSD and provides guidance on governing instruments, concepts and tools on how to overcome challenges during the data acquisition process. The course was last delivered to agency employees in January 2018, and does not include any guidance on the new legal interpretation of the Statistics Act that applies to data from alternative sources. It should be noted that DSD is currently updating the training course to address the implications of the new legislative requirements, and DSD's new role in the data acquisition process.

'Skillful Negotiations' was developed under the direction and guidance of the Employee Development and Wellness Division in order to assist agency employees in carrying out effective negotiations. The course effectively provides guidance on carrying out skillful negotiations including: identifying team roles, outlining different types of negotiations and how to leverage interpersonal skills. It also provides participants with the opportunity to provide feedback on the overall course content, including each of the four main training modules. Although the overall level of satisfaction from course participants is high (86.5%) the course could be improved by including specific guidance on the new legislative and legal requirements under the Statistics Act and how to effectively utilize DSD and OPMIC when seeking to acquire data from alternative sources.

Recommendation 1

It is recommended to the Assistant Chief Statistician, Analytical Studies, Methodology and Statistical Infrastructure to ensure that the realigned governance structure embeds effective risk management oversight for acquiring data from alternative sources.

Management response

Management agrees with the recommendation.

  • 1.1 Through the restructuring of the agency's Tier 2 governance committees, a governing body will be identified. The committee's responsibility will include risk management activities for the acquisition of data from alternative sources.
  • 1.2 An improved governance process for the acquisition of data from alternative sources will be developed and documented. Supporting material will include explicit documentation of the entire governance process using flow diagrams as well as templates to support efficient documentation of:
    1. specific steps of the governance process;
    2. the steps considered to mitigate risks;
    3. the record of decisions; and,
    4. accountability.
  • 1.3 Programs areas will be informed about the new governance process related to the acquisition of data from alternative sources.
Deliverables and timeline

The Director General of the Strategic Data Management Branch will identify a governing body whose responsibility will include risk management activities for the acquisition of data from alternative sources by March 2020.

The Director of the Data Stewardship Division will develop an improved governance process for the acquisition of data from alternative sources that will include key elements to mitigate risks and document accountability by June 2020.

The Director of the Data Stewardship Division and Director of the Office of the Chief Editor will:

  • Develop a communication plan to socialize the new governance process to managers and employees involved in the acquisition of data from alternative sources by March 2020.
  • Communicate activities defined in the communication plan by March 2021.

Recommendation 2

It is recommended to the Assistant Chief Statistician, Analytical Studies, Methodology and Statistical Infrastructure to ensure that key performance indicators and measurable outcomes are developed and aligned to business objectives for acquiring data from alternative sources in the Statistics Canada Data Strategy.

Management response

Management agrees with the recommendation.

  • 2.1 Key performance indicators associated with the acquisition of data from alternative sources will be defined.
Deliverables and timeline

The Director of the Data Stewardship Division will establish key performance indicators that will measure the effectiveness of the governance processes associated with the acquisition of data from alternative sources by November 2020.

Recommendation 3

It is recommended to the Assistant Chief Statistician, Analytical Studies, Methodology and Statistical Infrastructure to ensure that training courses and policy instruments are updated to ensure agency employees are provided with appropriate guidance and direction on new legislative requirements under the Statistics Act and DSD's new role in the acquisition of data from alternative sources.

Management response

Management agrees with the recommendation.

  • 3.1 Relevant policy instruments will be updated to reflect the latest legal and operational requirements based on the new governance process.
  • 3.2 Up to date training material related to the acquisition of alternate data will become a mandatory requirement for staff involved in the acquisition of data. Mandatory training centered on Statistics Canada's legal obligation and associated governance operations will be delivered.
Deliverables and timeline

The Director General of the Strategic Data Management Branch will:

  • Update versions of the following policy instruments by June 2020 (draft versions) and November 2020 (final versions):
    • Policy on the Use of Administrative Data Obtained under the Statistics Act
    • Directive on Obtaining Administrative Data under the Statistics Act
    • Guidelines on data available to the public
  • Update mandatory training material that reflects legal and operational requirements by February 2021.

Review of data acquisition files

Data acquisition agreements are used to acquire administrative data. Publicly available data do not need to be obtained under the Statistics Act and, generally speaking, are not subject to the same requirements as administrative data.

Legal oversight is provided by the OPMIC during the data acquisition process. When a data acquisition agreement is drafted, OPMIC is contacted to perform a review of the terms and conditions within the proposed agreement prior to obtaining signatures.

When the agency incurs a financial fee for acquiring data from alternative sources, a cost proposal is submitted to the agency by the provider that identifies the total cost along with supporting financial information. However, there is limited evidence to demonstrate how management reviews these costs to determine whether they are reasonable and represent value for money.

Statistical program managers were generally not using the standard evaluation questionnaire or any other suitable tool to assess data quality and fit for use. In collaboration with the Modern Statistical Methods and Data Science Branch, DSD is coordinating a more user friendly version of the quality evaluation questionnaire.

The Directive on Obtaining Administrative Data under the Statistics Act requires agency employees to implement a series of internal controls within the acquisition process to protect and safeguard the agency. To provide reasonable assurance that controls were in place and functioning as intended, the audit examined 12 private sector data acquisitions (7 administrative data files and 5 publicly available data files) that had been completed within the audit scope. The key controls assessed included:

  • use of a data acquisition agreement
  • legal oversight
  • financial oversight
  • quality assessment

Data acquisition agreements are used to acquire non-publicly available data but less so for publicly available data.

Under section 5.1.2 of the directive, the preferred method to obtain administrative data from private organizations is a data acquisition agreement, pursuant to the Statistics Act. However, the directive prescribes that an agreement may also take the form of an exchange of written communications or a contract, assuming it contains all the essential elements of a data acquisition agreement (i.e. legal authority to obtain data, its intended use or any legal requirements to protect it).

The audit reviewed seven administrative data acquisition files (obtained under the Statistics Act) to determine the extent to which the agency documents the terms and conditions of data agreements. In all seven files, the agency formalized data agreements that were aligned with the requirements under the Directive.

Publicly available data do not need to be obtained under the Statistics Act and, therefore are not subject to the same requirements as administrative data. The Guideline on data available to the public does not require or suggest that formal data acquisition agreements should be used when acquiring data available to the public.

The audit reviewed five acquisitions of publicly available data and found that three of the five files did not contain any form of agreement. The remaining two files contained either a formal license agreement or an exchange of written communications with the data provider. Under normal circumstances, there is no requirement to enter into an agreement for publicly available data.

Adequate legal oversight is provided by the Office of Privacy Management and Information Coordination.

OPMIC is responsible for reviewing all new agreements and working with legal counsel to ensure that the appropriate terms and conditions are in place to protect the agency's legal interests. Specifically, section 6.2.4.5 of the directive states that the Director of OPMIC must: 'support statistical program managers by reviewing all final data acquisition agreements before they are sent to the other organization.' As the directive does not specify what the review must include, we found that the review function varied depending on the complexity of the data acquisition.

Overall, when a data acquisition agreement was drafted, OPMIC was contacted to perform a review of the terms and conditions within the proposed agreement prior to obtaining signatures. The audit found that OPMIC provided legal oversight for all seven administrative data files (obtained under the Statistics Act). The exceptions where OPMIC did not perform a review included the file that contained an exchange of written communications and the three publicly available files without an agreement. As the Directive only identifies a requirement when there is a data acquisition agreement in place, OPMIC is not expected to be involved in the acquisition process in the absence of a formal agreement.

Financial reviews are taking place, but are not always formally documented.

When Statistics Canada acquires data from private sector organizations, the agency can acquire the data with no associated costs or pay the organization to compile the requested data. It is important to note that Statistics Canada does not pay for the data itself, rather, for the time and effort required to compile the intended data sources. DSD indicated that when there is a cost, the data provider develops a cost proposal that outlines the variables included in the final price. The cost proposal is submitted to Statistics Canada for review and acceptance. Part of the decision making process is to review the quality evaluation assessment to determine whether the value of the data is commensurate with its potential costs.

The directive and policy outline the requirements for financial oversight for data acquisitions with a cost. Specifically section 6.6 of the directive states that private sector acquisitions with a cost are to be provided to the CSSD for financial review. However, as of March 2018, CSSD was no longer involved in carrying out financial reviews for acquisitions that fall under the Statistics Act. Instead, a new process was implemented in which the responsibility to conduct a financial review of costs now falls under the responsibility of the statistical program manager and senior management with support from DSD and OPMIC. The agency's policy instruments have not been updated to reflect this change in process. They also do not prescribe any requirements for how program managers can demonstrate that they have considered whether costs are reasonable and represent value for money. Through interviews with program managers, the audit found that the financial review process that is in place includes exercising due diligence for expenditure initiation under section 32 of the Financial Administration Act.

The audit reviewed 4 acquisition files with an associated cost that were obtained under the Statistics Act to determine whether 1) a cost proposal was provided and 2) whether the cost proposal was reviewed to validate the costs for reasonableness. In all four files examined, the data provider submitted a cost proposal. In three of the four files, there was email documentation demonstrating that management was aware of and accepted the costs being proposed by the data provider. However, each of the four files did not contain any analysis to demonstrate how management determined that costs were reasonable in order to ensure value for money and that the agency's financial interests were protected.

Quality reviews of data from alternative sources are generally not being carried out.

Statistics Canada policy instruments are clear on the importance of and responsibilities surrounding the quality assessment of new data from alternative sources. As stated in section 6.4 of the directive, senior managers of statistical programs are responsible for assessing the quality of potential administrative data and their statistical usability, by using the data quality evaluation framework maintained by DSD or any other suitable tool. Contained within the data quality evaluation framework, is an evaluation questionnaire tool that is available for managers to assess new sources of data. The quality review process is an important step because it helps the agency to determine the value of the data, which in turn, helps to rationalize potential costs.

The audit reviewed the 12 acquisition files to determine whether a quality assessment was completed prior to obtaining the data. Overall, the audit found that program managers were generally not using DSD's data quality evaluation questionnaire or any other suitable framework. Four of the 12 files had documentation to demonstrate that a quality review took place. Of the four files that had completed a quality review, three were administrative data and one was publicly available data. The remaining eight files did not contain documentation to demonstrate that a quality review was completed prior to signing the data acquisition agreement. Through consultation with DSD, we were informed that statistical program managers were not using the standard evaluation questionnaire because of a perceived time burden. The audit also found cases in which the individuals responsible for the quality review were no longer in their roles resulting in documentation not being available. Without consistently evaluating the quality of data from alternative sources, there is a risk that statistical programs may acquire data that are incomplete or incompatible with their programming needs.

DSD has since taken steps to address this by updating the quality evaluation questionnaire to ensure it is more streamlined. In interviews with DSD they have stated that the updated quality evaluation framework, as developed by the Modern Statistical Methods and Data Science Branch, will be completed by the end of fiscal year 2019-2020 and the intent is to have it available for use in early 2020.

Recommendation 4

It is recommended to the Assistant Chief Statistician, Analytical Studies, Methodology and Statistical Infrastructure to ensure that the data quality evaluation questionnaire is updated and that agency employees are aware of the requirement to assess data for quality and statistical usability prior to acquiring data from alternative sources.

Management response

Management agrees with the recommendation.

  • 4.1 Employees will be informed regarding their roles and responsibilities associated with the quality assessment of data from alternative sources. Accountability regarding the documentation and registration of the quality assessment process will be embedded in the updated data governance process for the acquisition of data from alternative sources.

Deliverables and timeline

The Director of the Data Stewardship Division, Director of the Office of the Chief Editor and the Director of International cooperation and Methodology Innovation Centre will:

  • Develop a communication plan by May 2020 to inform managers regarding:
    • specific requirements associated with the quality assessment of data sources;
    • the quality assessment tools available; and,
    • the corporate tools available to register the quality assessment evaluation document.
  • Communicate activities defined in the communication plan by March 2021.

Appendices

Appendix A: Audit criteria

Audit criteria
Control objectives / Core controls / Criteria Sub-criteria Policy instruments/Sources

Audit objective: Provide reasonable assurance to the Chief Statistician and the Departmental Audit Committee that management has adequate processes and controls in place to support the strategic, transparent and timely acquisition of data from alternative sources while ensuring the sound stewardship of public assets and agency interests.

  • 1. An effective governance framework is in place over the acquisition of data from alternative sources to support agency objectives.
  • 1.1 Oversight bodies are in place and have clearly communicated mandates that include roles with respect to risk management and control.
  • 1.2 Management requests and receives sufficient, complete, timely and accurate information from oversight bodies to inform risk-based decision making in relation to acquiring data from alternative sources.
  • 1.3 Roles, responsibilities and accountabilities, as defined in key policy instruments, are clearly understood.
  • Audit Criteria related to Management Accountability Framework (MAF): A tool for Internal Auditors
  • Statistics Canada's Quality Assurance Framework
  • 2. Employees are provided with the necessary processes, tools and training to support the acquisition of data from alternative sources.
  • 2.1 A comprehensive training plan is in place to support agency officials related to their work in negotiating data acquisition agreements.
  • 2.2 The training plan is being provided to employees across the agency.
  • 2.3 The training plan incorporates feedback and lessons learned from agency officials, in order to address specific challenges/barriers in negotiating data acquisition agreements.
  • 2.4 Employees have access to and are aware of sufficient processes and tools such as software, equipment and standard operating procedures to support their work in negotiating data acquisition agreements.
  • 3. Processes and controls are in place and working effectively to ensure that the agency's interests are protected when acquiring data from alternative sources.
  • 3.1 Data from alternative sources acquisitions are formally documented.
  • 3.2 There is appropriate legal oversight of data acquisitions to ensure adequate protection to the agency.
  • 3.3 There is appropriate financial oversight of data acquisitions to ensure adequate protection to the agency.
  • 3.4 The quality of administrative/ data from alternative sources is assessed prior to its acquisition.

Appendix B: Initialisms

CS
Chief Statistician
CSSD
Corporate Support Services Division
DAC
Data Acquisition Committee
DSD
Data Stewardship Division
SCDS
Statistics Canada Data Strategy
OPMIC
Office of Privacy Management and Information Coordination

Canada 4.0: The Digital Transformation and its Impact on our Society and Economy

Catalogue number: Catalogue number: 11-629-x

Issue number: 2019003

Release date: February 10, 2020

Canada 4.0: The Digital Transformation and its Impact on our Society and Economy - Transcript

André Laronger: Et nous espérons profiter de la révolution numérique pour crée des opportunités à la faire d'avantage. Au jourd'hui, nous avons la chance d'avoir parmis nous le statisicien chief du Canada, Anil Arora, qui animera la discussion (inaudible) Mister Arora has over twenty years experience…

Anil Arora: Thank you very much André…eh. Um. Welcome everybody. Uberiz-uberization, uh, another word. Cloud computing, artificial intelligence, autonomous vehicles, digitalization is having a profound impact on Canadian society and the economy. While driving, our data is driving society, the economy and soon to be your car, there has been very little data that's been produced that informs Canadians about how everything digital is having an impact on their spending, their incomes, the prices they face, uh, their security, health, and overall well-being. Important data needs and data gaps are emerging. National statistical organizations like ours here at Statistics Canada are being pushed to go beyond our comfort zones and traditional roles to better measure social and economic issues and their inter-relationships in order to better define, describe and quantify these transformational changes. Through the Canada 4.0 initiative, Statistics Canada is helping Canadians to better placed through data and insights to understand the impact of digitalization. The init-initiative in partnership with Innovation, Science and Economic Development Canada is intended to gather the views of Canadians, our businesses, governments and international experts on their emerging data needs in this era of increased digitalization. Given we are measuring digitalization, it seems only fitting that we lead in a series of digitally-delivered expert panel discussions to be held over the next six months. Each panel discussion will explore a different digital topic, such as cybersecurity, the gig employment, and the value of data itself. The panel discussions will be streamed live as well as recorded and posted on Statistics Canada's website. Each panel discussion will last approximately one hour. The first session today would be to compare a typical morning commute to work ten years ago with that of a typical commuter going to work today. Ten years ago you may have taken the bus and paid using paper bus tickets, you would have probably pulled out a newspaper out of your briefcase and caught up on the latest news. You may have stopped for a coffee, paying cash, and then quickly called your daughter and reminded her to print off her latest book report so it would be submitted on time. Well, not that long after, ten years, today, you get on the bus using an Epass that debits your account immediately and in fact tracks your travel habits. You read multiple newspapers through an app on the bus along with your favourite social media feeds, with each click of course being recorded. You buy a coffee by tapping your debit card or holding your iPhone on a reader, sending digital signals to a myriad of actors. And you text your kids, you don't phone them, you text them now, and remind them to submit their book report via the school's electronic blackboard before today's deadline, and of course, you e-transfer them money to pay for the upcoming hockey camp. The world we live in is changing rapidly and with it, we are changing how we measure it, the way we measure it, and what we measure. This is what Canada 4.0 initiative is all about. It is about developing an information roadmap to help Canadians have the information they need to better understand this fast changing world. Today's discussion, in many ways, sets the stage for our future panel discussions as well. This session will touch on the broad changes that we're experiencing as a society and an economy. Our distinguished panelists today will discuss key cha-changes they're observing, and share with us their perspectives on what is coming on the digital horizon. This session will be followed by monthly sessions, where we explore key issues such as cybersecurity and gig employment in further detail. So, let's start by introducing our panelists. Mister Eric Santor. Mister Eric Santor was appointed advisor to the governor of Bank of Canada on digitalization in March of this year, 2019. In this new role he leads the Bank's digitalization work, including research into the impact of digitalization on the economy and our financial systems. Mister Santor leads the initiative to incorporate technologies such as artificial intelligence and machine learning, as well as big data into the bank's operations. This involves leveraging programs such as partnerships in innovation and technology, or PIVT, and the bank's relationship with the creative, sorry the creative destruction lab. Mister Santor joined the bank in 2001 as an economist in the former monteray and financial, sorry monetary and financial analysis department. He moved to the international economic analysis department in 2003 where he assumed increasing responsibilities until becoming managing director in 2013. Before his appointment as advisor to the governor on digitalization, Mister Santor served as managing director of the bank's Canadian economic analysis department. Our next panelist is Sarah Lubik.

Sarah Lubik is executive director at the Chang Institute for Entrepreneurship at Simon Fraser University, responsible for aligning, supporting, and accelerating entrepreneurship, education and early stage incubation at SFU. She's also a certified expert business coach and a mentor at SFU's Venture Connection incubator. In 2016, Doctor Lubik was named one of ten Canadian innovation leaders assisting with the government of Canada's inclusive innovation agenda. Prior to joining the Beedie School of Business, Doctor Lubik worked in the centre for strategy and performance at the Institute for Manufacturing at the University of Cambridge. She has also worked as a business coach, specializing in market analysis and project manager and coordinator on a number of international European projects supporting start-up firms through incubation, finance and policy. She's also actively involved in entrepreneurship as a co-founder and marketing director of Lungfish Dive Systems. Doctor Lubik holds a B.B.A. honours from SFU, concentrating in international business and marketing as well as a Masters and PhD from the University of Cambridge, where she was also a NanoForum Fellow. In 2014 Doctor Lubik was named one of Business in Vancouver's Top 40 under 40. In 2016 she was awarded the TD Canada Trust distinguished teaching award. Next is Erich Strassner. Erich Strassner is Associate Director for National Economic Accounts at the Bureau of Economic Analysis in the United States. Mister Strassner oversees the calculation of official economic statistics that track the performance of the US economy. These include BEA's flagship economic measure, Gross Domestic Product, as well as its major components such as consumer spending and business investment. Mister Strassner has led several new innovative data projects, he shaped the creation of statistics measuring the fast-changing cultural economy and capturing the effects of outdoor recreational activities on the country's economic performance. And Mister Strassner is leading efforts to explore economic measures beyond GDP to better gauge Americans' wellbeing. He has received a number of awards for leadership and management including the US department of commerce gold and silver medals, the department's highest honours, and the Arthur S. Fleming award for outstanding public service. Mr. Strassner holds a MBA from the McDonough School of Business at Georgetown University and a MA in economics from the George Washington University. And next we have Daniel Ker of the OECD. He is co-author of Measuring the Digital Transformation: A Roadmap for the Future, which the OECD launched along with an accompanying online toolkit at its Going Digital summit in March of this year, 2019. Together, these enable a holistic assessment of the digital transformation across the OECD and BRICs countries as well as identifying areas for future and further development in setting out a roadmap for addressing measurements. Prior to this, Daniel led the team responsible for the R and D statistics and survey framework at the OECD. Having previously been responsible for work to capitalize R and D in the UK National Accounts. And prior to that Daniel was co-deputy director of public sector statistics at the UK office for National Statistics. The views of the panelists reflect their own personal views and not necessarily the views of the organizations that they represent here today. So please join me in welcoming these panelists today. Applause. Mister Santor, let's start with you.

Eric Santor: Okay.

Anil Arora: Digitalization is pervasive, touching almost every aspect of society and our economy today. What do you see as the most significant impacts on society and the economy?

Eric Santor: Well, the uh, thank you Anil, thank you for the opportunity to be here. It's really fantastic to discuss these issues. I mean, digitalization's everywhere, as someone sagely said the digital economy is the economy and so it's affecting all aspects of how we look at the economy and what's happening in all the activity that's going on. When you, when you break it down, you think well, well from the household's side what we consume and how we consume it, is rapidly changing. There's digital services, uh ten years ago that just didn't exist, we can buy almost anything online 24/7 from anywhere around the world and you know, if your household's anything like mine there's a package arriving you know, a couple of times a week or more uh from something we've bought online. Umm, and there's also a lot of the goods we buy now have a lot of services embedded in them. Just think about the car, your car you have and all the software that's now ru-running inside of it, relative to ten years ago. More profoundly, it's also affecting how businesses operate and one of the great insights that's been made recently is that one of the key technologies driving the change in the economy, the digital transformation, is the use of artificial intelligence, machine learning, and big data. And uh, Ajay Agrawal at the University of Toronto's…and his co-authors Joshua Gans and uh, Avi Goldfarb really summarize it nicely, saying these technologies essentially reduce the cost of prediction. What that means is you can take any decision you're going to make and make it better by using IA, AI, ML and big data. And also you can take decisions or things that were not prediction problems and make them prediction problems. What that means is that firms can now think better, make better decisions about what they're going to produce for the customers, how they're going to produce for the customers and what prices they're going to charge for the customers in a much more effective way than they did before, a much more efficient way. So this is dramatically changing how they operate, disrupting industries, letting competitors move into other industries they weren't currently in and so we see this, you know, going through the economy. And what's really nice is recently Stats Can actually did a measure of the digital sector and found just how big it was. I mean, it's really impressive, it was bigger than mining, oil and gas extraction and quarrying combined and so that's really, makes, uh that's a big deal. The last big impact is of course on the labour market, we'll go-go into that later, simply digitalization's affecting how we work, where we work, and most importantly, what skills are we going to need, and what skills are our children going to need to operate in a digital economy. Needless to say, for the Bank of Canada, this matters a lot because we have to figure out, you know, what's going on in demand, how much supply there is in the economy, how much potential output, what this means for inflation of course, has big implications for the conduct of monetary policy in the coming years. Thanks.

Anil Arora: Thank you very much Eric. Um, Miss Lubik, um, you've got a unique perspective as both an academic as well as an entrepreneur in your own right. Um, what do you see as uh, the most significant changes that are being brought about by digitalization?

Sarah Lubik: This is a multifaceted question that I keep changing my mind on it. But at the moment I say it's, the amount of fear and uncertainty you hear when speaking to Canadians about the digital future and how many people are fearful of being replaced, of transferring to a gig-gig economy or those types of roles and a lack of trust in media and a lack of trust in what our data is being used for that needs to be addressed as we go forward. Uh, there's also challenge that we see in Canada around the adoption of innovation, so when you look at reports that Deloitte puts out we're seeing more and more of a need to adopt new innovations to keep up but not necessarily seeing the average company in Canada to be able to do that or being willing to do that or knowing what support is out there to do it. And finally, picking up on Mister Santor's point, that digital skills mean a lot more than coding, they mean a lot to do with digital literacy and about being comfortable with the changes that tech is going to have on our world.

Anil Arora: Well thank you, thank you very much. Let's move to Mister Strassner. Many of the digital innovations that we interact with everyday uh, in fact originate from the United States, just south of here. From your perspective, what do you see as the most significant impact of all these digital ideas?

Erich Strassner: Well let me begin by saying thanks very much for the invitation to participate in this panel to discuss these important issues. So when I reflect on your question Anil, what I really think about first and foremost is that digitalization is making the world a smaller place by connecting businesses and households all over the globe on a scale that quite frankly hasn't been possible even in the recent past. And it may sound like a cliché to answer this way, but the launch of the iPhone was quite, quite significant because it put a computer in many people's pockets, providing at one's fingertips access to traditional news outlets, social media, productivity apps, a camera of course. And in your introduction, Anil, you spoke about many of the ways in which uh, we transact today and and, perhaps most importantly when we think about the iPhone, it created the ability for new businesses to emerge and to disrupt traditional industries, really facilitating the creation of the so-called gig, or sharing economy and wh-when we think about, uh, this from the perspective of measurement as economists and statisticians who work on the national accounts, who work on the GDP accounts, this digital disruption really chall-challenges our traditional measurement approaches. It challenges it in terms of our data collections, which are generally not well-positioned to capture these changes. Uh, it really challenges the calculus for domestic requests, border transactions that used to be uh, more easily measurable with observable movements of goods and provisions of services that could be collected more easily in surveys or administrative data, so for example the emergence of free products, uh, often created through unobserved transactions. These free products that are often supported by advertising, marketing, or data arrangements, they're, they're hard to tackle within our traditional sources, so this poses some serious challenges to us within the measurement community.

Anil Arora: Thank you very much Erich. Um, let's move to Daniel, um, Mister Ker, you've done some real thinking about this, um, and you've looked at it in, in the OECD context, what do you see as some of the more significant impacts of digitalization?

Daniel Ker: Um, yes, hello and may I start as well by um saying it's a pleasure to be invited to spend this well, evening it is over here, with you, um, discussing the digital transformation. Um, clearly there are a great many impacts from the digital transformation which we, uh, which we are all intimately familiar, frankly, within our personal lives and our work lives. And if we're not uh, completely familiar with them, perhaps our publication, if I may same-shamelessly plug it to you, um, might help. Um, but, but I want to, a bit like several of the others, focus a bit more on the world of work, it's, it's interesting that when we look at contributions to the increases in, in employment seen in most OECD countries over the last ten years, that it's the highly digitally- intensive sectors that have tended to contribute especially strongly, with about four in ten of the, of the new jobs created coming from those sectors. Um, the, perhaps … I should mention that it's more like one in four in Canada. Um, that, that strong contribution comes from a lot of things, but it at least seems to be arising from impacts (inaudible) and we see sectors that are more digitally intensive um, um, more dynamic and faster growing. Um, we also see certain new kinds of forms, so online platforms really opening up markets and creating new markets. Um, that can act as an important enabler for business, particularly small businesses. But, but I just want to focus briefly back on those jobs, they're not necessarily like the jobs that came before, um, at the (inaudible) I'm sure we will talk about it more later uh, we see quite a number of people doing precarious work, you know, driving for Uber, delievering for Deliveroo and, and deb-debate about whether that's good or bad, will doubtless come up later. But actually we see jobs across the economy becoming more ICT task intensive. So that's intensive in tasks ranging from use of email to programming and maintaining ICT systems, and in fact if we look at it, for every person working in an ICT specialist position, so that's an occupation that is very focused on ICT, there's another three workers in occupations that are ICT task intensive. Um, so not specialists, but still very um, involved in ICT tasks. All this change is really uh, impacting, impacting the world of work, it's the workplace, it's putting emphasis on skills and training, um, and I think that Eric said that he will talk about this a bit more later, but one thing we see over on this side of the Atlantic is that ten percent of EU-28 workers feel that they need more ICT training to cope with the advance of their jobs. But interestingly, at the same time more than 20 percent of workers feel that they have ICT skills that are under-utilized. So those are sort of distributional or efficiency aspects here that we need to try and get, get uh, get to grips with. Um, one last thing I just want to quickly, I quickly highlight is that people perceive that digital technologies are really driving, sort of, material-like, ground level impacts in their work environments. With people on balance, generally feeling that independence in organizing tasks and use of collaboration have increased. Um, but still use technology to monitor performance and to uh, technology is better used as a driver of increased, uh, in regular working hours, um, so maybe that's not too good. At that same time, technology we should say is allowing people to change where they work with uh, with uh, about four in ten people, one third of people now teleworking from home once a week in Europe. Um, so perhaps I should conclude by saying that the world of work is, is, is one area that is, or one nexus of key impact in our, in our lives and, and our phones. But we still, but we still need more detailed statistics and analysis to actually kind of understand the nuance about what this means in terms of the links to well-being of productivity.

Anil Arora: Thank you very much. So, as you can see, um, what we're hearing is that the changes are real and that they're profound. And what we're talking about are data, technology, and ideas coalescing to actually change the way in which we work, the way in which we interact, uh, the mechanisms, and they're having a very disruptive effect, um, in the sense that it's creative destruction in some sense. Um, and while on the one hand we're seeing an explosion, on the other hand we're also uh, living in this paradox where there isn't enough information or insights about what these changes look like and so that is fuelling greater demand, uh, for statistics and a role for national statistical offices. So let me just push ahead a little bit, um, and maybe I could start with you, uh, Sarah, where do you see things on the horizon? I mean, where we should we be? I mean obviously we have to deal with the issues of today and we have to integrate uh, better insights and data into what we produce today, but if we want to get ahead as statisticians and, and being able to measure these phenomena, what do you see is the next thing on the horizon that we need to take into account?

Sarah Lubik: This is an important question, I think one of the most important things to think about for the future, because we already have talked about skills, is realizing that we're tracking very specific skills. So we're tracking the STEM skills gap often but we're not looking at changes in attitude, we're not looking at changes in mindset, which are things you can track, and changes in uh, how people are feeling about the future. So, there is a huge opportunity to be looking past those easier or more obvious metrics. So for example, we hear a lot about coding should be the third language of Canada and this is how many jobs are going to require those kind of skills and that's both catchy and potentially shortsighted cos a lot of digital skills are great for now but those are likely to be automated over time. So we need to separate between being comfortable with digital skills and thinking there are specific skills that won't date. Because if you look at the kind of skills that are going to be skills, attitudes, that are going to be important in the future, you still look at things like compassion, non-linear thinking, interdisciplinary problem solving, so looking at the kind of programs that address those and seeing how we do among those, it's going to be important. Because we have to realize that getting ahead in the digital world doesn't just mean leading in tech, it means leading in what we do with that tech. So in a recent event held at SFU on how to scale a hundred million dollar companies in Canada with people who had done it, you rarely heard well I needed more people with tech skills, of course we need that, but we also heard you also need people who know how to solve global problems and who know how to understand our customers and users better than anyone else. And so making sure that we're looking not just at digital skills and all of the numbers that go along with that, but all of the complementary things that will make us good at being competitive and problem-solvers in the future.

Anil Arora: And what advice would you have for national statistical offices to be able to measure as you said, uh, not just what are hard skills, but some of the more softer uh, uh, attributes, what kind of research are you doing, or what kind of models have you looked at that would help us as national statistical offices in getting a better handle on what those needs are and what those gaps are going forward?

Sarah Lubik: So, looking at things like the, the business skills that go along with those tech skills, so we looked at how many jobs need to be filled with tech skills, right? There's also how many of those comparable jobs need to be filled with say, marketing and sales? Because we have a little bit of that when you talk to people say, in Silicon Valley, they're saying that it's much easier to find people with that skillset there than when they move back to Canada. One of the other ones if we're talking more along the lines of education, attitude, for innovation and for the digital world, there's a number of studies that look at things like mindset and looking at how prepared people feel for the future.

Anil Arora: Thank you for that. Uh, let me turn to Erich Strassner. We've got two Eric's so I've got to kind of use both names here. Um, how is the Bureau of Economic Analysis in the United States positioning itself to get ahead of this curve? So what are the kinds of things that you're being pushed to uh, try and fill uh, some of these data gaps and how are you going about uh, to, uh, better uh, address if you like, this digitalization, uh, that you're seeing in the United States?

Erich Strassner: Well at the BEA and throughout the US statistical system, we are pursuing non-traditional data sources like never before. We're pursuing new public-private partnerships for things like private sector credit card transaction data, uh, making use of other uh, administrative data sets in new ways, and alternative big data sets to see whether or not by blending non-traditional data sets with traditional sourced data that's available to statistical agencies, that we can tackle some of these real measurement challenges that we face due to digitalization. We're also looking at making use of current data collections like that on our surveys of multi-national enterprises to determine whether we can better leverage that data to understand the size and scope of these MNEs. A lot of these MNEs who operate in this digital space, we're looking to see if we can understand uh, how these MNEs play a role in the US economy and also to better understand uh, global intellectual property flows that are resulting from uh, these MNEs. We've also within the BEA and other stats agencies in the US, we've begun to employ a lot more data science techniques like machine learning to inform things like judgment on early estimates of major components of GDP. This is all an attempt to make sure that we're keeping pace with this ever-evolving economy, keeping pace to keep these statistics accurate. One of our key overall projects has been to establish a multidimensional framework on the digital economy, this is in the form of satellite account, this is really a way to address the need of users to get more granular data on the digital economy. A spotlight on that to understand its overall size, its trends over times, its impacts on production, on consumption, on labour markets. The beauty of course, of a satellite account, or an economic account that's not the core account is that it allows us to quickly publish estimates, to rapidly respond to user interests whether or not we call them, for example, experimental or prototype estimates as a starting point. Also with a satellite account framework, it's a laboratory for further experimentation, so we can look at some of these thorny issues like quality adjustment of high-tech prices for goods and services, depreciation profiles for high-tech goods and services, thinking about the world of these so-called free goods and services that are supported by marketing or advertising and data and thinking about alternative ways to measure uh, to measure the accounts. And also uh, with partnering with Stats Canada, we're thinking about the role of data, digital data and the fact that in 2019 that role of digital data is profoundly different than say ten years ago, so we need to think about whether or not it's time to uh, look at our measurement frameworks and reconsider that role of data overall.

Anil Arora: Perhaps I can push a couple of the thoughts that you've put on the table. The first one is uh, you talked about uh, looking and going deeper into alternative uh, sources of administrative data and even data that's uh, held by the private sector. Well clearly uh, uh, social acceptability of using what are sensitive data, uh, has to be earned, how are you going about having that conversation uh, with Americans about the use of that uh, uh, that information? I mean we as national statistical offices uh, have worked hard to build trust and what are you doing uh, to continue to uh, to build that trust and secondly um, what are you doing when uh, you talk about experimental or prototype types of estimates? How are you ensuring that people understand, if you like, some of the strengths and also the limitations of uh, some of these types, uh, new types, if you like, of analyses that we're putting out?

Erich Strassner: Yeah, thanks for these questions, they're important questions for us to be considering along the way, and I think that one way to respond uh, to both questions is, is to be transparent about what we're doing. I think that's the best way we can move forward within uh, this framework, to be transparent in working with our data vendors, to identify sources of data, uh, that we can make use within our accounts, to be very cognizant of, of privacy and, and with all of the work we do at BEA, we protect uh, data confidentially, we we we don't disclose microdata, we don't disclose characteristics of anything, of any individuals or businesses, there's very strong laws in the United States that support these efforts so we try to be transparent as best we can in how we make use of these alternative datasets, these non-traditional datasets. And that, that goes also, this transparency response around uh, what these experiments are and are not and so we try to be very clear as we produce new estimates or alternative estimates, we, we try to do this in a way that's replicable, that's clear, that is explainable, we do a lot around trying to communicate uh, what we're doing through various channels and and uh, and and and then respond if we need to do better.

Anil Arora: Thank you very much. Daniel, perhaps I can turn to you, the OECD's been known to uh, shine its crystal ball uh, and look forward uh, and you're always uh, making sure that that radar uh, is, is functioning properly. What do you see on the horizon uh, from your work with OECD countries and some of the uh, some of the uh, the deeper research that you've been doing?

Daniel Ker: So I'm pleased to say we're in the process of developing a new crystal ball in the form of a technology (inaudible) that we're in the process of establishing that aims to spot and monitor, you know the big trends that are emerging in technology specifically but in digitaliz-digitalization more generally. Um, at the moment, in this bi-annum, we have a very strong focus on AI and on block chain. On the AI side, which is, is, the area that is led within my directorate, the directorate for science, technology and innovation. Um, much of the focus is on trying to reach international understanding on, on what AI is, sort of in a definitional sense, um, but also on its practical and ethical implications and on recommendations for policy around its use. Um, but we're also trying to work out how we track and monitor both its development and supply um, as well as its, as its, as well as its adoption and diffusion, uh, primarily in firms but also in terms of individuals who are often the end users of, of some forms of AI technology. Um, you know the the, the talking speaker in your house is the one example. Um, the, the idea is that technology foresight forum will continue to develop and look at other technologies as they emerge, looking further into the future I'm really hoping we're going to do something looking at um, new forms of manufacturing, in particular, 3D printing and technologies like that. Because this kind of technology really has the power, potential uh, to disrupt both how and where production takes place. So um, at the moment if I want a coat hook for my house say, I go to the DIY store and I buy one off the shelf or I go to Amazon and I, or you know, another online retailer and uh, choose a product from there and then I wait a few days and it arrives. In the future, I may well be able to go online, find uh a piece of IP that gives me a blueprint for a coat hook that I really like, like better than anything I could find in any of those shops, and I could print it directly in my home or have it printed at a local mater, maker station. So this is really going to change the way production looks and uh, that would further blur the boundaries between businesses and households in our statistical frameworks. So that will, that will create um, or accentuate some of the challenges that we're already encountering. Um, just there also other things that have been quite, around quite a while, uh, but we still need to get grip on measuring and understanding, so online platforms and Cloud services are an example of this and we were very pleased to, with the support of the government of Canada host a workshop last year that provided a step in working out how we look at these um, phenomena, um, work out what we want to know about them, uh, etcetera. Now one clear message that came out of that was firstly everyone agrees that these are important things that we need to look at and understand but also that some of the necessary foundations for statistics aren't really there or, in the way that we might like. So as an example, the OECD has recently developed a definition of online platforms but we need to develop taxonomies and classifications that will help us um, look at grouping different types of platforms based on meaningful characteristics to get uh, to produce statistics that can help us understand what is going on in the platform space and how they're affecting our business sectors and our economies.

Anil Arora: Thank you for that, Daniel. Just a couple of follow up questions. Firstly, uh, you know, uh as you talk about you know the kinds of models and how uh, AI is continuing to shape and will, will accelerate in a sense some of the changes that we're seeing, how can statistical offices get better embedded or should they and to what degree and how, uh, into data strategies and data flows? And secondly, where do you see, you know you talked about that sort of device that you can speak to that is making its way into more and more homes, I know in our home it's a, it's it's an integral part of what we do now. Um, what is that doing also in terms of a pull function, or increasing the demand for data and information, and again, what role do you think NSOs can play uh, national statistical offices, can play uh, so both from a pull and uh, a push? I would love to get your perspective on that.

Daniel Ker: Oh-okay, so to take the, take the question connected to speakers first, so you uh, if I understood correctly you're asking about what that's doing to um, data flows and uh, the information that's being generated.

Anil Arora: Well it's essentially uh, creating this demand for instantaneous information from a credible source. Um, so it's no longer just you know, statistical offices are, are really good at putting tables up and, and you know, the odd sort of pie graph, pie chart, um, what is this going to do uh, in uh uh, a world where there are uh, an increasing number of producers of data and the demands for instantaneous information and that's what the next generation, I think, is what you're saying, is becoming used to. So that's pulling in a sense uh, the traditional role of the national statistical offices.

Daniel Ker: So to some extent it's a continuation of what we saw with the development of twenty four hour news right, it's that, that people are gradually wanting everything, information faster and faster and faster and constantly. So for, for stats offices, of course that creates the issues that um, that we need to find ways of producing information uh, and sate that demand as quickly as possible. Um, one interesting point with uh, the, the home speaker type technologies, the intelligent speaker technologies is of course that you mentioned that people want uh, information from a trusted source and that's one way that they're getting it. Now of course through those kind of speakers you don't necessarily get the answer from a trusted source, you get the answer from whichever source Google or Amazon has decided is the most relevant to the question you've asked. And the way they decide that may be related to money that they've received. Um, so maybe there's a question about whether stats offices find a way of playing the game, maybe they pay the money to be the uh, to be the first answer to certain questions, or um, accept that certain questions that get asked, instead of an answer coming from our tables that may be great and robust, but not maybe penetrable enough, or machine readable enough to really uh, come out through those channels. Um, that that, other actors will, will fill that space, um.

Anil Arora: Thank you for that. Um, turning to you uh, Eric, um, Eric Santor. Um, you're an advisor to the governor, uh, Stephen Poloz, um, and what exactly are you advising him on uh, in this verge of you know, digital disruption, and in fact what do you, what, what advice do you give him in terms of the changing role of the bank itself?

Eric Santor: In terms of uh, the role of the bank, I mean, for us to, I know, conduct mone-, conduct our policies for the economic potential of all Canadians, we need to understand what's happening out there, both in terms of, as I mentioned before, it's (inaudible) the real economy but also understanding what's, what are the changes going on in the financial system and so again we see that you know, the use of AI, machine learning, big data, and is affecting the financial system in a number of ways that's changing rapidly. So to pick out three off the top of my head, there'd be you know, Fintech firms, they're innovating, they're looking to see, to seize parts of the value chain of any particular financial product or service and so that's going to put change into it that you know, will make the financial system evolve. Uh, there's robo-advisors, there's AI's selecting portfolios, and so this is all running there, and algorithmic trading's been around for a while, so that's going to be affecting financial markets. Uh, in the insurance spaces, it really lends itself well to uh, machine learning and big data where, you know, if you think about the cost of prediction going down, people (inaudible) insure tech is going to expand the zone of insurability, because they're going to be able to better target products and calculate risk and deliver those services to uh, an ever-widening range of things that can be insured. So that's going to cause some financial market development. And the last one, of course, is payments. You know, there's been an explosion of peer-to-peer, peer-to-peer lending, peer-to-peer payments, and you know, today, this morning, there was an announcement by a major player about their own currency, crypto-currency that they're thinking about and crypto assets. We need to be understanding all of what's going on in order to make sure that we're able to conduct our policy uh, effectively in this space.

Anil Arora: And how are you doing that role so far?

Eric Santor: So, heh, it's uh, it's um, I'm drinking from the fire hose, uh but no, it's, what we're doing, you know, is uh, we have an idea that we're going to be digital first in every aspect of our business and the simple idea here is we're going to be bringing on board these new technologies: machine learning, big data, AI, to best inform our analysis to help us make our decisions to inform it. Both to think about the data that's coming in, to understand it, but also at a very fundamental level, by using these tools we hope to better understand how the economy's operating in this new digital world.

Anil Arora: I guess, you know, how can we be helpful as a statistical agency as you, as you provide this type of advice?

Eric Santor: So the best thing that you can do is provide us the data that, the inputs, the feed stock into what we use to do our analysis. And uh, you know, in that sense, you've been very transparent about identifying where you think some of the big gaps are right now. So you know, some of those gaps are turns in investment, you know, you used to investment, used to be in plant and equipment, now it's really in IT and tangible investments, it's investment in data, it's investment in software as a service, to how we are handling that in the national accounts to get the better sense of investment decisions that firms are making. Trade in digital services, if you think of all the services that are being provided now, digitally, often in micro-transaction space, we need to better measure that. And it's easy to measure things you put on your foot, harder to measure uh, digital services. Prices of course, you know, with a lot of prices being online now, we need to make sure that as, adequately capture that, that you know, that's another gap that you've identified. Um, and the last one is of course is household to household production. You know, when the national accounts were set up, didn't really, it didn't really anticipate just how much households could directly link to other households not just inside Canada but across borders in the production of goods and services that are going to be transacted between them. And of course wrapping all this we have to understand how the labour market's going to evolve and very good measures of the, cos people are going to be disrupted by this, and people are going to benefit from this, so we need the better, the best measurement of how that's evolving in order to make sure that as a society we provide the proper support, social safety net, training, and other support to help people transition uh, themselves through this very interesting time.

Anil Arora: Well thank you very much, I see, and we feel those demands, just you know, up front, and and uh, I think that is uh, leading to a lot of the modernization efforts not only at Statistics Canada but I think similarly in many other uh, international agencies as well. But look, it would be an opportunity, you know, to capture here, I've got sort of four really broad thinkers, um, not only on the economics but also on the entrepreneurial and also on the academic sphere, um, and we have to take advantage of… There's been a lot of talk about the digital economy and perhaps not as much on the digital society and the social implications and impacts of things like screen time and, and our reliance on you know, as, as was mentioned earlier, that computer, that we now just you know, is kind of connected to our body. What do you see as some of those broader changes?

Eric Santor: Uh, so, just from our, my personal experience, what we know is that no, I'm pretty digital myself but I think we don't fully appreciate how digital our children are and how digital our children are going to be and you know, the anecdote I often like to use is my twelve year old son's only phoned me twice at work. Both times to tell me Dad, the Internet's out, because the power's out. Okay, that's the order of importance for the generation that's coming after us. They care about being connected, and so we have to, and that's for better or for worse, and so we have to understand just how they're going to operate in that world. What that means in terms of the labour market, and this is where we have a lot of focus right now, is how is the gig economy going to evolve in that space. And it's good to put this in context uh, in the gig, I mean we did a, we don't have good measures of the gig economy, uh, specifically, and so we do a survey at the bank of consumer expectations and we put a paper out earlier in the year called How Big is the Gig to try and measure that. Uh, and we found that you know, there is a significant portion of people who are in gig type jobs, you know, part-time, who would prefer to be in full-time jobs. And so the question is to what extent will digitalization affect that you know, that mix, that part of the labour market. The thing to keep in context though, and I think it was mentioned earlier by Daniel is well, on the one hand we have people being disrupted and we need to support them and on the other hand there's a lot of job growth in the digital sector. And so by your own estimate of the digital sector you know, the job growth in the digital sector in Canada since 2010 was forty percent, well just shy of forty percent. The rest of the economy is running about eight or nine percent job growth and what's important to remember is that people in those jobs earning incomes, they're going to buy all the stuff in the rest of the economy that we buy, like homes and cars, they go to restaurants, and buy services. And so what we need to keep in mind is when there's big transformations like this, over history, you know, this is 4.0, it means there's been 1.0 and 2.0 and 3.0, we found that overall it's been a net benefit. There's been net increase in jobs because of the effect that the people doing the new technology are creating demand in the rest of the economy. We just need to make sure that people who are being disrupted are being appropriately supported, uh, in that process. So when I think about, you know, the, we're living in this digital age, we need to make sure that people are ready to live in it and to work in it as best we can.

Anil Arora: Thank you for that, um, maybe I'll turn to you Daniel. I mean… The question to you was to build on what Eric just said, which is on the one hand, there's a need to nurture and grow uh, you know these opportunities for new jobs and, and new models and business models and societal models, um, and on the other side there's a real need to preserve and to protect uh, uh, those that are going to be disrupted. So what kind of research is the OECD doing? What kind of projects do you have underway on some of these broader societal issues and trends?

Daniel Ker: So this is one area where we still very much need to try and find out where the balance lies, um, you know, uh, one example of the work we have in this area, um, is the (inaudible) in the OECD produced a publication called house life in the digital transformation, um, which gathers all the metrics they could find, or indicators they could find related to how the digital transformation is affecting people's wellbeing. Um, and this sort of, the story there is that it's not clear what, what direction things are going in, you know, there are many things that could be good, um, in terms of uh, things like social networks allowing people to be more connected to each other, to um, keep contact with each other, um, but there are many things that could be bad such as technology inclu, intruding into the um, well bringing work into the homeplace, like I mentioned earlier, so that people are always connected and uh, ending up depressed and miserable as a result. Um, one of the real things, messages that comes out of that for us as statisticians is that there's a real need to try and develop more detailed, again more detailed, um, indicators, more nuanced indicators around that. And one path forward on that could be to include questions that probe at wellbeing on ICTU surveys so we can try and start to get a look at, on the same vehicle, um, the links between use of different types of technology and uh, some sort of high-level metrics on wellbeing. Another area I think is worth highlighting is trust, I mean it's quite clear that digital technologies, but especially social networks and e-commerce are making it really difficult for people to know who or what organizations or what information they can trust online. So the OECD is working with national statistics offices and other organizations to try and work out how we can develop metrics around this and we have some. There's a whole chapter in the publication on trust, but um, you, if you look you'll see the indicators are quite sort of around the edges, we still haven't quite managed to find the unicorn and measure it yet. Um, and that's because trust is really hard to define, let alone measure it, it's contextual, it's interpreted differently by different peoples, so there's still a lot, a lot of focus on that. Now just one final broader impact that I want to bring up, because I think it's, it's actually quite often overlooked and quite poorly understood, is the impact of digital technology on the environment. You know, we have anecdotal evidence that bitcoin mining is using more power than some countries, um, but when it came to trying to find indicators for our publication, the best we could do really, um, was to use some estimates on e-waste generated to get one angle on environmental impacts related to digital technology. By the way, they showed that Canada, uh, in 2016 produced twenty kilograms of e-waste per person. Um, which seems like quite a lot to me. Um, but I should say that by no way, by no means the worst, uh, Norway produced thirty kilograms per person in 2016. Uh, there are many questions about how we deal with that, and that's just one tiny element of the environmental impacts of digital transformation and our use of digital technology and our insatious appetite for these uh, these almost disposable devices that we have in our pockets these days. So we really need to understand the full picture of how this technology is impacting the, the environment around us.

Anil Arora: Thank you very much, uh, for that Daniel, um, as you say is nothing is free. Um, so Eric, if I could turn to you, Eric Santor, we've got about five minutes left in this session. What are you doing to make some of the invisible visible, especially in the areas of labour markets, uh, and jobs? Eric Santor, yeah.

Eric Santor: Uh well, in terms of uh, what we're doing at the bank is uh, so we have our own survey, so we have the consumer survey, the consumer survey of Canadian expectations. We're using that survey to ask questions about how people are working, what kind of job they have, how much of it's part-time, would they prefer to be full-time, how much is related to gig activity, strictly defined in a digital space and not, so we're using that, trying to use that survey to um, uh, uh, to capture that and we published some of that research online so we're doing that. Um, we're working with Stats Can, uh, to try and you know, improve our measures and understanding of what's happening in the labour market using microdata, um, but also you know, providing advice and support for looking at better measures of labour market activity. Um, and just more generally we're also trying to leverage big data and (inaudible) analysis and looking at other indicators of uh, uh, people's economic activity and behaviour, um, using big data and to do that we're introducing you know, new technologies into the bank in the space of machine learning and big data and AI. And building an infrastructure around that to use it, to use it you know, wisely and uh, useful.

Anil Arora: Thank you very much. Um, Sarah, perhaps I could turn to you. We've all talked about, you know, this uh, this concept of trust, we're seeing you know, greater demand for uh, the role of national statistical offices to better use data, even data exhaust, and yet at the same time we've got uh, real challenges in terms of public acceptability when it comes to privacy. What advice would you have for national statistical offices in achieving uh, that balance?

Sarah Lubik: You know, when you put it that way, I think one of the pieces where there's a huge opportunity is to align what we see as our current opportunities with the either policy frameworks, analytical frameworks etcetera, that we need to set up in order to make sure everyone feels like they understand what data is important, what data isn't important and that we know where we're going. Because so often we get very excited because we create so much data but at the same time there's a lot of data that's just not all that useful so we don't have to worry as much about it. So when we talk about building, building trust, I also think it's important to realize that the Canadian population isn't just one set of people, so how you build trust for say, entrepreneurs in genomics might have more to do with policy and making sure that their customers feel safe and that the things they can do with their data are uh, ethical and won't end up creating problems in the future. So one of the Canadian examples is the company that was doing uh, genomics testing, and then realized they had to make sure we had policy in place that said no one could use this data to then not, to be able to say you're customers now can't get insurance. So making sure that the policy implications of what we're creating, um, are actually setting up our entrepreneurs etcetera for success. And then to also realize that other, there are other populations, for example students, who need to know more things about, who we need to look at as generations. So for example even the millennial generation was very in love with social media and had no problem with putting their data online and just kind of figured that that is something people do. Where as we're seeing now, at least in a study done by the Vancouver Chamber of Commerce, showed that high school students are falling out of love with social media and that they're much, very much worried about social isolation and so they're concerned with what is the intersection of um, their data and digital use with mental health. So I think that it's looking at, making sure we look at the Canadian population as a number of different um, stakeholder groups.

Anil Arora: Thank you very much. So, in the few minutes that we've got remaining I'm going to turn to each of you to give us one piece of advice uh, in this digital world and increasingly digital world uh, to Statistics Canada and of course other national statistical offices who are participating virtually today. Um, so I'll turn to each of you, as I said, for one parting piece of advice. Perhaps I'll start with you Daniel.

Daniel Ker: Um, thank you, yes, so uh, never want to miss up an opportunity to shamelessly plug the publication we launched in March. I would encourage you to have a look at the measurement roadmap that's in there. It's got nine actions in it, um, four of which are overarching, um, and five of which are more specific about um, you know, looking at certain technologies or certain phenomena that we see out there. Uh, and really without having the time to go through that, just to say that I think that Canada and Statistics Canada in particular should continue to show leadership in this area alongside um, uh, Erich Strassner in the BEA and others. Um, you know, one of the actions in there is about making the digital economy visible in economic statistics, um, you know we need, we need leaders like you to be driving forward efforts around developing digital satellite accounts for example. Um, helping us with efforts to develop and promote the OECD framework for digital supply use tables, um, that we hope will uh, be something that's, the international community can congeal around. And also just want to highlight, there's another action about um, improving the measurement of data and data flows and we've heard several of the discussions today um, mention how important data, you know, they, first, a while ago they said that data is the new oil, apparently data's not the new oil anymore, it's not really the same. But we know it's important, and we want to work out how to theorize about data and its role and measure and capture its role properly and uh, Stats Canada last week shared a very exciting draft on how uh, on one approach to measuring the value of data, um, within the national accounts framework and I think it's really great to see that kind of leadership.

Anil Arora: Thank you very much Daniel, and uh, we look forward to our continued partnership, uh, in moving forward. Uh, next I'll turn to Erich Strassner, one piece of advice again, we're partnering on so many initiatives, one key takeaway from you.

Erich Strassner: Yeah, so, digitalization has joined topics like globalization and economic impacts, really as a catalyst to look for improving new measures of the economy, that take into account things like economic wellbeing and economic sustainability. And so really from our perspective, two of the major things on our agenda are to develop this digital economy satellite account that we've been speaking about today, to experiment around new measures, new methods that allow us to understand changes resulting from the digital economy. But stopping not there, stopping not at top-line impacts, say on GDP or personal income, understanding the distributions of income, distributions of wealth, distributions of consumption so that we have a better understanding going so-called beyond GDP. To know more about these economic wellbeing, economic sustainability impacts, and so these are really at the forefront of BEA and the US systems agenda and we think it ought to be that of most nations.

Anil Arora: Thank you very much Erich, uh, as many people may not know we have a long and deep partnership with the Bureau of Economic Analysis, uh, and we continue to work on many projects and I thank you Erich for joining us today. Next I'll turn to Sarah, Sarah, one piece of advice, one takeaway.

Sarah Lubik: Uh, I think that I'm going to build on what Erich was talking about, in that I think it's important to take a wide lense when it comes to the data you're gathering on skills and attitudes of the future. So the emphasis on STEM is not going away any time soon but changing it to things like steam, looking at mindset, looking at attitudes towards the future are going to be very important to make sure we have the, that we have the data that we need to make decisions on education, skills, and policy.

Anil Arora: Excellent, thank you, once again, uh, that expanded partnership and we've talked a lot about exhaust and steam today, so that's very good, so thank you very much Sarah for joining us today. Last but certainly not least, Eric uh, here, uh in, at our, uh, at our Statistics Canada offices.

Eric Santor: So um, a piece of advice, would be, from our own experience, when you think about how we can benefit from the technologies ourselves, to take a look at all the processes that we have and ask ourselves how can we use AI, ML, big data, to make better decisions. But when you're doing that and making those better, think about, cos the cost of prediction is lower, how you can make those better decisions really what it does, lowering the cost prediction means that the relative value of our judgment goes up. And so making sure that we put our judgment where we need to, and make sure that the leaders, the managers, know how to use that judgment, and I imagine a world one day where you ask a manager "what do you do?", "well I manage a team of fifteen people, four algorithms, and five hundred terabytes of data". And so, you want to think about how we're going to lead that, and how we're going to manage all of this and to do that effectively so we can really benefit from this technology and the way that we work ourselves as we serve Canadians.

Anil Arora: Thank you very much Eric. Um, uh, unfortunately time is running short. I know we've had a few questions from people uh, I know it's uh, literally more than a thousand people that are joining us virtually today, I know there have been a few questions that have come our way. I hope we've been able to answer some of your questions uh, through the dialogue and discussion that we've had. A very rich one, I may add. And uh, if I may invite all of you uh, to join us, uh, next week, where we have another one, uh, a session on June 25th on cybersecurity. And so all registered attendees will receive more information on the next week's session and future sessions that we will continue to host to broaden and further deepen this conversation. So I thank all our panelists, I thank people who joined us physically here, as well as everybody virtually. I hope it provides you with a better sense of the role that Statistics Canada and other national statistical offices are playing an important role in better understanding the various implications of a new bold digital world. So I thank you everybody. Merci beaucoup.

Manufacturing and Wholesale Trade (Monthly) - December 2018 to December 2019: National Level CVs by Characteristic

National Level CVs by Characteristic
Month Sales of goods manufactured Raw materials and components inventories Goods / work in process inventories Finished goods manufactured inventories Unfilled Orders
%
December 2018 0.59 0.94 1.23 1.34 1.13
January 2019 0.60 0.94 1.21 1.29 1.26
February 2019 0.62 0.93 1.22 1.26 1.13
March 2019 0.59 0.94 1.22 1.32 1.11
April 2019 0.60 0.96 1.20 1.33 1.16
May 2019 0.61 0.94 1.20 1.34 1.09
June 2019 0.58 0.94 1.18 1.38 1.15
July 2019 0.64 0.92 1.12 1.33 1.12
August 2019 0.61 0.92 1.18 1.34 1.11
September 2019 0.60 0.92 1.16 1.38 1.07
October 2019 0.60 0.93 1.18 1.39 1.14
November 2019 0.59 0.96 1.20 1.37 1.15
December 2019 0.57 0.99 1.29 1.38 1.10

National Weighted Rates by Source and Characteristic, December 2019

National Weighted Rates by Source and Characteristic, December 2019
Characteristics Data source
Response or edited Imputed
%
Sales of goods manufactured 91.0 9.0
Raw materials and components 84.5 15.5
Goods / work in process 86.4 13.6
Finished goods manufactured 83.1 16.9
Unfilled Orders 92.2 7.8
Capacity utilization rates 78.3 21.7

Quarterly Survey of Securitized Receivables and Asset-Backed Securities (F15)

Reporting entity

1. Indicate which type of corporation this report covers.

  1. A single corporation
  2. Part of a corporation
  3. A consolidated family of corporations
  4. Other (specify)

2. Is the reporting entity part of a Canadian consolidation?

  1. Yes
  2. No

3. Does this reporting entity have investments in partnerships or joint ventures?

  1. Yes
  2. No

4. Indicate the accounting standard used to complete this questionnaire.

  1. International Financial Reporting Standards (IFRS)
  2. Accounting Standards for Private Enterprises (ASPE)
  3. United States Generally Accepted Accounting Principles (U.S. GAAP)
  4. Other (specify)

5. Indicate the currency used to complete this survey.

  1. Canadian dollars
  2. U.S. dollars

6. What are the start and end dates of this enterprise's reporting period for the quarter ending:

From: YYYY-MM-DD to YYYY-MM-DD

Assets

7. Report your assets

  1. Cash and deposits – Canadian currency
  2. Cash and deposits – foreign currency
  3. Accounts receivable
  4. Allowance for credit losses on receivables
  5. Canadian investments in non-affiliates ─ debt securities issued by the Government of Canada
    • e.1 Term-to-maturity of less than one year
    • e.2 Term-to-maturity of one year or more
  6. Canadian investments in non-affiliates ─ debt securities issued by provincial and municipal governments
    • f.1 Term-to-maturity of less than one year
    • f.2 Term-to-maturity of one year or more
  7. Canadian investments in non-affiliates ─ debt securities issued by corporations, trusts or others
    • g.1 Term-to-maturity of less than one year
    • g.2 Term-to-maturity of one year or more
  8. Canadian investments in non-affiliates ─ corporate shares, fund or trust units and other equity
    • h.1 Publicly traded
    • h.2 Other equity
  9. Canadian investments in non-affiliates ─ other investments
  10. Foreign investments in non-affiliates ─ debt securities
    • j.1 Term-to-maturity of less than one year
    • j.2 Term-to-maturity of one year or more
  11. Foreign investments in non-affiliates ─ other investments
  12. Derivative assets
  13. Reverse repurchase agreements
  14. Mortgage loans to non-affiliates ─ secured by property in Canada
    • n.1 Residential ─ NHA insured
    • n.2 Residential ─ non-NHA insured
    • n.3 Non-residential
  15. Mortgage loans to non-affiliates ─ secured by property outside Canada
  16. Mortgage loans to non-affiliates ─ accumulated allowance for credit losses
  17. Non-mortgage loans to non-affiliates
    • q.1 To individuals and unincorporated businesses ─ credit cards
    • q.2 To individuals and unincorporated businesses ─ lines of credit
    • q.3 To individuals and unincorporated businesses ─ other loans
    • q.4 To corporations
    • q.5 To others
  18. Non-mortgage loans to non-affiliates ─ accumulated allowance for credit losses
  19. All other assets
    Specify all major items within other assets
  20. Other allowances for credit losses
    Total assets

Liabilities and equity

8. Report your liabilities.

  1. Accounts payable
  2. Amounts owing to affiliates
    • b.1 In Canada
    • b.2 Outside Canada
  3. Borrowing from non-affiliates ─ mortgage loans
    • c.1 Residential
    • c.2 Non-residential
  4. Borrowing from non-affiliates ─ non-mortgage loans and overdrafts
    • d.1 From lenders in Canada ─ banks
    • d.2 From lenders in Canada ─ credit unions
    • d.3 From lenders in Canada — other lenders in Canada
    • d.4 From lenders outside Canada
  5. Borrowing from non-affiliates ─ asset-backed securities
    • e.1 Term-to-maturity of less than one year
    • e.2 Term-to-maturity of one year or more
  6. Borrowing from non-affiliates ─ subordinated debt
  7. Borrowing from non-affiliates ─ other borrowings
  8. Derivative liabilities
  9. Obligations related to repurchase agreements
  10. Accrued pension liability
  11. Non-pension post retirement benefits
  12. All other liabilities
    Specify all major items within other liabilities
    Total liabilities

9. Report your equity.

  1. Share capital
    • a.1 Preferred
    • a.2 Common
  2. Accumulated other comprehensive income
  3. Retained earnings
    • c.1 Opening balance
    • c.2 Net income (loss) for the current period
    • c.3 All other additions (deductions)
      Specify all major items within other additions (deductions)
    • c.4 Reinvestment of income in additional trust equity units
  4. Dividends declared
    • d.1 Cash ─ preferred shares
    • d.2 Cash ─ common shares
    • d.3 Other dividends
      Closing balance
      Total equity
  5. Total liabilities and total equity

Income statement 

10. What period does this income statement cover?

From: YYYY-MM-DD to YYYY-MM-DD

11. Report your revenue.

  1. Interest revenue from Canadian sources
    • a.1 Debt securities
    • a.2 Mortgages
    • a.3 Consumer loans
    • a.4 Other interest revenue
  2. Interest revenue from foreign sources
  3. Dividends
    • c.1 From Canadian corporations
    • c.2 From foreign corporations
  4. Gains and losses ─ fair value adjustments
    • d.1 Realized
    • d.2 Unrealized
  5. Gains and losses ─ foreign exchange
    • e.1 Realized
    • e.2 Unrealized
  6. All other revenues
    Specify all major items within other revenues
    Total revenue

12. Report your expenses.

  1. Depreciation and amortization
    • a.1 Depreciation
    • a.2 Amortization ─ intangible assets
    • a.3 Amortization ─ other
  2. Software and research development
  3. Interest expense
    • c.1 Asset-backed securities ─ debt securities with term-to-maturity of less than one year
    • c.2 Asset-backed securities ─ debt securities with term-to-maturity of one year or more
    • c.3 Subordinated debt
    • c.4 Other interest expense
  4. All other expenses
    Specify all major items within other expenses
    Total expenses

13. Report your income. 

  1. Net income (loss)
    • a.1 Attributable to non-controlling interest
    • a.2 Attributable to equity shareholders
  2. Other comprehensive income
    • b.1 Items that will not be reclassified to net earnings
    • b.2 Items that may be reclassified subsequently to net earning
    • b.3 Reclassification of realized (gains) losses to net earnings
    • b.4 Income taxes
  3. Comprehensive income
    • c.1 Attributable to non-controlling interest
    • c.2 Attributable to equity shareholders

    Disclosure of selected accounts

14. Report other disclosures.

  1. Equity method dividends
    • a.1 Canadian dividends
    • a.2 Foreign dividends
  2. Capitalized expenses for software, research and development

15. Allocate the changes to selected assets and liabilities.

  1. Canadian and foreign investments in non-affiliates ─ debt securities
    • a.1 Initial balance
    • a.2 Net (purchases-sales or issuances-repayments and other changes)
    • a.3 Fair value adjustments and foreign exchange valuation adjustments
    • a.4 Other adjustments
      Closing balance
    • a.5 Realized gains and losses
  2. Canadian and foreign investments in non-affiliates ─ corporate shares, funds or trust units and other equity
    • b.1 Initial balance
    • b.2 Net (purchases-sales or issuances-repayments and other changes)
    • b.3 Fair value adjustments and foreign exchange valuation adjustments
    • b.4 Other adjustments
      Closing balance
    • b.5 Realized gains and losses
  3. Canadian and foreign investments in non-affiliates ─ other investments in non-affiliates
    • c.1 Initial balance
    • c.2 Net (purchases-sales or issuances-repayments and other changes)
    • c.3 Fair value adjustments and foreign exchange valuation adjustments
    • c.4 Other adjustments
      Closing balance
    • c.5 Realized gains and losses
  4. Mortgage loans to non-affiliates
    • d.1 Initial balance
    • d.2 Net (purchases-sales or issuances-repayments and other changes)
    • d.3 Fair value adjustments and foreign exchange valuation adjustments
    • d.4 Other adjustments
      Closing balance
    • d.5 Realized gains and losses
  5. Non-mortgage loans to non-affiliates
    • e.1 Initial balance
    • e.2 Net (purchases-sales or issuances-repayments and other changes)
    • e.3 Fair value adjustments and foreign exchange valuation adjustments
    • e.4 Other adjustments
      Closing balance
    • e.5 Realized gains and losses
  6. Other assets
    • f.1 Initial balance
    • f.2 Net (purchases-sales or issuances-repayments and other changes)
    • f.3 Fair value adjustments and foreign exchange valuation adjustments
    • f.4 Other adjustments
      Closing balance
    • f.5 Realized gains and losses
  7. Asset-backed securities
    • g.1 Initial balance
    • g.2 Net (purchases-sales or issuances-repayments and other changes)
    • g.3 Fair value adjustments and foreign exchange valuation adjustments
    • g.4 Other adjustments
      Closing balance
    • g.5 Realized gains and losses
  8. Other liabilities
    • h.1 Initial balance
    • h.2 Net (purchases-sales or issuances-repayments and other changes)
    • h.3 Fair value adjustments and foreign exchange valuation adjustments
    • h.4 Other adjustments
      Closing balance
    • h.5 Realized gains and losses
  9. Derivatives (assets and liabilities)
    • i.1 Initial balance
    • i.2 Net (purchases-sales or issuances-repayments and other changes)
    • i.3 Fair value adjustments and foreign exchange valuation adjustments
    • i.4 Other adjustments
      Closing balance
    • i.5 Realized gains and losses

Video - Exploring the Attribute Table and Layer Properties Box of Vector Data

Catalogue number: Catalogue number: 89200005

Issue number: 2020005

Release date: February 17, 2020

QGIS Demo 5

Exploring the Attribute Table and Layer Properties Box of Vector Data - Video transcript

(The Statistics Canada symbol and Canada wordmark appear on screen with the title: "Demo 5 - Exploring the Attribute Table and Layer Properties Box of Vector Data")

Following up from interacting with datasets in the Map Canvas, today we'll explore additional information and parameters found in the Attribute Table and Layer Properties Box. The Attribute Table contains additional variables for analyzing and visualizing vector data, while the Layer Properties box contains tabs that summarize information and provide additional functions. We'll quickly summarize some of the key tabs, their content and use, which we'll cover in detail in later demos.

So to open the Attribute Table of a layer, we can left-click it in the Layers panel and select the Attribute table icon, or right-click the layer and select Open Attribute Table.

So within the table, each column reports an additional variable tied to the vector dataset. These are referred to as fields within GIS, whereas each row corresponds to a specific feature or geometry within the canvas.

Using the tabs on the left-hand side we can select features. With an individual feature selected, we can right-click and Zoom to the Feature, and if we still couldn't see it we could also flash the feature. In this case we can't see our feature as it's hidden by our Census Subdivision layer.

Like the Interactive Selection tools, we can use Shift and Control to select multiple features. Using shift to select features within a range and Ctrl to add individual features. In conjunction, selecting features both within and between ranges. We could also then zoom to our selection. So as you can see, when features are selected in the Attribute Table they are also highlighted in the Canvas and vice-versa – highlighted in yellow in the Canvas and blue in the Attribute Table.

To sort a field, ascending or descending we can left-click once or twice on the field name as needed. This can help select features by specific criteria of interest such as selecting all features within a particular province in this case. We can then also zoom once more and using the Invert feature selection, we can switch the selection of features.

To move selections to the top of the attribute table, we can click the Move Selection to Top icon. So now if we add any additional features to our selection they are by default loaded at the top of the table. We could also copy our information and paste it into an external spreadsheet editor for further analysis.

Expanding the Show All Features dropdown, we could apply a field filter, selecting the field to filter by and specific criteria to use in filtering the table. Subsequently, the only remaining entries are those that satisfy the entered criteria, in this case Province name being Manitoba.

If we want a dynamic representation of our attribute features based on the scale and extent, we can apply a Show Features Visible on Map. Now if we change the scale or change the location, our table is filtered accordingly.

To enable additional tools we can enable the editor. This enables us to add or delete features, as well as add and delete fields. We can also click on an individual cell's content to edit its information, or for a selection of features we can use the Update Field Bar, specifying the field to update and the new attributes to update to – in this case clicking Update Selected. If we wanted to retain these changes we can save them, but in this case – since we want to keep our attribute table uniform - we'll just discard the changes and clear our selection.

To open the Layer Properties box of a layer we can right-click it and select Properties or simply double-left click within the Layers Panel.

The Layer Properties box contains various tabs which both summarize information and provide additional functions.

The Information tab summarizes the spatial characteristics as well as some of the attribute information within a dataset.

In the Source Tab we can rename a layer as we did with the Census Subdivisions. We can also use the Query Builder to filter features. However, this would filter the geometries of the layer in the Canvas as opposed to the table when using the Field Filter earlier.

The following four tabs are for visualization. We'll explore the Symbology and Labels tab in an upcoming demo, where we can apply different symbology styles to visualize fields within the attribute table, as well as differing labelling schemes. We can create Diagrams with the attribute information and, when enabled, also apply 3D visualizations.

The Source Fields tab provides more information on the Field Names, Types and additional parameters and with editor enabled we can add or delete a field, as well as rename a field.

So the Joins tab enables you to link datasets together – tables or vectors, by a field with common entries. The tab specifically works for one-to-one joins. So for example, here we could join the Census division and Subdivision layers using the unique Census Division identifier field. If we want to remove our join, simply select it and click the minus icon.

The final tab I'd like to cover is the rendering tab where we can apply a scale-dependent visibility, defining the minimum and maximum scale at which a dataset should begin or suspend rendering. We can set the scale from the drop-downs or set it to the current map canvas scale by clicking on this icon. This is helpful for large or highly detailed datasets that take a long time to render. Now, clicking OK, if we zoom in – our layer remains visible, but zooming out beyond the specified scale, you can see rendering is suspended.

Congratulations everyone! Today you've learned key skills in exploring, selecting and filtering features within the attribute table, performing simple edits and the use of some tabs within the Layer Properties box. In the next demo, we'll cover procedures for creating vector datasets, which includes delineating features and populating their attributes.

(The words: "For comments or questions about this video, GIS tools or other Statistics Canada products or services, please contact us: statcan.sisagrequestssrsrequetesag.statcan@canada.ca" appear on screen.)

(Canada wordmark appears.)

Video - Interacting with data in the Map Canvas

Catalogue number: Catalogue number: 89200005

Issue number: 2020004

Release date: February 17, 2020

QGIS Demo 4

Interacting with data in the Map Canvas - Video transcript

(The Statistics Canada symbol and Canada wordmark appear on screen with the title: "Demo 4 - Interacting with data in the Map Canvas")

Now that we have learned to load and order our datasets in QGIS, let’s explore some tools for interacting with them in the Map Canvas, particularly those found on the Map Navigation and Attribute toolbars. The skills covered today will provide skills for changing and saving the extent, as well as identifying and selecting features from layers in the Map Canvas.

So picking up where we left off…

The Map Navigation toolbar contains tools for changing the scale of the Canvas. By default the Pan Map tool is engaged. Simply left-click and drag the Canvas in the direction of interest.

The Zoom Tools operate similarly, left-click and drag across the area you’d like to zoom to. Depending upon the size of the box that’s drawn determines how much the scale changes. So if we draw a large box the change is negligible, whereas a smaller box the change is much more substantial. Alternatively you can use the scroll-bar of your mouse, scrolling backward and forward to zoom out and in respectively.

If we want to return to the extent of all active layers in the Panel we can use the Zoom to Full tool – helpful when we can’t find a particular dataset or if we just want to return to the full extent.

The Zoom to Layer tool is useful when the extents of loaded datasets differ

and works on the selected layer in the Layers Panel. Applying it to the road segments layer, it zooms to Manitoba, the area for which we downloaded the dataset.

The Zoom Last and Next tools are effectively the Undo and Redo of changes in the Canvas, enabling us to scroll through our previous zooms.

If you are going to be focussing on one area quite a lot for analysis or visualization, you can add a Spatial Bookmark and provide the bookmark with a name. Then if we were to close the Panel and zoom to another area in the map canvas, we can reopen the Panel, select the bookmark and the zoom icon to return to the saved extent.

Just before moving on to the Attribute Toolbar lets discuss grouping layers. We can use the Shift and Control keys to create a selection of layers, then right-click and hit Group Selected. This has many applications such as grouping thematically related layers, preparing mapping groups or organizing datasets such as toggling off many layers at once. Within the group, individual layers can be toggled off and on as normal. We can also right-click to Move a layer out of the Group or drag and drop – as desired.

Now on to the Attribute toolbar – which as the name suggests contains various tools for selecting, editing and examining the attributes of active layers in the Layers Panel. Today we’ll use the Interactive Selection and Identify tools, which default to the selected layer in the Layers Panel.

So with the Census Division layer selected, we can zoom in and left-click to select individual features. We can also drag across to select multiple features. Using Control we can add and remove individual features, or remove a selection of features. Alternatively we can use Shift to add many features to the selection. We can click the Deselect Icon on the toolbar to remove the selection.

If we expand the drop-down there are alternative selection options:

Select by Polygon is helpful for selecting irregular shaped features. We can left-click to add individual vertices and right-click to complete the polygon.

There is also Select by Radius, where we can zoom in, left-click a point of interest and left-click again when satisfied with the radius. Alternatively, we can specify the radius value in the top-right corner.

The Identify tool operates in a similar fashion. We can click an individual feature, and as we can see the Identify Panel returns information on both the geometry and attributes of the identified feature. Similar to the Interactive Selection tools we can drag across to identify multiple features and use the Collapse and Expand All icons to rapidly examine their attributes. Re-enabling the Census Subdivision layer, we can right-click and select Identify All. Here we returned two division features and six census subdivision features.

The same options from the interactive selection tool are available in the Identify tool by expanding the drop-down icon in top-centre of the Panel. Additionally we can change the Mode to alter which layers features are returned by the tool. Changing from Current to Top-Down will identify from all active layers. So re-enabling our grouped layers and creating a small selection in Northern Ontario we’ve identified a few features within the hydrological layer and ultimately returned features from three separate layers.

To remove the identified features click the Clear Results icon within the Identify Panel.

So that summarizes some of the basic tools for changing the extent and scale of the map canvas as well as interacting with vector datasets in the map canvas. In the next demo we will explore additional information found within the Attribute table and Layer Properties box of vector datasets.

(Canada wordmark appears.)

Video - Loading and Ordering Spatial Data in QGIS

Catalogue number: Catalogue number: 89200005

Issue number: 2020003

Release date: February 17, 2020

QGIS Demo 3

Loading and Ordering Spatial Data in QGIS - Video transcript

(The Statistics Canada symbol and Canada wordmark appear on screen with the title: "Demo 3 - Loading and Ordering Spatial Data in QGIS")

Hello everyone! So now that we've downloaded QGIS and spatial data, today we'll learn how to load and order datasets of different geometry types in QGIS, and save the Project for later use. For the demonstration we'll use several datasets that we downloaded in the previous video, covering the main geometry types of vector data: points, lines & polygons.

So the first step is to open QGIS Desktop from a desktop shortcut or from the start-bar.

And the first thing well do is pin QGIS to the taskbar since we will be using it frequently in subsequent training videos.

When you open QGIS for the first time it looks like this.

To load spatial data into QGIS, they are added from the Browser panel, in to the Layers panel, and also visualized in the Map Canvas.

So the first thing we need to do is expand the folders to find where we downloaded our spatial datasets to in the previous video. So I'll expand the Home folder and the Documents folder to find the GeospatialData folder.

Since it's the first time we're locating this folder, we'll right-click and add it as a favourite, which adds it to our favourites drop-down at the top, which will help us load datasets more quickly and easily in the future.

To see the available layers just continue expanding the folders, and within the Intro Demo folder there are 4 shapefiles and 2 geodatabase files.

So to load datasets in it is quite simple, you can just double-left click or drag-and-drop from the Browser to the Layers panel.

These procedures can also be applied to geodatabase files, you just need to expand the folder to see the available layers first. For Grain Elevators there is only one, so just double left-click, while for Transport Features there are many, but for the purpose of the demo we'll use the Road Segments layer.

Finally we will load in our two census boundary files into the layers panel.

Don't worry if the colours of your files differ from those in this video. QGIS assigns a single random colour when vector datasets are loaded.

So within the Layers Panel, individual layers can be toggled off and back on again, as well as renamed. So here I'll just rename the Census Subdivisions file with a more intuitive name.

Despite having loaded the six layers into the Layers Panel, we can only see one within the Map Canvas. This is because the order within the Layers Panel affects the order that they are rendered in the Map Canvas.

So in general points are placed above lines, which themselves are placed above polygons. For vectors of the same geometry type it is important to think about their position in the landscape relative to one another – so do rivers flow over roads, or do roads tend to get built over rivers? Well often roads are built over rivers, so we'll just switch their order in the Layers Panel. And similarly, the Lakes and Rivers polygon, as a land-cover feature we'll place it above the census boundary files.

So now if we zoom in we can see that all of our layers are visible in the Map Canvas.

The final component of the video I'd like to discuss today is saving the project for later use. This will save the order of layers in the Layers Panel, any visualizations styles such as labels or colours as well as any joins– all procedures that we'll discuss in later demos. So navigate to the Project Toolbar and click on the Save Icon. In general we want to store the project in the same location as the spatial data, and provide it with an intuitive filename, like Loading and Ordering Spatial Data.

So that concludes the procedures for loading datasets into QGIS from the Browser to the Layers Panel, which will work for most spatial data, and how to order them in the layers panel for their visualization in the Map Canvas. Additionally, we learned how to save our project and the specific properties that are retained. Stay tuned for the next demo, where we will explore some of the tools on the Map Navigation and Attribute toolbars for interacting with these datasets in the Map Canvas.

(Canada wordmark appears.)