Statistical Information Service Evaluation 2015/2016

Archived information

Archived information is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please "contact us" to request a format other than those available.

Consultation objectives

During the 2015/2016 fiscal year, Statistics Canada's Statistical Information Service will be evaluated to assess its ability to meet the information needs of the Canadian public.

This evaluation is intended to allow users of this service to provide feedback and to express their level of satisfaction with the services they received.

Feedback will be used to help Statistics Canada further improve its service delivery.

How to get involved

Individuals who wish to obtain more information or to take part in a consultation should contact Statistics Canada by sending an email to consultations@statcan.gc.ca.

Please note that Statistics Canada selects participants for each consultation to ensure feedback is sought from a representative sample of the target population for the study. Not all applicants will be asked to participate in a given consultation.

Statistics Canada is committed to respecting the privacy of consultation participants. All personal information created, held or collected by the Agency is protected by the Privacy Act. For more information on Statistics Canada's privacy policies, please consult the Privacy notice.

Results

Results of the client satisfaction evaluation will be published online when available.

Date modified:

Audit of Collection and Regional Services

November 18, 2014
Project Number: 80590-81

Executive Summary

Statistical information is critical for effective decision making in a modern economy. Statistics play an essential role in the production and dissemination of statistical information.  Because of the importance of the information required, quality is fundamental to Statistics Canada's mandate. Data collection activities form the basis of much of the information Statistics Canada disseminates and survey collection activities are the main source of contact the Agency has with the public they rely on. As such, ensuring the quality of collection activities is a critical aspect to ensure the accuracy of the information.

The objectives of the audit were to provide the Chief Statistician (CS) and the Departmental Audit Committee (DAC) with assurance that:

  • Statistics Canada has appropriate governance mechanisms in support of the planning and resource allocation of Collection and Regional services.
  • Appropriate quality assurance mechanisms have been established and are consistently applied to ensure that Collection and Regional Services Branch are gathering quality data and are compliant with the Statistics Canada Quality Guidelines.

The audit was conducted by Internal Audit Division in accordance with the Government of Canada's Policy on Internal Audit.

Key Findings

Responsibilities and accountabilities are defined and communicated in the Collection and Operations Services Agreement (COSA) and the SSO handbook and clearly defined mandates have been developed for collection oversight committees. Effective capacity planning takes place within Collection Planning and Management Division (CPMD) and the regional offices to ensure collection activities take place as planned.

While the risk management framework includes the identification of risks and high level mitigation strategies, it does not include detailed risk mitigation activities nor does it assign specific accountability for each activity or timelines for implementation.

Survey collection management in the regions and CPMD inconsistently apply survey reports, which may result in undetected data quality issues. Currently, the primary focus of survey management reports is to ensure response rate targets are met and specific quality reports or indicators are not being leveraged to assess the quality of collections.

CPMD and Regional offices have established an effective process for feedback and the escalation of issues. Communication occurs daily and the escalation of issues occurs at the appropriate level.

Basic interviewer and survey training is effective and the tools in place help ensure that interviewers understand survey procedures and concepts. However, training for the Business Register does not effectively prepare interviewers to make changes to the frame with confidence.

The use of Quality Control Feedback System (QCFS) is not optimized to ensure monitoring targets are met at the regional and interviewer level and the results of monitoring activities are not being analyzed to ensure the quality of collections. Computer Assisted Personal Interview (CAPI) monitoring requires improvement to ensure that interviewers receive timely feedback, interviewers and respondents are made aware of the importance of quality assurance, and observational monitoring takes place in all regions— as outlined in the SSO handbook—to meet monitoring expectations and enhance the quality of CAPI collection activities.

Overall Conclusion

The governance framework in place in Collection and Regional Services branch is effective; responsibilities and accountabilities are documented and effective capacity planning within Collection and Regional Services Branch takes place.

Although appropriate quality assurance mechanisms exist within the Collection and Regional Services Branch (CRSB), they are not adequately leveraged or applied. The Statistics Canada Quality Guidelines note that an effective collection management framework should strike a balance between survey performance and quality. Current survey collection monitoring and management practices focus primarily on collection performance and should be enhanced to better ensure the quality of data collected.

Conformance with Professional Standards

The audit was conducted in accordance with the Internal Auditing Standards for the Government of Canada, which includes the Institute of Internal Auditors (IIA) and the International Standards for the Professional Practice of Internal Auditing.

Sufficient and appropriate audit procedures have been conducted and evidence gathered to support the accuracy of the findings and conclusions in this report and to provide an audit level of assurance. The findings and conclusions are based on a comparison of the conditions, as they existed at the time, against pre-established audit criteria. The findings and conclusions are applicable to the entity examined and for the scope and time period covered by the audit.

Patrice Prud'homme
Chief Audit Executive

Introduction

Background

Statistics Canada was established to ensure that Canadians have access to a trusted source of Canadian statistics to meet their highest priority needs. Access to trusted statistical information underpins democratic societies, as it supports evidence-based decision-making in the public and private sectors, and informs debate on public policy issues. Under the Statistics Act, Statistics Canada is required to "collect, compile, analyze, abstract and publish statistical information relating to the commercial, industrial, financial, social, economic and general activities and conditions of the people of Canada", which requires the organization to collect data from a wide variety of Canadian businesses and households.

At Statistics Canada, Collection and Regional Services Branch (CRSB) is responsible for the majority of data collection activities. Its mandate is to:

  • Provide data collection services to Statistics Canada's statistical programs (Household surveys, Business surveys and Census collection);
  • Provide the Management Structure for the Separate Employer – Statistical Survey Operations (SSO) – which comprises Statistics Canada's interviewers;
  • Promote the availability and effective use of Statistics Canada's products and services through the Advisory Services and Communications program in the regions.

Within the branch, Collection Planning and Management Division (CPMD) is accountable for the coordinated planning of the collection capabilities, and the capacities of the collection infrastructure. They also act as the front door for most survey partners who require collection support. CPMD is the interface between the subject matter divisions and the regions and designs collection activities in response to client specifications, provides cost estimates, acquires requisite services from supplying divisions within the Field to execute the survey, monitors and reports on survey progress and conducts post-mortems of completed projects.

There are three regions that manage survey data collection operations: the Eastern Region, which has offices in Halifax, Montreal and Sherbrooke; the Central region, with offices in Ottawa, Toronto and Sturgeon Falls; and the Western Region and Northern Territories with offices in Edmonton, Regina, Calgary, Winnipeg and Vancouver. Within these regions, there are approximately 2000 interviewers and public servants providing services and conducting surveys.

The CRSB branch began piloting a branch renewal project in January 2014, with full implementation scheduled for April 1, 2014. Under this project, the roles and responsibilities for regional offices and CPMD will change. CPMD will transfer the management of surveys to the regions, and subject matter areas will communicate directly with the regions. CPMD will continue to do the planning and prepare the training materials for surveys, while regional offices will be fully responsible for the resolution of survey collection issues.

Audit objectives

The objectives of the audit were to provide the Chief Statistician (CS) and the Departmental Audit Committee (DAC) with assurance that:

  • Statistics Canada has appropriate governance mechanisms in support of the planning and resource allocation of Collection and Regional services.
  • Appropriate quality assurance mechanisms have been established and are consistently applied to ensure that Collection and Regional Services Branch are gathering quality data and are compliant with the Statistics Canada Quality Guidelines.

Scope

The scope of this audit included an examination of the adequacy and effectiveness of the quality controls in place for the collection of data conducted by Collection and Regional Service branch. Specific areas that were examined include the quality assurance controls currently in place within the Computer Assisted Telephone Interview (CATI) and Computer Assisted Personal Interview (CAPI) collection environments to ensure compliance with the Statistics Canada Quality Guidelines.

The audit also examined the effectiveness and adequacy of the governance and capacity planning for Collection and Regional Services. During the course of the audit, the audit team examined Collection Planning and Management Division at head office, as well as the regional offices in Edmonton, Sherbrooke and Sturgeon Falls. The audit covered the period from January 2013 to January 2014. The audit did not include infrastructure elements related to Shared Services Canada, as they will be examined in a separate engagement.

Approach and methodology

The audit consisted of a comprehensive review and analysis of relevant documentation, as well as interviews with key management and staff from CRSB at headquarters and regional offices. The field work included a review, assessment, and testing of the processes and procedures in place to ensure the Agency provides quality statistical information.

This audit included interviews with personnel in all of the regions, subject matter divisions, as well as interviews with CRSB staff located at headquarters. Document review included survey reports and documentation from each of the regions and headquarters. A random sample of interviewers was drawn from each of the sites visited. Testing included a random sampling of interviewer files from each of the three sites visited and examination of the Quality Control Feedback System (QCFS) reports for the specific months over the period under examination, and a validation to ensure training was provided to interviewers and that it occurred prior to collection activities. The audit also tested to determine the procedures in place to ensure that SSO employees were informed of and acknowledged the code of ethics and conduct for SSO employees. Additionally, because the Edmonton Regional office was the only office visited responsible for CAPI interviewers, a sample of CAPI interviewer files were examined.

This audit was conducted in accordance with the Internal Auditing Standards for the Government of Canada, which includes the Institute of Internal Auditors (IIA) International Professional Practices Framework.

Authority

This audit was conducted under the authority of the approved Statistics Canada Integrated Risk-Based Audit and Evaluation Plan 2013/14 to 2017/18.

Findings, Recommendations and Management Responses

Objective 1: Statistics Canada has appropriate governance mechanisms in support of the planning and resource allocation of Collection and Regional services.

Governance

Responsibilities and accountabilities are defined and communicated in the COSA and the SSO handbook.

Clearly defined mandates have been developed for collection oversight committees and effective capacity planning takes place within CPMD and the Regional offices to ensure collection activities take place as planned.

While the risk management framework includes the identification of risks and high level mitigation strategies, it does not include detailed risk mitigation activities nor does it assign specific accountability for each activity or timelines for implementation.

A robust governance framework is essential to ensure that Collection and Regional Services Branch (CRSB) provides quality data collection services to Statistics Canada's statistical programs. Authorities, responsibilities and accountabilities should be clearly defined and understood at all levels to support effective collection and capacity management, and a well-developed approach to risk management should be in place.

Responsibilities and accountabilities for CPMD and RO staff are defined and communicated

Responsibilities and accountabilities of the Collection Planning and Management Division (CPMD) and Regional offices (ROs) have been clearly defined in the Collection and Operations Services Agreement (COSA), which is a formalized agreement that has been developed to define roles, responsibilities and accountabilities of key stakeholders in the survey process.

The COSA describes the project, details the collection and operation activities, outlines the areas responsible for each activity and provides timelines. It also details what the deliverables are, and how they will be measured and monitored, including what management information reports will be used. The COSA includes details of the governance and communications processes that will be implemented to manage collection and operations activities. All new surveys are required to have a COSA completed and signed, but because COSA is new and is being implemented in stages, most ongoing surveys do not yet have an approved COSA in place.

Regional collections staff roles and responsibilities are outlined in the SSO employee handbook. It outlines key tasks, expectations and responsibilities for field and office interviewers, and senior interviewers.

Clearly defined mandates have been developed for collection oversight committees

Effective oversight bodies are important to ensure management's direction, plans and actions are appropriate and responsible. In order for oversight bodies to be effective, they should be provided with timely and accurate information to adequately fulfil their oversight function.

The audit noted that three oversight committees have been established for survey collections. These are:

  • Collection Planning Committee (CPC);
  • Social Collection Steering Committee (SCSC); and,
  • Business and Agriculture Surveys Collection Steering Committee (BACSC).

The mandate of the Collection Planning Committee is primarily to review and recommend strategies for collection, respondent relations and operational efficiencies related to cost, quality and timeliness. The committee is also responsible for reviewing demands and priorities for collection services to recommend capacity adjustments. The CPC meets monthly and is chaired by two directors general. Membership is comprised of directors and assistant directors from within CRSB, as well as key stakeholder divisions from statistical infrastructure, informatics, and subject matter divisions. This committee reports to Executive Management Board at Statistics Canada.

The audit found that the committee is fulfilling its objectives with respect to collection strategies, respondent relations, quality, timeliness and reviews capacity demands. A review of the committee's minutes and interviews with key CPC members revealed that various issues related to the mandate are discussed and action items are assigned as required to ensure follow-up occurs. Additionally, representatives from working groups are invited to CPC meetings to make informational presentations regarding the status of initiatives or research.

The Social Collection Steering Committee and the Business and Agriculture Collection Steering Committee have clearly defined mandates. Both committees provide oversight of household, business and agriculture surveys collection and are required to report back to CPC on business or household survey collection issues, committee initiatives or decisions. SCSC and BACSC membership is at the director level or their delegates from subject matter and statistical infrastructure divisions, and representatives from CRSB are also members of these committees. The audit reviewed the committees' minutes during the last fiscal year that the SCSC and the BACSC are meeting the obligations noted in their mandates.

Effective capacity planning takes place

The Statistics Canada quality guidelines note that capacity planning is an important step in the survey process and effective capacity planning should be used as a tool to help ensure the quality of collection activities.

The audit found that capacity planning within CPMD is formalized and aligned with data collection planning in the regions. Interviews and document review revealed that business rules are in place and planning assumptions are documented. Current and future needs for resources are assessed on a regular basis and the information provided by headquarters is sufficient for regional offices to undertake their planning activities. Within the regions, labour market conditions are monitored to ensure offices have adequate staffing capacity to carry out collection activities.

CRSB and regional office risk management activities require further development

A well-developed approach to risk management should include identification and assessment of risks, development of mitigation plans to reduce the likelihood of risks, and the on-going monitoring of conditions to ensure risk management strategies are working as intended.

Within Statistics Canada, integrated risk management is performed at the program, division or branch level. Each year, areas identify the risks that may impact Statistics Canada's ability to accomplish objectives, along with the potential likelihood, impact and mitigation strategies.

The audit noted that risk management is developed at the Collection and Regional Services Branch level. Eight key risks facing the branch that may preclude the attainment of objectives were noted. Broadly, these risks can be organized into risks related to respondent relations, human resource risks, competing priorities, interdependencies, and the stewardship of information. High-level mitigation strategies have been identified, but do not outline the specific risk management activities to be performed, nor assign the accountabilities or timelines for implementation.

Recommendations:

The Assistant Chief Statistician, Census, Operations and Communications field should ensure that:

  • Specific risk mitigation activities are established, accountability is assigned and timelines for implementation are documented.

Management Response:

Management agrees with the recommendations.

  • The Director General, CRSB will modify the comprehensive Branch level risk profile to provide additional detail including specific risk mitigation activities, with appropriate designated accountabilities and specific timelines.

    Deliverables and Timeline: Revised CRS Branch Risk Profile will be completed by March, 2015.

Objective 2: Appropriate quality assurance mechanisms have been established and are consistently applied to ensure that Collection and Regional Services Branch are gathering quality data and are compliant with the Statistics Canada Quality Guidelines.

Survey Collection Management

Survey collection management in the regions and CPMD inconsistently apply survey reports, which may result in undetected data quality issues. Currently, the primary focus of survey management reports is to ensure response rate targets are met and specific quality reports or indicators are not being leveraged to assess the quality of collections.

CPMD and Regional offices have established an effective process for feedback and the escalation of issues. Communication occurs daily and the escalation of issues occurs at the appropriate level.

The Statistics Canada Quality Guidelines note that data collections and capture operations have an impact on the accuracy of data. Given this, there should be a balance between quality and performance measurement tools used to manage data collections to help ensure the accuracy of the information. The Guidelines outline several reports that can be used as measures of quality and further notes that these measures help support decisions regarding the need to amend collection processes or redesign collection tools.

There are inconsistent approaches to survey collection management by Regional Offices and CPMD

Survey collection management includes the monitoring and controlling of collection activities. It should ensure that survey production plans are implemented and that necessary corrections or adjustments are made and communicated to subject matter and other relevant stakeholders. Regional office staff manages regional data collection activities and CPMD project officers manage collections, as well as monitor and report on overall survey progress.

Reports related to overall collection activities are prepared in the regions by data collection managers (DCMs), district managers and regional program managers (RPMs). Within CPMD, project officers are responsible for the preparation of reports to support survey management. The audit also found that, for some of the surveys examined, subject matter divisions also prepare and use collection reports. These reports analyze response rates, outcome codes, and other paradata to support survey collection management.

DCMs and RPMs within the regional offices prepare and review a number of system generated reports designed to monitor survey performance and interviewer productivity. These reports include outcome codes and daily progress reports, time per unit, and cost versus claims reports. The audit found inconsistencies in the use and frequency of the review of these reports. For example, some DCMs noted reviewing some or all of these reports and, in some cases, DCMs did not review any of these reports. The variation in survey management approaches within the regions increases the risk of discrepancies in the reports created by regions for CPMD and other partners, which may affect CPMD's ability for effective decision-making.

In addition, the reports used by CPMD for collection management purposes vary depending on the project officer. The audit found that some CPMD project officers rely solely on the daily response rate reports to monitor their surveys. Others indicated that they reviewed an array of reports, such as reports on results of conversion and tracing efforts. No procedural documentation exists outlining what reporting should be reviewed by CPMD project officers for effective collections management.

Interviews with subject-matter representatives noted that the differences in collection management approaches affect the usefulness of the information they are receiving regarding the status and quality of the survey's collection activities, resulting in quality issues that may go undetected.

Quality assurance tools are insufficiently leveraged in the management of collection activities

The Statistics Canada Quality Guidelines outline several reports that may be used as survey collection management tools by both CPMD and Regional Offices. These reports include processing error rates, follow-up rates, rates of non-response by reason, response rates, and capture/coding error rates.

Management noted that, for many surveys, response rates are declining. The audit found that, as a result of this decline, significant effort is placed on ensuring response rates for surveys, as these rates are indicators of both performance and data quality. At the same time, adequate response rates alone do not guarantee data quality. The Statistics Canada Quality Guidelines note that an effective collection management framework should also include tools specifically designed to monitor quality.

The audit team examined the reports prepared in CPMD and the regions. Within each of the three regions examined, the primary focus of the survey-reporting that is prepared and reviewed is to ensure that response rate targets are being met, and that interviewers are meeting productivity targets. Specific reports being used include: outcome codes, time per unit and cost versus claim reports. While these reports form part of an overall quality assurance suite of indicators, they are used as performance management tools and not sufficiently leveraged in the management of data quality.

Within CPMD, the audit found no indication that specific reporting on the quality of the collected data is being created or quality is being monitored. Reports designed to examine overall collections quality would help with the early identification and mitigation of issues affecting the quality of the data being collected.

The Quality Control Feedback System (QCFS) is used to monitor individual interviewers, but also has reporting capabilities that allow users to create reports, which enable analysis of the quality of data collections by creating and analysing reports by error type, errors by survey, trends in interviewer performance, etc. The audit noted that this type of analysis is not done within CPMD or in the regions, which would help interviewers understand survey requirements and be used as a tool to monitor interviewer collection performance.

In order to address survey management and quality reporting weakness, the audit noted that one subject matter division has been requesting additional reports from CPMD in order to conduct their own paradata analysis in an attempt to identify quality issues. Through this analysis, they have been able to provide feedback to CPMD on areas requiring investigation. This exercise has proven to be useful and, in one instance, led to the identification of serious interviewing gaps.

An effective process for feedback and the escalation of issues has been established

Communication of issues between Regional Office and CPMD takes place daily. Specifically, the audit found evidence that survey-specific issues with potential impacts on collection activities are reported and escalated within the regions and to CPMD for action. These issues include such things as, capacity and budgets, labour and environmental issues, technical issues, and survey-specific informational requests.

The audit found that CPMD and Regional offices have established an effective process for feedback and the escalation of issues. Communication occurs daily and issues escalation occurs at the appropriate level.

Recommendations:

The Assistant Chief Statistician, Census, Operations and Communications field should ensure that:

  • A collection management approach, including the identification of reports to be produced, is established and communicated, to ensure consistency in the collection services provided to partners;
  • Quality indicators, such as those outlined in the Statistics Canada Quality Guidelines, are included within the mandatory reporting requirements, and information from QCFS is regularly analyzed in order to identify training weaknesses and other survey issues.

Management Response:
Management agrees with the recommendations.

  • The Director, Collection Planning and Research Division will develop a set of quality indicators and reports that can be used to identify issues during or after collection activities and to maintain or improve the quality of data collection. The development of these indicators will be done in collaboration with the Social Survey Collection Steering Committee and the Business and Agriculture Collection Steering Committee. Should the Branch be unable to absorb the costs associated with developing, implementing and maintaining the expanded quality indicators, a business proposal will be brought forward through the Department's long term planning process.

    Deliverables and Timeline: Development of the Collection Data Framework will be completed by December 2014.

Training and Monitoring in Support of Quality

Basic interviewer and survey training is effective and the tools in place help ensure interviewers understand survey procedures and concepts; However, training for the Business Register does not effectively prepare interviewers to make changes to the frame with confidence.

The use of QCFS is not optimized to ensure monitoring targets are met at the regional and interviewer level and the results of monitoring activities are not being analyzed to ensure the quality of collections.

The audit revealed that Computer Assisted Personal Interviewing (CAPI) monitoring requires improvement to ensure that interviewers receive timely feedback, interviewers and respondents are made aware of the importance of quality assurance, and observational monitoring takes place in all regions—as outlined in the SSO handbook—to meet monitoring expectations and enhance the quality of CAPI collection activities.

Training and Tools

The Statistics Canada Quality Guidelines note that interviewer manuals and training must be carefully prepared and planned, since they provide the best way to guarantee data quality (e.g., high response rate and accurate responses), the comprehension of survey concepts and subject matter, and ensure proper answers to questions from respondents.

Effective basic and survey-specific training and tools for interviewers are in place, however, Business Register training should be enhanced to ensure interviewers understand requirements

The audit examined basic training given to all interviewers upon hire. This training effectively outlines Statistics Canada's mandate and objectives, the roles and responsibilities of interviewers and senior interviewers, and the importance of data collection. It also describes collection activities and quality control.

Survey-specific training is to be given to interviewers assigned to that specific survey. To ensure interviewers understand survey methods and concepts and the survey application, and have the opportunity to do mock interviews, training should take place prior to them beginning work on the survey. The audit examined two business surveys and three social surveys and found that training materials outline specific concepts, procedures and applications. In accordance with the Statistics Canada Guidelines, survey training also included several approaches to training, including home study, classroom training, and mock interviews. Audit testing confirmed that interviewers received basic and survey- specific training and that it took place prior to interviewers beginning any collection activities.

The Business Register is the survey frame for business and agricultural surveys. Prior to 2011, any changes to the frame were made by staff in the Business Register Division and were subject to validation with subject matter areas. Beginning in 2012, the responsibility for making live updates to the register was transferred to interviewers in the regions.  Interviewers in all regions visited noted that the Business Register training currently provided does not effectively prepare them to be able to make changes to the register with confidence. Interviews with subject-matter areas substantiated this by noting that there have been changes made to the frame by interviewers in the regions that were inaccurate, which have resulted in erroneous changes to the frame. The audit examined the Business Register training materials and noted that it assumes a level of knowledge of industrial organization and classification that staff in the regions may not have. Without effective training for interviewers, there is a risk that invalid changes made to the Business Register may go undetected and impact the quality of business and agricultural surveys.

Monitoring

The Statistics Canada Quality Guidelines note that the 'interviewing skills of interviewers should be monitored to ensure that they conform to a pre-established list of standards,' and that, '...monitoring should also be used to identify strengths and weaknesses in the interviewer's skill set, to provide feedback to the interviewers and to focus training on weaker areas.'

The QCFS is designed to capture the results of quality control monitoring operations for both Computer Assisted Telephone Interviewing (CATI) and Computer Assisted Personal Interviewing (CAPI), and to provide quality estimates and feedback reports to interviewers and managers. It also generates interviewer sampling plans required for the efficient administration of quality control procedures and monitoring. Each CATI and CAPI interviewer is assigned to a monitoring plan based on the interviewer's past performance. Interviewer plans and the required number of monthly monitoring sessions for CATI and CAPI interviewers in each plan are classified in QCFS as follows:

Plan A: Experienced/excellent. Monitoring sessions required: CATI-1, CAPI-1
Plan B: Very good. Monitoring sessions required: CATI-2, CAPI-2
Plan C: Acceptable/new interviewers. Monitoring sessions required: CATI-4, CAPI-3
Plan R: Unacceptable—re-training. Monitoring sessions required: CATI-6, CAPI-4.

During a given monitoring session, the quality of the interviewer's work is evaluated against a pre-defined set of criteria. If an interviewer makes an error or shows poor interviewing practices for any question, the information is recorded in QCFS.

CATI interviewers work out of regional offices across the country, and using a computer survey application, telephone respondents to conduct the interview. Monitoring is carried out by senior interviewers who listen, observe, and assess the live interaction between the interviewer and the respondent, while using a telephone listening device and observe a simultaneous duplicate image of the interviewer's computer screen. Respondents are advised that the call may be listened to by a supervisor.

CAPI interviewers work in the field and go to respondent's residences to complete interviews. Survey responses are captured by the interviewer in a computer survey application. Monitoring is carried out by reviewing digitally recorded segments of interviews. Each recorded question is saved in a separate audio file and transmitted daily to the regional offices—where monitoring activities can take place. Respondents are asked by the interviewer if they consent to being recorded, allowing them the option to decline. If they do not to give consent, the recording is turned off.

The audit team observed eight monitoring sessions and confirmed that monitoring activities are performed according to the QCFS process. The audit noted that monitors actively listen to interviewers to ensure data are coded as required, interviewers ask questions as per the questionnaire and that the interviewers' conduct is professional. Errors and comments from each monitoring session were subsequently entered into the system, and for CATI monitoring sessions feedback was provided immediately after each monitoring session.

Monitoring of CATI interviewers should be enhanced to optimize quality

The audit assessed the monitoring activities within each of the sites visited to confirm whether monitoring occurred, if it was relevant and if feedback was given to interviewers. Of the 53 CATI interviewer files tested across the regions, only three interviewers were monitored as frequently as required by their monitoring plans. Interviews with regional management noted that senior interviewers have day-to-day responsibilities in addition to monitoring activities and that monitoring targets are still considered onerous, despite recent reductions in the required monitoring targets. Regional management also stated that interviewer plans for those requiring more monitoring due to identified quality issues, are not reviewed to ensure monitoring plans are implemented as required.

The audit noted that feedback from monitoring sessions is provided to CATI interviewers in a timely manner. However, regions do not use QCFS to identify performance trends for interviewers as QCFS is considered to be a coaching tool only and not a performance management tool. Management in the regions noted that the focus of QCFS monitoring is to meet monitoring targets set by head office and explained that, because feedback is given to interviewers after each monitoring session, quality is assured. Without analysis of monitoring results, the need for specific training or specific survey issues may not be identified or addressed.

CAPI monitoring is inconsistent across regions

There are several methods of monitoring CAPI interviews to ensure the quality of interviewer collections, including monitoring using the QCFS, validation monitoring and observation monitoring. Of the 15 CAPI surveys currently in the field, the QCFS is used to monitor CAPI interviewers for 2 CAPI surveys only—the Canadian Community Health Survey (CCHS) and the Survey of Household Spending (SHS). As a result, only CAPI interviewers working on these two surveys can be monitored using the QCFS.

The audit examined the QCFS monitoring consent-rate report for SHS produced in CPMD which detailed, for each CAPI interviewer, the rates of consent for recording of the interview. It showed that, on average, 29% of CAPI respondents refuse to give consent. However, the audit noted significant variation across interviewers. For example, examination of the consent report revealed that 24% of CAPI interviewers had refusal rates of more than 50%. As a result, there is often little sample available to monitor. The DCM responsible for CAPI interviewers in the Edmonton region noted that these reports were provided for informational purposes only and no action is taken to determine why consent rates varied. During interviews it was noted that there have been several instances of interviewers coaching respondents to decline having the interview recorded.

CAPI interviewers are not monitored as frequently as required by their plan. The reason given was because there is little sample available to monitor, and respondents have the option to decline being recorded. Additionally, CAPI monitors stated that providing timely feedback to CAPI interviewers is difficult. Because CAPI interviewers work in the field, the monitor must call and leave a message requesting the interviewer to call back. Many CAPI interviewers are reluctant to call back and avoid receiving feedback because it is perceived negatively. Without effective feedback mechanisms for CAPI interviewers, it is unlikely that risks to the quality of collections resulting from ineffective interviewing skills are adequately addressed.

Validation monitoring consists of telephoning respondents to verify that a Statistics Canada employee has been to their residence and has done an interview. Key data are confirmed and the respondent is questioned about the overall professional impression of the interviewer. The audit tested and confirmed that validation monitoring takes place at the Edmonton regional office, as it was the only one of the three sites visited responsible for CAPI interviewers.

Observation monitoring occurs when a senior interviewer accompanies a CAPI interviewer in the field and observes collection activities. The CAPI Statistical Survey Operations (SSO) employee handbook noted that observational monitoring must be conducted at a minimum of once every two years. Within the Eastern and Western regions, the audit confirmed that observational monitoring is taking place. In the Central region, staff noted that observational monitoring had been discontinued and has not taken place since 2010.

Recommendations:

The Assistant Chief Statistician, Census, Operations and Communications and the Assistant Chief Statistician, Analytical Studies, Methodology and Statistical Infrastructure should ensure that:

  • Business Register Training is adapted for SSO staff to ensure quality frame maintenance.

Management Response:

Management agrees with this recommendation.

  • The Director of the Collection Planning and Research Division, in collaboration with the Director of the Business Register Division, will ensure the Business Register training for interviewers is adjusted to meet the users' needs.

    Deliverables and Timeline:
    • New streamlined course based on needs identified through consultation with CRSB. This was completed in December 2013.
    • First iteration of new course delivered nationally. This was completed in March 2014.
    • New training materials made available to SSO/CRSB. This was completed in May 2014.
    • To ensure all interviewers and Senior Interviewers are properly trained, CRSB and the Regions use an Excel listings of trained or to be trained staff on the BR. This will be an ongoing activity.

Recommendations:

The Assistant Chief Statistician, Census, Operations and Communications field should ensure that:

  • The CATI and CAPI interviewer monitoring plan targets are met and that the results of monitoring are examined at the interviewer and survey level to ensure the quality of operations.
  • For CAPI operations, the feedback from QCFS monitoring be provided to interviewers in a timely manner, interviewers and respondents are made aware of the importance of monitoring as a quality assurance tool to minimize refusals to monitoring, and there is clarification of the observation monitoring requirements.

Management Response:

Management agrees with this recommendation.

  • For CATI, the Assistant Directors/Operations will work with Collection Planning and Research Division to update the monitoring targets, and develop a plan to ensure those targets are met and tracked. Feedback mechanisms to interviewers will be examined as a part of the plan.

    Deliverables and Timeline: Updated CATI monitoring targets and plan for assessing the program by March 2015
  • For CAPI, Regional Directors will work with Collection Planning and Research Division to develop and cost out a revised monitoring program, similar to the CATI program, and develop an implementation plan. If necessary, an LTP proposal may be developed to fund CAPI monitoring. This plan will set time requirements for feedback and clarify monitoring requirements for CAPI interviewers.

    Deliverables and Timeline: CAPI monitoring program proposal and implementation plan will be developed by March 2015.

Appendices

Appendix A: Audit criteria
Control Objective / Core Controls / Criteria Sub-Criteria Policy Instrument
1) Statistics Canada has appropriate governance mechanisms in support of the planning and resource allocation of Collection and Regional services.
1.1 Oversight bodies for Collection and Regional Services Branch have been established and their roles and responsibilities have been formalized. (G-3, G-4 & G-6) Clearly defined mandates have been established and communicated for the oversight bodies responsible for Collections and Regional Services.

Oversight bodies requests and receives sufficient, complete, timely and accurate information for decision-making purposes.

The oversight bodies have the appropriate authority level for effective decision making.
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
1.2 Roles, responsibilities and accountabilities for Collection and Regional Services Branch staff are clear, communicated and understood. (AC-1). Responsibilities and accountabilities for CPMD staff are formally defined and clearly communicated.

Responsibilities and accountabilities for regional collection staff are formally defined and clearly communicated.

Roles and responsibilities regarding collection activities are exercised as intended.
Statistics Act
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
Directive on Informing Survey Respondents
Directive on the Security of Sensitive Statistical Information
SSO employee Handbook -Office
SSO employee Handbook -Field
CATI Quality Control Monitoring – Monitor's Manual
CAPI Quality Control Monitoring – Monitor's Manual
COSA
1.3 Effective capacity resource planning takes place at the branch-level and is aligned with survey collection planning. (PPL-1, PPL-2, PPL-4) Capacity planning is aligned with data collection planning.

Capacity planning is documented and communicated and includes analysis of current and future resource requirements.

Changing labour market conditions are monitored and addressed on a regular basis by Regional Office Management.
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
1.4 An effective risk management framework exists to identify the key risks, including emerging risks, facing the collection activities, and adequate risk management strategies have been developed and communicated. (RM-2,3,6) Management identifies and periodically assesses the risks that may preclude the achievement of collection objectives.

Risk management strategies have been developed and communicated to the key stakeholders of Regional Collection Services.
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
Directive on Informing Survey Respondents
Directive on the Security of Sensitive Statistical Information
2) Appropriate quality assurance mechanisms have been established and are consistently applied to ensure that Collections and Regional Services Branch is gathering quality data and is compliant to the Statistics Canada Quality Guidelines.
2.1 Collections and Regional Services Branch provide employees with the necessary training to support the discharge of their responsibilities. (PPL-4) 2.1.1 CPMD staff are provided with adequate training to ensure the quality of data collection of the surveys for which they are responsible.
2.1.2 CPMD provides adequate and timely training to all interviewers assigned to a survey.
2.1.3 Regional Operations staff are provided with adequate training regarding the fundamental data collection (i.e. required for all surveys).
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors

Directive on Informing Survey Respondents
2.2 Collections and Regional Services Branch provide employees with the necessary tools to support the discharge of their responsibilities (PPL-4). 2.2.1 CPMD staff are provided with adequate tools (SOPs) to ensure the quality of data collection of the surveys for which they are responsible.

2.2.2 CPMD provides adequate and timely tools (FAQs, definitions, interview guides, etc.) to all interviewers assigned to a survey.
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
Directive on Informing Survey Respondents
Statistics Canada – Quality Guidelines
2.3 There is effective supervision over the collection of data to ensure the integrity of the collection process. (PP-3, PPL-8, PSV-5) 2.3.1 Monitoring of CATI and CAPI interviews is being conducted frequently and issues are addressed in a timely manner within Regional Offices.

2.3.2 The monitoring includes an assessment of interviewers compliance to the Directive on Informing Survey Respondents, as well as Statistics Canada principals of sound Integrity and ethical values.

2.3.3 Regional Office Management performs timely periodic reviews of the monitoring performed over collections and that ensured that issues have been communicated and addressed per established processes.

2.3.4 Feedback and information provided to CPMD by stakeholders regarding improvements in the collection of data have been formally communicated and addressed in a timely manner.
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
Directive on Informing Survey Respondents
Statistics Canada – Quality Guidelines
Directive on the Transmission of Protected Information
2.4 An effective monitoring and reporting framework exists to ensure collection objectives are met and issues are addressed in a timely manner. (PP -3, ST-20, RP-3) 2.4.1 Effective reporting exists and includes relevant quality assurance indicators such as those described in the Statistics Canada Quality Guidelines (i.e. rejection rates, coding error rates, NR rates, average interview length reports etc).

2.4.2 Issues regarding the achievement of collection results are identified, escalated to appropriate authority-levels and addressed in a timely manner.

2.4.3 The results of data collection are reported to Subject Matters in a timely and consistent manner.
TBS Audit Criteria related to the Management Accountability Framework: A Tool for Internal Auditors
Statistics Canada – Quality Guidelines
Directive on the Transmission of Protected Information
CATI Quality Control Monitoring – Monitor's Manual
CAPI Quality Control Monitoring – Monitor's Manual
Appendix B: Acronyms
Acronym Description
BACSC Business and Agriculture Collection Steering Committee
CATI Computer Assisted Telephone Interview
CAPI Computer Assisted Personal Interview
CCHS Canadian Community Health Survey
CoSD Collection Systems Division
COSA Collection and Operations Services Agreement
CPMD Collection Planning and Management Division
CRSB Collection and Regional Services Branch
CS Chief Statistician
DAC Departmental Audit Committee
EQ Electronic Questionnaire
IBSP Integrated Business Statistics Program
ICOS Integrated Collection and Operation Systems
IIA Institute of Internal Auditors
OID Operations and Integration Division
QCFS Quality Control Feedback System
RO Regional Office
SCSC Social Collection Steering Committee
SHS Survey of Household Spending
SSO Statistical Survey Operations
STC Statistics Canada
TBS Treasury Board Secretariat

Business and Community Newsletter

About the newsletter

Businesses, municipalities and community organizations have specific information needs. Statistics Canada's Outreach Program is dedicated to serving you with this free newsletter, as well as with ongoing learning and sharing activities.

Note: The Business and Community Newsletter is distributed by email. To join the mailing list, please send an email to StatCanEngage: statcan.statcanengage-statcanmobilise.statcan@statcan.gc.ca.

Help us spread the word

If you know an organization that may benefit from what this newsletter has to offer, please pass it on or put them in contact with us. Please also feel free to share it on your website or other social media platforms.

Previous newsletters

Got a question or comment?

Please contact our data ambassadors in your region:

Newsletter copyright

All rights reserved. Use of this publication is governed by the Statistics Canada Open Licence Agreement.

Stay connected

Visit the Stay connected portal on Statistics Canada website.

No endorsement of any social media products or services is expressed or implied.

Review of Statistics Canada's Governance with Shared Services Canada

November 18, 2014
Project Number: 80590-83

Executive Summary

The landscape for Information Technology (IT) has changed for Statistics Canada since 2011. The introduction of Shared Services Canada (SSC) transferred ownership of IT infrastructure and telecommunications from 43 departments and agencies, including Statistics Canada, to SSC. This change has resulted in an increased dependence on a third party for the provision of these services and has required Statistics Canada, specifically IT Branch, to work with a newly established service provider to maintain stable IT services while managing the ambitious change agenda of transformation set out by TBS and SSC. While Statistics Canada recognizes and supports the Government of Canada Modernization Agenda, there have been challenges, as SSC's mandate, priorities and timelines are not necessarily aligned with those of Statistics Canada.

With the transfer of the control over these services to SSC, there are increased risks affecting Statistics Canada's ability to meet its operational requirements, including the 2016 Census. Additionally, as an organization which collects and maintains sensitive information about individuals and businesses, the introduction of SSC has increased Statistics Canada's inherent risk in relation to the security of sensitive statistical information. With these risks in mind, the Internal Audit Division has conducted a review to identify and assess the current governance structure in place to manage and oversee the relationship between SSC and Statistics Canada.

The objectives of this engagement were to proactively examine the governance framework, risk management program and control activities in place relative to the management of the relationship between Statistics Canada and SSC, as the outsourced service provider of IT infrastructure services, and to provide recommendations for management's consideration in order to improve the current management control framework.

This review was conducted by Internal Audit Division in accordance with the Government of Canada's Policy on Internal Audit.

Key Findings

Given the inherent risks created with the introduction of SSC, a governance framework has been established by Statistics Canada to oversee the relationship with SSC, including escalation mechanisms. While this governance framework is in place and operating, it is not formally documented to ensure roles and responsibilities are understood between the two departments. Within Statistics Canada, internal governance mechanisms have been enhanced to ensure an efficient and effective approach to identifying and escalating issues.

A risk management framework has been established and is being maintained to document and proactively mitigate the risks, to the extent possible, associated with SSC's responsibilities in managing key elements of Statistics Canada's IT infrastructure and telecommunications systems.

Although governance and risk management frameworks are in place to oversee the relationship with SSC, as this relationship matures, internal processes should be reviewed and updated to include consideration of the impact(s) of the relationship with SSC on key processes.

Overall Conclusion

Statistics Canada has taken a proactive approach in working with SSC. The governance structure, although undocumented, ensures that Statistics Canada is in the best position to have its voice heard and to mitigate the risk associated with its loss of control over its IT infrastructure and telecommunications. Representatives within SSC highlighted that the engagement by Statistics Canada and their proactive approach to dialogue on issues is considered a leading practice and has been used as a case study with other partner organizations.

Conformance with Professional Standards

The review was conducted in accordance with the Internal Auditing Standards for the Government of Canada, which includes the Institute of Internal Auditors (IIA) International Standards for the Professional Practice of Internal Auditing.

Sufficient and appropriate procedures have been conducted and evidence gathered to support the accuracy of the findings and conclusions in this report. The findings and conclusions are based on a comparison of the conditions, as they existed at the time, against pre-established review criteria. The findings and conclusions are applicable to the entity examined and for the scope and time period covered by the review.

Patrice Prud'homme
Chief Audit Executive

Introduction

Background

Shared Services Canada (SSC) was created in 2011 with the mandate to fundamentally transform how the Government manages its Information Technology (IT) infrastructure. Per its mandate, SSC currently delivers email, data centre and telecommunication services to 43 federal departments and agencies, including Statistics Canada. The creation of SSC brought together people, technology resources and assets from the 43 federal departments. As of August 2011, 157 IT employees transferred from Statistics Canada to SSC in order to provide the above noted services.

SSC's Report on Plans and Priorities for 2013-14 outlines that they will continue to renew the Government of Canada's IT infrastructure focusing on the procurement of a single email solution, enhancing IT security across the Government of Canada, and finalizing its consolidation strategies for data centres and networks.

Specifically affecting Statistics Canada, SSC has initially focused on the centralization of email services, data centres and networks. With the transfer of the control over these services to SSC, there are increased risks affecting Statistics Canada's ability to meet its operational and service delivery requirements, including the 2016 Census. As SSC establishes itself to provide these services to 43 departments, Statistics Canada has faced challenges in getting attention, responsiveness and priority from SSC. Additionally, as an organization which collects and maintains sensitive, confidential information about individuals and businesses, the introduction of SSC has increased Statistics Canada's inherent risk in relation to the security of sensitive statistical information.

With these risks in mind and now that two full years have passed since the inception of SSC, Statistics Canada's Internal Audit Division conducted a review engagement to identify and assess the current governance structures in place to manage and oversee the relationship between SSC and Statistics Canada. This review is being conducted to assess the governance framework, risk management mechanisms and control activities in place within Statistics Canada, with the intent to recommend opportunities for improvement as Statistics Canada works towards the achievement of their strategic objectives with a new reality of outsourced IT infrastructure support.

Review Objectives

The objectives of this engagement were to proactively examine the governance framework, risk management program and control activities in place relative to the management of the relationship between Statistics Canada and SSC, as the outsourced service provider of IT infrastructure services, and to provide recommendations for management's consideration to improve the current management control framework.

Scope

The scope of the engagement included a review of:

  • The governance framework in place to manage the relationship with SSC;
  • The sufficiency and adequacy of the risk management program developed to mitigate the risks associated with the introduction of SSC; and
  • The appropriateness of the control activities established to ensure that Statistics Canada's needs are being met given the changes in control over Statistics Canada's IT infrastructure.

The governance, risk management and control activities relative to Statistics Canada's relationship with SSC were assessed based on evidence provided during the period from January to April 2014.

Approach and methodology

The review engagement included gaining an understanding of the key risks associated with the transfer of services to SSC and the existing governance control frameworks, risk management approaches and control activities that were designed and implemented to mitigate the identified risks associated with SSC. This was achieved through the conduct of a comprehensive review and analysis of relevant documentation, including relevant guidelines, risk management and performance reporting, organization charts, etc., and the conduct of interviews with key management and staff from IT, Census program, other stakeholders within Statistics Canada and, as required, key contacts at SSC.

This review was conducted in accordance with the Internal Auditing Standards for the Government of Canada, which includes the Institute of Internal Auditors (IIA) International Standards for the Professional Practice of Internal Auditing.

Authority

This engagement was conducted under the authority of Statistics Canada's integrated Risk-Based Audit and Evaluation Plan 2013/14 to 2017/18, approved by the Departmental Audit Committee.

Findings, Recommendations and Management Responses

Objectives: To proactively examine the governance framework, risk management program and control activities in place relative to the management of the relationship between Statistics Canada and SSC, as the outsourced service provider of IT infrastructure services and to provide recommendations in order to improve the current management control framework.

Governance Framework to Oversee the Relationship with SSC

A governance framework has been established by Statistics Canada to oversee the relationship with SSC. While this governance framework is in place and operating, it is not formally documented to ensure roles and responsibilities are understood between the two departments.

Statistics Canada's internal governance mechanisms have been enhanced to ensure an efficient and effective approach to identifying and escalating issues.

In situations where the service provider is an external entity, a robust governance framework is essential to the management of the relationship. This governance structure should be documented and have in place adequate mechanisms to communicate the organization's plans and priorities to the service provider and have an effective method for the escalation of issues to ensure operational objectives are met.

Effective oversight bodies have been established; however the governance framework between Statistics Canada and Shared Services Canada has not been formally documented

Management at Statistics Canada has recognized the need to manage the relationship with Shared Services Canada (SSC) in order to effectively work with the new organization and as a result, a formal governance framework has been established in which Statistics Canada has regular meetings with the SSC counterparts to discuss departmental priorities and requirements and proactively address concerns or issues.

Governance bodies with membership from both Statistics Canada and Shared Services Canada have been created at various levels. The current structure consists of meetings between Statistics Canada and Shared Services Canada at several levels. At the senior management level, Assistant Deputy Ministers at both departments meet regularly and the Deputy Ministers meet on an as needed basis, to discuss the risk environment and significant elements of the relationship including critical projects and administrative issues. The Director General (DG) of the Industry Portfolio at SSC and the Chief Information Officer (CIO) at Statistics Canada meet monthly to discuss ongoing projects and issues and at the director level, meetings occur weekly between the Director of Information Technology at Statistics Canada and the Director of Network and Security at SSC, and the Director of the Client Relationship unit (SSC) to discuss day-to-day operational issues.

At the working level, Statistics Canada created a liaison position to coordinate and manage interactions with SSC. An Assistant Director of Information Technology Operations Division was named as the Liaison Officer for Statistics Canada in April 2013. Within this context, he takes part in the operational level meetings between Statistics Canada and SSC and works directly with the SSC Relationship Manager to prioritize needs and resolve issues as they arise and to act as a single point of contact for the communication of needs and issues to SSC.

Additionally for large-scale projects such as the Census, project level governance structures have been established. Integrated project teams which are comprised of both Statistics Canada and SSC employees report to a joint management/steering committee about project related progress and issues. On-going concerns are also communicated to the Statistics Canada Liaison Officer to be addressed within the larger Statistics Canada/Shared Services Canada governance framework.

Statistics Canada and Shared Services Canada Governance Structure for Relationship Management
Deputy Ministers Level
  • Annual and Adhoc Meetings
  • Minutes taken
Assistant Deputy Minister /
Assistant Chief Statistian Corporate Services
  • Every 6 weeks
  • Minutes taken
Director General /
Chief information Officer (STC)
  • Monthly
  • Register of action items
Director Level
  • Weekly
  • Register of action items
Operations – STC Liaison and SSC operations
and SSC Client Relationship Manager
  • Multiply times per week
  • Discussions of emerging operational issues
Large Scale Projects – STC Liaison
Officer and Integrated Project teams
  • Regularly as required by project
  • Reports to Steering Committee

Relative to telecommunications, a separate governance process has been established. The Director of Corporate Support Services (CSSD) at Statistics Canada and the Chief of Telecommunications at Statistics Canada discuss day-to-day operational issues with the Director of Telephony at SSC. More specifically, the Director of Corporate Support Services at Statistics Canada liaises regularly (bi-weekly) with the SSC telephony team to address operational issues that arise. Should any issues require escalation; the Director of CSSD will address them at the operational meeting between SSC and Statistics Canada. If required, any additional escalation of issues would follow the same governance structure set up for IT infrastructure.

The review noted that there had been some challenges with the telecommunications governance mechanism; however, with changes in SSC representatives, this mechanism seems to be working better and Statistics Canada representatives believe that the responses they have been receiving take into consideration Statistics Canada's operating environment. In an attempt to increase the visibility of telecommunication needs and issues, the governance structure in place for IT infrastructure has been expanded to include telephony issues and the Statistics Canada Director of Corporate Support Services has been invited to the weekly operational meetings to highlight or escalate any telephony issues since January 2014.

Although governance frameworks are in place for IT and Telephony between Statistics Canada and Shared Services Canada, no formal documentation of the governance framework is in place and roles and responsibilities, escalation protocols and decision making authorities have not been formally established between the two departments. As a result, instances have occurred in which modifications to IT environment were not appropriately authorized and required subsequent intervention and resolution. In the absence of formal documentation, there is an increased risk that decisions could be made relative to SSC activities that have not been appropriately authorized and are not aligned to the priorities of the organization.

Statistics Canada's internal governance structure is used to communicate and address concerns with SSC

In order to manage the relationship with SSC and to meet the needs and expectations of SSC, Statistics Canada has enhanced its internal committee structure and escalation process to address issues with SSC. The review noted that at the senior management level that the Assistant Chief Statistician (ACS) of Corporate Services may escalate issues related to SSC to the Executive Management Board at Statistics Canada to ensure issues are addressed in a timely manner.

Other internal Statistic Canada committees that are used to help address issues and aid in the management of the relationship with SSC include:

  • Field Information Technology Managers (FITM) – Issues related to IT and SSC are identified and discussed at FITM meetings. These meetings are attended by the Statistics Canada Liaison Officer who includes items on the issues log for discussion with SSC at the regular meetings. These meetings help ensure issues identified are addressed and solutions documented.
  • Informatics Committee – This committee considers impacts of SSC changes on Statistics Canada's operations. If an infrastructure incident has occurred, an incident report is generated with recommendations; this report is escalated to the Informatics Committee or Security Coordination Committee for oversight.
  • Corporate Business Architecture (CBA) Committee – This committee is represented by most DGs within Statistics Canada and examines key transformational projects. If there are issues with SSC, they are escalated to the ACS level to ensure they are brought to the attention of SSC.

Additionally, an Infrastructure Gatekeeping Committee has been established to prioritize and approve the short-term infrastructure requests to be processed by SSC. While being overseen by the Liaison Officer at Statistics Canada, this committee does not have a formal mandate or formal delegated authority for decision making.

Internal governance committees within Statistics Canada have adapted processes to ensure issues related to the IT and telecommunications with SSC are logged, addressed and monitored.

Considerations for management:

It is management's responsibility to determine the appropriateness of control activities and to implement corrective measures if deemed necessary. Potential considerations outlined below should not be considered formal recommendations, but should facilitate discussions related to the adaptation of internal control activities that reflect new IT and telecommunications realities.

  • The governance framework between Statistics Canada and SSC should be formally documented. Over the long-term this should be formalized in an overall Memorandum of Understanding (MOU) or Service Level Agreement (SLA). In the absence of these more joint mechanisms, Statistics Canada should document the governance framework and the associated levels of authority for decision-making so that the governance, escalation and decision making authority relative to IT infrastructure and telecommunications is communicated and understood by stakeholders within Statistics Canada.

Risk Management

A risk management framework has been established and is being monitored to document and proactively mitigate the risks, associated with SSC's responsibilities in managing key elements of Statistics Canada's IT infrastructure and telecommunications systems.

An effective risk management framework includes formal risk management and institutionalized practices that enable management to assess, mitigate and monitor the internal and external risk environments.

The risk management framework in place works to proactively mitigate the risks associated with SSC as an external service supplier

Statistics Canada has recognized that there is an increased risk to the successful delivery of its programs given the responsibility and control that Shared Services Canada has over Statistics Canada's IT infrastructure and telecommunications system and the dependence the organization has on these elements. At the highest level within Statistics Canada, risks associated with the relationship with SSC have been reflected within the existing Corporate Risk Profile (2012 – 2014). These risks have been specifically reflected in Risk #2 – Loss of Reputation and Public Trust. This corporate risk highlights the heightened potential threat of breach of Statistics Canada's informatics infrastructure with the creation of SSC. High level mitigation action plans have been identified including: establishing SLAs with SSC, coordination with SSC's IT infrastructure roadmap to ensure Statistics Canada needs and priorities are reflected and monitoring of the informatics infrastructure through quality reviews, evaluations and business continuity plans.

During the course of the review, additional risk management activities were identified relative to the management of the relationship between SSC and Statistics Canada. These activities include:

  • Each program develops and maintains a risk register as part of the corporate risk planning exercise. The 2013 Informatics Branch Risk Register has highlighted SSC as a risk – specifically S10 – Interdependency – External. Specified mitigation strategies and action plans include establishing an SSC-Statistics Canada project plan to manage the government-wide change agenda (relative to IT infrastructure) and ensuring that SSC understands Statistics Canada priorities and that they have been factored into the whole of government initiatives.
  • Corporate Support Services completes a risk register as part of the risk planning exercise. Since the ownership of telephony services moved over to SSC, external risks impact the Corporate Support Services program. The 2013 risk register identifies external dependencies as medium risk. However, the only mitigation strategy specified to address risks associated with SSC is, "to put in place a software maintenance contract SLA with IT and touchpoints in SSC."
  • Project related risks involving SSC are documented and escalated as part of the overall project governance. For example, due to its size and complexity, the Census project has its own risk register; of which, the risks associated with the reliance on SSC has been identified. Another example of specific project-related risks is the Space Optimization Project– Workplace 2.0). Meeting minutes from the project team have confirmed that risks and issues (including those relative to SSC's role) are discussed and documented and escalated if required.
  • Minutes of the FITM committee meetings demonstrate that risks associated with SSC/Statistics Canada IT infrastructure are being highlighted to the Statistics Canada Liaison Officer for inclusion on the issues log for discussion with SSC and as necessary, escalation within Statistics Canada.

All ongoing operational issues and risks are expected to be communicated to the Statistics Canada Liaison Officer. This includes project-related issues unless the project has a dedicated SSC Project Manager (i.e. Census). However, if a project has been assigned a dedicated SSC Project Manager, there is a mechanism within SSC for the Relationship Manager to maintain awareness of project status and issues for discussion with Statistics Canada as part of the regular meetings, as necessary. For telecommunications, although there is a separate point of contact for discussions and issue resolution on a daily basis, should escalation be required, the issue is to be brought to the attention of the Statistics Canada Liaison Officer.

Having a single point of contact for documenting, communicating and escalating issues relative to the relationship with SSC (i.e. the Statistics Canada Liaison Officer) is a good practice and ensures that the existing governance structure and risk management approach work as intended. The Liaison Officer, in consultation with programs, determines when and if escalation of an issue is required. This ensures a consistent approach with respect to the escalation of issues.

Control Activities

Key internal businesses processes have not been reviewed and updated to include consideration of the impacts of SSC as the external service provider.

In a sound internal control environment, control activities should be integrated into business practices to manage risks associated with the services delivered by external parties to ensure the organization can meet its strategic and operational objectives.

Some Key internal processes have not been adapted to take into consideration the introduction of an external service provider

With the introduction of SSC and its responsibility for the IT infrastructure and telecommunications systems in place within Statistics Canada, internal business processes have been impacted and require updating to include the need to address SSC processes and priorities. The review identified the following processes that should be considered for revision to ensure the organization takes into consideration the responsibilities and authorities transferred to SSC:

Long-Term Planning:

The Integrated Strategic Planning Process (ISPP) is an annual six step process that begins with a review of the strategic planning priorities and concludes with the allocation of resources for approved projects. Typically, projects that result from this process are transformative in nature and include an IT component. Within this IT component, an IT infrastructure or telecommunications impact is likely (i.e. server capacity) and therefore, these projects require the involvement of SSC.

The ISPP does not currently incorporate a mechanism to share the long-term plan and investment decisions with SSC for consideration of impact, alignment with Government of Canada (GoC) priorities and the consideration of realistic time horizons given GoC initiatives/Other Government Departments (OGD) initiatives and limited resources within SSC. Although Statistics Canada management noted that they have provided SSC senior managers with Statistics Canada's Integrated Plan, SSC CRM representatives stated that they do not have timely insight into Statistics Canada's long-term plan, which limits SSC's ability to consider Statistics Canada's requirements in the SSC long-term planning process. This elevates the risk that Statistics Canada's investment plans, resource allocation decisions and established timeframes for projects requiring IT infrastructure will not be aligned with SSC plans and priorities, which could potentially impact the ability for SSC to support the initiative or meet the project timelines.

Project Management:

The departmental guidance for project management is the Departmental Project Management Framework (DPMF) which is a set of standard project management processes, templates and tools to be used throughout a project's life cycle to initiate, plan, execute, control and close a project. All projects valued at over $150,000 are expected to follow the DPMF. Similar to the ISPP, the majority of projects that follow this process have an IT component and involve an IT infrastructure or telecommunications element.

Currently, based on discussions with SSC's CRM representatives, this framework does not incorporate or take into consideration the gating process in place within SSC. Specifically, in order for SSC to support a project (assuming there is an IT infrastructure or telecommunications component), information should be provided as early as possible to SSC so they can submit it to the SSC Project Execution Committee for approval.

Although continuing to mature and subject to change, SSC has developed templates for use by their customer departments to communicate their needs. Historically, when Statistics Canada had control over its own IT infrastructure, the organization could define the IT infrastructure solution. However, SSC expects clients to only submit their business requirements and SSC will determine the optimal solution. This change in process impacted the Census program, whose representatives provided SSC with IT documentation based on what they used for the previous Census. SSC would not accept this and requested they complete their business requirements (consistent with other requests) and that SSC would determine the solution, creating delays in the process.

Without aligning the existing project management/gating process (including tools and templates) within Statistics Canada to the SSC gating process, delays may be experienced and projects put on hold while SSC puts the IT component of projects through its own approval process.

Short-Term Infrastructure Needs Assessment:

Consistent with the communication of Statistics Canada's long-term planning needs to SSC, timely communication of short-term, operational infrastructure needs has been requested by SSC. As a result, within the operational management of the relationship with SSC, process changes have been made to ensure consistent, timely short-term (one-year) operational requirements are being communicated to SSC. For fiscal 2014/15, the Liaison Officer within Statistics Canada initiated a process where he requested that upcoming year operational requirements be identified and documented by all IT Field Managers in a standard template. This template was then consolidated and reviewed for any duplication. This final document is being shared with SSC for information and planning purposes. This change in process and provision of short-term infrastructure requirements was noted as a leading practice by SSC.

In addition to communication of short-term needs, the process to request in-year infrastructure (not previously approved by SSC) has also been modified. All current requests for infrastructure are initiated through the Statistics Canada Portal (service request system). Once the service request is identified as an infrastructure need, it is automatically forwarded to the Statistics Canada Liaison Officer. These requests are consolidated and prioritized by the newly established Gatekeeping Committee. Once prioritized, the Liaison Officer provides the listing to SSC for action. The current arrangement with SSC is that a service request is closed before a new one is opened. However, if the request is of a critical nature, it will be forwarded to the Liaison Officer who will release if for immediate action by SSC. This change in process for fiscal 2014/15 is supporting SSC's ability to efficiently plan and coordinate infrastructure needs of their partner departments over the short-term.

Incident Management/Change Management:

In spring 2014, Statistics Canada began the implementation of an information technology incident management framework for issues relating to SSC. This framework builds upon the 2011 framework and now addresses the role that SSC plays in Information technology. The framework is intended to standardize the prioritization and escalation of IT incidents within the organization in order to restore normal service operation as quickly as possible and to minimize the impact on business operations of Statistics Canada's mission critical programs and key service areas. This framework does not include desk-top related issues or existing application and systems maintenance. The framework outlines the roles and responsibilities for the Incident Coordinator Team whose membership consists of representatives from both the program areas as well as IT staff who develop action plans to address incidents. The Director of ITOD is responsible for ensuring timely follow-up on recommendations.

With respect to IT application change management, Statistics Canada uses the Jira change, issue and risk tracking tool to manage IT application changes. However, it was noted during interviews that program areas have created their own processes to determine how and when this tool is used, or when IT personnel should be consulted. For infrastructure changes, SSC has implemented a Change Advisory Board and STC program representatives have been invited to attend, although it was noted that it was unclear if Statistics Canada has a role in the decision making or is there for information purposes only.

Given the creation of SSC as a single point of contact for all infrastructure needs and the decentralized nature of Statistics Canada, without standardized IT change management processes aligned to SSC's needs/processes, there is an increased risk that infrastructure decisions will be made and actioned without the appropriate authority and assessment of impact on the organization prior to implementation.

Additionally, the review noted that for telecommunications, all service requests and telecommunications issues are being forwarded to SSC. Interviews noted that it is not clear what responsibilities remain within Statistics Canada for telecommunications. As a result, it is unclear which requests should be actioned by Statistics Canada representatives (i.e. password resets for voicemail and cell phones) and those that require escalation to SSC.

Opportunities to Enhance Service

Given that the introduction of SSC has required Statistics Canada to work with a new service provider, one element of a successful relationship is continuous improvement. This can be achieved in different ways including active engagement with the service provider as well as sharing practices and experiences internally.

Recognizing that SSC has been assigned a significant GoC mandate for transformation and that Shared Services Canada supports 43 departments, the CIO at Statistics Canada has been proactive in volunteering to participate in CIO Committees and GoC initiative working groups (i.e. network transformation, evaluation of e-mail technology) to ensure Statistics Canada's voice is heard at the table. As participant, the CIO is kept up to date on decisions made on these initiatives and is able to identify potential impacts on Statistics Canada.

Although the governance structure within Statistics Canada has multiple touch points with SSC representatives on an ongoing basis, opportunities exist to enhance the current governance structures by periodically soliciting from within Statistics Canada and at SSC lessons learned or best practices for managing the relationship with SSC to ensure that approaches and techniques that are working well are known to areas.

Considerations for management:

It is management's responsibility to determine the appropriateness of control activities and to implement corrective measures if deemed necessary. Potential considerations outlined below should not be considered formal recommendations, but should facilitate discussions related to the adaptation of internal control activities that reflect new IT and telecommunications realities.

  • The current long-term planning process is reviewed to incorporate the consideration of the impact of proposed projects / priorities on SSC through the communication and engagement of SSC in the process in order to confirm that the priorities and time horizons are aligned to SSC's expectations and capacity.
  • Statistics Canada's DPMF is reviewed and revised to align the existing gating process with SSC's gating process – when the project has an IT infrastructure component. This would include the early identification of an IT infrastructure component so that SSC can be engaged as early as possible and can initiate its own gating process, minimizing delays to Statistics Canada projects. Further, the project management guidance should be reviewed to ensure that information needs/format of SSC requirements are reflected (i.e. template, level of detail) to avoid inefficiencies and time delays.
  • Formal Agency-wide IT change management processes (including assignment of roles and responsibilities between SSC and Statistics Canada) are defined and implemented which align with the processes and definitions in place within SSC.
  • The existing governance framework incorporates a formal process to periodically solicit lessons learned/best practices from within Statistics Canada and SSC for purposes of collaborating and sharing this information to encourage continuous improvement of the relationship.

Appendices

Appendix A: Review Objectives
Control Objective / Core Controls / Criteria Sub-Criteria
1) Proactively examine the governance framework, risk management program and control activities in place relative to the management of the relationship between Statistics Canada and SSC, as the outsourced service provider of IT infrastructure services and to provide recommendations in order to improve the current management control framework.
1.1 Effective oversight bodies are established. (G-1) A formal governance framework is in place to manage the relationship with SSC.

The formal governance framework is appropriate given Statistics Canada's mandate and the role of SSC.

The governance framework is communicated and understood by all stakeholders within Statistics Canada.

Evidence is in place to demonstrate use of the existing governance framework.
1.2 Management identifies the risks that may preclude the achievement of its objectives. (RM-2) A risk management framework has been established and is being maintained to document and proactively mitigate the risks associated with SSC managing key elements of Statistics Canada's IT infrastructure.
1.3 Management identifies and assesses the existing controls that are in place to manage its risks. (RM-3)

1.4 The organization leverages, where appropriate, collaborative opportunities to enhance service. (CFS-3)
Key processes and approaches are being tailored and revised to allow Statistics Canada to continue to achieve its mandate while being reliant on SSC to provide key IT infrastructure services.
Appendix B: Acronyms
Acronym Description
ACS Assistant Chief Statistician
ADM Assistant Deputy Minister
CBA Corporate Business Architecture
CFO Chief Financial Officer
CIO Chief Information Officer
CS Chief Statistician
DAC Departmental Audit Committee
DG Director General
DM Deputy Minister
DPMF Departmental Project Management Framework
FITM Field Information Technology Managers
GoC Government of Canada
IIA Institute of Internal Auditors
IPT Integrated Project Teams
ISPP Integrated Strategic Planning Process
IT Information Technology
MOU Memorandum of Understanding
OGD Other Government Department
SLA Service Level Agreement
SSC Shared Services Canada
Statistics Canada Statistics Canada

Audit of Research Data Centre Dalhousie University

November 18, 2014
Project Number: 80590-86

Executive Summary

The Research Data Centre (RDC) at Dalhousie University is one of 27 RDCs operating across Canada. These RDCs were established through the efforts of Statistics Canada, Social Sciences and Humanities Research Council, Canadian Institutes of Health Research, Canadian Foundation for Innovation and university consortia, to strengthen Canada's social research capacity and support the policy research community. The Dalhousie RDC facility was first opened in 2001.

The mandate of RDCs is to promote and facilitate social science research using Statistics Canada's confidential microdata, while protecting the confidentiality of data through effective operational and analytical policies and procedures that create a culture of confidentiality.

The RDCs are staffed by Statistics Canada employees and are operated under the provisions of the Statistics Act in accordance with all confidentiality rules, and are accessible only to researchers with approved research projects who have been sworn in under the Statistics Act. Day-to-day monitoring of the environment and physical security within the RDC is the responsibility of RDC analysts. RDC analysts administer the operation of the RDCs and ensure that the activities are consistent with Statistics Canada's mandate.

The objectives of this audit are to provide the Chief Statistician (CS) and the Departmental Audit Committee (DAC) with assurance that the RDC at Dalhousie University

  • has effective practices and mechanisms in place to ensure that the confidentiality of data is protected in the delivery of services; and
  • complies with applicable Treasury Board Secretariat (TBS) and Statistics Canada policies and standards regarding Information Technology (IT) and physical security, to ensure that confidentiality of data is protected in the delivery of services.

The audit was conducted by Internal Audit Division (IA) in accordance with the Government of Canada's Policy on Internal Audit.

Key findings

The administration of research contracts is supported by roles and responsibilities that are well defined and communicated both at the program level and within the RDC. Communiqués are an effective means to inform staff in the regions of changes in policies and procedures.

Staff at the Dalhousie RDC follows procedures to ensure that researchers become deemed employees prior to being approved for research contracts. There are complete records supporting contract management on file at headquarters, but there are opportunities to improve procedures for contract management to ensure that acknowledgements of the Values and Ethics Code are signed by all researchers and are on file.

There are regular discussions on risks between the regional manager, the RDC analyst and MAD management, and they are considered within the context of the annual risk register exercise. Integration of RDC program risk information by CSSD into a risk based inspection approach would improve and optimize inspection activities.

Processes and procedures for confidentiality vetting are in place and are effective in protecting the confidentiality of the data. The analyst also maintains an audit trail of all vetted documents which cannot be modified by researchers; this has been deemed a good practice.

Roles, responsibilities and accountabilities for Dalhousie IT support staff are outlined in service level agreements, and are aligned to government policies for IT and the Statistics Act. IT general controls, including access, identification and authentication safeguards were embedded in systems and software configurations and were operating as intended at the Dalhousie RDC.

Staff at the Dalhousie RDC is employing an effective practice by using a reliable USB key strictly dedicated for transferring electronic files to the server. Currently, there are no documented procedures or protocols in place to mitigate security threats associated with the use of external USB keys for the RDC program. All RDCs could benefit from this practice and further protect the data stored on the closed network.

Physical security measures in place within the Dalhousie University RDC comply with applicable TBS policies and Statistics Canada's Security Practices Manual. Key controls such as a secure perimeter with intrusion detection and restricted access to the centre are in place and effective to ensure the security of the information held in the facility.

Overall conclusion

The RDC at Dalhousie University is well managed and has effective practices and mechanisms in place to ensure that the confidentiality of data is protected in the delivery of services. There are opportunities for improvement in areas of acknowledgments for values and ethics, and by formalizing risk management and integrating the results into the RDC inspection strategy.

The RDC's physical and IT environments comply with TBS, as well as Statistics Canada policies and standards, and are effective in protecting the confidentiality of data in the delivery of services.

Conformance with professional standards

The audit was conducted in accordance with the Internal Auditing Standards for the Government of Canada, which includes the Institute of Internal Auditors (IIA) International Standards for the Professional Practice of Internal Auditing.

Sufficient and appropriate audit procedures have been conducted and evidence gathered to support the accuracy of the findings and conclusions in this report and to provide an audit level of assurance. The findings and conclusions are based on a comparison of the conditions, as they existed at the time, against pre-established audit criteria. The findings and conclusions are applicable to the entity examined and for the scope and time period covered by the audit.

Patrice Prud'homme
Chief Audit Executive

Introduction

Background

The Research Data Centres (RDCs) are part of an initiative by Statistics Canada, the Social Sciences and Humanities Research Council (SSHRC), Canadian Institutes of Health Research (CIHR), Canadian Foundation for Innovation and university consortia to strengthen Canada's social research capacity and to support the policy research community. The SSHRC is a federal agency that promotes and supports university-based research and training in the social sciences and humanities disciplines. CIHR is the major federal agency responsible for funding health research in Canada.

The Microdata Access Division (MAD) provides restricted access to confidential microdata through RDCs at universities across the country and the federal RDC in Ottawa. MAD is responsible for ensuring the confidentiality of information provided by Canadians. Currently, there are 27 RDCs: 26 are located in a secure setting on university campuses, and one is located within a research institute. These RDCs provide researchers with access to microdata from population and household surveys, meaning that researchers do not need to travel to Ottawa to access Statistics Canada microdata. In addition to centres located on campuses, the Federal Research Data Centre (FRDC) in Ottawa provides microdata access to researchers from federal policy departments. For the RDC program as a whole, functional authority is formally delegated to the manager/director of the RDC Program. At the regional level, functional authority resides with the RDC regional manager.

The mandate of RDCs is to promote and facilitate social science research using Statistics Canada's confidential microdata, while protecting the confidentiality of data through effective operational and analytical policies and procedures that create a culture of confidentiality. The RDCs are staffed by Statistics Canada employees and are operated under the provisions of the Statistics Act in accordance with all confidentiality rules and are accessible only to researchers with approved research projects, who have been sworn in under the Statistics Act. Day-to-day monitoring of the environment and physical security within the RDC is the responsibility of RDC analysts. RDC analysts administer the operation of the RDCs and ensure that the activities are consistent with Statistics Canada's mandate.

The Statistics Canada Risk-Based Audit and Evaluation Plan requires that the Internal Audit Division completes an audit of one RDC per year. Over the past three years, the RDCs located in the following universities were audited: University of Calgary and University of Lethbridge (2011); University of Alberta (2012); and McMaster University (2013).

Audit objectives

The objectives of the audit were to provide the Chief Statistician (CS) and the Departmental Audit Committee (DAC) with assurance that the RDC at Dalhousie University

  • has effective practices and mechanisms in place to ensure that the confidentiality of data is protected in the delivery of services; and
  • complies with applicable Treasury Board Secretariat (TBS) and Statistics Canada (StatCan) policies and standards regarding Information Technology (IT) and Physical Security, to ensure that confidentiality of data is protected in the delivery of services.

Scope

The scope of this audit included a detailed examination of the systems and practices of the RDC at Dalhousie University for the protection of data, the use of technology and the physical security.

The audit focused on the confidentiality vetting of data output by the on-site Statistics Canada employees; deemed employee status and security clearance requirements for access to microdata; research proposal process for RDC; microdata research contracts; physical security of the RDC site in compliance with applicable TBS and Statistics Canada policies and standards and IT protection in compliance with applicable TBS and Statistics Canada policies and standards.

Approach and methodology

The audit work consisted of an examination of documents, interviews with key program management, and personnel within the Microdata Access Division (MAD), Information Technology Operations Division (ITOD) and Dalhousie University, as well as a review for compliance with relevant policies and guidelines.

The field work included a review, assessment, and testing of the processes and procedures in place to ensure physical security, use of technology and the protection of data at Dalhousie University. A sample of microdata research contracts (completed, in progress, and microdata research contracts in evaluation) was examined to ensure coverage of contract types, data sources, multiple contract holders and research purpose. A combination of judgemental and systematic samples, totaling 43 out of 89 contracts having a start date between 2010 and 2014, was selected for testing, representing nearly 50% of recent microdata research contracts for this RDC.

This audit was conducted in accordance with the Internal Auditing Standards for the Government of Canada, which includes the Institute of Internal Auditors (IIA) International Professional Practices Framework.

Authority

The audit was conducted under the authority of Statistics Canada's Integrated Risk-Based Audit and Evaluation Plan for 2014/15 to 2018/19.

Findings, Recommendations and Management Responses

Objective 1: The Dalhousie University RDC has effective practices and mechanisms in place to ensure that the confidentiality of data is protected in the delivery of services.

Administration of microdata research contracts

The administration of research contracts is supported by roles and responsibilities that are well defined and communicated both at the program level and within the RDC. Communiqués are an effective means to inform staff in the regions of changes in policies and procedures.

Staff at the Dalhousie RDC follows procedures to ensure that researchers become deemed employees prior to being approved for research contracts. There are complete records supporting contract management on file at headquarters, but there are opportunities to improve procedures for contract management to ensure that acknowledgements of the Values and Ethics Code are signed by all researchers and are on file.

There are regular discussions on risks between the regional manager, the RDC analyst and MAD management, and they are considered within the context of the annual risk register exercise. Integration of RDC program risk information by CSSD into a risk based inspection approach would improve and optimize inspection activities.

Processes and procedures for confidentiality vetting are in place and are effective in protecting the confidentiality of the data. The analyst also maintains an audit trail of all vetted documents which cannot be modified by researchers; this has been deemed a good practice.

Effective management of research contracts is key to ensuring that only approved data are used by the authorized individuals and for purposes that are in line with program objectives. Program and RDC staff have a shared responsibility in ensuring that researchers become deemed employees with valid security clearance. As RDCs are located within university campuses, a collaborative approach to contract management, ongoing communication and risk management are required to protect the confidentiality of data.

Roles and responsibilities

Roles, responsibilities and accountabilities should be clearly defined and communicated. Effective means of communication are also necessary to ensure that staff is up to date on current policies, practices and procedures.

The roles and responsibilities for the management of the Microdata Research Contracts (MRCs), access to confidential microdata and confidentiality vetting are defined and communicated to stakeholders in policies, guidelines, standards and detailed guides. At the program level, authority is formally delegated to the RDC manager in Statistics Canada's Security Practices Manual,which states that the RDC manager:

"is responsible for establishing and maintaining an inventory of administrative information on research projects involving deemed employees for headquarters, the regional offices and the research data centres. Information includes research proposals and other information throughout the life-cycle of the project and certification that required procedures have been followed."

Additionally, the Policy on the Security of Sensitive Statistical Information assigns to Directors,

"the responsibility for controlling and protecting all sensitive statistical information obtained or held by their respective areas in the pursuit of their program objectives. When access to sensitive statistical information is provided in a Research Data Centre or equivalent, the Manager, Research Data Centre Program, assumes these responsibilities."

At the Dalhousie RDC, there is one full-time RDC analyst and two part-time statistical assistants. The RDC analyst reports to the regional manager, and the statistical assistants report to the full-time RDC analyst. The regional manager responsible for the Dalhousie RDC is located at the University of Guelph.

Information from RDC contracts is compiled by the Head Office Operations Unit (HOOU) in the Client Relationship Management System (CRMS) central database. Information entered in the system includes contract status, approval dates, names of researchers, reviewers and review outcomes, contract end dates and data approved for access. Staff working in RDCs cannot access this system and do not use its outputs within the context of their daily operations; however, they do received periodic reports generated from the CRMS and are asked to validate the information with their records. Information drawn from the CRMS is used by headquarters to manage the final stages of project completion, to follow up on security clearance renewal, and to monitor program growth and data usage. Information on the number of deemed employees and the use of datasets is also compiled and reported to Subject Matter Divisions (SMD). The audit team tested the accuracy of the information entered in CRMS on a sample of contracts. Test results revealed a small number of immaterial data-entry errors in CRMS, which did not impact the RDC's operations.

Communiqués are posted on the RDC extranet and provide information on new policies, processes, procedures and best practices to RDC staff. During interviews, it was established that staff at the Dalhousie RDC knew where to find these communiqués and were also able to provide examples of recent messages communicated through this means.

The administration of research contracts is supported by roles and responsibilities that are well defined and communicated both at the program level and within the RDC. Communiqués are an effective means to inform staff in the regions of changes in policies and procedures.

Deemed employees

A key management control relied upon to ensure the confidentiality of information within RDCs is the deemed employee status which all researchers must obtain prior to accessing the RDC. In addition to having an approved project, each researcher must undergo a security screening and be sworn in under the Statistics Act.

As per the Policy on the Use of Deemed Employees revised in August 2007, researchers wishing to access the RDC are required to become deemed employees and undergo a reliability security screening pursuant to sub-sections 5(2) and 5(3) of the Statistics Act, and take an oath or affirmation of office and secrecy, pursuant to sub-section 6(1) of the Statistics Act. They must also sign an acknowledgment that they have read and understood theStatistics Canada Values and Ethics Code for the Public Service. These actions are to be completed prior to the MRC being signed by Statistics Canada. Once a researcher has successfully completed these requirements and attended an orientation session, they are officially a deemed employee of Statistics Canada.

Testing was conducted to ensure that all required documentation was in place and valid for 31 researchers associated with 15 sampled contracts. Results revealed that valid security clearances and oaths of office and secrecy had been signed by all researchers. Additionally, tests were conducted to ensure that researcher acknowledgements of the Values and Ethics Code for the Public Service were on file. Results revealed that of the 31 researchers associated with the sampled contracts, 24 had signed this acknowledgement and copies were on file. For the other seven researchers, there were no signed copies of the acknowledgements on file, nor were they subsequently found. According to program management, researchers were allowed to submit their acknowledgements of the Values and Ethics Code after the research contracts were approved. Signed Values and Ethics forms attest to the fact that researchers have read and agreed to the terms and conditions set out by the RDC program. In order to ensure that Values and Ethics acknowledgment forms are on file, the RDC program has recently adopted a new approach where forms are required as part of the proposal package sent to headquarters for evaluation. This practice is expected to ensure that acknowledgements of the Values and Ethics Code are signed by all researchers and are on file.

Staff at the Dalhousie RDC follows procedures to ensure that researchers become deemed employees prior to being approved for research contracts. There are complete records supporting contract management on file at headquarters, but there are opportunities to improve procedures for contract management to ensure that acknowledgements of the Values and Ethics Code are signed by all researchers and are on file.

Contract management

MRCs are signed either by the Director of MAD or a delegated manager within the RDC program once project proposals have been evaluated and approved by the program. The audit tested compliance of the contract processing procedures by reviewing a sample of 31 active and completed contracts associated with the Dalhousie RDC. All proposals, project descriptions or course syllabuses and signed MCRs were found to be on file at headquarters. The audit also determined that contracts were signed by the appropriate authority at Statistics Canada. According to procedures established for the RDC Program, a new contract cannot be approved until all deliverables for other contracts are completed. Researchers have 12 months after the contract expiry date to complete and remit end products (publication or results). Contracts for which the end product has not been remitted become delinquent in the CRMS. MAD has implemented a checklist which is completed by the RDC program staff prior to approval of all new contracts; this control includes verification that all deliverables for previous contracts have been submitted prior to approval of the contract.

File documentation supporting MRCs was found to be complete. Contracts were signed by the appropriate authority and there are mechanisms in place to ensure that new contracts are signed only for researchers with projects in good standing.

Risk management

Risk management practices involving both program management and RDC staff in the regions are essential to identify, assess and respond to risks that may preclude the achievement of RDC program objectives.

Interviews with program management and RDC staff revealed that regular discussions on risks are held between the regional manager, the RDC analyst and MAD, and they are considered within the context of the annual risk register exercise.

IT and Physical Security Inspection Report are also used as a means to identify and mitigate risks that are specific to individual RDCs. Inspections are led by CSSD with the help of ITOD staff. Two physical security inspections and two IT security inspections have been conducted for the Dalhousie University RDC, once prior to opening the centre in 2001 and again in 2011. The strategy used to establish the calendar of security inspections for RDCs is currently established by CSSD. The current approach neither considers nor integrates risks identified by the RDC program, such as changes to the IT environment. MAD management has stated that the current approach to security inspections for RDCs could be improved and optimized by integrating risk information obtained from the RDC program and adopting a risk-based approach to RDC inspections, which the RDC program itself would be better positioned to determine.

There are regular discussions on risks between the regional manager, the RDC analyst and MAD management, and they are considered within the context of the annual risk register exercise. Integration of RDC program risk information into a risk based inspection approach would improve and optimize inspection activities.

Confidentiality vetting

RDCs are repositories of Statistics Canada microdata files that are accessible to researchers with approved projects. Effective and appropriate processes and procedures for confidentiality vetting should be in place and adhered to in order to significantly reduce the risk of unwanted disclosure.

Confidentiality vetting is the process of screening research outputs, syntax or any confidential data-related material to assess the risk of a prohibited disclosure. This is done by analysing whether obvious identification of individual cases or information about individual cases can be inferred or deduced from the statistical output. The RDC analyst's primary responsibility with respect to confidentiality vetting is to ensure confidentiality is not breached when allowing research outputs to leave the RDC. The analyst should review all materials that the researcher would like to remove from the RDC and the final responsibility and decision to release the output rests with the analyst. Confidentiality vetting is conducted using the survey-specific guidelines for all surveys housed in the RDCs. Questions or concerns related to the vetting process or to unfamiliar statistical techniques are addressed by the RDC regional manager or with the RDC Vetting Committee.

During the orientation session, researchers receive training on the confidentiality vetting process and the required documentation for vetting requests. This documentation includes descriptions of variables, weighted and non-weighted counts, syntax and completion of the disclosure request form for every output request. A detailed draft document entitled, Disclosure Control Rules for Outputs from Survey Data at RDCs provides instructions on how to conduct and perform confidentiality vetting. Guidelines on disclosure risk analysis for various data types and descriptive or tabular output and variance-covariance and correlation matrices, graphs, and models are included.

Confidentiality vetting guidelines and processes are found in the Researcher Guide. An important part of the process is for researchers to complete the Vetting Request Form, which provides the required information for the analyst to conduct and document the vetting request. Information required from the researcher includes:

  • the name of the output file, survey and cycles used
  • characteristics of the population being analyzed
  • the statistical procedure and weights used
  • a description of the variables
  • weighted and unweighted outputs.

Once the vetting is complete, output deemed non-confidential is released to the researcher.

At the Dalhousie RDC, all confidentiality vetting is completed by the full-time RDC analyst. This same analyst has been working with the RDC program for several years and understands Statistics Canada data and the confidentiality requirements. This analyst also has active MRCs; to ensure segregation of duties, the confidentiality vetting for her outputs are completed at headquarters.

Using judgemental sampling (to ensure the inclusion of a variety of data sets, researchers and contract types); 14 completed, active, delinquent and withdrawn contracts were selected to verify that confidentiality vetting takes place at Dalhousie and that the method used is appropriate. Results showed that for all contracts, confidentiality vetting forms were completed and that the method used for each survey was in accordance with the established process. The required supporting documentation for previously vetting material, variables used, definitions of derived variables, as well as weighted and unweighted counts were provided. Evidence was in place that the analyst used the appropriate vetting techniques and effectively applied vetting procedures.

Additionally, the analyst has implemented a procedure to ensure that the finalized vetted material was under the analyst's control. This control helps ensure, should vetting have to be recreated or more vetting is to be done, the analyst has a record that cannot be modified by a researcher.

Processes and procedures for confidentiality vetting are in place and are effective in protecting the confidentiality of the data. The analyst also maintains an audit trail of all vetted documents which cannot be modified by researchers; this has been deemed a good practice.

Recommendations

It is recommended that the Assistant Chief Statistician of Social, Health and Labour Statistics should ensure that:

  • procedures for contract management are strengthened to ensure that acknowledgements of the Values and Ethics Code are signed by all researchers and are on file;
  • discussions on risks between the regional manager, the RDC analyst and MAD management are used to inform and determine the physical and IT inspections strategy.

Management response:

Management agrees with the recommendations.

  • The contracts that were missing the signed Value and Ethics forms were mainly dating from contracts signed between 2009 and 2012. A number of improvements in the contract processing system, including the acknowledgements of the Values and Ethics Code component, have been made since 2012. These have strengthened the process to ensure that all the necessary documents are completed and stored on file/integrated with the research contracts. The following three improvements were made in the past year to address the deficiency that had been identified internally prior to the audit, and will continue to be put in place to address this situation:
    • Introduced procedures when sending documents to Head Office -outlined in communiqué 2013-05. Contracts will not be processed by Head Office unless all documentation is received (since October 2013).
    • Introduced the use of a checklist when the Microdata Research Contract (MRC) is signed by the Director or designate. The checklist indicates that the Head Office staff have received and processed all documents. This checklist must be completed before an MRC is signed (since December 2013).
    • Implemented a new MRC to integrate the Network Use Form and Values and Ethics Code into the contract (since July 2014).
  • The Director of MAD will work with IT and physical security to develop a more integrated schedule for the RDCs taking into account risk management and mitigation strategies for the RDC program. Focus will be placed on IT inspections to be conducted in each of the research data centres that are connected to the Wide Area Network over the next 2 years with a view to ensuring that new and upgraded equipment and configurations meet TBS security requirements. While no on site physical inspections will be done unless a new centre is built or a centre has been renovated, physical Security inspectors will meet with RDC Analysts by phone to confirm that no changes have occurred at their centre since the last inspection. MAD management will continue to meet with IT and physical security several times per year and will review the schedule and inspection strategy with the Security Coordinating Committee as required.

    Deliverables and Timeline: A revised strategy for IT and physical security inspections, and an integrated risk-based schedule will be developed between January 2015 and September 2016.

Objective 2: The RDC at Dalhousie University complies with applicable TBS and Statistics Canada policies and standards' regarding Information Technology Security and Physical Security to ensure that confidentiality of data is protected in the delivery of services.

Information technology security

Roles, responsibilities and accountabilities for Dalhousie IT support staff are outlined in service level agreements, and are aligned to government policies for IT and the Statistics Act. IT general controls, including access, identification and authentication safeguards were embedded in systems and software configurations and were operating as intended at the Dalhousie RDC.

Staff at the Dalhousie RDC is employing an effective practice by using a reliable USB key strictly dedicated for transferring electronic files to the server. Currently, there are no documented procedures or protocols in place to mitigate security threats associated with the use of external USB keys for the RDC program. All RDCs could benefit from this practice and further protect the data stored on the closed network.

Information technology security in RDCs should be compliant with applicable TBS policies, such as the Operational Security Standards, Management of IT Security and Statistics Canada's Security Practices Manual. Roles, responsibilities, and accountabilities should be clearly defined and communicated. In the context of RDCs, IT security should include controls for the protection of the information system; communications with and within the information system; access controls that ensure the ability to permit or deny user access to the systems; and identification and authentication controls that allow unique identification and authentication of each user.

Roles and responsibilities

Within Statistics Canada the Information Technology Operations Division (ITOD) provides guidance and directives on IT security requirements for the RDC program.

At the Dalhousie RDC, IT services are provided locally by university IT staff members. These staff members respond to the RDC analyst's requests as required and ensure that workstation computers, the RDC server and other IT equipment are configured to adhere to Statistics Canada directives and policies.

Roles, responsibilities and accountabilities for Dalhousie IT support staff are outlined in service level agreements, and are aligned to government policies for IT and the Statistics Act.

IT systems safeguards and software configurations

In 2013, all computer systems and hardware at the Dalhousie RDC were replaced and the IT environment was configured to join the headquarters domain. As a result of this change, user accounts are now being created by the HOOU, and only the perimeters of access are controlled locally at the RDC. The server at the Dalhousie RDC has recently been updated and is a stand-alone setup with open directories, using the BASIS Proxcard-II Access System to grant permissions. Apart from the wide-area network (WAN), the server has no external connection. As a result, remote access to the server outside of the RDC is not possible.

During the on-site visit there were nine functional stand-alone workstations available for use by the researchers. These were new computer systems acquired in the last year, all identically configured, with the same hardware and software. The audit team selected a number of key computer safeguards which were tested to ensure they were functioning as intended. Results of the audit team's inspection were as follows:

  • Computers in the research lab are not connected to the Internet (Internet access is only available to RDC employees in the RDC analysts' offices), and data and researcher folders are stored on the server.
  • Software is installed on each workstation by Dalhousie's IT support and each workstation has a Deepfreeze application which ensures no residual data remains on the computer upon log out. The audit team tested the Deepfreeze and confirmed it to be effective; documents appeared in a local temporary folder, and were erased when the user logged back in.
  • The McAfee anti-virus is the prescribed software to be used and was operational on all computers. For all computers linked to the closed network, regular updates are processed by headquarters every week via the WAN. For the computer having Internet access in the RDC analyst's office, the anti-virus application is updated daily via Internet.
  • Password configuration and validation have been set to standards that are in accordance with Statistics Canada's IT requirements.
  • The server and back-up drives are locked in a cabinet housed inside the RDC secured area, for which only the analyst has the keys; this complies with the program's security requirements.
  • Printouts of researchers' work can only be produced from a network printer which is located in the RDC analyst's office.
  • USB ports available on computers in the research lab are programmed to detect and reject all devices which have storage capacity and/or communication media. The audit team connected a cell phone and USB key to a sample of three out of the nine functional lab computers, all devices were rejected by the system.

In all cases, IT general controls were embedded in systems and software configurations and were operating as intended.

Access, identification and authentication safeguards

Procedures specify that user accounts should be created only when a contract is approved and becomes active. Access should be removed upon the expiry date of the MRC and password configuration should meet Statistics Canada standards.

The RDC analyst is responsible for configuring accounts to ensure that only data approved in the final contract are accessible for the duration of the project and has administrative privileges to access the system. The statistical assistants do not have administrative privileges. Individual userIDs are created for each researcher and for each contract. When researchers are associated with more than one research project, a separate userID is created corresponding to each project. This way, access user accounts are set to reflect the contract start and end dates and the security clearance expiry date. This also prevents researchers from moving files between projects. Password configuration for access user accounts is set in accordance with Statistics Canada standards.

Although not Statistics Canada employees, the Dalhousie IT support staff are deemed employees. They ensure that systems within the RDC are configured to StatCan requirements and have administrative privileges for IT systems only. This access allows them to modify computer system configurations, such as downloading software, installing printers or other devices locally. IT staff at Dalhousie also use administrative privileges to service IT problems, workstation issues and all server related requirements. They do not have administrative privileges to modify access perimeters for individual userID accounts created for researchers.

The audit team tested a sample of 43 out of 89 contracts having a start date in 2010 to 2014, and compared the data sets noted in the MRC to the information recorded in CRMS and data sets included in the IT system parameters for selected users. Results showed that the list of data sets entered in the system for access privileges agreed with the list of data sets included in the contract or subsequent amendments.

The audit team also tested a random sub-sample of nine individual researchers selected for active contracts to ensure that expiry dates did not exceed the valid security clearance period and that access was granted only for the period stipulated in the MRC. Results confirmed that when the security clearance date expired before the contract end date, the date entered was the security clearance expiry date; this control is effective in ensuring that individuals have security clearance in order to access Statistics Canada data. All other dates were consistent with the MRC, as required.

The audit team also tested data file access perimeters entered in the system for contracts indicating a status of suspended, incomplete, withdrawn or inactive and verified that access was disabled. Tests confirmed that, as required, userID accounts were disabled.

The audit determined that applicable IT security measures are in place and adhere to Statistics Canada's standards for safeguarding and protecting confidential data. IT access, identification and authentication safeguards are embedded in systems and software configurations at the Dalhousie RDC and are working as intended.

Protection of RDC servers against IT threats and protocol for reporting incidents

The Analyst and Statistical Assistants control which electronic files can be added to research project files on the closed network. Making researcher's electronic documents and tables available on the closed network is necessary as part of daily operations. Researchers bring their files on a personal USB key. Because workstations in the research lab are configured in such a way that USB keys cannot be accessed, the retrieval of researchers' files is done from the computers under the RDC staff's control.

At the program level, there are procedures on the RDC extranet that explain the terms and conditions for which a researcher can have data, documentation or other information added to their research projects. However, these procedures do not explain how to safely transfer the researchers' electronic documents from an external USB key onto the server.

In order to reduce the risk of a computer virus, malware or other spyware coming into contact with the data stored on the closed network, specific procedures have been implemented at the Dalhousie RDC for electronic file transfers when using a researcher's USB key. The researcher's USB key is inserted into the RDC analyst's Internet computer and the McAfee virus scan is run on the entire key. Copies of the files that the researcher wants transferred to his/her project folder on the server are then saved to the desktop and individual files are scanned a second time for viruses. The RDC analyst transfers the files/folders of documents from the desktop of the Internet computer to a dedicated RDC USB key and then transfers the files from the researcher's account to the server by using the computer that is linked to the closed network. Using a separate USB dedicated to the RDC was recommended by Dalhousie's IT staff.

Interviews with ITOD confirmed that docking a USB key owned by external users onto a computer that is linked to the closed network increases the risk of inadvertently transferring viruses, spyware and/or malware and should be prohibited. Using a reliable USB key strictly dedicated for transferring files to the server is a good practice which significantly reduces the risk of inadvertently transferring viruses, spyware and/or malware, as the USB key has not been in contact with computers outside of the RDC facility.

Staff at the Dalhousie RDC is employing an effective practice by using a reliable USB key strictly dedicated for transferring electronic files to the server. Currently, there are no documented procedures or protocols in place to mitigate security threats associated with the use of external USB keys for the RDC program. All RDCs could benefit from this practice and further protect the data stored on the closed network.

Recommendations:

It is recommended that the Assistant Chief Statistician of Social, Health and Labour Statistics should ensure that:

  • Procedures are documented, on the use of USB keys to transfer researchers' data files onto the closed network.

Management response:

Management agrees with the recommendations.

  • This is a best practice that is utilized in every centre in the program, but it has not been systematically documented. The Director of MAD will prepare and distribute a Communiqué to all RDC staff and researchers to document procedures on the use of USB keys to transfer researchers' data files onto the closed network.

    Deliverables and Timeline: Procedures will be posted to the communications network by December 31, 2014.

Physical security

Physical security measures in place within the Dalhousie University RDC comply with applicable TBS policies and Statistics Canada's Security Practices Manual. Key controls such as a secure perimeter with intrusion detection and restricted access to the centre are in place and are effective to ensure the security of the information held in the facility.

The physical security measures required in RDCs are intended to safeguard the confidentiality of the information held in the facility. Physical security inspections verify that security measures comply with applicable TBS policies, such as the Government Policy on Security (GPS) and Statistics Canada's Security Practices Manual. Physical security should include key controls such as the establishment of a secure perimeter with intrusion detection, restricted access to the centre, and ongoing monitoring through observation during business hours.

Departmental physical security inspections

Physical security inspections are completed upon initial opening of RDCs and Statistics Canada management has determined that RDC inspections will take place every four years. Departmental security staff performs the physical inspections, and provide recommendations to the RDC regional managers and headquarters staff. The last Dalhousie University RDC physical security inspection was conducted in 2011. As a result of this inspection, one recommendation was issued: it was recommended that access system reports be printed and reviewed on a regular basis. The RDC staff is able to login to a security system supported by the Dalhousie Security office and print access system reports. At the Dalhousie RDC, access system reports are produced monthly, mainly to track the hours recorded for projects involving fee-for-services. The swipe card log reports are available for examination if required to investigate the comings and goings of researchers more thoroughly. By printing out access system reports and reviewing them monthly, staff at the Dalhousie RDC has addressed the recommendation issued from the 2011 physical inspection.

Through comparison with the information provided in the 2011 physical site inspection and interviews with MAD and RDC staff, it was confirmed that the RDC has not relocated or made any significant changes to its physical structural environment since it was last inspected. In light of this, the audit team selected a number of key physical controls within the RDC's physical environment and verified compliance with RDC physical security requirements. Results of the audit team's inspection were as follows:

  • The facility has secure locked storage cabinets for storing researchers' files.
  • There are no printers located in the research area.
  • The printer/fax/scanning device is for RDC staff use only and is located in the RDC analyst's office.

In all cases, key physical controls were set up in accordance with RDC physical security requirements.

Secure perimeter with intrusion detection

The RDC is located on the main floor at Dalhousie University. The RDC was constructed in compliance with Statistics Canada's requirements for perimeter security for 'shared floor occupancy.' Physical access in and out of the RDC is through a single door entrance, accessible from the university library. In accordance with security requirements for RDCs, the centre is secured by a steel door with a deadbolt with a one-inch throw. RDC staff and campus security have keys to the facility. The RDC does not have exterior windows. Interior windows are frosted except the one in the RDC analyst office (which faces out to the library) which has vertical blinds that are kept closed.

Campus security provides 24/7 monitoring of the university facilities. The RDC also has an alarm system and motion detectors, which are functional and safeguard the facility after working hours. If the alarm or motion sensor system is triggered, campus security would be notified as first response who would then notify the RDC analyst.

Restricted access to the RDC

At the Dalhousie RDC, there is one full-time RDC analyst and two part-time statistical assistants. RDC staff is present during business hours and monitor researchers' presence at the facility, to ensure that access to the centre is restricted to individuals who are authorised. The presence of RDC staff during business hours is a critical control in safeguarding assets within the secure area. RDC staff at Dalhousie set work schedules to ensure continuous presence at the centre to cover vacation leave and personal appointments. In rare cases where coverage amongst staff is not possible during extended periods which go beyond health breaks and brief absences during lunch, the RDC at Dalhousie is closed.

An electronic swipe card access system is also in place. Identification cards are assigned to authorised researchers and there are two swipe readers located on the exterior and interior sides of the door to the RDC. The card must be swiped in order to unlock the door when entering and leaving the secured area. In doing so, the system records all swipe entries and exits. RDC staff has access to the electronic swipe card access system's logs from the analyst's computer through remote login to the Dalhousie security system. The audit team examined the swipe access logs for the RDC for the three days the auditors were on site, as well as the system's reports for the RDC for the month of June 2014. Tests confirmed that the system accurately recorded all swipe entries and exits for the centre. However, reports generated by the access card system do not reflect all individuals' entries and exits during business hours. There are situations where individuals can enter or leave the centre during operating hours without having to swipe their own individual card. For example, if a number of individuals leave the RDC at the same time, or if someone enters the facility just as someone exits, individuals do not remember to always swipe their card. Additional tests performed showed that the use of the manual sign-in log as a compensatory control was effective in ensuring that a list of all visitors to the centre is maintained.

Ongoing monitoring

In order to effectively monitor activities in the RDC, the analyst should have a clear view of researchers while in the centre. At Dalhousie, the RDC analyst can easily observe researchers when they use the workstations located at the front of the RDC. While in the RDC analyst's office, there are challenges in observing researchers sitting at workstations located in the rear of the RDC. As a mitigation strategy, the RDC staff walks through the RDC and observes the workstations from various positions on a regular basis. Program management has stated that it is a challenge to strike the appropriate balance between protecting the confidentiality of the information and affording researchers a certain level of privacy to carry out their work. Each RDC is configured differently; RDC managers are encouraged to use a risk based approach in this regard for each RDC.

Physical security measures in place within the Dalhousie University RDC comply with applicable TBS policies and Statistics Canada's Security Practices Manual. Key controls such as a secure perimeter with intrusion detection and restricted access to the centre are in place and are effective to ensure the security of the information held in the facility.

Appendices

Appendix A: Audit criteria
Control Objective / Core Controls / Criteria Sub-Criteria Policy Instrument
1) The Dalhousie University RDC complies with applicable TBS and Statistics Canada policies and standards' regarding Information Technology Security and Physical Security to ensure that confidentiality of data is protected in the delivery of services.
1.1 The physical environment in which the RDC operates complies with current StatCan policies. 1.1.1 Policies, directives and procedures are in place detailing physical security requirements.

1.1.2 Physical access controls are in place to ensure that the physical environment is effective in safeguarding sensitive data.

1.1.3 Both manual and automated controls exist to ensure physical security (i.e. card readers, alarm systems, sign-in sheets).

1.1.4 Ongoing monitoring of the environment takes place to ensure changes/new risks can be quickly addressed.

1.1.5 Regular periodic Physical inspections take place to ensure compliance to policies and are conducted by corporate service functions. Results from Physical inspections are recorded and remedial action is taken when non-compliance is found.
TBS Government Policy on Security

TBS Standard on Physical Security

TBS Directive on Departmental Security Management

Statistics Canada Security Practices Manual

Internal RDC physical security documentation

Security of Sensitive Statistical Information

Statistics Act

Discretionary Disclosure Directive

Policy on Deemed Employees
1.2 The IT environment in which the RDC operates complies with current StatCan policies. 1.2.1 Policies, directives and procedures are in place detailing IT security requirements.

1.2.2 IT hardware, software and general computer controls are in place to safeguard sensitive data.

1.2.3 Each workstation is configured to ensure compliance to StatCan and TBS IT security requirements.

1.2.4 Passwords must be entered to activate the computer systems and are regularly updated and time-outs are functional.

1.2.5 Regular periodic IT inspections take place to ensure compliance to policies and are conducted by corporate service functions. Results from IT inspections are recorded and remedial action is taken when non-compliance is found.
TBS Government Policy on Security

TBS Directive on Departmental Security Management

Statistics Canada Security Practices Manual

Statistics Canada IT Security Policy

Security of Sensitive Statistical Information

Statistics Act

Discretionary Disclosure Directive

Policy on Deemed Employees
1.3 Access to sensitive statistical information is restricted to authorized individuals using IT and environmental control systems that are maintained in accordance with applicable policies. Physical and IT access is controlled to ensure only those authorized can physically access the RDC premises, and log-in to workstations restricts access to authorized data sets only.

1.3.1 Physical and IT Access control listings are regularly updated and validated.

1.3.2 University staff who maintain the IT systems understand the IT security requirements and ensure access to data is restricted to authorized uses only.

1.3.3 RDC staff monitor researchers and workstations to ensure researchers comply procedures

1.3.4 Researchers authorized to use the RDC have access to only those data sets noted in the MRC.

1.3.5 Accounts are automatically disabled upon contract expiry dates and all external ports have been disabled on researcher workstations.

1.3.6 Access to files is restricted to researchers having MRCs in good standing.
Statistical Information Security of Sensitive

Discretionary Disclosure Directive

TBS Directive on Departmental Security Management

Statistics Canada Security Practices Manual

Statistics Canada IT Security Policy

TBS Government Policy on Security

TBS Standard on Physical Security

Discretionary Disclosure Directive
1.4 The confidentiality of sensitive statistical information is protected through the application of continuous vetting activities prior to letting written documentation leave the RDC. 1.4.1 Practices of continuous data vetting are applied to ensure documents containing sensitive statistical information do not leave the RDC. Statistics Canada Security Practices Manual

Directive on Sensitive Statistical Information
2) The Dalhousie University RDC has effective practices and mechanisms in place to ensure that the confidentiality of data is protected in the delivery of services.
2.1 Accountabilities in support of the RDC's operations and collaborative initiatives shared among RDC staff, university staff and researchers are formally defined. 2.1.1 Agreements, terms of reference or equivalent documents outlining roles, responsibilities and accountabilities for functions involving the Dalhousie University staff are in place outlining the responsibilities for the:
 
  • Regional Manager
  • RDC analyst and statistical assistant
  • Academic Director
  • IT support
2.1.2 Microdata Research Contracts (MRCs) templates outline roles and responsibilities for StatCan and researchers with respect to the treatment and usage of Statistics Canada survey data and information. MRCs templates are used for new contracts and are signed by those with the appropriate authority.

2.1.3 Oaths and values and ethics documents outline requirements related to the confidentiality of Statistics Canada data and are in place prior to granting access to data.

2.1.4 Documentation is in place to outline confidentiality data vetting responsibilities for statistical outputs is in place.

2.1.5 RDC staff receives regular communications and updates from headquarters related to new processes and procedures, changes to process, issues and other items related to RDC operations, MRC management and confidentiality requirements.

2.1.6 RDC staff receives regular information updates related to confidentiality vetting and when new data sets arrive in the RDC locations, vetting requirements are communicated.
Internal RDC roles and responsibilities documentation

RDC documentation for Academic Directors

RDC Researcher Guide

Policy on Deemed Employees

MRC contracts templates

Oath / Affirmation of Secrecy

Values and Ethics documents

Internal Confidentiality Vetting documents
2.2 As deemed employees, researchers, RDC staff and university staff formally acknowledge compliance with Statistics Canada's corporate values and ethics, code of conduct or equivalent policies as it pertains to the confidentiality of sensitive statistical information. 2.2.1 Upon commencement of a new contract with the RDC, researchers are required to sign a statement acknowledging understanding and compliance with the policies and the Statistics Act through the following activities:
 
  • Orientation sessions are held to ensure researchers understand confidentiality requirements.
  • Values and ethics forms are signed by all researchers and are on file.
  • Documentation is provided to all researchers accessing the RDC to remind them of their responsibilities related to the confidentiality of sensitive statistical information.
  • University IT, and academic directors have signed oaths and are deemed employees.
Values and Ethics documents

Documentation distributed at orientation session

RDC Researcher Guide

Evidence of orientation sessions provided, and acknowledgement to comply with values and ethics/code of conduct

Evidence of security clearance for researchers
2.3 Management identifies, assesses and responds to the risks that may preclude the achievement of its objectives and assesses the effectiveness of existing controls. 2.3.1 Regular discussions are held between the Regional Manager, the RDC Analyst and MAD.

2.3.2 Management led IT and physical security Inspection Report are conducted for the Dalhousie University and used to determine risks and mitigation strategies.
RDC Security Inspections

Confidentiality Vetting guidelines

Audit trail/files kept within the RDC in support of vetting activities.
2.4 Management has established processes to develop and manage relevant agreements, Memorandum of Understandings (MoUs), and/or contracts, for the purposes of the RDC Program in the region. 2.4.1 Microdata Research Contracts exist, are up to date and outline data requirements, the research being conducted and contain relevant dates (start and expiry dates), and outline the terms and conditions for RDC usage.

2.4.2 All security screening is in place for contracts.

2.4.3 Oaths are signed and in place.
Internal RDC documentation

Security clearance evidence

Confidentiality oaths
Appendix B: Acronyms
Acronym Description
CIHR Canadian Institute of Health Research
CRDCN Canadian Research Data Centre Network
CRMS Client Research Management System
CS Chief Statistician
CSSD Corporate Support Services Division
DAC Departmental Audit Committee
DS Departmental Security
FRDC Federal Research Data Centre
HOOU Head Office Operations Unit
IA Internal Audit Division
ICN Internal Communication Network
IIA Institute of Internal Auditors
IT Information Technology
ITOD Information Technology Operations Division
MAD Microdata Access Division
MRC Microdata Research Contract
RDC Research Data Centre
SMD Subject Matter Division
SSHRC Social Sciences and Humanities Research Council
TBS Treasury Board Secretariat
USB Universal Serial Bus
WAN Wide Area Network

2015 submissions

Linkage of records from the 2011 survey for the Programme for the International Assessment of Adult Competencies (PIAAC), the 2011 Census of Population and the 2011 National Household Survey (NHS) (002-2015)

Purpose: Given that the linguistic practices of official language minorities in the labour market and their communities affect their cultural and economic vitality, linking PIAAC data with 2011 NHS and 2011 Census data will provide information on each member of a PIAAC respondent's household, which cannot be done at this time. This will help us gain a better understanding of the relationship between the characteristics of household members and the level of skills measured in the PIAAC. As well, the census and NHS include questions that were not asked in the PIAAC survey (e.g., questions to derive the first official language spoken and a question on languages used regularly at work), hence the importance of linking data from different sources.

Description: The PIAAC survey is part of a series of international surveys that have been conducted since the mid-1980s to measure the various dimensions of adult literacy, numeracy and problem-solving skills. The 2011 Census and 2011 NHS contain information on respondents' first official language spoken and on the members of the respondents' household.

Records from the PIAAC, 2011 Census and 2011 NHS are linked using a (deterministic hierarchical) record linkage program.

Only PIAAC survey respondents and members of their households will be retained for this record linkage.

Output: Only estimates that present aggregate data in accordance with the confidentiality provisions of the Statistics Act will be published outside Statistics Canada. Products derived from the linkage between PIAAC, the census and the NHS will be in the form of cross-tabulations, charts, geographical maps and results of multivariate logistic and linear regressions.

The results of the linkage, including the variables used to link the records, such as personal identifiers and information for measuring linkage quality, will be destroyed by March 31, 2016 at the latest, or as soon as they are no longer required. All files will be stored on a server in a secure location. Access to the linkage results is restricted to Statistics Canada employees and deemed employees of Statistics Canada whose work assignment requires this access.

Development of predictive models for admission to long-term care and residential care facilities in Canada – Canadian Community Health Survey to Hospital, Mortality, Census (2011), Tax and Continuing Care Reporting System Linkage (003-2015)

Purpose: The purpose of this linkage project is to identify the factors associated with admission to long-term care and residential care facilities among household dwelling Canadians and develop a predictive model that can be used to estimate future demand for these services. Currently in Canada, as in other developed countries, there is ongoing concern and debate regarding the future demand for long-term and residential care. Currently, estimates of the future need for long-term care typically rely on age and sex population projections alone without accounting for other factors known to be associated with admission including physical and mental disability, acute health events (e.g. stroke and hip fractures) as well as social support and household composition (i.e. living alone or with others) and income. While few Canadian studies on population-based predictors for long-term care have been conducted, none have considered a full range of health states and acute health events or changes in household dwelling. Furthermore, there is currently little to no information regarding the factors associated with the admission to residential care, an increasingly important service for seniors with less serious health needs. This data linkage will create a unique retrospective longitudinal cohort by linking health survey, health administrative and census data to follow survey respondents overtime to identify those factors associated with transitioning from the community to either long-term or residential care.

Description: Building on existing linkages, this project will extend the linkage of the Canadian Community Health Survey (2000/01-2011, 4.2) to the Discharge Abstract Database (DAD) (1996/1997 to 2013/2014), Canadian Mortality Database (CMDB), 2000 to 2012 and Historical Tax Summary File (HTSF), 1990 to 2012 (Record Linkage #030-2012) to include the 2011 Census, the (2000-2013) T1Family File and the Continuing Care Reporting System (CCRS) to provide information on those institutionalized. Linkages would occur only for those CCHS respondents who have given consent to link information to their survey data.

The CCHS provides comprehensive information regarding health, socio-economic and household dwelling status of community dwelling seniors. The DAD and NACRS provide comprehensive information regarding the use hospital services including diagnosis, treatment, and use of resources which can be used to identify a major adverse health event. The CMBD will provide information regarding mortality outcomes, primary cause of death, and allow calculation of loss to follow-up and competing events. The HTSF will be used to assist in record linkage. The T1FF file will provide information on individual and family income and household composition. The 2011 Census of Population and the CCRS will be used to identify those individuals that have transitioned into institutional and/or residential care following response to the survey. The final analysis file will not contain direct personal identifiers such as names, health information numbers or death registration numbers or tax information.

Output: The linked files will at all times remain on Statistics Canada Head Office premises. Only non-confidential aggregate data that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. Major findings will be used to prepare research papers for publication in peer-reviewed journals (including Statistics Canada's Health Reports) and presentation at workshops and conferences.

The linked analysis files, stripped of direct personal identifiers, will be retained until no longer required by Statistics Canada, up to December 31, 2020, at which time they will be destroyed. The corresponding linkage key files housed in the Statistics Canada Head Office will also be retained until no longer required by Statistics Canada, up to December 31 2020, at which time they will be destroyed.

2015 General Social Survey on Time Use: linking tax data from the T1 Personal master File, T1 Family File and T4 Summary and Supplementary file (007-2015)

Purpose: The General Social Survey (GSS) program, established in 1985, conducts telephone surveys from a sample selected across the 10 provinces (excluding the Territories). The GSS is recognized for its regular collection of cross-sectional data that allows for trend analysis, and its capacity to test and develop new concepts that address emerging issues. Each year the GSS focuses on a different topic, such as family, victimization, social support and aging, and time use. A specific topic is usually repeated approximately every 5 years. The 2015 GSS will focus on Time Use.

The 2015 GSS on Time Use is the fifth iteration of a series of surveys which began in 1986. By linking the 2015 GSS on Time Use responses to personal tax files of respondents, and the tax files of all household members, more accurate income (personal and household), will be obtained for respondents. At the same time, response burden will be minimized, and collection and data processing costs will be reduced.

Description: The 2015 GSS on Time Use is a sample based survey with a cross-sectional design. Telephone and /or Internet surveys are conducted through computer assisted telephone or Electronic Questionnaire (EQ) interviews from a sample selected across the 10 Canadian provinces.

By linking data, we are aiming to obtain better quality data for income (personal and household).

Questions relating to income show rather high non-response rates, the incomes reported by respondents are usually rough estimates and donor imputation is used for partial and item non-response.

The information collected during the 2015 GSS on Time Use will be linked to the personal tax records (T1, T1FF or T4) of respondents, and tax records of all household members.

Respondents will be notified of the planned linkage before and during the survey. Any respondents who object to the linkage of their data will have their objections recorded, and no linkage to their tax data will take place.

Output: The availability of the 2015 GSS on Time Use analytical data file will be announced in The Daily. The analysis file will be made available to Statistics Canada researchers, and to deemed employees at the Statistics Canada Research Data Centres. All data will remain confidential and protected under the Statistics Act.

Along with the availability announcement of the analytical data file (in The Daily), only non-confidential aggregate statistics will be released.

Business Development Bank of Canada: The Importance of Business Development Bank of Canada Client Services on Firm Performance and Survival (008-2015)

Purpose: This project examines BDC client performance relative to firms that do not receive guidance and support from BDC, firm characteristics that are affected the most by BDC support, and which services provide the greatest effect on the growth and survival of businesses. An increased understanding of the effect of its services will enable BDC to adjust their services to better support their clients in the future.

Description: A list of firms in the BDC portfolio in the 2008 to 2012 period will be linked to data from National Accounts Longitudinal Microdata File (data from the Business Register, Corporate tax data-T2 tax database, PD7 and T4). The BDC firms records will be linked probabilistically using name and address. This is a one-time linkage.

Output: Only non-confidential aggregate statistical outputs and analyses that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. The information will be presented in the form of tables of regression results and summary statistics related to the project's goal of ascertaining the impact of receiving BDC support.

The linked file will be retained until March 31, 2020. All direct business identifiers will be removed from the analysis file once linkage is complete, and placed in a separate linkage key file. The linked file and the linkage key file will be retained until no longer required up to March 31, 2020, at which time it will be destroyed.

Linkage of the 2014 Teacher's Questionnaire to the 2014 Ontario Child Health Study (OCHS) (010-2015)

Purpose: The main objective of this linkage is to combine the data provided by a teacher of a child who participated in the 2014 Ontario Child Health Study (OCHS) with data collected in main survey (OCHS). The linkage will allow for a more complete portrait of children's mental health in Ontario.

Description: Responses to the Teacher's Questionnaire and 2014 Ontario Child Health Study (OCHS) will be matched for each respondent using the variable sample_id (which identifies a child uniquely in the sample). This linkage be used to create an analytical file.

Output: The data obtained on the Teacher's Questionnaire will include information about the child's school achievement and behaviour at school and combined with parent (guardian) reported data on the 2014 Ontario Child Study. The data are processed and prepared for dissemination using a regular suite of Statistical products including analytical files (with personal identifiers removed) made available in the Research Data Centres.

Prostate Cancer Surveillance and Occupational Exposures: a Subsequent Use of Linkage 049-2012 (011-2015)

Purpose: Utilizing a large and accessible population dataset like the 1991 Canadian Census cohort will provide evidence on multiple occupational exposures and prostate cancer to further research in identifying risk factors for prostate cancer. There is a need to explore occupational exposures and prostate cancer at a national level with available occupational information. This large dataset will provide more knowledge and understanding while contributing to the insufficient evidence in the literature. This is an important area of research as prostate cancer incidence is increasing and as there continues to be little known about the etiology of this cancer. Is there a relationship between occupational exposures and prostate cancer in Canadian workers is the research question. The objectives are to test relevant hypotheses related to occupational exposures in the etiology of prostate cancer and to evaluate if specific industry and occupational exposures are related to prostate cancer in Canadian workers.

Description: The 1991 Canadian Census of Population, Canadian Mortality & Cancer Follow-up study is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence.

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles, presentations at conferences and a part of a graduate level thesis/dissertation.

2012 Canadian Survey on Disability and 2011 National Household Survey Linkage (013-2015)

Purpose: The Canadian Survey on Disability (CSD) is a post-censual survey which provides information on Canadians whose everyday activities may be limited because of a condition or health-related problem. Information from this survey is essential for the effective development and operation of national programs such as employment equity and is required by the Government of Canada to fulfill various international commitments, including the United Nations Convention on the Rights of Persons with Disabilities.

An application (024-2013) had been made in April 2013 to conduct a linkage between the 2012 Canadian Survey on Disability (CSD) and the 2011 National Household Survey (NHS). Approval was received to link the data files and a final analytical file was created in the fall of 2013. The retention period for the CSD-NHS composite file expired in August 2014, however, we are receiving a number of requests to include additional NHS variables on the file. This request is therefore to further enrich the analytical potential of the 2012 CSD microdata file by including additional variables that had not been included on the original request.

Researchers who use the CSD data have expressed the desire to have the new NHS variables added to the existing file in order to further enhance their analytical objectives. NHS data complement the findings of the CSD, providing information on topics that were either beyond the scope of the CSD or which were explored in the survey in only a very limited way in order to reduce response burden. The new variables being proposed are consistent with the goal of enriching the analytical potential of the 2012 CSD microdata file.

Description: Responses to the 2012 CSD and 2011 NHS will be matched for each respondent using the variables frame_id (which identifies a household uniquely in Canada) and persnr (which identifies a person uniquely within the household). This linkage will result in the CSD-NHS linked analytical microdata file.

Output: Linked data, including the newly requested variables, from the 2012 Canadian Survey on Disability and 2011 National Household Survey will be disseminated on the analytical microdata file produced for the 2012 CSD. A microdata file was released to the National Research Data Centre in January 2014 and will be re-released in Spring 2015, once the new variables have been added. Any CSD products containing linked data will be disseminated in accordance with Statistics Canada's policies, guidelines and standards. Only aggregate statistical estimates that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada.

Economic Development Agency of Canada for the Regions of Quebec (EDAC): Economic Impact – 2001 to 2012 (018-2015)

Purpose: To support the evaluation of the Economic Development Agency of Canada for the Regions of Quebec's (EDAC) financing services program, by producing objective measures of its economic impact on the performance of small and medium-sized enterprises (SMEs). Key performance indicators, and value-added measures such as sales, profits, firm survival rate, and employment, will be calculated for EDAC client businesses and for comparable non-client businesses.

Description: A list of firms that were EDAC clients in the period 2001 to 2012 will be linked to the Business Register to obtain the Business Number and Statistical Enterprise Number, to facilitate linkage to payroll and tax data. In order to measure the effectiveness and the impact of EDAC financing services, a comparison group of non-EDAC client firms with similar characteristics will be selected.

Records of EDAC clients and the businesses in the comparison group will be linked to the Payroll Deduction Account (PD7), T2 Corporate Tax data, the General Index of Financial Information (GIFI), Research and Development in Canadian Industry (RDCI), and the Chart of Accounts database for the period 2001 to 2015. The records will be linked using the Business Number and Statistical Enterprise Number. The resulting linked analysis file will enable longitudinal analysis of each cohort. The characteristics of the matched and un-matched businesses will also be compared. This is a one-time linkage.

Output: Only non-confidential aggregate statistical outputs and analysis that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. These will be in the form of separate summary tables of regression analysis results relating to the study hypotheses of the economic impact of EDAC's financing services, in addition to profiling tables.A methodology report will be prepared, explaining the file matching processes and constraints and key issues related to the quality of the data. An analytic report will be produced by Statistics Canada.

Extending the Relevance of Longitudinal Files (023-2015)

Purpose: The goal of this linkage is to add repeated measures for important outcome domains for each respondent to the five terminated longitudinal surveys to extend their analytical relevance with minimal investment when compared to the cost of new data collection. This linkage will allow researchers both inside Statistics Canada and through the Research Data Centres to analyze longer term outcomes for the cohorts in the five longitudinal surveys.

Description: The longitudinal surveys involved are:

  • Youth in Transition Survey (YITS),
  • National Population Health Survey (NPHS), Household component,
  • Survey of Labour and Income Dynamics (SLID),
  • National Longitudinal Survey of Children and Youth (NLSCY), and
  • Longitudinal Survey of Immigrants to Canada (LSIC).

To extend the analytic value of these surveys, a file containing variables that measure key outcomes (e.g. income, health, employment and mobility) will be created using data from the following Statistics Canada surveys/administrative data bases:

  • Census 2006 and 2011
  • National Household Survey 2011
  • Vital Statistics - Deaths (1993 to 2011)
  • Canadian Cancer Registry (containing cancer diagnoses from 1992 to 2011)
  • T1 Family File (T1FF) (1993 to 2011)

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles, presentations at conferences and a part of a graduate level thesis/dissertation.

Examining the association between melanoma cancer incidence and environmental UVR exposure using the 1991 Canadian Census Cohort. A subsequent use of linkage 049-2012. (030-2015)

Purpose: This national epidemiological study will examine the relationship between average ambient residential UV radiation during a 16 year period and the relative risk of developing melanoma in Canada. Respondents in the 1991 Canadian Census Cohort will be spatially linked to a modelled monthly mean environmental ultraviolet radiation (UVR) and UV Index estimates by postal code. Surface models for UV values in each month will be constructed using spatial interpolation in Geographic Information Systems (GIS). Using these surface models, unique postal code localities will be assigned UVR and UV Index values for each of the summer months and will be joined with the 1991 Canadian Census Cohort respondents by postal code for each of the 16 years of Cohort follow-up. Cox proportional hazard models will be used to estimate the hazard of melanoma diagnosis associated with summer UV exposures among genders, age groups, visible minority groups, and socioeconomic groups.

Description: Environmental UV models will be provided to Statistics Canada researchers through collaboration with Environment Canada and the World Ozone and Ultraviolet Radiation Data Centre (WOUDC). The UVR datasets include monthly mean daily UVR and mean noon UV Index values, for a period of 1980-1990.

The 1991 Canadian Census Cohort: mortality & cancer follow-up is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence.

Output: The linked data file will remain on Statistics Canada premises. Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada, in the form of peer reviewed journal articles or correspondence with collaborators.

Examining the mortality effects and socioeconomic inequalities of industrial emissions using the 1991 Canadian Census Cohort. A subsequent use of linkage 049-2012. (032-2015)

Purpose: This research will examine socioeconomic differences and potential mortality effects of residing near industrial facilities. Using the 1991 Canadian Census Cohort, subjects will be spatially joined to industrial facilities within a specified geographic range using the residential postal code (1984 through 2006) and facility location. The analysis will first examine the socio-economic differences in the potential for exposure to industrial emissions using individual-level variables from the 1991 Census of Population and ecological variables from the 1991 Census. Second, survival modelling will be undertaken with emissions assigned to subjects based on their residential postal codes. The analysis will include the individual-level variables from the 1991 Census and ecological variables at the Census Tract and Census Division calculated previously by Statistics Canada.

Description: The 1991 Canadian Census Cohort: mortality & cancer follow-up is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence.

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles.

National Apprenticeship Survey (NAS) - 2015: linking tax data from the T1 Family File (033-2015)

Purpose: The National Apprenticeship Survey (NAS), established in 1989, conducts telephone surveys from a sample selected across the 10 provinces and 3 territories. The NAS is an occasional survey, the last one being conducted in 2007. The NAS 2015 is a survey of apprentices that targets individuals who have completed or discontinued their apprenticeship in the year 2011, 2012 or 2013. This survey aims to understand the factors that influence whether apprentices complete or discontinue their apprenticeship, the challenges of obtaining certification and the effectiveness of the most recent financial support programs. It also serves to examine the transition to the labour market of apprentices who completed or discontinued their apprenticeship.

By linking the NAS 2015 responses to the personal tax files of respondents, more accurate income (personal) will be obtained for respondents. At the same time, response burden will be minimized, data quality will be improved, and collection and data processing costs will be reduced.

Description: The NAS 2015 is a sample based survey with a cross-sectional design. Telephone surveys are conducted through computer assisted telephone interviews (CATI) from a sample selected across the 13 Canadian provinces and territories. By linking data, we are aiming to obtain better quality data for income (personal).

The information collected during the NAS 2015 will be linked to the personal tax records (T1FF) of respondents.

Respondents will be notified of the planned linkage during the survey. Any respondents who object to the linkage of their data will have their objections recorded, and no linkage to their tax data will take place.

Output: The availability of the NAS 2015 analytical data file will be announced in The Daily. The analysis file will be made available to Statistics Canada researchers, and to deemed employees at the Statistics Canada Research Data Centres. All data will remain confidential and protected under the Statistics Act.

Along with the availability announcement of the analytical data file (in The Daily), only non-confidential aggregate statistics will be released.

Amendment to include the T1FF and extending by one year the retention period of the linked files; 2014 General Social Survey on Victimization: linking tax data from the T1 Personal File and T4 Summary and Supplementary file (040-2015, 075-2013)

Purpose: This amendment will add the T1FF file to the previously approved record linkage 075-2013. There is no change to the proposal other than the addition of this file.

The General Social Survey (GSS) program, established in 1985, conducts telephone surveys from a sample selected across the 10 provinces. Population in Yukon, Northwest Territories and Nunavut are not usually part of the targeted GSS population with the exception of cycles on victimization. The GSS is recognized for its regular collection of cross-sectional data that allows for trend analysis, and its capacity to test and develop new concepts that address emerging issues. Each year the GSS focuses on a different topic, such as family, victimization, social support and aging, and time use. A specific topic is usually repeated approximately every 5 years. The 2014 GSS which will focus on Victimization is the sixth iteration.

This survey is an important source of information to better understand how safe people feel, what they think of the justice system and their experiences of crime.

By linking the 2014 GSS on victimization responses to personal tax files of respondents, and the tax files of all household members, more accurate income (personal and household) information will be obtained for respondents. At the same time, response burden will be minimized, and collection, data processing, and testing costs will be reduced.

Description: The 2014 GSS on Victimization is a sample based survey with a cross-sectional design. Telephone surveys are conducted through computer assisted telephone interviews from a sample selected across the 10 Canadian provinces and interviews are conducted through a mix of computer assisted telephone interviews and computer assisted personal interviews in the territories. By linking data, we are aiming to obtain better quality data for income (personal and household).

Questions relating to income show rather high non-response rates, the incomes reported by respondents are usually rough estimates. Linking will allow getting such information without having to ask questions.

The information collected during the 2014 GSS on Victimization will be linked to the personal tax records (T1, T1FF or T4) of respondents, and tax records of all household members. Household information (address, postal code, and telephone number), respondent's information (social insurance number, surname, name, date of birth/age, sex) and information on other members of the household (surname, name, age, sex and relationship to respondent) will be key variables for the linkage.

Respondents will be notified of the planned linkage before and during the survey. Any respondents who object to the linkage of their data will have their objections recorded, and no linkage to their tax data will take place.

Output: The availability of the 2014 GSS on Victimization analytical aggregated data file will be announced in The Daily. The analysis file containing only aggregated data created using confidentiality procedures as required by Statistics Canada's directives will be made available to Statistics Canada researchers, and to deemed employees at the Statistics Canada Research Data Centres. All data will remain confidential and protected under the Statistics Act.

Along with the availability announcement of the analytical data file (in The Daily), only non-confidential aggregate statistics will be released.

Long-Term Family Economic Consequences of a Childhood Cancer Diagnosis (041-2015)

Purpose: The objectives of this study are (1) to evaluate the proportion of families whose income is impacted and to quantify the extent to which the income is impacted after a diagnosis of childhood cancer by linking incident childhood cancer patients to their parent's income tax file data and exploring the short- and long-term economic impacts in comparison to a matched set of controls, (2) to evaluate patient, disease and family factors which may be associated with greater economic disparity, or which may ameliorate or temper any disparity and (3) to evaluate the proportion of individual cancer survivors whose income is impacted and to quantify the extent to which the income is impacted by exploring the short- and long-term economic impacts in comparison to a matched set of controls.

Descriptions: Information on children diagnosed with cancer in Ontario, held in the Pediatric Oncology Group of Ontario Networked Information System (POGONIS) will be linked to

Statistics Canada's T1 Family File (T1FF), and two variables from the Immigrant Landing File (ILF). Specifically, cancer diagnoses to children between the ages of 0 and 14 years, in Ontario between 1992 and 2006, will be linked to the T1FF, from 1989 to the most recent year of T1FF available at the time of linking, and immigrant identifier and landing year from the ILF. T1FF/ILF information for families and individual cancer survivors will be examined and compared to T1FF/ILF information from a set of matched families who did not experience a childhood cancer diagnosis.

The linkage will be produced by Statistics Canada staff on the agency's premises.

Output: Only aggregate data that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. Findings such as research papers will be offered for publication consideration in regular Statistics Canada reports such as Health Reports and will be prepared for submission to peer-reviewed international science journals. All reports will be made available to the Pediatric Oncology Group of Ontario. To support on-going analysis, the linked analysis file will be retained at Statistics Canada until 31 December, 2022 at which time it will be destroyed. The retention period may end sooner if the data file is no longer needed. Access to this linked analysis file will be by Statistics Canada employees or Statistics Canada deemed employees whose assigned work activities require such access.

AMENDMENT: Data linkage to examine pathways of students through post-secondary education (PSE) and into the labour market, 2005-2013 (042-2015)

Purpose: The main objective of this project is to link the PSE institution student administrative data from 2005 to 2013, to the tax data (using the T1 Family File) of the corresponding years. This amendment is to expand the observation period to 2013; the observation period was originally up to 2012. Now that data from T1FF-2013 has been released it is now possible to add this additional year to the scope of the project.

The linkage will enable the tracking of post-schooling earning trajectories of PSE institutions students by various fields of study and by cohort of graduates.

Description: Records of students from 14 PSE institutions would be linked to the T1 Family File (T1FF) over an 8 year period (from 2005 to 2013). The data linkage will be done in two stages:

In the first stage, PSE institutions will send a file containing the student identification variables as well as a pseudo-identification variable for each student. The linkage will be done with the T1 Family File containing an identification number and a selection of variables to conduct the research. Once the linkage is finalized, the student identification variables will be destroyed except the pseudo-identification variable from the PSE institutions.

In Stage 2, the PSE institutions will provide a file with the pseudo-identification variable and the student information. This second file will be linked to the reduced T1FF file from stage 1. The record linkage will be done by Statistics Canada personnel.

Output: The outputs will consist of two types: 1. a report submitted to ESDC, containing data tables and regression models on all participating PSE institutions and 2. Individual reports on each participating institution consisting of aggregate statistics on their own students.

Two types of micro data files will be created to produce the two types of outputs. One linked file on all participating institutions for the first report and one linked file per institution for the production of individual reports.

Further analytical research may be produced from the resulting linked files

Women's Enterprise Initiative Project: Linkage of Client List to the Canadian Employer-Employee Dynamics Database, 2007 to 2012 (044-2015)

Purpose: To provide statistical information to support the assessment of the effectiveness of the Women's Enterprise Initiative (WEI) program in assisting women owned enterprises, by comparing the performance of enterprises that received financial assistance under the program to the performance of other unassisted enterprises in the same region. This information will be used by Western Economic Diversification Canada (WD) which manages the WEI programs to determine more effective means of providing assistance to their clients. Employment dynamics, enterprises entering and exiting, selected financial statistics, as well as measures of employment will be analyzed.

Description: A list of enterprises assisted by the WEI Program will be linked to the Canadian Employer-Employee Dynamics Database (CEEDD): 2007 to 2012 to identify the assisted and non-assisted groups and to produce custom tabulations on the two groups.

Output: The outputs released outside of Statistics Canada will be non-confidential aggregate statistics and analyses that conform to the confidentiality provisions of the Statistics Act. The information will be presented in the form of statistical tables, broken down by industry sector and enterprise size.

The linked analysis file, containing the linkage keys and identifiers, will be retained until March 31, 2018, or until no longer required, at which time it will be destroyed.

Air Pollution Study: Linkage of 2001 Census of Population, T1 Universe Files, Mortality and Cancer Databases (045-2015)

Purpose: To assess the impact of long-term exposure to air pollution on human health, with the objective to inform the development of Canada-wide standards for key criteria pollutants. Linkage of separate sources of information is an important way in which Statistics Canada can meet identified data gaps on environmental data related to human exposure to air pollution.

The specific objectives of this study are: to determine whether non-accidental deaths and cancers are associated with long-term low exposure to ambient air pollutants;

Description: A sample of approximately 3.7 million Canadians was selected from respondents to the 2001 Census of Population long-form questionnaires and their Census information was linked to the T1 Universe Files (1981 to 2021), the Amalgamated Mortality Database (2001 to 2021) and the Canadian Cancer Registry (1992 to 2021). Air pollution data (e.g. fine particulate matter (PM2.5), nitrogen dioxide (NO2), ozone (O3)) will be spatially integrated to these files.

The linked files will contain only those data items required to conduct the study. Personal identifiers, such as name and social insurance number, will be used only for linkage purposes, then removed from the linked analytical microdata file. Only a sample of individuals who completed the 2001 Census of Population long-form questionnaires are included on the file.

Output: All access to the linked microdata file will be restricted to Statistics Canada personnel (including Statistics Canada deemed employees) whose work activities require access. Only aggregate data that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. Major findings will be used to create research papers for publication in peer-reviewed journals and presentation at workshops and conferences.

The linked file, stripped of personal identifiers, will be retained until no longer required, at which time the file will be destroyed.

Linkage of Annual Return of Broadcasting Distribution (Statistics Canada survey title) Annual Return of 'Broadcasting Distribution' Licensee (CRTC Title) to business tax data T2 tax data for Imputation of non-surveyed small cable entities. (053-2015)

Purpose: Linkage to business tax data using General to Detail Allocation (GDA) and Chart of Accounts (COA) in order to impute for selected financial variables for non surveyed small cable entities. Use of tax data for data replacement and derivation of tax ratios minimises response burden while ensuring better coverage of the industry

Description: Selected financial variables such as operating revenue, operating expenses, salaries and wages and amortization for non surveyed small cable entities are imputed through direct data replacement using General to Detail Allocation (GDA) and its Chart of Accounts (COA cells). Revenues and expenses ratios are then produced and used to derive detailed revenue and expenses items. BN numbers and names of entities are used in the linkage process.

Output: Only aggregated data at national or provincial grouping level are disseminated, after confidentiality procedures are implemented. No tax records are provided to data sharing partners. Temporary files containing individual tax information are destructed after each survey cycle, once the imputed data have been validated and exported into the final production database.

Education Longitudinal Linkage Platform (ELLP): Creation of a record linkage platform to allow development of key education indicators and analysis related to postsecondary education and apprenticeship programs (059-2015)

Purpose: Longitudinal data are needed for the development of key, Pan-Canadian, longitudinal indicators and analysis related to postsecondary education and apprenticeship programs. These outputs will lead to a better understanding of student pathways through postsecondary education and training including completion rates and outcomes. They will be useful for education and labour market policy and planning and fill gaps in current knowledge.

Administrative data files from the Postsecondary Student Information System (PSIS), the Registered Apprenticeship Information System (RAIS) and the T1 Family Files (T1FF) will be used to create a linkage platform for relating longitudinal education information and other data sources listed below.

The linkage platform will permit use of the longitudinal administrative data while protecting the privacy of individuals.

Description: The target population for the linkage platform and education indicator development comprises individuals who were enrolled in postsecondary institutions (PSIS) or registered in apprenticeship programs or as trade qualifiers (RAIS), at some time since 2008. Data for selected jurisdictions will go back as far as 2004.

Anonymized linking keys will be associated to the records of analytical variables from the data source files and all personal identifiers will be removed. A registry of these linking keys will be created. To protect the sensitivity of the information, the registry of keys and the personal identifiers required for updating the linkage platform will be stored in separate files in a separate location accessible only to the few Statistics Canada employees whose job duties require access. The registry of keys will be used to create customized, linked files that merge variables from the different data sources for creating longitudinal education indicators and for analytical purposes. These customized, linked files will not include the data source linking keys or personal identifiers.

Data sources used to construct the linkage platform or that will be linked for analytical purposes include:

  • Postsecondary Student Information System (PSIS) annual pan-Canadian records beginning with 2008-09 and ongoing, and records for selected jurisdictions for 2004-05, 2005-06, 2006-07, 2007-08;
  • Registered Apprenticeship Information System (RAIS) annual pan-Canadian records beginning with 2008 and ongoing, and records for selected jurisdictions for 2004, 2005, 2006, 2007;
  • Selected, tax-related, administrative and concordance files needed to establish and validate record matches between the annual PSIS and RAIS data files.
  • The T1 Family Files (T1FF), beginning with 1997 and ongoing
  • National Apprenticeship survey, 2015 and ongoing;
  • National Graduate Survey, beginning with 2013 (graduates of 2009/2010) and ongoing;
  • the Alberta Graduate Outcomes Survey, beginning with 2004 or the first year available after that and ongoing;
  • Additional files from the Alberta data systems that are used to report PSIS and RAIS data to Statistics Canada and files from selected institutions, beginning with 2004 and ongoing;
  • the Citizenship and Immigration Canada Landing File; the Census; the National Household Survey (NHS); the Canadian Employer-Employee Dynamics Database (CEEDD); and the Longitudinal Apprentices and Trade Qualifiers Database; all beginning with 2004 or the first year available after that and ongoing;
  • Data on student and apprenticeship loans and grants from provinces, territories and/or Employment and Social Development Canada (ESDC), beginning with 2004 and ongoing.

New years of data will be added when they become available.

The eventual production of the ELLP within the Social Data Linkage Environment will be explored.

Output: Analytical data linked using this linkage platform will be used to prepare indicators, tables, analytical reports and research papers for publication, for presentation at conferences, workshops and meetings and to fill cost-recovery requests for clients. They will also be used to provide insights for improving education data collection and data quality.

Only non-confidential aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act or as permitted by the Statistics Act will be released outside of Statistics Canada. A discretionary disclosure approval has been granted to allow the PSIS program to release aggregated enrolment and graduation information at the postsecondary institution level for institutions that have signed a waiver covering the specific PSIS release period.

Longitudinal Immigration Database (IMDB): Extension and Updates (060-2015)

Purpose: The Longitudinal Immigration Database (IMDB) is used to analyze immigrants' economic integration as well as internal mobility. It is a unique source of data at Statistics Canada that provides a direct link between immigration policy and the economic performance of immigrants.

Specifically, the IMDB provides federal and provincial departments involved in immigration issues and programs, the research community, and immigrant settlement agencies in Canada with crucial data to conduct research regarding the selection process of immigrants, their settlement patterns and their economic integration.

Description: The Longitudinal Immigration Database (IMDB) is a database that is created by linking Immigration, Refugees and Citizenship Canada's (IRCC) administrative immigrant files with personal tax files obtained by Statistics Canada from Canada Revenue Agency.

The IMDB currently includes tax data from 1982 to 2013 and covers immigrants who landed in Canada from 1980 to 2013. The IMDB is being re-designed as follows:

  • to extend the universe of the database to include immigrants who landed before 1980 (1952 to 1979) to ensure a better coverage of the immigrant population in Canada;
  • to extend the universe of the database to include temporary residents who arrived in Canada from 1980 to 2019 to account for pre-landing experience in Canada and to study pathways from arriving as temporary residents to landing;
  • to include a date of citizenship to study pathways to citizenship;
  • to include a date of death from the Amalgamated Mortality Database to better account for the population in scope;
  • to take advantage of newly developed files such as the Dependent Registry to improve record linkage; and
  • to use this new methodology for seven reference years of updates, i.e. data reference years 2013 to 2019 (for immigration records and tax files).

Immigrant identifiers will continue to be added to the Longitudinal Administrative Databank (LAD).

Output: Only aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. These will be in the form of tables on income distribution, interprovincial mobility, industry of employment, and provincial indicators produced for IRCC, as well as other federal and provincial organizations. On request, multivariate analyses and statistical tables will be produced from the IMDB analysis file for researchers. All access to the analysis file will be on Statistics Canada premises and will be restricted to only those employees and deemed employees of Statistics Canada whose assigned work duties require such access.

The IMDB linked analysis database will be retained until at least July 2021, at which time the Executive Management Board will be asked to review continuance of the program.

Canadian Health Measures Survey (CHMS) – 2016, Cycle 5 Linkage to Tax Data (061-2015)

Purpose: The Canadian Health Measures Survey (CHMS), launched in 2007, is collecting key information relevant to the health of Canadians by means of direct physical measurements such as blood pressure, height, weight and physical fitness. In addition, the survey is collecting blood and urine samples to test for chronic and infectious diseases, nutrition and environment markers.

Through household interviews, the CHMS is gathering information related to nutrition, smoking habits, alcohol use, medical history, current health status, sexual behaviour, lifestyle and physical activity, the environment and housing characteristics, as well as demographic and socioeconomic variables.

All of this valuable information will create national baseline data on the extent of such major health concerns as obesity, hypertension, cardiovascular disease, exposure to infectious diseases, and exposure to environmental contaminants. In addition, the survey will provide clues about illness and the extent to which many diseases may be undiagnosed among Canadians. The CHMS will enable us to determine relationships between disease risk factors and health status, and to explore emerging public health issues.

CHMS data are representative of the population whether they are healthy or not and provide a better picture of the actual health of Canadians.

By linking the CHMS cycle 5 to the personal tax files of respondents, more accurate income (personal and household), will be obtained for respondents. At the same time, response burden will be minimized, and collection and data processing costs will be reduced.

Description: The CHMS cycle 5 is a sample based survey with a cross-sectional design.

The sample is allocated over 11 age-gender groups, with between 500 to 600 units per group (5,700 total) required to produce national estimates.

Collection includes a combination of a personal interview using a computer-assisted interviewing method and, for the physical measures, a visit to a mobile examination centre (MEC) specifically designed for the survey.

For the cycle 5 collection period (January 2016 – December 2017), approximately 5,700 participants between the ages of 3 and 79 will complete both a household health questionnaire and a physical measures test. The mobile clinic (MEC) will be set up in 16 different sites across Canada, and will remain at each location for approximately five weeks.

The information collected during the 2016 CHMS will be linked to the personal tax records (T1, T1FF or T4) of respondents, and tax records of all household members.

Respondents will be notified of the planned linkage at the end of the household interview. Any respondents who object to the linkage of their data or the data of other members of their household will have their objections recorded, and no linkage to the tax data will take place.

Output: The availability of Canadian Health Measures Survey, cycle 5 data file(s) will be announced in The Daily. The data file containing the income data is expected to be made available in Fall 2016 to approved researchers in partner departments (Health Canada and the Public Health Agency of Canada) through a share agreement, Statistics Canada researchers, and to deemed employees at the Statistics Canada Research Data Centres. All data will remain confidential and protected under the Statistics Act. There will be no personal indentifies on this data file.

Along with the availability announcement of the analytical data file (in The Daily), only non-confidential aggregate statistics will be released.

Canadian Income Survey: Linkage to Income Data Files (063-2015)

Purpose: The purpose of this linkage is to obtain income data and reduce respondent burden, interviewer time and collection costs for the Canadian Income Survey. The linkage allows obtaining information on income variables without burdening respondents with detailed questions about their income.

Description: The Canadian Income Survey database and the T1, T1IDENT and T5007 Files will be linked using the address, city, date of birth, first name, surname, sex, province, social insurance number, codes for surname, postal code, marital status, telephone number and first initial. This information will be removed from the linked file as soon as the linkage is completed, and stored separately. Access to these files will be restricted to Statistics Canada employees whose assigned work activities require access.

Output: No information containing personal identifiers would be released outside of Statistics Canada from this linkage activity. Only non-confidential aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada.

Occupational Cancer Surveillance using the 1991-2009 Canadian Census Mortality and Cancer Cohort: Secondary use of 049-2012 (064-2015)

Purpose: The objectives of this study are to: 1) Test topical and relevant hypotheses related to occupational exposures in the etiology of cancer; 2) Target cancer sites and suspected carcinogens for informed hypothesis generating analyses; and to 3) Conduct a global analysis of relationships between occupation and cancer in Canada. Broad objectives of this study include the creation of a platform for surveillance of occupational cancer in Canada, identification of industries/occupations and target exposures for prevention and risk mitigation efforts and the generation of hypotheses for future etiologic research.

Description: The 1991 Canadian Census Cohort: mortality & cancer follow-up is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence. A custom-tabulation from the Survey of Labour and Income Dynamics (1996) was used to develop a Shift Work Job-Exposure Matrix. This matrix will be used to estimate exposure to shift work in the 1991 Canadian Census Cohort based on sex, occupation and industry.

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles and presentations.

Strengthening the Longitudinal Worker File (065-2015)

Purpose: The objective of this initiative is to strengthen the analytical value of the Longitudinal Worker File by increasing its sample size and by incorporating additional input data files. The Longitudinal Worker File is a multi-purpose file used to support research on a range of labour market issues such as worker mobility, layoffs and retirement.

Description: Information at the level of the business-enterprise will be drawn from the Longitudinal Employment Analysis Program (LEAP) file, while individual- and job-level data will be drawn from T1 files, the T4 Supplementary File, the T4 Statement of Employment Insurance Benefits Paid file, and the Record of Employment (ROE) file. All linkages will be done on a deterministic basis using Business Numbers (BNs) and/or Social Insurance Numbers (SINs).

Business Numbers and SINs will be transformed into unique personal identifiers that will remain on the individual-level linked file in a scrambled form. The use of scrambled identifiers will allow users to follow individuals longitudinally over time. Postal code information will be used to create aggregated geography variables and then removed from the files.

All BNs, SINS and postal codes will be removed from the linked file and stored in a separate location accessible only to Statistics Canada employees whose job duties require them to access this information.

Output: Methodological and analytical findings resulting from these linked data will be used to prepare research papers for publication in analytical reports, peer-reviewed scientific journals (including Statistics Canada's Health Reports), CANSIM, for presentation at conferences, workshops and meetings.

Only aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. The linked file will be retained by Statistics Canada until December 31, 2025, at which time the continued retention of the file will be reviewed. All linkage keys and identifiers will be removed from the linked file and retained separately, with access limited to Statistics Canada employees whose assigned work requires access to the file.

Adding new cohorts to the Intergenerational Income Mobility Database (066-2015)

Purpose: The objective of this initiative is to extend the coverage of the Intergenerational Income Mobility Database by incorporating additional cohorts of Canadian youth and their parents into the file and by updating several input data files. The database is used to examine the extent to which the financial outcomes achieved by teenagers later in life are correlated with the incomes of their parents.

Description: Using information from the T1 Family file, the Intergenerational Income Mobility Database links together teenagers and co-resident parents. These teenager-parent matches are subsequently linked to the T1 Personal Master files, making it possible to track the income trajectories of youth into their thirties and forties. Information is also available on the incomes that the parents of these teenagers reported when they too were in their thirties and forties. This allows researchers to compare the incomes of youth and parents when they were at the same stage of the life course.

To select the 1991 cohort, a sample of all individuals aged 16 to 19 in 1991 will be identified in the 1991 T1FF. The child-parents link is taken from the Family Identification Number (FIN) available in the T1FF. If no child-parent match is found in 1991, a linkage will be attempted in each of 1992 to 1995 in order to improve the coverage of the sample and reduce potential sample selection bias. Once the family linkage file has been constructed, all individuals in that file will be linked to the administrative information from the T1 files and the T4-ROE-LEAP linked files to obtain longitudinal information on their income and employment dynamics over time. These are deterministic linkages based on SINs. Once the linked data files have been constructed, Social Insurance Number will be removed from the linked file and replaced by a 15-digit unique personal identifier. This will allow observations to be identified across years without knowing their SIN. A confidential program used to convert SINs into a personal identifier will be kept separately, with access limited to Statistics Canada employees whose assigned work requires access to the file. In addition, Payroll Deduction Account Number (PD) and Business Number (BN) will be removed and replaced by a unique Longitudinal Business Register Identifier (LBRID). The same process will be used to identify cohorts of youth who were aged 16 to 19 in 1996 or 16 to 19 in 2001.

Output: Methodological and analytical findings resulting from these linked data will be used to prepare research papers for publication in analytical reports, peer-reviewed scientific journals, CANSIM, for presentation at conferences, workshops and meetings. The linked file will also be used to develop tabular data and indicators for release on Statistics Canada's website. Only non-confidential aggregate statistics that will not result in the identification of an individual person, business or organization will be released outside of Statistics Canada.

Strengthening the Refugee Claimant Database (067-2015)

Purpose: The objective of this initiative is to strengthen the Refugee Claimant Database—a data file used for examining income characteristics of refugee claimants in Canada. The inclusion of information on the outcomes of refugee claims and linkages to landing records will increase record linkage rates, improve data quality, and increase the analytical value of the data base. This will yield better information on refugee claimants in Canada and their financial and labour market characteristics over time.

Description: The linked data file will provide better information on the income characteristics of refugee claimants by incorporating the claim decision and decision date from the Immigrant Refugee Board. These two pieces of information are required to identify and remove refugee claimants who have left the country—a group that would otherwise remain in the data with uncertain income characteristics. In addition, landing information from the Immigration Landing File at Statistics Canada will be included in the data.

Output: Analytical findings resulting from the linked data file will be used to prepare tabulations and research papers for publication.

Only aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. The linked file will be retained by Statistics Canada until no longer required, up to, December 31, 2017, at which time it will be destroyed. All linkage keys and identifiers will be removed from the linked file and retained separately, with access limited to Statistics Canada employees whose assigned work requires access to the file.

2016 Census of Population Program linkage to income information from personal income tax and benefits records (071-2015)

Purpose: The purpose is to obtain information on the income of respondents to the 2016 Census of Population Program. The Census Program requires detailed information on several different sources of income, as well as income taxes paid and various deductions and contributions, and accurate reporting would require that respondents consult their own personal records. Linking the Census records to the administrative records reduces response burden and improves the data quality. The income data are used, among other uses, to measure total income, after-tax income, contributions to various programs, disposable income and the Market-Basket Measure of low-income.

Description: Respondents' information on income, income taxes and various expenditures is extracted from their personal income tax and benefits records (including the T1 income tax return, various information slips held by CRA and CCTB and GST credit programs) and added to their responses to the Census of Population Program (short and long forms).

Output: Only aggregate statistical estimates and analyses conforming to the confidentiality provisions of the Statistics Act are released outside of Statistics Canada. The linked Census to the personal income tax and benefits records information are used to produce income estimates for dissemination as part of the Census product line. Outputs for the Census include a wide range of analysis and standard data tables, as well as custom tabulations.

The linked Census edit and imputation files will be retained indefinitely. The linking key file, containing personal identifiers, will be kept until June 2020, or until no longer required, at which time it will be destroyed. All files are password-protected and kept on a server in a secure area. Access to the linking keys and linked Census edit and imputation files is restricted to Statistics Canada employees whose assigned work activities require such access.

2016 Canadian Community Health Survey Annual Component (CCHS) Linkage to Tax Data (072-2015)

Purpose: The purpose of this linkage is to reduce respondent burden while improving data quality. This will also reduce the overall survey time which will reduce collection costs.

Description:

HSD is planning to link the 2016 CCHS survey data to existing tax files to collect income information.

The first step is to determine if tax data are available for the CCHS 2016 sampled households. When this information is available, respondents will be given a linkage statement which includes a specific reference to linking to tax data. They will have the opportunity to refuse the linkage. For those respondents that refuse to link, a set of income questions will then be asked. For households where there is no tax data available, the income questions will be asked followed by the linkage statement.

After collection, the second step will be to link the 2016 CCHS data to the most recent available tax files (generally a two year lag from the collection year) to collect the income information for those respondents who did not refuse to link.

Given the CCHS sample is drawn from two frames (Canadian Child Tax Benefit file for respondents aged 12-17 and the Labour Force Survey (LFS) area frame for those 18+), there will be slightly different approaches to the two step linking strategy. For those aged 18 years or older, the sample records will all contain an ARUID. Prior to collection of the CCHS Annual 2016, the ARUIDS for the selected sample will be linked to the 2014 IDENT_ARUID file using ARUID and then linked to the most recent tax data available at the time of collection to identify cases that do not have 2014 tax data. So for the 2016 CCHS master data file, this will be 2014 T1 Personal Master File(T1). Cases that do not have 2014 tax data will be asked income questions as a back-up measure to provide income data. All respondents will also be given the tax linkage statements. For all those agreeing to the tax linkage statement (regardless of whether they were also asked income questions) we will attempt data linkage in the following manner:

  1. Link the ARUID to the 2015 IDENT_ARUID then use this to link to the 2015 T1, T1FF or T4 to obtain tax data.
  2. If a link is not found for 2015 then link to the 2014 IDENT_ARUID and use that link to find the 2014 T1, T1FF, T4 tax data.

Personal information such as name, date of birth and gender, or contact information such as telephone number or postal code may be used to verify the links (through ARUID), or improve linkage rates.

For the 12-17 year old selected respondents, records can be linked through the SIN number of the parents to identify those without 2014 T1, T1FF or T4 data. Those without the 2014 T1 data will be asked the income questions as a back-up measure. All respondents will also be asked the tax data linkage statement. For those agreeing to it (regardless of whether they are asked the income questions) we will attempt linkage as follows:

  1. If the child still lives with the recipient (parent/guardian) then link the SIN of the parent to the 2015 T1,T1FF or T4 to obtain the most recent tax data.
  2. If a link is not found for the 2015 T1 or T1FF and the child still lives with the recipient (parent/guardian) then use the SIN to link to the 2014 T1,T1FF or T4 to obtain tax data.

If the child no longer lives with the recipient (parent/guardian) then linking through contact information such as name, address or phone number may be attempted.

Output: The release of data from the 2016 Canadian Community Health Survey will be announced in The Daily. Data will be made available to deemed employees at the Statistics Canada Research Data Centres. All data will remain confidential and protected under the Statistics Act. There will be no personal identifiers on the data file.

Along with the availability announcement of the analytical data file (in The Daily), only non-confidential aggregate statistics will be released.

The Relationship between Early Social Development and Long-Term Economic Outcomes: A Linkage of the Montréal Longitudinal-Experimental Study (MLES) and the Quebec Longitudinal Study of Kindergarten Children (QLSKC) and the T1 Family File (T1FF) (073-2015)

Purpose: The purpose of the proposed study is to examine the relationship between early indicators of social behaviour (aggressiveness-opposition, hyperactivity-inattention, anxiety, prosociality) and later economic outcomes (employment status, earnings, receipt of income assistance). Information on the relationship between early mental health indicators and later economic outcomes will be an important contribution to policy discussions regarding investments in early as well as later mental health prevention and treatment, as well as those focused on ameliorating labour market outcomes for Canadians.

Output: Only aggregate data that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. Major findings will be used to prepare research papers for publication in internal and external peer-reviewed journals and presentation at workshops and conferences.

Adding immigrant admission category variables to the 2016 Census of Population long-form (075-2015)

Purpose: This project would add immigrant admission category (e.g., economic class, family class, refugees, etc.) and principal applicant status to the 2016 Census of Population database by linking to the Immigration, Refugees, and Citizenship Canada (IRCC) Immigrant Landing File.

Description: The Census of Population provides detailed information on the demographic, social and economic characteristics of people in Canada, as well as providing information about the housing units in which they live. The IRCC Immigrant Landing File provides information on immigrants to Canada since 1980 such as admission category.

This project will build on the previous record linkage project funded by IRCC (037-2013) which linked the Immigrant Landing File with the 2011 National Household Survey by integrating the admission category variables into the 2016 Census of Population Program databases, processing the variables to address inconsistencies and missing values, developing reference material, and disseminating the resulting variables with the 2016 Census of Population Program variables for broad access.

Output: Only aggregate statistical estimates that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. The admission category variables will follow the same dissemination and output considerations of any other 2016 Census of Population Program variable and could be included in custom tabulations, standard tables or articles.

A linkage key will be retained indefinitely as part of this record linkage. The linkage results including variables used to perform the record linkage such as personal identifiers and information used to measure the linkage quality will be destroyed by March 31, 2019. All files will be kept on a server in a secure area. Access to these files will be restricted to Statistics Canada employees whose assigned work activities require such access.

Black-White disparities in mortality in Canada: A subsequent use of linkage 049-2012 – (076-2015)

Purpose: To estimate absolute and relative Black-White mortality gaps for all-cause and cardiovascular mortality in Canada and compare with those estimated for the US.

Description: The 1991 Canadian Census Cohort: mortality & cancer follow-up is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence.

We will estimate age- and sex-specific standardized mortality rates for cohort members identifying as "Black" and non-visible minority. Person time for each cohort member will be calculated from the beginning of the study (June 4, 1991) until the date of death or the end of the study (December 31, 2009). The Canadian cohort population structure will be used as the standard population for estimating mortality rates (also for the US to facilitate comparability between the countries). Age standardized mortality rate differences (RD) and rate ratios (RR) will be estimated to compare between Blacks and non-visible minorities. We will also fit standardized survival curves to assess absolute survival probabilities for the two groups, adjusted for age and socio-demographic variables. This method overcomes some of the limitations of the standard Cox proportional hazards model and permits estimation of absolute effect measures.

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles and presentations.

A Microsimulation Analysis of Hidden Heterogeneity in Population Mortality: A subsequent use of linkage 049-2012 – (077-2015)

Purpose: The purpose of this study is to investigate hidden heterogeneity in the Canadian population using, as a starting point, differences in survival patterns among broad ethnic groups in Canadian Census Cohort: mortality & cancer follow-up.

Description: The 1991 Canadian Census Cohort: mortality & cancer follow-up is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence.

The principal research questions of this study are:

  1. Do difference in survival exists among different ethnic groups in Canada?
  2. Can these differences in survival, once account is taken of various covariates, be explained by posited or hypothetical differences in proportions of low frailty and high frailty subpopulations among the different ethnic groups?
  3. Are the proportions of low frailty and high frailty subpopulations among different ethnic groups comparable to the frequency of low frailty and high frailty subpopulations in the published literature?

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles and presentations.

Social and Spatial Determinants of Mortality in the Maritimes using the 1991 Canadian Census Cohort: A subsequent use of linkage 049-2012 – (078-2015)

Purpose: The purpose of this project is to examine the social and spatial determinants of health in the Maritimes.

The social gradient in health is well established, with studies showing higher rates of morbidity and mortality between different social strata (Mackenbach et al. 2008). Difference in health can be explained by individual characteristics, social dimensions, and environmental attributes (Marmot 2005; O'Neill et al. 2003). Within Canada, there has been extensive research on the social determinants of health, with recent advances making use of the 1991 Canadian Census Cohort (Hwang et al. 2009; Omariba, Ng, and Vissandjée 2014; Peters et al. 2013; Simonet et al. 2010; Tjepkema and Wilkins 2011; Tjepkema et al. 2011; Wilkins et al. 2008). This project seeks to focus on geographic variations in the social determinants of health in the Maritimes.

Description: The 1991 Canadian Census Cohort: mortality & cancer follow-up is a probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who were enumerated by the 1991 long-form census, were followed for mortality, cancer and annual place of residence.

The study addresses several research questions:

  1. What are there socio-economic inequalities of health for individuals who resided in the Maritimes at baseline and how do these differ compared to those in other Canadian regions?
  2. How do migration patterns for residents of the Maritimes relate to socio-economic inequalities in health? What are the differences in health outcomes for those who migrated versus those who stayed?

Output: Only aggregate data and analyses conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles and presentations.

The socioeconomic determinants of changes in the distribution of deaths by age, sex and cause in Canada: subsequent use of linkage no. 049-2012 – (079-2015)

Purpose: This project will examine the role of certain socioeconomic determinants in relation to new patterns in old age mortality, namely compression of mortality or movement of mortality to older ages, and longevity differences by sex. The level of education—an important determinant for old age survival—will be examined in particular.

Description: The 1991 Canadian Census Cohort: mortality & cancer follow-up is a database probabilistic linked database. Approximately 2.7 million individuals aged 25 or older, who completed the 1991 long-form census questionnaire, were followed for mortality, cancer and annual place of residence.

The study will primarily attempt to answer the following research questions:

  • Can certain socioeconomic characteristics, in particular, the level of education, explain the differences in modal age at death (the most frequent age) and the dispersion of old age deaths for general mortality and for certain causes of death?
  • How does the situation in Canada compare to that of the United States in terms of survival inequalities by level of education?

Output: Only aggregate data and analyses that comply with the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada Research Data Centres, in the form of peer reviewed journal articles.

Changes in work and earnings following health shocks (082-2015)

Purpose: The objective of this initiative is to create a linked database that will support research on the labour market and financial outcomes experienced by individuals and families following hospitalizations resulting from accidents and acute illness. The proposed linkage will combine data on acute inpatient hospitalizations with data from various taxation- and employment-based administrative files. The resulting analytical files will support research on the economic consequences of 'health shocks' for individuals and their families and the implications for income, labour and health policies. This information does not currently exist and this linkage project will fill an important data gap.

Description: Health related information will be drawn from the Discharge Abstract Database (DAD) which contains demographic, administrative and clinical data on all hospital admissions in Canada (excluding Quebec), from April 1, 1999 to the present. The data include information on hospital admission and discharge dates, admission to intensive care, and hospital diagnoses. These data allow 'health shocks' to be identified in terms of type and severity.

Information on labour market and financial outcomes of individuals as well as job-level data will be drawn from the following administrative data files: T1 Family File, T1 Personal Master File, T1 Historical Personal Master File, T4 Summary File, T4E Statement of EI Benefits Received, EI Status Vector File, Record of Employment, and Longitudinal Employment Analysis Program. These data allow the economic characteristics of individuals (and their spouses) to be identified both before and after a health shock, so that the impacts of the health shock can be estimated on outcomes such as cessation of employment, earnings losses, job instability, and receipt of income support.

The linkage process will involve linking identifiers available in both data files - date of birth, postal code and sex - to create a link between Health Insurance Number (HIN) in the DAD and Social Insurance Number (SIN) in tax files. The linkage keys will be kept separately, with access limited to Statistics Canada employees whose assigned work requires access to the file.

Output: Methodological and analytical findings resulting from these linked data will be used to prepare research papers for publication. The linked file will also be used to develop tabular data and indicators for release on Statistics Canada's website. Only non-confidential aggregate statistics that will not result in the identification of an individual person, business or organization will be released outside of Statistics Canada.

Farm Financial Survey Linkage to Taxation Data (083-2015)

Purpose: Linkage of the Farm Financial Survey with taxation data will allow Statistics Canada to continue to produce estimates on the financial and physical aspects of farm operations in Canada while at the same time reducing burden on survey respondents. Respondents will have the option to replace 18 specific questions on revenues and expenses, previously included on the Farm Financial Survey, with taxation data.

The linkage will further allow critical cross-tabulations that are used by the survey sponsor to inform policy decisions and as performance measures for government funded agriculture programs that benefit survey respondents. These data are also used within the Agriculture Division (in processes that feed the System of Macroeconomic Accounts) and by the Investment, Science and Technology Division

Description: Commencing with the 2015 reference year, data from the Farm Financial Survey will be linked with taxation data from the T1 business and personal master files, as well as T2, T3 and T4 tax files.

Output: Linkage results will be used to produce non-confidential aggregate estimates that will be published outside of Statistics Canada; published estimates will conform to the confidentiality provisions of the Statistics Act.

The linked file used to produce the aggregate estimates will be saved indeterminately to continue to respond to client requests for custom tabulations of the data.

Atlantic Canada Opportunities Agency (ACOA) – Update of Business Performance Evaluation Report (2016) (087-2015)

Purpose: To assess the effectiveness of ACOA's programs and activities, to assess the usefulness of the Agency's efforts to assist small and medium-sized enterprises, and to determine more effective means of providing assistance to this business community. ACOA assists businesses by providing loans, as well as a broad range of programs and services, for purposes of establishing, expanding, or modernizing businesses, and for the development of human resources. Information resulting from the linkage will be used by ACOA to measure the performance of businesses which received financial assistance under the Agency's programs, and compare it to the performance of other firms in the Atlantic region. Employment dynamics, businesses entering and exiting, selected financial statistics, as well as measures of labour productivity and business owners' characteristics will be analysed. Findings from this assessment may be used by ACOA to improve assistance to businesses.

Description: A list of ACOA-assisted businesses will be linked to the following files: the 2003 to 2013 Business Register, the 2013 vintage Longitudinal Employment Analysis Program (LEAP) file, the 2003 to 2013 Corporate Tax-General Index of Financial Information (GIFI) and Scientific Research and Experimental Development Expenditures (SRED), the 2013 Trade by Enterprise Characteristics (TEC), and the 2013 Canadian Employer-Employee Dynamics Database (CEEDD) . The files will be linked using the Business Number (BN), Statistical Enterprise Number (SNUM) and the legal/operating name.

Output: Only non-confidential aggregate statistical outputs and analysis that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. These will be in the form of statistical tables at the business sector and business size level for Atlantic Canada. ACOA will publish these results in their annual performance report to Parliament, which will be available on the ACOA website, and in research studies on topics such as entrepreneurial start-ups, employment patterns and growth in Atlantic Canada.

Canadian Income Survey: Linkage to Income Data Files (091-2015)

Purpose: The purpose of this linkage is to obtain income data and reduce respondent burden, interviewer time and collection costs for the Canadian Income Survey. The linkage allows obtaining information on income variables without burdening respondents with detailed questions about their income

Description: The Canadian Income Survey database and the T1, T1IDENT, T5007 and CCTB files will be linked using the address, city, date of birth, first name, surname, sex, province, social insurance number, codes for surname, postal code, marital status, telephone number and first initial. This information will be removed from the linked file as soon as the linkage is completed, and stored separately. Access to these files will be restricted to Statistics Canada employees whose assigned work activities require access.

Output: No information containing personal identifiers would be released outside of Statistics Canada from this linkage activity. Only non-confidential aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada.

Longitudinal perspectives on employment, income and health: Linkage of the Longitudinal Worker File, 1991 Census, Canadian Mortality Database and Canadian Cancer Database (092-2015)

Purpose: The objective of this project is to create a new database that will support longitudinal analysis and outcome measures pertaining to employment, income and health. The database will be used to examine various issues pertaining to returns to education and training, the labour market outcomes of immigrants, retirement transitions, and changes in individual- and family-level earnings in the wake of layoffs or a cancer diagnosis. In addition, the file will be used to strengthen inputs into Statistics Canada's Population Health Model (POHEM) cancer module and the Dynamic Socio-Economic Modelling (DYSEM).

Description: This project builds on previous initiatives undertaken by Statistics Canada. First, in 2003, Statistics Canada's Policy Committee approved an initiative that drew a 15% sample of Canadians aged 25 or older from the 1991 Census 2B and 2D Long Forms and linked them to their 1991 and/or 1992 T1 tax returns, and subsequently to the Canadian Mortality Database (record linkage #012-2001). In 2009, this database was extended to cover a longer reference period and expanded to include information from the Canadian Cancer Database as well as postal code information on an annual basis (record linkage #052-2009).

Second, in 1999, Statistics Canada's Policy Committee approved the creation and annual update of the Longitudinal Worker File (LWF) (record linkage #006-99) for data year 1983 onward. An amendment was approved in 2007 (record linkage # 007-07) to add additional variables from the T1 personal tax file. In 2015, an improvement to the LWF was approved which expanded the file's sample size from a 10% random sample of Canadian workers to 100% of Canadian workers (record linkage #065-2015). The LWF contains information drawn from the T1, T4, Record of Employment, and the Longitudinal Employment Analysis Program (LEAP) files. The LWF provides longitudinal information on employment and earning outcomes from 1987 onward.

These two initiatives have yielded large and complementary databases – the first containing rich socio-demographic information (but little information on economic outcomes) and the second containing rich information on economic outcomes (but little socio-demographic information). Because of the large size of both databases, the overlap between them yields a subsample comprised of approximately 15% of Canadians who were aged 25 or older in 1991.

Output: Four separate analytical files will be created and linkable with a randomly-generated Statistics Canada respondent number.

Longitudinal Worker File output file: This file contains the demographic and economic variables from the 1987 onward LWF, individual- and family-level variables appended from the T1 Family File, and a randomly-generated Statistics Canada respondent number.

Census of Population output file: This file contains the socio-demographic variables from the 1991 Census of Population 2B and 2D (long forms) available in the original 1991 Census mortality cohort, as well as a randomly-generated Statistics Canada respondent number.

Mortality Output file: This file will contain the randomly-generated Statistics Canada number for each individual in the cohort, and the following mortality information: age, province/country of birth, underlying cause of death, nature of injury, province/country of death, sex, postal code and standard geographic codes of residence (e.g. Census Sub-Division), year, month, and day of death, derived person-years at risk, and mortality linkage weight.

Cancer Output file: This file will contain the randomly-assigned Statistics Canada number for each individual in the cohort, and the following information from the cancer database (CCDB): sex, province and year, month and day of diagnosis, year of birth, age, province or country of birth, diagnostic information (diagnostic codes, morphology and topography, morphology code indicator, source of registration, method of diagnosis, laterality, primary site number), patient vital status, province of residence, postal code of residence at diagnosis, year and province of death (if applicable), postal code of death (if applicable), cause of death (if applicable), and the cancer incidence linkage weight.

Methodological and analytical findings resulting from these linked data will be used to prepare research papers for publication in analytical reports, peer-reviewed scientific journals (including Statistics Canada's Health Reports), CANSIM, for presentation at conferences, workshops and meetings.

Only aggregate statistics and analysis conforming to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. The output files will be retained by Statistics Canada until December 31, 2022, at which time the continued retention of the files will be reviewed. All linkage keys and identifiers will be removed from the output files and retained separately, with access limited to Statistics Canada employees whose assigned work requires access to the file.

Linkage of the Census of Population 2006 and the Indian Register (IR) to mortality records for the purpose of estimating mortality rates for First Nations including Registered Indians, Inuit and Métis and examining the effect of social determinants of health on relative risk of death among Aboriginal populations. (093-2015)

Purpose: The record linkage and analysis is a Social and Aboriginal Statistics Division (SASD)-initiated project to generate new estimates for mortality rates for First Nations including Registered Indians, Inuit and Métis. The objective of the initiative is to address important information gaps in mortality rates, life expectancies, and role of social determinants of health in disparities in mortality rates, and also to explore improvements in methodology for estimating mortality rates. To this end, the mortality datasets (AMDB, CMBD) will be linked to the 2006 Census of Population and the Indian Register. As well, there will be an assessment of the validity of the linked file for analytical use.

An estimate of the mortality rates from different causes is vital for developing policies which may allocate scarce resources for prevention programs; developing prevention programs; informing and guiding future research for government agencies (including Statistics Canada), academic researchers, Aboriginal organizations, and other organizations; and informing the public and policy makers of potential disparities in mortality rates between First Nations, Métis and Inuit and non-Aboriginal populations. This information is expected to be useful to governmental agencies in all levels of government or organization that works on First Nations, Métis and Inuit issues or develops policies or programs.

Finally, better understanding of the estimation of risk of death after taking into account socio-economic characteristics in the different Aboriginal groups in comparison to the non-Aboriginal group will enable policy makers to see how much of the disparities in mortality rates can be attributed to these characteristics.

Description: The Census of Population 2006 and the Indian Register will be linked to the mortality datasets (AMDB, CMDB), 2006 to 2011.

The linked Census/IR/CMDB file will contain only those data items required to conduct the studies. All direct personal identifiers and addresses will be removed from the analysis file. Personal identifiers used for linkage purposes, such as name, death registration number and health insurance number, will be stored in separate files.

Output: The linked Census/IR/CMDB file will remain within Statistics Canada. All access to the linked microdata file will be restricted to Statistics Canada employees whose work activities require access. Only aggregate data that conform to the confidentiality provisions of the Statistics Act will be released outside of Statistics Canada. Research papers based on analyses of the linked data will be published by SASD or submitted for publication in the Statistics Canada peer-reviewed quarterly, Health Reports.

The linked analysis file will be retained until December 31, 2025, or until no longer required by Statistics Canada, at which point the continued retention of the file will be reviewed.

Creation of a Derived Record Depository and Key Registry for the Purposes of the Social Data Linkage Environment (094-2015)

Purpose: The Social Data Linkage Environment (SDLE) builds on past record linkage experience to make possible a program of pan-Canadian socio-economic record linkage research. A well-structured and regulated program of record linkage will increase the relevance of existing Statistics Canada surveys; substantially increase the use of administrative data; facilitate the integration of data from various social domains, such as health, education, justice and income thereby increasing the ability to analyse the impact of social determinants from any of these domains to the outcomes in other domains; reduce the burden on survey respondents by re-using already collected data; and maintain the highest data privacy and security standards.

A Derived Record Depository and separate Key Registry will be created to reduce privacy risks and to improve the efficiency and quality of the linkages.

Statistics Canada has responsibility for securely storing and processing data files and for the production of analysis files needed to carry out approved research studies. SDLE research projects will involve the use of linked records, and in accordance with Statistics Canada's Directive on Record Linkage, approval by the Chief Statistician is required for each new linkage project.

Description: The Derived Record Depository (DRD) is created by linking various Statistics Canada data files for the purpose of producing a list of unique individuals. Each individual in the DRD is assigned an anonymous SDLE identifier. The identifier is randomly assigned and has no value outside of the SDLE. Some of the data files used for the DRD include the T1 Personal Master Files (Tax), Canadian Child Tax Benefits (CCTB) files, Canadian Child Tax Benefits – Ident (CCTB-Ident) files, the SIN_ARUID, the DIN_ARUID, the DIN_ARUID, the SINSIN, the DINDIN, the DINSIN, the Dependant Registry, the Social Insurance Registry, the Canadian Birth Database (CBDB), the Canadian Mortality Database (CMDB), the Landed Immigrant Database and the Indian Registry. Future updates to these files will be used for further updates to the DRD.

The DRD would initially be comprised of the following personal identifiers: Surnames; Given names; Date of birth; Sex; Marital status; Date of landing/immigration; Date of emigration; Date of death; Social Insurance Numbers (SIN), Temporary Taxation Numbers (TTN), Dependant Identifier Numbers (DIN); Spouse's SIN/TTN; Dependant/Disabled individual SIN/TTN/DIN; Parent SIN/TTN; Health Information Numbers; Addresses; Address Registry Unique Identifier (ARUID); Standard Geography Classification (SGC) codes; Telephone numbers; Spouses' surname; Mother's surname; Father's surname; Alternate surname and a Statistics Canada-generated sequential identification number for each individual identified through the annual Derived Record Depository linkage process. Access to the Derived Record Depository will be restricted to the Statistics Canada employees responsible for its development and maintenance.

Linkage of the Derived Record Depository to administrative and survey databases held by Statistics Canada will be performed in a dedicated social data linkage data environment (the "SDLE"). To ensure a high level of data security and privacy, the association of Statistics Canada-generated identification numbers from the Derived Record Depository and the administrative and survey database Record Identifiers will be stored in a separate Key Registry, thus avoiding the need to store survey data with personal identifiers. For analytical studies, the associated SDLE Identifiers and the Record Identifiers will be used to link an individual's records within and among the databases in the SDLE environment. All such analytical studies will require prior linkage approval from Statistics Canada's Executive Management Board. Access to the Key Registry will be restricted to the Statistics Canada employees responsible for its development and maintenance and those responsible for the creation of linked analysis data files.

The Key Registry will contain linkage keys to permit linkage for approved studies to data files held at Statistics Canada. Some of these files include but are not limited to:

  • T1 Personal Master File;
  • Canadian Child Tax Benefits;
  • Longitudinal Immigration Database;
  • Birth and death databases;
  • Census of Population (1991 onward);
  • National Household Survey;
  • National Longitudinal Survey of Children and Youth;
  • Longitudinal Survey of Immigrants to Canada;
  • Survey of Labour and Income Dynamics;
  • Youth in Transition Survey;
  • National Population Health Survey;
  • T1 Family File;
  • Clinical administrative databases (inpatient and outpatient hospital records, 1992 onward);
  • Canadian Cancer Registry;
  • Canadian Community Health Survey (all cycles);
  • Canadian Health Measures Survey (all cycles);

Output: No information from the Derived Record Depository will be released outside of Statistics Canada. The Derived Record Depository and Key Registry will be used exclusively to support the development of research files within the SDLE. Statistics Canada will retain the Derived Record Depository and Key Registry files until it is determined that there is no further need for them.

Research projects will be approved on a study-by-study basis. These may be carried out as part of a research agenda initiated by Statistics Canada or in response to client requests. A summary of each approved study will be posted on the Statistics Canada web site.

Statistics Canada's Website Evaluation 2010

Archived information

Archived information is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please "contact us" to request a format other than those available.

Background

  • Website evaluation first conducted in 1997
  • Conducted annually until 2007
  • 2010: Focus on task completion
    • Now THE measure of a successful user-centric website
    • Fact-based

Research objectives

  • Measure success
    • Task completion based on primary purpose of “today’s” visit
    • Overall satisfaction with the website in general
  • Identify any significant changes to respondent profile
  • Identify priorities for improvement
  • Obtain feedback on two recent site changes: redesigned Home page and updated search function

Methodology

  • Innovative intercept technology developed for the invitation
    • Deployed across the site
    • All visitors invited to participate
  • Short core questionnaire with optional content (search/Home page)
  • Launched April 8, 2010
    • Live for 15 days to April 23, 2010
    • Almost 10,000 respondents (versus slightly over 2000 in 2007)
    • Response rate: 3%

Results: Respondent profile

  • Occupation/Sector: Results similar to previous years – Education represents the largest sector, followed by government and business
  • New - Usage of mobile devices: Devices currently used to access websites in general (check all)
    • Most common way is still a desktop PC (72%)
    • Laptop/notebook (61%)
    • Mobile Phone/Smartphone/or similar device (15%)
      • Recent Visitor Pattern Analysis indicated that only 0.4% of visitors to the StatCan site used mobile devices

Findings: Frequency of visits

  • In 2010, infrequent visitors (62%) represented the majority of visitors

Findings: Information sought and planned use

  • Looking for data/tables on a specific topic (48%) and studies /articles/publications on a specific topic (16%)
    • The top topics of interest:
      • 4 Key Indicators (13%)
        (CPI annual inflation; Population estimate; Unemployment rate; Monthly GDP growth)
      • Health (9%)
      • Population/Demography (9%)
    • Half of respondents were looking for social statistics topics
  • How respondents were planning to use the information
    • For school assignment purposes (19%)
    • For academic purposes (16%)
    • For business development or analysis (13%)
    • For policy research, analysis and development (12%)

Findings: Task completion success

  • In 2010, 65% of respondents completed their task successfully…
  • …compared with only 55% who found All/Most of their information in 2007
  • Three-quarters of frequent visitors were successful in completing their task
  • The rate was highest for respondents looking for information in The Daily (86%)
  • The rate for respondents looking for census, aboriginal and demography statistics was 69%

Findings: Overall satisfaction

  • Overall satisfaction (65%) appears to have decreased since 2007

Findings: Optional questions

  • Home page used today (2,073)
    • Frequent visitors - 48%; Infrequent visitors – 52%
    • Of these, 59% of respondents found what they were looking for using new features – Analysts and researchers; Browse by key resource
  • Search function used today (2,029)
    • Frequent visitors –38%; Infrequent visitors – 62%
    • Of these, 49% succeeded in finding the information they were looking for using search
      • Of these, 48% found what they were looking for in the first 3 search results

Findings: Suggestions for improvement

  • Ease of access to data/information still ranks as the top priority for improvement

Summary of findings

  • Top three sectors are still education, government and business
  • Infrequent visitors represent a majority of respondents (62%)
  • 65% of respondents succeeded in completing their task
    • Of these, 71% found it easy to complete
  • Low completion rate when looking for information on:
    • Jobs at Statistics Canada
    • Specific topics:
      • Education, training and learning
      • Crime and justice
      • Health
      • Families, Households and Housing
  • Respondents’ top priorities for improvement:
    • Ease of access to data/information
    • Search
Date modified:

Social and Aboriginal Statistics Program

Archived information

Archived information is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please "contact us" to request a format other than those available.

Consultation summary

This document contains excerpts from the 2009 Quadrennial Program Report for the Social and Aboriginal Statistics Program, covering the 2005/06 – 2008/09 reference period. Statistics Canada has established an integrated program evaluation and reporting system. In that system, statistical programs undergo a full program evaluation every four years. A major component of the evaluation is the extent to which existing statistical products and services continue to meet the evolving needs of clients.

Results

A satisfaction survey of clients of the Social and Aboriginal Statistics Division (SASD) was conducted in June 2009, and included clients who used the data in 2007/2008 and 2008/2009. A total of 129 clients participated in the survey.

The SASD solicited comments from the clients of its survey programs (General Social Survey (GSS), Aboriginal Children's Survey (ACS) and Aboriginal Peoples Survey (APS)), of its data products (Immigrant Database, Statistics Canada website products and custom tabulations) and its analytical publications (Canadian Social Trends, Women in Canada and A Portrait of Seniors in Canada).

The clients of SASD products consider them very important since all of the overall appreciation scores were above 4 out of 5 (on a scale from 1 to 5).

Generally, client satisfaction was quite high, with most of the products scoring an average of 4 or more. The products related to Aboriginal surveys scored somewhat lower on average. The clients of these two surveys indicated slightly less satisfaction with the accessibility and timeliness of these survey results.

The compiled results clearly indicate that the quality of the Division's surveys, products and services is considered very high, if we judge by the high percentage of clients who rated 4 or 5 for each of the quality indicators (relevance, timeliness, accessibility, interpretability and accuracy). Among these indicators, client satisfaction with the accuracy of our surveys, products and services was quite high. For the remaining indicators, the degree of satisfaction was generally quite high, although some clients indicated less satisfaction for some surveys, products or services. SASD will use these results to make the necessary improvements.

Accessibility

As seen from the client satisfaction survey, our clients value accessibility highly. Some clients appeared to be concerned about access to GSS and the APS data based on the high percentages indicating a low level of satisfaction in this area (16% and 24% respectively). Some clients commented that they could not access the data centre, that they would like more detailed geographic data on our website and, with respect to Aboriginal statistics, that they would like all of the data on the topic to be accessible in one place on our site.

Statistics Canada thanks participants for their participation in this consultation. Their insights guide the Agency's web development and ensure that the final products meet users' expectations.

Date modified: