Data ethics part 2: Ethical reviews

Catalogue number: 892000062022004

Release date: October 17, 2022

In this video, you will learn the answers to the following questions:

  • What are ethical reviews?
  • How do ethical reviews help Statistics Canada apply data ethics principles throughout the data journey?

Using a case example, this video will show you how Statistics Canada uses ethical reviews to apply data ethics principles throughout the data journey.

Data journey step
Foundation
Data competency
  • Data quality evaluation
  • Data security and governance
  • Data stewardship
Audience
Basic
Suggested prerequisites
Data ethics: An introduction
Length
11:20
Cost
Free

Watch the video

Data ethics part 2: Ethical reviews - Transcript

(The Statistics Canada symbol and Canada wordmark appear on screen with the title: "Data ethics part 2: Ethical reviews - A case study")

Gathering, exploring, analyzing and interpreting data are essential steps in producing information that benefits society, the economy and the environment. In this video, we will discuss the importance of considering data ethics throughout the process of producing statistical information.

Learning goals

(Text on screen: In this video, you will learn the answers to the following questions:

  • What are ethical reviews?
  • How do ethical reviews help Statistics Canada apply data ethics principles throughout the data journey?

Pre-requisite viewing: "Data Ethics: An introduction"" also available in Statistics Canada's Data Literacy Training Learning Catalogue.)

As a pre-requisite to this video, make sure to watch the video titled "Data Ethics: An Introduction" also available in Statistics Canada's data literacy training catalog. In this video, you will learn the answers to the following questions:

  • What are ethical reviews?
  • And how do ethical reviews help Statistics Canada apply data ethics principles throughout the data journey?

Using a case example, this video will show you how Statistics Canada uses ethical reviews to apply data ethics principles throughout the data journey.

Steps of the data journey

(Diagram of the Steps of the data journey: Step 1 - define, find, gather; Step 2 - explore, clean, describe; Step 3 - analyze, model; Step 4 - tell the story. The data journey is supported by a foundation of stewardship, metadata, standards and quality.)

This diagram is a visual representation of the data journey from collecting the data to exploring, cleaning, describing and understanding the data. To analyzing the data and lastly to communicating with others the story the data tell.

Data ethics principles are relevant throughout all steps in the data journey.

What is an ethical review?

(Text on screen:

  • Series of questions, comments and statements that are meant to obtain enough information about a given project to have a rational discussion on its ethical merits.
  • Always conducted by more than one individual. Each member of this ethics committee should have a professional background in science and/or ethics.
  • Aimed at providing ethical guidance to those working on the project.
  • Organized following the 6 guiding principles of Data Ethics at Statistics Canada.)

In part one of this video series on data ethics, we introduced you to the concept of data ethics and why data ethics are important. We also touched on how ethical reviews helped to obtain enough information about a given data acquisition or project in order to have a rational discussion on its ethical merits. This discussion always involves more than one person, and each person should have a professional background in science and or ethics in order to provide ethical guidance to those working on the project.

The ethical review we will use in this case study is organised to follow Statistics Canada's six guiding principles of data ethics.

Six guiding principles

(Text on screen: The six guiding principles of data ethics at Statistics Canada are...

  • Data are used to benefit Canadians
  • Data are used in a secure and private manner
  • Data acquisitions and processing methods are transparent and accountable
  • Data acquisitions and processing methods are trustworthy and sustainable
  • The data themselves are of high quality
  • Any information resulting from the data are reported fairly and do no harm)

At Statistics Canada, the ethical review of a project is generally based on 6 guiding principles:

  • Data are used to benefit Canadians.
  • Data are used in a secure and private manner.
  • Data acquisitions and processing methods are transparent and accountable.
  • Data acquisitions and processing methods are trustworthy and sustainable.
  • The data themselves are of high quality.
  • Any information resulting from the data are reported fairly and do no harm.

Case study: Survey on Narcotics Among Minors

(Text on screen: The Centre for Population Health Data is currently developing a new survey, the 2022 Canadian Survey on Narcotics among Youth (CSNY). Given that youth are a vulnerable population and the subject matter could be considered sensitive, the purpose of the following ethical review is to help make informed decisions with respect to this data acquisition, as well as to assist in completing the documentation required in order to justify its use.

The 2022 Canadian Survey on Narcotics among Youth (CSNY) is a fictitious survey to be used as an example throughout this video.)

The following is a fictitious survey that will be used as an example throughout this video.

The Centre for Population Health Data is currently developing a new survey, the 2022 Canadian Survey on Narcotics among Youth, or CSNY. Given that youth are a vulnerable population and that the subject matter could be considered sensitive, the purpose of the following ethical review is to help make informed decisions with respect to this data acquisition, as well as to assist in completing the documentation required in order to justify its use.

Benefits to Canadians.

(Text on screen: Data should be used to make informed decisions and manage resources effectively, ultimately aiming to clearly benefit the lives of Canadians.

  • Why is this data necessary? Who will it benefit and how?
  • What are some examples of ways in which these data could be used to help Canadians?)

When asking about the benefits to Canadians, the intention of an ethical review is to ensure that the data acquisition is necessary and provide examples of the ways in which these data could be used to help Canadians.

Case Study: Benefits To Society

(Text on screen: Obtaining data on narcotic use among youth is necessary in order to allocate resources and create prevention programs tailored to address the specific variables shown to impact drug use among young Canadians.

  • Example: Survey responses could suggest a link between experiencing bullying at school and drug use. Programs could aim to address bullying.
  • A persistent data gap in this area could have negative consequences.)

In regards to our case study, the justification for collecting data on the use of narcotics among youth, is that data on narcotics or opioids, specifically among minors, was previously unavailable and by collecting these data, there could be an opportunity to allocate resources and create prevention programs tailored to address the specific drivers shown to impact drug use among young Canadians.

For example, should the analysis of these data suggest a link between experiencing bullying at school and narcotic use, such prevention programs could aim to address bullying. Inversely, it might be argued that not going forward with the survey could have negative consequences. Most severely of which being a number of deaths which possibly could have been avoided had the current data gap been filled, and prevention programs put in place.

Privacy and Security.

(Text on screen: There is a fine balance between respecting privacy and producing information. We must ensure that any intrusion our statistical activities may cause is proportional to the requirements identified as absolutely necessary in order to produce that information.

  • Every data point counts. Is all of the information being requested, needed?
  • What measures are being taken in order to protect the privacy of Canadians?)

There is a fine balance between respecting privacy and producing information. We must ensure that any sense of intrusion our statistical activities may cause is proportional to the requirements identified as absolutely necessary in order to produce that information.

  • Remember, every data point counts. So is all of the information being requested actually needed?
  • What measures are being taken in order to protect the privacy of Canadians?

Case Study: Privacy and Security

(Text on screen:

  • Why are we asking for this information?
    • A data gap currently exists regarding use of narcotics among youth. Meaning, no existing sources are available.
  • What measures are being taken in order to protect the privacy of respondents?
    • The questionnaires will be password-protected and have a quick-exit option to help ensure privacy throughout the survey completion process.)

Our fictional survey proposes to ask potentially sensitive questions to youth, therefore we need to explain how the acquisition of these data is proportional to the benefit it aims to achieve. In this case, there is no other reliable data available, and so this survey would become a viable option for programs requiring this kind of information.

The ethical review process also allows us to take a deeper dive into what security measures are being taken to avoid any breach of privacy, as well as any countermeasures in place, should a breach occur. For this particular survey, there are safety mechanisms in place to protect the privacy of respondents who, as miners might feel more comfortable knowing their answers, will remain confidential. We will discuss the specifics of these measures later on in the video.

Transparency and Accountability.

(Text on screen: Statistical organizations have the responsibility to be transparent about where the data come from, how they are used and the steps taken to ensure confidentiality.

  • It is common to make available such details as what strategies they intend to put in place to inform Canadians about this data acquisition.
  • How are we communicating the benefits of the acquisition and the measures taken to protect their privacy?)

Statistical activities have the responsibility to be transparent about where the data comes from, how they are used and the steps taken to ensure confidentiality.

Questions commonly asked at this stage include a request to provide more detail on what strategies they intend to put in place to inform Canadians about this data acquisition, as well as how the data acquisition benefits Canadians and measures taken to protect their privacy.

Case Study: Transparency and Accountability

(Text on screen:

  • What strategies will be put in place to inform Canadian youth about this survey?
    • Information about the survey will be placed on Statistics Canada's website to be accessed by all interested parties. In the survey questionnaire itself, young respondents will be informed of the goals of the survey.
    • The questionnaire will also inform respondents how the survey plans to benefit society, the measures taken to protect privacy and how their information will remain confidential.)

In our case study, aspects around transparency and accountability will be addressed when the strategies to be put in place to inform Canadian youth about this survey are specified.

Information about the survey will be placed on Statistics Canada's website for all interested parties to view freely. Then, via the survey questionnaire itself, young respondents will be informed of the goals of the survey.

The questionnaire will also inform respondents how the survey plans to benefit them and society as a whole, the measures taken to protect their privacy and how their information will remain confidential even if the data are used by other government agencies for their research and programs purposes. In this case, such agencies might include Health Canada and the Public Health Agency of Canada.

Data Quality

(Text on screen: Acquired data must be as representative and accurate as possible.

  • Have any potential sources of bias for this data source been identified so far? If so, how will they be managed?)

Canadians should expect that the data acquired and statistical information provided by their government be as representative as possible. Maintaining this expectation means ensuring that biases and errors do not compromise the potential benefits of a project. At Statistics Canada, we meet this expectation by applying scientifically proven and statistically rigorous methods in all steps of the data journey.

Case Study: Data Quality

(Text on screen:

  • What strategies will be put in place to inform Canadian youth about this survey?
    • Information about the survey will be placed on Statistics Canada's website to be accessed by all interested parties. In the survey questionnaire itself, young respondents will be informed of the goals of the survey.
    • The questionnaire will also inform respondents how the survey plans to benefit society, the measures taken to protect privacy and how their information will remain confidential.)

A potential threat to data quality is the fact that respondents often live with their parents, and some of them may not benefit from total privacy in order to give honest answers to questions, especially concerning questions on drug use, be these illegal or prescribed. there could be significant bias if respondents do not answer honestly. In this case, the questionnaires will be password protected and have a quick exit option to help preserve privacy, but the potential for bias still exists if the respondent finds the questions too personal.

Fairness and Do No Harm

(Text on screen: When conducting statistical activities, it is necessary to consider all the potential risks that a statistical activity may pose to the well-being of individuals or specific groups.

  • Can you foresee any negative consequences an individual might experience as a result of this data acquisition?
  • Might any part of the data acquisition process cause undue stress to Canadians?)

It is necessary to consider all the potential risks to the well-being of Canadians. How statistical activities are carried out and how the resulting information is communicated must be considered in order to promote equity among all Canadians. To be fair and do no harm means any negative consequences an individual might experience as a result of this data acquisition must be foreseen before any data is collected or obtained. Is it possible that any part of the data acquisition process might cause undue stress to Canadians?

Case study: Fairness and Do No Harm

(Text on screen:

  • What, if any, negative consequences might a respondent experience as a result of answering this survey?
    • Some of the topics covered in the survey can trigger emotional responses: Bullying, mental health, school performance
  • How will you address questions that might be distressing to respondents?
    • Mental health resources will be provided to respondents along with the questionnaire, and interviewers have received training to deal with difficult situations.)

When thinking about potential negative consequences to taking part in our fictional survey, respondents to the Canadian Survey on Narcotics among Youth might have emotional responses triggered by questions on their experiences with bullying, mental health or school performance. In this case, the ethical review committee should have inquired about the steps taken to mitigate the risk and in response, confirmed that mental health resources will be given to respondents throughout the duration of the questionnaire completion process and, afterwards, should they be required.

Trust and Sustainability

(Text on screen: Statistics Canada needs active participation from Canadians to ensure that we can continue our statistical activities going forward.

  • How will we ensure we are able to continue producing high quality information that matters to Canadians while maintaining the trust of the public long-term?)

Statistics Canada needs active participation from Canadians to ensure that we can continue our statistical activities going forward. Assuring confidentiality, protecting personal information, producing representative data, and being accountable are all choices Statistics Canada makes in order to show Canadians that their trust is well-placed. This trust is essential if Statistics Canada is to continue producing high quality information that matters to Canadians while maintaining the trust of the public long-term.

Case Study: Trust and Sustainability

(Text on screen:

  • The survey will inform respondents that any information that they provide will not be shared with legal authorities, parents or guardians of any kind.
  • Explaining our statistical business processes, including our ethical reviews, will help maintain the trust of Canadians and, thus, ensure the sustainability of our statistical programs.)

In order to maintain the trust of Canadian youth, we will explain to respondents that any information that they provide will not be shared with legal authorities or their parents. Explaining our statistical business processes, including our ethical reviews, will help maintain the trust of Canadians, their confidence in our processes and our promise of confidentiality. Because, in the absence of such trust, we cannot continue to produce high quality information that benefits society, the economy and the environment.

Recap of Key Points

(Text on screen:

  • Ethical reviews are a series of questions and comments that are meant to obtain enough information about a given project to have a rational discussion on its ethical merits.
  • Ethical reviews are organized following the 6 Guiding Principles of Data Ethics at Statistics Canada.)

In this video entitled Data ethics part 2: Ethical reviews, we learned that ethical reviews are a series of questions and comments that are meant to obtain enough information about a given project to have a rational discussion on its ethical merits.

At Statistics Canada, ethical reviews are organized following the six guiding principles of data ethics.

(The Canada Wordmark appears.)

What did you think?

Please give us feedback so we can better provide content that suits our users' needs.