Subject: Participate in Statistics Canada's Study on Living with a Life-limiting Illness: Access to Care and Related Experiences

While slower labour productivity growth over much of the past decade stems largely from declines in business investment, concerns persist over the extent to which businesses are harnessing the benefits of innovation and advanced technologies. This presentation highlights data and analysis at Statistics Canada that can be used to explore linkages between innovation, technology adoption and productivity. It draws on new estimates from the agency’s productivity research program, along with recent surveys that examine the innovation and technological stance of Canadian businesses. The presentation is intended to support ongoing research on the competitiveness of Canada’s economy.

English webinar:

• Thursday, October 3, 2024, 1:00 pm to 2:00 pm, Eastern Time

French webinar:

• Friday, October 11, 2024, 1:00 pm to 2:00 pm, Eastern Time

Getting started

Why are we conducting this survey?

This survey collects information to better understand the issues that impact the sexual and reproductive health of women aged 18 to 49 in Canada. Topics include menstruation, sexual health and behaviours, birth control, pregnancy intentions, as well as access and barriers to care for miscarriage, still birth, ectopic pregnancy and abortion. The survey also collects information about access to a regular health care provider, as well as gynaecological surgeries and procedures.

Even after agreeing to participate in the survey, you may choose not to answer specific questions where you feel uncomfortable providing a response.

Results from the survey will be used by researchers, all levels of government and other organizations to assess and inform equitable program and policy development to better support women's sexual and reproductive health.

Your information may also be used by Statistics Canada for other statistical and research purposes.

Although voluntary, your participation is important so that the information collected is as accurate and complete as possible.

Other important information

Authorization and confidentiality

Data are collected under the authority of the Statistics Act, Revised Statutes of Canada, 1985, Chapter S-19. Your information will be kept strictly confidential.

Record linkages

To enhance the data from this survey and to reduce the response burden, Statistics Canada will combine the information you provide with information from the tax data of all members of your household. Statistics Canada and your provincial ministry of health, and the Institut de la statistique du Québec for Quebec respondents, may also combine the information you provide with other surveys or administrative data sources.

Statistics Canada may also combine the information you provide with other survey or administrative data sources.

Contact us if you have any questions or concerns about record linkage:

Email: infostats@statcan.gc.ca

Telephone: 1-877-949-9492

Mail:
Chief Statistician of Canada
Statistics Canada
Attention of Director, Centre for Population Health Data
150 Tunney's Pasture Driveway
Ottawa, Ontario K1A 0T6

Demographics

Are you [FIRSTNAME] [LASTNAME]?

• Yes
• No
• No, my name has changed

What is your new name?

• First name
• Last name

What is your date of birth?

• Year
• Month
• Day

What is your age?

• Age in years

Geographic region

In which province or territory do you currently live?

• Province or territory
  OR
• Outside of Canada

To determine which geographic region you live in, provide your postal code.

• Postal code
  Example: A9A 9A9

Including yourself, how many people usually live in your household?

Note: Press the help button (?) for additional information, including who to include and who not to include.

• Number of people

Sex and Gender

The following questions are about sex at birth and gender.

What was your sex at birth?

Sex refers to sex assigned at birth.

• Male
• Female

What is your gender?

Gender refers to current gender which may be different from sex assigned at birth and may be different from what is indicated on legal documents.

Is it:

• Male
• Female
• Or please specify
  • Specify your gender

Please verify that all of the information is correct.

If all the information is correct, press the Next button.

To make changes, press the Previous button.

Your information

Sex assigned at birth: [Male/Female/Information not provided]

Gender: [Male/Female/Response/Information not provided]

Marital status

What is your marital status?

Is it:

• Married
  For Quebec residents only, select the "Married" category if your marital status is "civil union".
• Living common law
  Two people who live together as a couple but who are not legally married to each other.
• Never married (not living common law)
• Separated (not living common law)
• Divorced (not living common law)
• Widowed (not living common law)

Steady relationship

Are you currently in a steady relationship?

• Yes
• No

Sexual orientation

This question collects information on sexual orientation to inform programs that promote equal opportunity for everyone living in Canada to share in its social, cultural, and economic life.

What is your sexual orientation?

Sexual orientation refers to how a person describes their sexuality.

Would you say:

• Heterosexual (i.e., straight)
• Lesbian or gay
• Bisexual or pansexual
• Or please specify
  • Specify your sexual orientation

General health

The following questions are about health. By health, we mean not only the absence of disease or injury but also physical, mental and social well-being.

In general, how is your health?

Would you say:

• Excellent
• Very good
• Good
• Fair
• Poor

In general, how is your mental health?

Would you say:

• Excellent
• Very good
• Good
• Fair
• Poor

Disability

Do you identify as a person with a disability?

A person with a disability is a person who has a long-term difficulty or condition, such as vision, hearing, mobility, flexibility, dexterity, pain, learning, developmental, memory or mental health-related impairments, that limit their daily activities inside or outside the home such as at school, work, or in the community in general.

• Yes
• No

Menstruation

This survey asks questions related to sexual behaviours, birth control and pregnancy, all of which are based on sex at birth.[ If specific questions are not relevant, they can be skipped./BLANK]

Menstruation can be an indication of reproductive health. The information provided will help inform guidelines, programs and policies.

At what age did you have your first menstrual period?

Menstruation is when blood and tissue from your uterus comes out of your vagina.

If exact age is not known, provide your best estimate.

• Age in years
  OR
• I have never had a menstrual period 

In the past 12 months, have you had a menstrual period?

Select "Yes" if you have had at least one menstrual period.

• Yes
• No

What is the main reason you have not had a menstrual period?

Was it:

• Pregnancy or breastfeeding
• Removal of the uterus or both ovaries
• Radiation or chemotherapy affecting the uterus or both ovaries
• Menopause
• Hormonal birth control
  e.g., birth control pill, hormonal intrauterine device (IUD), injection
• Medication, hormones, or drugs
  Exclude birth control.
• Excessive physical activity, stress, weight loss
• Other
  • Specify other reason
• I don't know

Sexual behaviour and birth control

The next questions are about sexual behaviour. Understanding sexual behaviour can help inform the development of more equitable programs and policies related to birth control and pregnancy. Please be assured that, like all other information you have provided, these answers will be kept strictly confidential.

Have you ever had sex?

Include vaginal, oral or anal sex.

Note: Press the help button (?) for a list of support resources.

• Yes
• No

Who have you had sex with?

Please respond based on sex assigned at birth.

Include vaginal, oral or anal sex.

Select all that apply.

Was it:

• Males
• Females

Which of the following types of sex have you ever had?

Select all that apply.

Would you say:

• Vaginal
  i.e., a penis in a vagina
• Oral
  i.e., a mouth on the penis, vagina or anus
• Anal
  i.e., a penis in an anus

How old were you the first time you had vaginal sex?

If exact age is not known, provide your best estimate.

• Age in years

How old were you the first time you had oral sex?

If exact age is not known, provide your best estimate.

• Age in years

How old were you the first time you had anal sex?

If exact age is not known, provide your best estimate.

• Age in years

How many sexual partners have you ever had?

Sexual partners are people who have sex together, whether just once, a few times or as regular partners.

Include vaginal, oral or anal sex.

Would you say:

• 1
• 2 to 4
• 5 to 9
• 10 to 14
• 15 or more

In the past 12 months, have you had sex?

Include vaginal, oral or anal sex.

Note: Press the help button (?) for a list of support resources.

• Yes
• No

In the past 12 months, who have you had sex with?

Respond based on sex assigned at birth.

Include vaginal, oral or anal sex.

Select all that apply.

Was it:

• Males
• Females

In the past 12 months, which of the following types of sex have you had?

Select all that apply.

Was it:

• Vaginal
  i.e., a penis in a vagina
• Oral
  i.e., a mouth on the penis, vagina or anus
• Anal
  i.e., a penis in an anus

In the past 12 months, how many sexual partners have you had?

Sexual partners are people who have sex together, whether just once, a few times or as regular partners.

Include vaginal, oral or anal sex.

Would you say:

• 1
• 2 to 4
• 5 to 9
• 10 to 14
• 15 or more

The last time you had vaginal sex, did you or your partner use any of the following types of birth control?

Select all that apply.

Would you say:

• Rhythm or calendar method
  e.g., tracking ovulation cycle
• Condoms
• Birth control pills
• Injection
  e.g., Depo-Provera®
• Hormonal intrauterine device (IUD) such as Mirena® or Kyleena®
• Copper intrauterine device (IUD) also called a "Coil" or "Copper T"
• Hormonal implant such as NEXPLANON®
• Contraceptive patch or vaginal contraceptive ring
  e.g., EVRA® patch, NuvaRing®
• Withdrawal or pulling out
• Vasectomy
  i.e., a permanent surgical procedure to close or block the Vas Deferens, that is the tubes that carry sperm to penis
• Tubal sterilization, also known as having your "tubes tied", or hysterectomy
• Cervical cap or diaphragm
• Spermicide
  e.g., jelly, foam or contraceptive sponge
  OR
• None
  OR
• I don't know

Since the last time you had vaginal sex, have you [changed the type of birth control you are using/started using birth control]?

• Yes
• No

Birth control

Birth control can be used for pregnancy prevention or for other health reasons. Are you currently using any of the following types of birth control?

Select all that apply.

Are you using:

• Rhythm or calendar method
  e.g., tracking ovulation cycle
• Condoms
• Birth control pills
• Injection
  e.g., Depo-Provera®
• Hormonal intrauterine device (IUD) such as Mirena® or Kyleena®
• Copper intrauterine device (IUD) also called a "Coil" or "Copper T"
• Hormonal implant such as NEXPLANON®
• Contraceptive patch or vaginal contraceptive ring
  e.g., EVRA® patch, NuvaRing®
• Withdrawal or pulling out
• Vasectomy
  i.e., a permanent surgical procedure to close or block the Vas Deferens, that is the tubes that carry sperm to penis
• Tubal sterilization, also known as having your "tubes tied", or hysterectomy
• Cervical cap or diaphragm
• Spermicide
  e.g., jelly, foam or contraceptive sponge
  OR
• None of the above

People may not be able to get birth control or access their preferred type of birth control. In the past 12 months, did any of the following reasons make it difficult for you to get birth control?

Select all that apply.

Would you say:

• Cost
• Lack of health care provider
• Getting an appointment or wait time too long
• Negative attitude of health care provider or previous negative experience
  e.g., lack of respect, culturally appropriate care or a disagreement
• Lack of social support or worried about reaction of others
  e.g., personal, family, cultural or religious values or beliefs
• Transportation
• Preferred type of birth control not available in area
• Concerns about privacy
• Side-effects, health concerns or medical concerns
• Other
  OR
• No difficulties
  OR
• I do not want to use birth control

Emergency birth control

The next few questions are about emergency birth control. Emergency birth control, sometimes known as the "morning after pill" is birth control that can be used after sex to lower the chance of becoming pregnant.

People may not use birth control, can forget to use birth control or forget to use it regularly.

In the past 12 months, have you needed emergency birth control?

Emergency birth control includes the "morning after pill" such as Plan B®.

Note: Press the help button (?) for more information or for a list of support resources.

• Yes
• No

In the past 12 months, did you use emergency birth control?

• Yes
• No

In the past 12 months, did you have any difficulties getting emergency birth control?

Would you say:

• Yes
• No
• I have not tried to get emergency birth control

Sexual behaviour and communication

Please think back to the past 12 months and indicate the answer that most applies to you in sexual situations with a partner. In these statements, "partner" refers to any sexual partners you had in or out of a relationship, in the past 12 months.

Note: Press the help button (?) for a list of support resources.

a. I am open with my partner about my sexual needs

• Strongly disagree
• Disagree
• Agree
• Strongly agree

b. I let my partner know if I want to have sex

• Strongly disagree
• Disagree
• Agree
• Strongly agree

c. It is easy for me to discuss sex with my partner

• Strongly disagree
• Disagree
• Agree
• Strongly agree

d. I refuse to have sex if I don't want to

• Strongly disagree
• Disagree
• Agree
• Strongly agree

e. I find myself having sex when I do not really want it

• Strongly disagree
• Disagree
• Agree
• Strongly agree

f. It is easy for me to say no if I don't want to have sex

• Strongly disagree
• Disagree
• Agree
• Strongly agree

Please think back to the past 12 months and indicate the answer that most applies to you in sexual situations with a partner. In these statements, "partner" refers to any sexual partners you had in or out of a relationship, in the past 12 months.

For partners who have been together for more than 12 months, consider the whole relationship.

Note: Press the help button (?) for a list of support resources.

a. I ask my partner if they practiced safe sex with other partners

• Strongly disagree
• Disagree
• Agree
• Strongly agree

b. I ask my partner about their sexual history

• Strongly disagree
• Disagree
• Agree
• Strongly agree

c. I ask my partner whether they have ever had a sexually transmitted infection or disease

• Strongly disagree
• Disagree
• Agree
• Strongly agree

Sexual health

Some people go through times when they are not interested in sex or find it difficult to enjoy sexual activities. The questions that follow are about some common difficulties that people experience.

In the past 12 months, how often have you had any of the following sexual health concerns?

a. Loss of pleasure

• Always
• Often
• Sometimes
• Rarely
• Never

b. Little interest in sex

• Always
• Often
• Sometimes
• Rarely
• Never

c. Difficulty with arousal

• Always
• Often
• Sometimes
• Rarely
• Never

d. Fear of sexual activity

• Always
• Often
• Sometimes
• Rarely
• Never

e. Pain or physical discomfort during or after intercourse or sexual activity

• Always
• Often
• Sometimes
• Rarely
• Never

Using a scale of 0 to 10 where 0 means "Very dissatisfied" and 10 means "Very satisfied", how do you feel about your sex life as a whole right now?

• 0 ─ Very dissatisfied
• 1
• 2
• 3
• 4
• 5
• 6
• 7
• 8
• 9
• 10 ─ Very satisfied

Pregnancy, pregnancy outcomes and access to care

Have you ever been pregnant?

Select "Yes" if you are currently pregnant or have had a live birth, abortion, stillbirth, miscarriage, ectopic or tubal pregnancy.

Note: Press the help button (?) for a list of support resources.

• Yes
• No

Have you ever given birth?

Select all that apply.

Would you say:

• Yes, vaginal
• Yes, caesarean
  OR
• No, I have not given birth

Are you currently pregnant?

• Yes
• No
• I don't know

How many weeks pregnant are you?

• Less than 12 weeks
• 12 to less than 20 weeks
• 20 to less than 24 weeks
• 24 weeks or more

Please indicate to what extent the following statement describes your current situation.

It is important to me to avoid getting pregnant right now.

Would you say you:

• Strongly agree
• Agree
• Neither agree nor disagree
• Disagree
• Strongly disagree

In the past 5 years, have you been pregnant? Include pregnancies that resulted in a live birth, abortion, stillbirth, miscarriage, ectopic or tubal pregnancy. 

• Yes
• No

Thinking of your [current/most recent] pregnancy, in the month that you became pregnant, which of the following statements best describes how birth control was being used? Pregnancies resulting in a live birth, abortion, stillbirth, miscarriage, ectopic or tubal pregnancy should be included.

Note: Press the help button (?) for more information or for a list of support resources.

In the month you became pregnant:

• Birth control was not used
• Birth control was used but not every time
• Birth control was always used and we thought it failed at least once
  e.g., it broke, moved, came off, came out, or similar
• Birth control was always used and we did not think it had failed

For this question, think of when you first learned about your [current/most recent] pregnancy.

In terms of becoming a mother or a parent, for the first time or again, which of the following statements best describes your feelings about when this pregnancy happened?

Would you say:

• It was the right time
• It was later than you wanted
• It was sooner than you wanted
• It was the wrong time
• There would never be a right time

For your [current/most recent] pregnancy, thinking about the time just before you became pregnant, which of the following statements best describes your intentions about getting pregnant?

Would you say:

• You intended to get pregnant
• Your intentions to get pregnant kept changing
• You did not intend to get pregnant

For your [current/most recent] pregnancy, thinking about the time just before you became pregnant, which of the following statements best describes your feelings about having a baby?

Would you say you:

• Wanted to have a baby
• Had mixed feelings about having a baby
• Did not want to have a baby

Before your [current/most recent] pregnancy, which of the following statements best described your situation?

A partner could be a husband, wife, common-law partner or someone you have had sex with once or twice.

Would you say:

• You chose to become pregnant without a partner
• You and your partner had discussed getting pregnant together
• You and your partner never discussed having children together

What was the result of the discussion about pregnancy?

Was it:

• We agreed to get pregnant
• We had not agreed about getting pregnant
• We agreed to not get pregnant

In preparation for your [current/most recent] pregnancy, did you take any of the following actions before becoming pregnant?

Select all that apply.

Did you:

• Take prenatal vitamins
  e.g., folic acid
• Seek health advice to prepare for pregnancy
  e.g., from books or professionals
• Review or make changes to improve health
  e.g., you or your partner stopped or reduced smoking, use of alcohol, cannabis or other drugs; you ensured healthy eating and exercise
• Track your monthly menstrual cycle to try to become pregnant
• Use fertility or ovulation testing products
• Use any fertility medications or treatments to help you get pregnant
• Take some other health-related action
  • Specify other health-related action

OR

• I did not do anything in preparation for pregnancy

Sometimes a pregnancy does not result in a live birth. For example, a pregnancy may end in an abortion, a stillbirth, a miscarriage, or an ectopic or tubal pregnancy. Please be assured that, like all other information you have provided, these answers will be kept strictly confidential.

Thinking about your last pregnancy, how did the pregnancy end?

Note: Press the help button (?) for more information or for a list of support resources.

Was it:

• Live birth
• Abortion
  i.e., the medical termination of an ongoing pregnancy
• Miscarriage
  i.e., the spontaneous or natural loss of a pregnancy before 20 weeks of pregnancy
• Stillbirth
  i.e., the loss of a pregnancy after 20 weeks of pregnancy but before the baby is born, can occur during pregnancy or during labour
• Ectopic or tubal pregnancy
  i.e., any pregnancy outside the uterus or womb, like in the fallopian tube or abdomen

How many weeks pregnant were you when you experienced this [abortion/miscarriage/stillbirth/ectopic or tubal pregnancy]?

If unsure, provide your best estimate.

• Less than 12 weeks
• 12 to less than 20 weeks
• 20 to less than 24 weeks
• 24 weeks or more
• I don't know

How old were you when you experienced this [abortion/miscarriage/stillbirth/ectopic or tubal pregnancy]?

If exact age is not known, provide your best estimate.

• Age in years

Did you have any of the following types of care as part of the [abortion/miscarriage/stillbirth/ectopic or tubal pregnancy]?

Include both in-person and virtual consultations such as over the telephone or by video.

Select all that apply.

Would you say:

• Yes, medication to help pass pregnancy tissue[ or to terminate a pregnancy/BLANK]
  e.g., Mifegymiso (Mifepristone and Misoprostol), Cytotec^TM (Misoprostol), Methotrexate, Potassium Chloride (KCl)
• Yes, [a procedural abortion or a surgical procedure/a surgical procedure]
  e.g., manual vacuum aspiration (MVA), dilation and curettage (D&C), dilation and evacuation (D&E)
• Yes, other type of care

Where did you get the medication? Was it a:

For medications that you obtained from a pharmacy, report where they were prescribed.

• Hospital
• Specialized clinic
  e.g., sexual health, birth control or abortion clinic
• Regular health care provider or walk-in clinic
  Include both in-person and virtual consultations such as over the telephone or by video with your regular provider.
  Include walk-in clinics, even if you have an appointment.
• Telemedicine or telehealth provider
  A healthcare provider prescribes the medication over the phone or internet.
• Other

What type of facility did you use for the [procedural abortion or surgical procedure/surgical procedure]? Was it a:

• Hospital
• Specialized clinic
  e.g., sexual health, birth control or abortion clinic
• Other

Did you have any of the following types of care as part of the [abortion/miscarriage/stillbirth/ectopic or tubal pregnancy]?
Include both in-person and virtual consultations such as over the telephone or by video.

Select all that apply.

Would you say:

• Yes, medication to help pass pregnancy tissue
  e.g., Mifegymiso (Mifepristone and Misoprostol), Cytotec^TM (Misoprostol), Methotrexate, Potassium Chloride (KCl)
• Yes, a surgical procedure
  e.g., manual vacuum aspiration (MVA), dilation and curettage (D&C), dilation and evacuation (D&E)
• Yes, other type of care
  OR
• No, I did not have any type of care

Where did you get the medication? Was it a:

For medications that you obtained from a pharmacy, report where they were prescribed.

• Hospital
• Specialized clinic
  e.g., sexual health, birth control or abortion clinic
• Regular health care provider or walk-in clinic
  Include both in-person and virtual consultations such as over the telephone or by video with your regular provider.
  Include walk-in clinics, even if you have an appointment.
• Telemedicine or telehealth provider
  A healthcare provider prescribes the medication over the phone or internet.
• Other

What type of facility did you use for the surgical procedure? Was it a:

• Hospital
• Specialized clinic
  e.g., sexual health, birth control or abortion clinic
• Other

Did you or someone else have to pay for any of the following expenses to get the [medication/procedural abortion or surgical procedure/surgical procedure/medication, procedural abortion or surgical procedure/medication or surgical procedure]?

Include costs covered by an organization, such as a charity, or costs that were or will be reimbursed.

Select all that apply.

Would you say:

• Yes, medication
• Yes, [a procedural abortion or a surgical procedure/a surgical procedure]
• Yes, transportation
• Yes, a place to stay
• Yes, meals
• Yes, childcare
• Yes, other costs
  OR
• No, I did not have to pay for any of these expenses
  OR
• I don't know

Approximately how much did the transportation cost?

Include costs for yourself or other people that were with you.

Was it:

• Less than $20
• $20 to $99
• $100 to $300
• More than $300
• I don't know

Did you experience any of the following difficulties seeking care for the [abortion/miscarriage/stillbirth/ectopic or tubal pregnancy]?

Select all that apply.

Would you say:

• Cost
• Lack of information about how to access services
• Getting an appointment or wait time too long
• Negative attitude of health care provider or previous negative experience
  e.g., lack of respect, culturally appropriate care or a disagreement
• Lack of social support or worried about reaction of others
  e.g., personal, family, cultural or religious values or beliefs
• Transportation
• Not available in my area
• Getting childcare
• Getting time off work or school
• Concerns about privacy
• Side-effects, health concerns or medical concerns
• Personal safety or harassment
• Other difficulty
  OR
• No difficulties

What province or territory did you live in when you had the [abortion/miscarriage/stillbirth/ectopic or tubal pregnancy]?

• Province or territory
  OR
• Outside of Canada

Did you travel outside the province or territory you lived in to get care, medication or a procedure?

• Yes, to another province or territory
• Yes, outside of Canada
• No

Overall, how satisfied were you with the quality of the care you received?

Were you:

• Very satisfied
• Somewhat satisfied
• Neither satisfied nor dissatisfied
• Somewhat dissatisfied
• Very dissatisfied

Women may have an abortion, or may consider having an abortion, for different reasons. Thinking about the past 5 years, which of the following statements best describes your experience with abortion?

If you have had more than one experience with abortion in the past 5 years, refer to the last experience.
Note: Press the help button (?) for a list of support resources.

Would you say you:

• Have not been pregnant in the past 5 years
• Considered having an abortion but did not have one
• Had an abortion
• Have not considered getting an abortion
• Prefer not to answer

What was the reason you did not have an abortion?

Would you say:

• Could not access services and brought the pregnancy to term
• Too far along in the pregnancy
• Influence or pressure from others changed my decision
• Changed my mind
• My pregnancy ended in another way first

How many weeks pregnant were you when you experienced this abortion?

If unsure, provide your best estimate.

Was it:

• Less than 12 weeks
• 12 to less than 20 weeks
• 20 to less than 24 weeks
• 24 weeks or more
• I don't know    

How old were you when you experienced this abortion?

If exact age is not known, provide your best estimate.

• Age in years

Which of the following types of care did you receive for the abortion?

If you sought services for abortion for more than one pregnancy, refer to the most recent time you sought services.
Include both in-person and virtual consultations such as over the telephone or by video.

Was it:

• Medication to help pass pregnancy tissue or to terminate a pregnancy
  e.g., Mifegymiso (Mifepristone and Misoprostol), Cytotec^TM (Misoprostol), Methotrexate, Potassium Chloride (KCl)
• Procedural abortion or surgical procedure
  e.g., manual vacuum aspiration (MVA), dilation and curettage (D&C), dilation and evacuation (D&E)
• Other type of care

Where did you get the medication? Was it a:

For medications that you obtained from a pharmacy, report where they were prescribed.

• Hospital
• Specialized clinic
  e.g., sexual health, birth control or abortion clinic
• Regular health care provider or walk-in clinic
  Include both in-person and virtual consultations such as over the telephone or by video with your regular provider.
  Include walk-in clinics, even if you have an appointment.
• Telemedicine or telehealth provider
  A healthcare provider prescribes the medication over the phone or internet.
• Other

What type of facility did you use for the procedural abortion or surgical procedure? Was it a:

• Hospital
• Specialized clinic
  e.g., sexual health, birth control or abortion clinic
• Other

Did you or someone else have to pay for any of the following expenses to get the [medication, procedural abortion or surgical procedure/medication/procedural abortion or surgical procedure]?

Include costs covered by an organization, such as a charity, or costs that were or will be reimbursed.

Select all that apply.

Would you say:

• Yes, medication
• Yes, procedural abortion or surgical procedure
• Yes, transportation
• Yes, a place to stay
• Yes, meals
• Yes, childcare
• Yes, other costs
  OR
• No, I did not have to pay for any of these expenses
  OR
• I don't know

Approximately how much did the transportation cost?

Include costs for yourself and other people that were with you.

Was it:

• Less that $20
• $20 to $99
• $100 to $300
• More than $300
• I don't know

What province or territory did you live in when you [considered having an abortion/had the abortion]?

• Province or territory
  OR
• Outside of Canada

Did you travel outside the province or territory you lived in to get care, medication or a procedure?

• Yes, to another province or territory
• Yes, outside of Canada
• No 

Overall, how satisfied were you with the quality of the care you received?

Were you:

• Very satisfied
• Somewhat satisfied
• Neither satisfied nor dissatisfied
• Somewhat dissatisfied
• Very dissatisfied

Did you experience any of the following difficulties when seeking care for the abortion?

Select all that apply.

Would you say:

• Cost
• Lack of information about how to access services
• Getting an appointment or wait time too long
• Negative attitude of health care provider or previous negative experience
  e.g., lack of respect, culturally appropriate care or a disagreement
• Lack of social support or worried about reaction of others
  e.g., personal, family, cultural or religious values or beliefs
• Transportation
• Not available in my area
• Getting childcare
• Getting time off work or school
• Concerns about privacy
• Side-effects, health concerns or medical concerns
• Personal safety or harassment
• Other difficulty
  OR
• No difficulties

Surgeries and medical procedures

The following questions are about surgeries or medical procedures you may have had

Have you ever had any of the following surgeries or medical procedures?

Select all that apply.

Have you had:

• Removal of uterus
• Removal of one ovary
• Removal of both ovaries
• Endometrial ablation
• Removal of fibroids
• Removal of one fallopian tube
• Removal of both fallopian tubes
• Tying of the fallopian tubes also known as having your "tubes tied"
• Mastectomy, lumpectomy, breast reconstruction, reduction or augmentation
• Surgery for pelvic organ prolapse
• Surgery for urinary incontinence
  OR
• None of the above

At what age did you have your uterus removed?

If exact age is not known, provide your best estimate.

• Age in years

At what age did you have your second ovary removed?

If exact age is not known, provide your best estimate.

• Age in years

At what age did you have your second fallopian tube removed?

If exact age is not known, provide your best estimate.

• Age in years

At what age did you have your fallopian tubes tied?

If exact age is not known, provide your best estimate.

• Age in years

Healthcare

Now, here is a question about primary health care. This type of health care is often delivered by family doctors or nurse practitioners.

Do you have a regular health care provider? By this, we mean a primary health care professional that you can consult with when you need care or advice for your health.

Select "Yes, another health professional" if you receive regular care from locums.

• Yes, a family doctor
• Yes, a nurse practitioner
• Yes, another health professional
  • Specify the other health professional
• No

In the past 5 years, did you feel that you were discriminated against in a health care setting for any reason?

Discrimination is an action or a decision that treats a person or a group badly for reasons such as their race, religion, age, sex, gender, marital status, or disability. These reasons are protected under the Canadian Human Rights Act.

• Yes
• No

Indigenous Identity

Are you First Nations, Métis or Inuk (Inuit)?

First Nations (North American Indian) includes Status and Non-Status Indians.

If "Yes", select the responses that best describes this person now.

• No, not First Nations, Métis or Inuk (Inuit)
  OR
• Yes, First Nations (North American Indian)
• Yes, Métis
• Yes, Inuk (Inuit)

The following question collects information in accordance with the Employment Equity Act and its Regulations and Guidelines to support programs that promote equal opportunity for everyone to share in the social, cultural, and economic life of Canada.

Select all that apply.

Are you:

• White
• South Asian
  e.g., East Indian, Pakistani, Sri Lankan
• Chinese
• Black
• Filipino
• Arab
• Latin American
• Southeast Asian
  e.g., Vietnamese, Cambodian, Laotian, Thai
• West Asian
  e.g., Iranian, Afghan
• Korean
• Japanese
• Other
  • Specify other group

Education

What is the highest certificate, diploma or degree that you have completed?

• Less than high school diploma or its equivalent
• High school diploma or a high school equivalency certificate
• Trades certificate or diploma
• College, CEGEP or other non-university certificate or diploma (other than trades certificates or diplomas)
• University certificate or diploma below the bachelor's level
• Bachelor's degree
  e.g., B.A., B.A. (Hons), B.Sc., B.Ed., LL.B.
• University certificate, diploma or degree above the bachelor's level

Administrative Information

To enhance the data from this survey and to minimize the reporting burden for respondents, Statistics Canada will combine your responses with information from the tax data of all members of your household. [Statistics Canada, the provincial ministry of health and the Institut de la statistique du Québec/Statistics Canada and the provincial ministry of health] may also add information from other surveys or administrative sources.

Having a provincial or territorial health number will assist us in linking to this other information. Do you have a [PROVINCE] health number?

• Yes
• No

For which province or territory is your health number?

If you do not have a Canadian health number, select "Does not have a Canadian health number" from the drop-down list.

• Province or territory

What is your health number?

Enter a health number for [PROVINCE]. In [PROVINCE], the health number is made up of [DIGITS]. Do not insert blanks, hyphens or commas between the numbers.

[Note: In Manitoba, health numbers of families can be listed on the same card. Be sure to capture the intended respondent's health number if there is more than one on the card./Note: In British Columbia, residents may have a combined driver's license and health card. If the respondent has a combined card, the health number is on the back above the barcode./BLANK]

• Health number

[To avoid duplication of surveys, Statistics Canada has signed agreements to share the data from this survey with provincial ministries of health. Provincial ministries of health may make the data available to local health authorities.

Data shared with your ministry of health may also include identifiers such as name, address, telephone number and health number. Local health authorities would receive only survey responses and the postal code. /

To avoid duplication of surveys, Statistics Canada has signed agreements to share data from this survey with provincial ministries of health and the Institut de la statistique du Québec. The Institut de la statistique du Québec and provincial ministries of health may make this data available to local health authorities.

Data shared with your ministry of health or the Institut de la statistique du Québec may also include identifiers such as name, address, telephone number and health number. Local health authorities would receive only survey responses and the postal code.]

These organizations have agreed to keep the data confidential and use it only for statistical purposes.
Do you agree to share the data you provided?

• Yes
• No

To reduce the number of questions in this questionnaire, Statistics Canada will use information from your tax forms submitted to the Canada Revenue Agency. With your consent Statistics Canada will share this information from your tax forms with [provincial ministries of health and the Institut de la statistique du Québec/provincial ministries of health].

These organizations have agreed to keep the information confidential and to use it only for statistical and research purposes.

Do you give Statistics Canada permission to share your tax information with [provincial ministries of health and the Institut de la statistique du Québec/provincial ministries of health]?

• Yes
• No

Resources

Thank you for completing the Canadian Sexual and Reproductive Health Survey.

[Contact information for some resources that may help support you or someone you know is available.

While you may wish to use these services, please note Statistics Canada is not affiliated with any of these organizations./Some resources are provided that may help support you or someone you know.

While you may wish to use these services, please note Statistics Canada is not affiliated with any of these organizations.] 

Resources list

Baby’s Breath

Provides support for parents experiencing all sudden and unexpected infant deaths and stillbirth
https://www.babysbreathcanada.ca/
Telephone: 1-800-363-7437

Parent Orphelins (Quebec residents)

Provides support for parents grieving due to pregnancy and infant loss
Telephone: 514-686-4880
https://parentsorphelins.org/en/

Access line for Action Canada for Sexual Health and Rights

The Access Line is a 7-day a week toll-free, confidential phone and text line. It is available for questions about sexual health, pregnancy options, abortion, and safer sex. They provide information and make referrals to sexual health providers.
https://www.actioncanadashr.org/call-access-line-1-888-642-2725

Canadian Mental Health Association (National)

Provides advocacy, programs and resources that help to prevent mental health problems and illnesses and support recovery and resilience
https://cmha.ca/find-info/mental-health/
Telephone: 1-833-456-4566
Telephone: 1-866-277-3553 (in Quebec)

Government of Canada (Family violence resources and services in your area)

Links for family violence resources and services in your area
https://www.canada.ca/en/public-health/services/health-promotion/stop-family-violence/services.html

Suicide Crisis Helpline

A national network of existing distress, crisis and suicide prevention line services
https://988.ca/
Telephone: 9-8-8
Text: 9-8-8

Information for respondents

Authority to publish

Section 17 of the Statistics Act allows for the disclosure of certain information relating to an organization. For this survey, Statistics Canada will release the names of federal departments and agencies whose science and technology (S&T) expenditures surpass 2% of the total federal S&T expenditures for the 2025/2026 reference year. This applies to departments that previously authorized publication in the 2024/2025 collection cycle. For each of these departments, data on expenditures and personnel will be published. 

Respondent Information:

• Name of person who approved the data reported
• Signature
• Official position
• Program
• Department or agency
• E-mail address
• Telephone number

Enquiries to be directed to:

• Name
• Date
• Position title
• Telephone number
• Email address
• Fax number

Purpose

This survey collects financial and operating data on expenditures and full-time equivalent personnel on the scientific activities of Federal Government Public Administration in Canada.

Additional information

The data collected are used by federal and provincial science policy analysts, and are also part of the gross domestic expenditures on research and development (GERD). Your information may also be used by Statistics Canada for other statistical and research purposes.

Authority

Collected under the authority of the Statistics Act, Revised Statutes of Canada, 1985, Chapter S-19.

Completion of this questionnaire is a legal requirement under this Act.

Confidentiality

Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act. Statistics Canada will use the information from this survey for statistical purposes.

Data-sharing agreements

To reduce respondent burden, Statistics Canada has entered into data-sharing agreements with provincial and territorial statistical agencies and other government organizations, which have agreed to keep the data confidential and use them only for statistical purposes. Statistics Canada will only share data from this survey with those organizations that have demonstrated a requirement to use the data.

Section 11 of the Statistics Act provides for the sharing of information with provincial and territorial statistical agencies that meet certain conditions. These agencies must have the legislative authority to collect the same information, on a mandatory basis, and the legislation must provide substantially the same provisions for confidentiality and penalties for disclosure of confidential information as the Statistics Act. Because these agencies have the legal authority to compel businesses to provide the same information, consent is not requested and businesses may not object to the sharing of the data.

For this survey, there are Section 11 agreements with the provincial and territorial statistical agencies of Newfoundland and Labrador, Nova Scotia, New Brunswick, Quebec, Ontario, Manitoba, Saskatchewan, Alberta, British Columbia, and the Yukon.

The shared data will be limited to information pertaining to federal departments and agencies located within the jurisdiction of the respective province or territory.

Section 12 of the Statistics Act provides for the sharing of information with federal, provincial or territorial government organizations. Under Section 12, you may refuse to share your information with any of these organizations by writing a letter of objection to the Chief Statistician and returning it with the completed questionnaire. Please specify the organizations with which you do not want to share your data.

For this survey, there are Section 12 agreements with the statistical agencies of Prince Edward Island, the Northwest Territories, Nunavut, Innovation Science and Economic Development Canada (ISED), as well as the Office of the Chief Science Advisor (OCSA) of ISED. 

The shared data will be limited to information pertaining to federal departments and agencies located within the jurisdiction of the respective province or territory.

Record linkage

To enhance the data from this survey and to minimize the reporting burden, Statistics Canada may combine it with information from other surveys or from administrative sources.

Security of emails and faxes

Statistics Canada advises you that there could be a risk of disclosure during the transmission of information by facsimile or e-mail. However, upon receipt, Statistics Canada will provide the guaranteed level of protection afforded all information collected under the authority of the Statistics Act.

Return procedures

Please forward the completed questionnaire and listing of extramural performers through the Electronic File Transfer service (EFT).

For further inquiries:

• Phone Number: toll free at 1-888-659-8229
• Fax number: toll free at 1-800-755-5514
• Email: statcan.fsepsurv-enqdmsf.statcan@statcan.gc.ca

Thank you for your co-operation.

FSEP - Introduction

This introduction is intended to provide an overview of the process of collecting science expenditure data; definitions of and explanatory notes on natural sciences and engineering, social sciences, humanities and the arts, scientific and technological activities, performance sectors, and other terms used are given in subsequent sections.

The collection of science expenditure data is organized by the Centre for Innovation, Technology and Enterprise Statistics (CITES) of Statistics Canada. This exercise was formerly conducted under the aegis of the Treasury Board of Canada Secretariat but is now solely a Statistics Canada survey.

Collection is undertaken to gather essential data describing the recent, current and proposed state of the federal resources allocated to science. Federal science expenditures data are provided to Innovation, Science and Economic Development Canada who in turn use the data in the development of advice to the Assistant Deputy Ministers' Steering Committee on the Management of S&T, their Minister and the Treasury Board of Canada Secretariat, as well as in policy development and in monitoring the implementation of science policies. Statistics Canada maintains historical expenditure series in natural sciences and engineering dating back to 1963 and to 1971 in the social sciences, humanities and the arts. These data are available through the Centre for Innovation, Technology and Enterprise Statistics (CITES) or through special requests.

The basic reporting unit is the budgetary program of a department or agency. Each budgetary program forms the subject of separate scientific expenditure reports for the natural and for the social science activities within it. Both the program and the program activities within it may be scientific in whole or in part only. Only expenditures on the scientific components of a program or its activity are reported. In some programs it will be difficult to distinguish between the natural and social sciences. However, some allocation must be made and in determining this allocation, the dominant orientation of the projects and the area of expertise of the personnel involved must be considered. Detailed definitions are given on the following pages.

On the questionnaires, the identified expenditures are looked at from several different viewpoints and in various subdivisions. Expenditures on research and development (R&D) and related scientific activities (RSA) are subdivided to provide an indication of the "what" of a department's scientific effort. Expenditures in each category of scientific activity are further subdivided into "current" and "capital" segments. Current expenditures are additionally subdivided by sector, to indicate the "where" and "by whom" the activity is performed (e.g., in business enterprise, in higher education).

The human resources allocated to scientific activities are summarized in terms of the involved categories of personnel (scientific and professional, technical, etc.) and the principal focus of their efforts (R&D, RSA and, administration of extramural programs).

When completed, checked for consistency with previous reports, entered into the database and totaled along the various dimensions, these data provide snapshots of the federal resources allocated to science, supporting not only the work of central agencies but also the submissions of departments and agencies requesting resources.

Purpose

This survey collects financial and operating data on expenditures and full-time equivalent personnel on the scientific activities of Federal Government Public Administration in Canada.

Question 1: Expenditures by activity and performer

General

The social sciences, humanities and the arts consist of disciplines involving the study of human actions and conditions and the social, economic and institutional mechanisms affecting humans. Included are such disciplines as arts, economics and business, education, history and archaeology, law, language and linguistics, media and communications, philosophy, ethics and religion, psychology and cognitive sciences, social and economic geography, and sociology.

Expenditures by activity and performer

Scientific and technological (S&T) activities can be defined as all systematic activities which are closely concerned with the generation, advancement, dissemination and application of scientific and technology knowledge in all fields of science and technology, that is the natural sciences and engineering, and the social sciences, humanities and the arts.

The central activity is scientific research and experimental development (R&D). In addition there are a number of activities closely related to R&D, and are termed related scientific activities (RSA). Those identified as being appropriate for the federal government in the social sciences, humanities and the arts are: general purpose data collection, information services, special services and studies and education support.

The performer is equivalent to the sector in which the scientific activity is conducted. The basic distinction is between intramural and extramural performance. Extramural payments are classified on the basis of the performance sectors to which they are made. The appropriate extramural performers are business enterprise, higher  education, Canadian non-profit institutions, provincial and municipal government, and foreign performers.

I. Performers

lntramural activities include all current expenditures incurred for scientific activities carried out by in-house personnel of units assigned to the program; the related gross fixed capital expenditures (acquisition of land, buildings, machinery and equipment for scientific activities); the administration of scientific activities by program employees; and, the purchase of goods and services to support in-house scientific activities (include royalties or licences for the use of patents and other intellectual property rights, the lease of capital goods (machinery and equipment, etc.) and the rental of buildings to support scientific activities performed by the statistical unit in the reference year).

The intramural expenditures reported for scientific activities are those direct costs, including salaries, associated with scientific programs. The costs should include that portion of a program's contribution to employee benefit plans (e.g., superannuation and compensation) which is applicable to the scientific personnel within the program. The summation of intramural R&D activity is synonymous with the performance of R&D for the entire economy (GERD).

Extramural performers are groups being funded by the federal government sector for S&T activities. In this survey the extramural performers include:

• Business enterprise – business and government enterprises including public utilities and government-owned firms. Both financial and non-financial corporations are included. Incorporated consultants or unincorporated individuals providing scientific and engineering services are also included. Industrial research institutes located at Canadian universities are considered to be in the higher education sector.
• Higher education – comprises all universities, colleges of technology and other institutes of post-secondary education, whatever their source of finance or legal status. It also includes teaching hospitals (non-teaching hospitals are in the Canadian non-profit sector), all research institutes, centers, experimental stations and clinics that have their scientific activities under the direct control of, or administered by, or associated with, the higher education establishments.
• Canadian non-profit institutions – charitable foundations, voluntary health organizations, scientific and professional societies, non-teaching hospitals (teaching hospitals are in the higher education sector) and other organizations not established to earn profits. Non-profit institutions primarily serving or controlled by another sector should be included in the controlling sector.
• Provincial and municipal governments – departments and agencies of these governments as well as provincial research organizations. Government enterprises, such as provincial utilities are included in the business enterprise sector, and non-teaching hospitals in the Canadian non-profit institutions sector.
• Foreign performers – all foreign government agencies, foreign companies (including foreign subsidiaries of Canadian firms), international organizations, non-resident foreign nationals and Canadians studying or teaching abroad.

II. Research and experimental development (R&D)

Research and experimental development (R&D) - comprise creative and systematic work undertaken in order to increase the stock of knowledge - including knowledge of humankind, culture and society - and to devise new applications of available knowledge.

R&D activities may be aimed at achieving either specific or general objectives. R&D is always aimed at new findings, based on original concepts (and their interpretation) or hypotheses. It is largely uncertain about its final outcome (or at least about the quantity of time and resources needed to achieve it), it is planned for and budgeted (even when carried out by individuals), and it is aimed at producing results that could be either freely transferred or traded in a marketplace.

For an activity to be an R&D activity, it must satisfy five core criteria:

• To be aimed at new findings (novel);
• To be based on original, not obvious, concepts and hypothesis (creative);
• To be uncertain about the final outcome (uncertainty);
• To be planned and budgeted (systematic);
• To lead to results that could be possibly reproduced (transferable/or reproducible).

Examples of R&D:

• A review of theories on the factors determining regional disparities in economic growth.
• Understanding the fundamental dynamics of spatial interactions.
• Comparative evaluations of national education programs aimed at reducing the learning gap experienced by disadvantaged communities.
• Research studies analyzing the spatial-temporal patterns in the transmission and diffusion of an infectious disease outbreak.

Both "research" and "development" are often used with different meanings in the government. For example, it is increasingly common to hear that a person is "researching" something (i.e. the person is looking for information about something). Similarly, there are many units with either "research" or "development" or both terms in their titles which are concerned primarily with information gathering, speech writing, and preparation of position papers. These should be excluded from the scientific activity of R&D. On the other hand, a case study on unemployment in a specific region, if applying original techniques in interviewing survey respondents could include such data collection in its R&D effort. From a broad perspective, to the extent that the social sciences are using empirical data, the same guidelines have to be applied as for the natural sciences (although excluding the testing of their results on an experimental basis).

Many social scientists perform work in which they bring the established methodologies and facts of the social sciences to bear upon a particular problem, but which cannot be classified as research. The following are examples of work which might be included in this category and are not R&D: interpretative commentary on the probable economic effects of a change in the tax structure using existing economic data; forecasting future changes in the pattern of the demand for social services within a given area arising from an altered demographic structure; operations research as a contribution to decision-making, e.g. planning the optimal distribution system for a factory; the use of standard techniques in applied psychology to select and classify industrial and military personnel, students, etc., and to test children with reading or other disabilities.

1. In-house R&D – R&D performed by personnel of the reporting program. It may include R&D carried out on behalf of another program or federal government department.

2. R&D contracts – R&D contracts to an outside institution or individual to fund R&D performed by the institution or individual. The criterion is: would the performer report the R&D contract as in-house (intramural) R&D that is government-funded? If the answer is yes the activity would be an R&D contract. If no, and the funding is to provide goods and services necessary to support the in-house R&D of the federal government it should be reported as In-house R&D.

3. R&D grants and contributions – awards to organizations or individuals for the conduct of R&D and intended to benefit the recipients rather than provide the program with goods, services or information. These funds are normally identical to that portion of the budgetary "grants and contributions" line object of expenditure which is devoted to R&D activities.

4. Research fellowships – awards to individuals for advanced research training and experience. Awards intended primarily to support the education of the recipients should be reported as "education support".

5. Administration of extramural programs – the costs of identifiable units engaged in the administration of contracts and grants and contributions for scientific activities that are to be performed outside the federal government. These expenditures should be broken down by the type of scientific activity supported, i.e. R&D or RSA.

6. Capital expenditures – the annual gross amount paid for the acquisition of fixed assets that are used repeatedly or continuously in the performance of scientific activities for more than one year. They should be reported in full for the period when they took place, whether acquired or developed in house, and should not be registered as an element of depreciation.

The most relevant types of assets used for capital expenditures are:

• Land and buildings
• Machinery and equipment
• Capitalized computer software
• Other intellectual property products

III. Related scientific activities (RSA)

Related scientific activities (RSA) are all systematic activities which are closely concerned with the generation, advancement, dissemination and application of scientific and technological knowledge. The types of related scientific activities for the social sciences, humanities and the arts are described below.

7. In-house RSA – RSA performed by personnel of the reporting program. It may include RSA carried out on behalf of another program or federal government department.

In-house RSA activities include all current expenditures incurred for scientific activities carried out by in-house personnel of units assigned to the program; the purchase of goods and services to support in-house scientific activities (include royalties or licences for the use of patents and other intellectual property rights, and the rental of buildings to support scientific activities performed by the statistical unit in the reference year). Also include expenses of persons who provide ancillary services such as security, cleaning and maintenance work, finance and administration that are proportional to the RSA being conducted. However, the personnel providing these services are not to be included in the in-house personnel counts (see Section 2. Personnel).

The intramural expenditures reported to RSA are those direct costs, including salaries, associated with scientific programs. The cost should include that portion of a program's contribution to employee benefit plans (e.g., superannuation and compensation) which is applicable to the scientific personnel within the program. Also include the costs of self-employed individuals, consultants and researchers who are working on-site on the departments' RSA projects.

8. RSA contracts – contracts to an outside institution or individual to fund RSA performed by the institution or individual. The criterion is: would the performer report the RSA contract as in-house (intramural) RSA that is government-funded? If the answer is yes the activity would be an RSA contract. If no, and the funding is for the purchase goods and services to support the in-house RSA of the federal government department, it should be reported as In-house RSA (Item 7).
Contracts to other federal government departments should be reported as a transfer of funds in question 3A (i) and 3A (ii) of the questionnaire.

9. RSA grants and contributions – awards to organizations or individuals for the conduct of RSA and intended to benefit the recipients rather than provide the program with goods, services or information. These funds are normally identical to that portion of the budgetary "grants and contributions" line object of expenditure which is devoted to RSA.

In-house RSA, RSA Contracts and RSA grants and contributions can include the following items:

• General purpose data collection – the routine gathering, processing, collating and analyzing and publication of information on human phenomena using survey, regular and special investigations and compilations of existing records. It excludes data collected primarily for internal administrative purpose (e.g. departmental personnel statistics) as well as the collection of data as part of an R&D project.
  Data collected as part of an existing or proposed research project are charged to research. Similarly, the costs of analyzing existing data as part of a research project are R&D costs, even when the data were originally collected for some other purpose. The institutions involved are generally the statistical bureaus of Canadian governments and the statistical sections of departments and agencies. If there are units whose principal activity is R&D, their costs and personnel should be assigned to R&D; specialized libraries with separate budgets should be assigned to information services.
• Information services – all work directed to collecting, coding, analyzing, evaluating, recording, classifying, translating and disseminating scientific and technological information as well as museum services. Included are the operations of scientific and technical libraries, S&T consulting and advisory services, the Patent Office, the publication of scientific journals and monographs, and the organizing of scientific conferences. Grants for the publication of scholarly works are also included.
  General purpose information services or information services directed primarily towards the general public are excluded, as are general departmental and public libraries. When individual budgets exist, the costs of libraries which belong to institutions otherwise entirely classified to another activity, such as R&D, should be assigned to information services. The costs of printing and distributing reports from another activity, such as R&D, are normally attributed to that activity.
• Sub category under Information services:
  • Museum services – the collecting, cataloguing and displaying of specimens and representations relating to human history, social organization and creations. The activity involves a systematic attempt to preserve and display the works of human beings and to provide information on their works, history, and nature. The scientific activities of historical museums, archeological displays, and art galleries are included. In all cases the costs of providing entertainment and recreation to visitors should be excluded (e.g. restaurants, children's gardens and museums).
    When a museum also covers aspects of natural history, the museum's operations should be divided between the social and natural sciences. However, museums of science and technology, war, etc., which display synthetic or artificial objects and may also illustrate the operations of certain technologies, should be considered as engaged in museum services in social sciences.
  • Special services and studies - systematic investigations carried out in order to provide information needed for planning or policy formulation. Demonstration projects are also included.
    The work is usually carried out by specialized units in some government departments, by consultants, by royal commissions, and by task forces. The activity is similar to R&D since it may require innovative analyses and a high degree of scientific ability. However, such studies are not intended to acquire new knowledge but to provide specific answers to specific problems (generally immediate, localized and perhaps temporary). The day-to-day operations of units concerned with departmental planning, organization or management are not normally included (i.e. administrative records kept by departments of education) but special projects may be relevant.
• Sub categories under Special services and studies include:
  • Economic and feasibility studies – the investigation of the socio-economic characteristics and implications of specific situations (e.g. a study of the variability of a petrochemical complex in a certain region). Note that feasibility studies on research projects are part of R&D.
  • Operations and policy-related studies – covers a range of activities, such as the analysis and assessment of the existing programs, policies and operations of government departments and other institutions; the work of units concerned with the continuing analysis and monitoring of external phenomena (e.g. defence and security analysis); and the work of legislative commissions of inquiry concerned with general government or departmental policy or operations.
    Any activity aimed at providing close support to policy actions, as well as to legislative activity, should be included as a related scientific activity (RSA). This includes policy advice and relations with the media, legal advice, public relations or even technical support for the administrative activity (e.g. accounting).
    Research activities aimed at providing the decision makers with a thorough knowledge of social, economic or natural phenomena have to be included in R&D. These R&D activities are usually performed by skilled personnel - researchers - in small teams of experts and consultants and meet the standard academic criteria for scientific work (in addition to the R&D criteria).
  • Education support – grants to individuals or institutions on behalf of individuals which are intended to support the post-secondary education of students in technology and the social sciences. General purpose grants to educational institutions are excluded. The activity includes the support of foreign students in their studies of the social sciences at Canadian or foreign institutions. Grants intended primarily to support the research of individuals at universities are either R&D grants or research fellowships.

10. Administration of extramural programs – the costs of identifiable units engaged in the administration of contracts and grants and contributions for scientific activities that are to be performed outside the federal government. These expenditures should be broken down by the type of scientific activity supported, i.e. R&D or RSA.

11. Capital expenditures – the annual gross amount paid for the acquisition of fixed assets that are used repeatedly or continuously in the performance of scientific activities for more than one year. They should be reported in full for the period when they took place, whether acquired or developed in house, and should not be registered as an element of depreciation.

The most relevant types of assets used for capital expenditures are:

• Land and buildings
• Machinery and equipment
• Capitalized computer software
• Other intellectual property product

Question 2: Personnel

Full-time equivalent (FTE) – the ratio of working hours actually spent on scientific activities during a specific reference period divided by the total number of hours conventionally worked in the same period by an individual or a group. For example, an employee who is engaged in scientific activities for half a year has a full-time equivalence of 0.5. Personnel data reported should be consistent with expenditures data.

Scientific and professional – researchers and professionals engaged in the conception or creation of new knowledge. They conduct research and improve or develop concepts, theories, models, techniques instrumentation, software or operational methods. They require at least one academic degree or a nationally recognized professional qualification, as well as those with equivalent experience.

Technical – technicians and equivalent staff are persons whose main tasks require technical knowledge and experience in one or more fields of engineering, the physical and life sciences, or the social sciences, humanities and the arts. They perform scientific and technical tasks involving the application of concepts and operational methods and the use of research equipment, normally under the supervision of researchers.

Other – other supporting staff includes skilled and unskilled craftsmen, and administrative, secretarial and clerical staff participating in science and technology projects or directly associated with such projects.

Question 2: Personnel by gender

Gender – refers to current gender which may be different from sex assigned at birth and may be different from what is indicated on legal documents. Categories include: man, woman, and non-binary person.

Man – this category includes persons whose reported gender is male. It includes cisgender (cis) and transgender (trans) men. 

Woman – this category includes persons whose reported gender is female. It includes cisgender (cis) and transgender (trans) women. 

Non-binary person – this category includes persons whose reported gender is not exclusively male or female.

Question 3: Sources of funds

Question 3A (i). Transfers for social sciences, humanities and the arts activities

Include payments and recipients for contracts, transfers and joint programs from/to other federal government departments. Please identify the amount and names of the origination and recipient programs.

Question 3A (ii). Sources of funds for total scientific and technological activities

This question identifies the sources of funds for expenditures on scientific activities reported for all three years. It will help to ensure that work funded from outside the department is not overlooked.

• Departmental S&T budget – that portion of the total departmental budget which was spent on social sciences, humanities and the arts activities.
• Revenues to / from other federal departments – money transferred from this program to another federal department or money transferred into this program from another federal department for activities in the social sciences, humanities and the arts.
• Provincial government departments – all funds from the provincial government used for social sciences, humanities and the arts activities. The funds are referred to as payments, contributions, transfers, etc. Also include provincial portions of federal-provincial cost sharing programs performed by the department program.
• Business enterprises – all funds from business enterprises used for social sciences, humanities and the arts activities performed by the department.
• Other – all funds for social sciences, humanities and the arts activities from sources not specified above.

Question 4: Socio-economic objectives

Intramural and extramural scientific and technological expenditures by socio-economic objective for the reporting year by activity (research and experimental development, related scientific activities, and total).

• 1. Exploration and exploitation of the Earth
• 2. Environment 
• 3. Exploration and exploitation of space
• 4. Transport, telecommunication and other infrastructures
• 5. Energy
• 6. Industrial production and technology
• 7. Health
• 8. Agriculture (include forestry and fisheries)
  • 8.1: Agriculture
  • 8.2: Fishing
  • 8.3: Forestry
• 9. Education 
• 10. Culture, recreation, religion and mass media
• 11. Political and social systems, structures and processes
• 12. Defence

1. Exploration and exploitation of the Earth – scientific activities with objectives related to the exploration of the Earth's crust and mantle, seas, oceans and atmosphere, as well as on their exploitation. It also includes climatic and meteorological research, polar exploration (under various headings, as appropriate) and hydrology. It does not include scientific activities related to soil improvement (objective 4), land use or fishing (objective 8), or pollution (objective 2).

Examples:

• General scientific activities
• Mineral, oil and natural gas prospecting
• Exploration and exploitation of the sea-bed
• Earth's crust and mantle excluding sea-bed and studies of soil for agriculture (objective 8)
• Hydrology - excludes scientific activities on: water supplied and disposal (objective 4) and water pollution (objective 2)
• Sea and oceans
• Atmosphere
• Other scientific activities on the exploration and exploitation of the earth

Excludes: scientific activities on pollution (objective 2), soil improvement (objective 4), land-use and fishing (objective 8).

2. Environment - covers scientific activities aimed at improving the control of pollution, including the identification and analysis of the sources of pollution and their causes, and all pollutants, including their dispersal in the environment and the effects on humans, species (fauna, flora, micro-organisms) and the biosphere.

The development of monitoring facilities for the measurement of all kinds of pollution is included, as is scientific activities for the elimination and prevention of all forms of pollution in all types of environment.

3. Exploration and exploitation of space – covers all civil space scientific activities relating to the scientific exploration of space, space laboratories, space travel and launch systems. Although civil space scientific activities is not in general concerned with particular objectives, it frequently has a specific goal, such as the advancement of knowledge (e.g. astronomy) or relates to particular applications (e.g. telecommunications satellites or earth observation). This chapter does not include corresponding scientific activities for defence purposes.

4. Transport, telecommunication and other infrastructures – Transport, telecommunication and other infrastructures - covers scientific activities aimed at infrastructure and land development, including the construction of buildings. More generally, this objective covers all scientific activities relating to the general planning of land use. This includes scientific activities into protection against harmful effects in town and country planning but not research into other types of pollution (objective 2). This objective also includes scientific activities related to transport systems; telecommunication systems; general planning of land use; the construction and planning of buildings; civil engineering; and water supply.

5. Energy – covers scientific activities aimed at improving the production, storage, transportation, distribution and rational use of all forms of energy. It also includes scientific activities on processes designed to increase the efficiency of energy production and distribution, and the study of energy conservation. It does not include scientific activities related to prospecting (objective 1) or scientific activities into vehicle and engine propulsion (objective 6).

Examples:

• Fossil fuels and their derivatives
• Nuclear fission
• Radioactive waste management including decommissioning with regard to fuel/energy
• Nuclear fusion
• Renewable energy sources
• Rational utilization of energy

6. Industrial production and technology – covers scientific activities on the improvement of industrial production and technology. It includes scientific activities on industrial products and their manufacturing processes except where they form an integral part of the pursuit of other objectives (e.g. defence, space, energy, agriculture).

Examples:

• Increasing economic efficiency and competitiveness
• Manufacturing and processing techniques
• Petrochemical and coal by-products
• Pharmaceutical products
• Manufacture of motor vehicles and other means of transport
• Aerospace equipment manufacturing and repairing
• Electronic and related industries
• Manufacture of electrical machinery and apparatus
• Manufacture of non-electronic and non-electronical machinery
• Manufacture of medical and surgical equipment and orthopaedic appliances
• Manufacture of food products and beverages
• Manufacture of clothing and textiles and leather goods
• Recycling

7. Health - covers scientific activities aimed at protecting, promoting and restoring human health broadly interpreted to include health aspects of nutrition and food hygiene. It ranges from preventive medicine, including all aspects of medical and surgical treatment, both for individuals and groups, and the provision of hospital and home care, to social medicine and paediatric and geriatric research.

Examples:

• General scientific activities
• Medical scientific activities, hospital treatment, surgery
• Preventive medicine
• Biomedical engineering and medicines
• Occupational medicine
• Nutrition and food hygiene
• Drug abuse and addition
• Social medicine
• Hospital structure and organization of medical care
• Other medical scientific activities

8. Agriculture (include forestry and fisheries) – covers all scientific activities on the promotion of agriculture, forestry, fisheries and foodstuff production, or further knowledge on chemical fertilizers, biocides, biological pest control and the mechanization of agriculture, as well as concerning the impact of agricultural and forestry activities on the environment. Also covers scientific activities on improving food productivity and technology.

8.1 Agriculture – covers scientific activities on animal products, veterinary medicine, crops, food technology and other scientific activities on agricultural production and technology.

8.2 Fishing – covers scientific activities on fishing, salting, drying, and initial freezing of products (but not on preparation and canning (objective 6)), scientific activities on fish-farming, exploration of new fishing grounds, exploration and development of new and unconventional sources of seafood.

8.3 Forestry – covers scientific activities into the ecological and economic aspects of forestry and timber production.

9. Education – covers scientific activities aimed at supporting general or special education, including training, pedagogy, didactics, and targeted methods for specially gifted persons or those with learning disabilities. Applied to all levels of education as well as to subsidiary services to education.

10. Culture, recreation, religion and mass media – covers scientific activities aimed at improving the understanding of social phenomena related to culture activities, religion and leisure activities so as to define their impact on life in society, as well as to racial and cultural integration and on socio-cultural changes in these areas. The concept of "culture" covers sociology of science, religion, art, sport and leisure, and also comprises inter alia R&D on the media, the mastery of language and social integration, libraries, archives and external cultural policy.

11. Political and social system, structures and processes – covers scientific activities aimed at improving the understanding and supporting the political structure of society, public administration issues and economic policy, regional studies and multi-level governance, social change, social processes and social conflicts, the development of social security and social assistance systems, and the social aspects of the organization of work.

12. Defence – covers scientific activities for military purposes. It also includes basic research and nuclear and space research financed by the Department of National defence. Civil scientific activities financed by ministries of defence, for example, in the fields of meteorology, telecommunications and health, should be classified in the relevant objectives.

Question 5: Expenditures and personnel by region

Scientific and technological expenditures and personnel of federal organizations for the reference year, including current and capital expenditures for intramural R&D and RSA and by scientific and professional and total personnel for R&D and RSA.

• Newfoundland and Labrador
• Prince Edward Island
• Nova Scotia
• New Brunswick
• Quebec (excluding NCR - Quebec)
• National Capital Region (NCR) - Quebec
• Ontario (excluding NCR - Ontario)
• National Capital Region (NCR) - Ontario
• Manitoba
• Saskatchewan
• Alberta
• British Columbia
• Yukon, Northwest Territories and Nunavut
• Canada Total

Information for respondents

Authority to publish

Section 17 of the Statistics Act allows for the disclosure of certain information relating to an organization. For this survey, Statistics Canada will release the names of federal departments and agencies whose science and technology (S&T) expenditures surpass 2% of the total federal S&T expenditures for the 2025/2026 reference year. This applies to departments that previously authorized publication in the 2024/2025 collection cycle. For each of these departments, data on expenditures and personnel will be published.

Respondent Information:

• Name of person who approved the data reported
• Signature
• Official position
• Program
• Department or agency
• E-mail address
• Telephone number

Enquiries to be directed to:

• Name
• Date
• Position title
• Telephone number
• Email address
• Fax number

Purpose

This survey collects financial and operating data on expenditures and full-time equivalent personnel on the scientific activities of Federal Government Public Administration in Canada.

Additional information

The data collected are used by federal and provincial science policy analysts, and are also part of the gross domestic expenditures on research and development (GERD). Your information may also be used by Statistics Canada for other statistical and research purposes.

Authority

Collected under the authority of the Statistics Act, Revised Statutes of Canada, 1985, Chapter S-19.

Completion of this questionnaire is a legal requirement under this Act.

Confidentiality

Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act. Statistics Canada will use the information from this survey for statistical purposes.

Data-sharing agreements

To reduce respondent burden, Statistics Canada has entered into data-sharing agreements with provincial and territorial statistical agencies and other government organizations, which have agreed to keep the data confidential and use them only for statistical purposes. Statistics Canada will only share data from this survey with those organizations that have demonstrated a requirement to use the data.

Section 11 of the Statistics Act provides for the sharing of information with provincial and territorial statistical agencies that meet certain conditions. These agencies must have the legislative authority to collect the same information, on a mandatory basis, and the legislation must provide substantially the same provisions for confidentiality and penalties for disclosure of confidential information as the Statistics Act. Because these agencies have the legal authority to compel businesses to provide the same information, consent is not requested and businesses may not object to the sharing of the data.

For this survey, there are Section 11 agreements with the provincial and territorial statistical agencies of Newfoundland and Labrador, Nova Scotia, New Brunswick, Quebec, Ontario, Manitoba, Saskatchewan, Alberta, British Columbia, and the Yukon.

The shared data will be limited to information pertaining to federal departments and agencies located within the jurisdiction of the respective province or territory.

Section 12 of the Statistics Act provides for the sharing of information with federal, provincial or territorial government organizations. Under Section 12, you may refuse to share your information with any of these organizations by writing a letter of objection to the Chief Statistician and returning it with the completed questionnaire. Please specify the organizations with which you do not want to share your data.

For this survey, there are Section 12 agreements with the statistical agencies of Prince Edward Island, the Northwest Territories, Nunavut, Innovation Science and Economic Development Canada (ISED), as well as the Office of the Chief Science Advisor (OCSA) of ISED. 

The shared data will be limited to information pertaining to federal departments and agencies located within the jurisdiction of the respective province or territory.

Record linkage

To enhance the data from this survey and to minimize the reporting burden, Statistics Canada may combine it with information from other surveys or from administrative sources.

Security of emails and faxes

Statistics Canada advises you that there could be a risk of disclosure during the transmission of information by facsimile or e-mail. However, upon receipt, Statistics Canada will provide the guaranteed level of protection afforded all information collected under the authority of the Statistics Act.

Return procedures

Please forward the completed questionnaire and listing of extramural performers through the Electronic File Transfer service (EFT).
For further inquiries:

• Phone Number: toll free at 1-888-659-8229
• Fax number: toll free at 1-800-755-5514
• Email: statcan.fsepsurv-enqdmsf.statcan@statcan.gc.ca

Thank you for your co-operation.

FSEP - Introduction

This introduction is intended to provide an overview of the process of collecting science expenditure data; definitions of and explanatory notes on natural sciences and engineering, social sciences, humanities and the arts, scientific and technological activities, performance sectors, and other terms used are given in subsequent sections.

The collection of science expenditure data is organized by the Centre for Innovation, Technology and Enterprise Statistics (CITES) of Statistics Canada. This exercise was formerly conducted under the aegis of the Treasury Board of Canada Secretariat but is now solely a Statistics Canada survey.

Collection is undertaken to gather essential data describing the recent, current and proposed state of the federal resources allocated to science. Federal science expenditures data are provided to Innovation, Science and Economic Development Canada who in turn use the data in the development of advice to the Assistant Deputy Ministers' Steering Committee on the Management of S&T, their Minister and the Treasury Board of Canada Secretariat, as well as in policy development and in monitoring the implementation of science policies. Statistics Canada maintains historical expenditure series in natural sciences and engineering dating back to 1963 and to 1971 in the social sciences, humanities and the arts. These data are available through the Centre for Innovation, Technology and Enterprise Statistics (CITES) or through special requests.

The basic reporting unit is the budgetary program of a department or agency. Each budgetary program forms the subject of separate scientific expenditure reports for the natural and for the social science activities within it. Both the program and the program activities within it may be scientific in whole or in part only. Only expenditures on the scientific components of a program or its activity are reported. In some programs it will be difficult to distinguish between the natural and social sciences. However, some allocation must be made and in determining this allocation, the dominant orientation of the projects and the area of expertise of the personnel involved must be considered. Detailed definitions are given on the following pages.

On the questionnaires, the identified expenditures are looked at from several different viewpoints and in various subdivisions. Expenditures on research and development (R&D) and related scientific activities (RSA) are subdivided to provide an indication of the "what" of a department's scientific effort. Expenditures in each category of scientific activity are further subdivided into "current" and "capital" segments. Current expenditures are additionally subdivided by sector, to indicate the "where" and "by whom" the activity is performed (e.g., in business enterprise, in higher education).

The human resources allocated to scientific activities are summarized in terms of the involved categories of personnel (scientific and professional, technical, etc.) and the principal focus of their efforts (R&D, RSA and, administration of extramural programs).

When completed, checked for consistency with previous reports, entered into the database and totaled along the various dimensions, these data provide snapshots of the federal resources allocated to science, supporting not only the work of central agencies but also the submissions of departments and agencies requesting resources.

Purpose

This survey collects financial and operating data on expenditures and full-time equivalent personnel on the scientific activities of Federal Government Public Administration in Canada.

Question 1: Expenditures by activity and performer

General

The natural sciences and engineering consist of disciplines concerned with understanding, exploring, developing or utilizing the natural world. Included are the engineering and technology, mathematical, computer and information sciences, physical sciences, medical and health sciences, and agricultural sciences, veterinary sciences and forestry.

Expenditures by activity and performer

Scientific and technological (S&T) activities can be defined as all systematic activities which are closely concerned with the generation, advancement, dissemination and application of scientific and technology knowledge in all fields of science and technology, that is the natural sciences and engineering, and the social sciences, humanities and the arts.

The central activity is scientific research and experimental development (R&D). In addition there are a number of activities closely related to R&D, and are termed related scientific activities (RSA). Those identified as being appropriate for the federal government in the natural sciences are: scientific data collection, information services, special services and studies and education support.

The performer is equivalent to the sector in which the scientific activity is conducted. The basic distinction is between intramural and extramural performance. Extramural payments are classified on the basis of the performance sectors to which they are made. The appropriate extramural performers are business enterprise, higher education, Canadian non-profit institutions, provincial and municipal government, and foreign performers.

I. Performers

lntramural activities include all current expenditures incurred for scientific activities carried out by in-house personnel of units assigned to the program; the related gross fixed capital expenditures (acquisition of land, buildings, machinery and equipment for scientific activities); the administration of scientific activities by program employees; and, the purchase of goods and services to support in-house scientific activities (include royalties or licences for the use of patents and other intellectual property rights, the lease of capital goods (machinery and equipment, etc.) and the rental of buildings to support scientific activities performed by the statistical unit in the reference year).

The intramural expenditures reported for scientific activities are those direct costs, including salaries, associated with scientific programs. The costs should include that portion of a program's contribution to employee benefit plans (e.g., superannuation and compensation) which is applicable to the scientific personnel within the program. The summation of intramural R&D activity is synonymous with the performance of R&D for the entire economy (GERD).

Extramural performers are groups being funded by the federal government sector for S&T activities. In this survey the extramural performers include:

• Business enterprise – business and government enterprises including public utilities and government-owned firms. Both financial and non-financial corporations are included. Incorporated consultants or unincorporated individuals providing scientific and engineering services are also included. Industrial research institutes located at Canadian universities are considered to be in the higher education sector.
• Higher education – comprises all universities, colleges of technology and other institutes of post-secondary education, whatever their source of finance or legal status. It also includes teaching hospitals (non-teaching hospitals are in the Canadian non-profit sector), all research institutes, centers, experimental stations and clinics that have their scientific activities under the direct control of, or administered by, or associated with, the higher education establishments.
• Canadian non-profit institutions – charitable foundations, voluntary health organizations, scientific and professional societies, non-teaching hospitals (teaching hospitals are in the higher education sector) and other organizations not established to earn profits. Non-profit institutions primarily serving or controlled by another sector should be included in the controlling sector.
• Provincial and municipal governments – departments and agencies of these governments as well as provincial research organizations. Government enterprises, such as provincial utilities are included in the business enterprise sector, and non-teaching hospitals in the Canadian non-profit institutions sector.
• Foreign performers – all foreign government agencies, foreign companies (including foreign subsidiaries of Canadian firms), international organizations, non-resident foreign nationals and Canadians studying or teaching abroad.

II. Research and experimental development (R&D)

Research and experimental development (R&D) - comprise creative and systematic work undertaken in order to increase the stock of knowledge - including knowledge of humankind, culture and society - and to devise new applications of available knowledge.

R&D activities may be aimed at achieving either specific or general objectives. R&D is always aimed at new findings, based on original concepts (and their interpretation) or hypotheses. It is largely uncertain about its final outcome (or at least about the quantity of time and resources needed to achieve it), it is planned for and budgeted (even when carried out by individuals), and it is aimed at producing results that could be either freely transferred or traded in a marketplace.

For an activity to be an R&D activity, it must satisfy five core criteria:

• To be aimed at new findings (novel);
• To be based on original, not obvious, concepts and hypothesis (creative);
• To be uncertain about the final outcome (uncertainty);
• To be planned and budgeted (systematic);
• To lead to results that could be possibly reproduced (transferable/or reproducible).

Examples of R&D:

• A special investigation of a particular mortality in order to establish the side effects of certain cancer treatment is R&D.
• The investigation of new methods of measuring temperature is R&D, as is the study and development of new models for weather prediction.
• Investigation on the genetics of the species of plants in a forest in an attempt to understand natural controls for disease or pest resistance.
• The development of new application software and substantial improvements to operating systems and application programs.

R&D is generally carried out by specialized R&D units. However, an R&D project may also involve the use of non R&D facilities (e.g., testing grounds), the purchase or construction of specialized equipment and materials, and the assistance of other units. Costs of such items, attributable to the project, are to be considered R&D costs.

R&D may also be carried out by units normally engaged in other functions (e.g. a marine survey ship used for hydrological research, a geological survey team may be directed to work in a certain area in order to provide data for a geophysical research project). Such effort is part of an R&D project and, again, so far as is practical, the costs should be assigned to R&D expenditures.

On the other hand, R&D units may also be engaged in non R&D activities such as technical advisory services, testing, and construction of special equipment for other units. So far as is practical, the effort devoted to such operations should be included in the related scientific activities (RSA).

1. In-house R&D – R&D performed by personnel of the reporting program. It may include R&D carried out on behalf of another program or federal government department.

2. R&D contracts – contracts to an outside institution or individual to fund R&D performed by the institution or individual. The criterion is: would the performer report the R&D contract as in-house (intramural) R&D that is government-funded? If the answer is yes the activity would be an R&D contract. If no, and the funding is for the purchase of goods and services to support the in-house R&D of the federal government department, it should be reported as In-house R&D (Item 7).

3. R&D grants and contributions – awards to organizations or individuals for the conduct of R&D and intended to benefit the recipients rather than provide the program with goods, services or information. These funds are normally identical to that portion of the budgetary "grants and contributions" line object of expenditure which is devoted to R&D activities.

4. Research fellowships – awards to individuals for advanced research training and experience. Awards intended primarily to support the education of the recipients should be reported as "education support".

5. Administration of extramural programs – the costs of identifiable units engaged in the administration of contracts and grants and contributions for scientific activities that are to be performed outside the federal government. These expenditures should be broken down by the type of scientific activity supported, i.e. R&D or RSA.

6. Capital expenditures – the annual gross amount paid for the acquisition of fixed assets that are used repeatedly or continuously in the performance of scientific activities for more than one year. They should be reported in full for the period when they took place, whether acquired or developed in house, and should not be registered as an element of depreciation.

The most relevant types of assets used for capital expenditures are:

• Land and buildings
• Machinery and equipment
• Capitalized computer software
• Other intellectual property products

III. Related scientific activities (RSA)

Related scientific activities (RSA) are all systematic activities which are closely concerned with the generation, advancement, dissemination and application of scientific and technological knowledge. The types of related scientific activities for the natural sciences and engineering are described below.

7. In-house RSA – RSA performed by personnel of the reporting program. It may include RSA carried out on behalf of another program or federal government department.

In-house RSA activities include all current expenditures incurred for scientific activities carried out by in-house personnel of units assigned to the program; the purchase of goods and services to support in-house scientific activities (include royalties or licences for the use of patents and other intellectual property rights, and the rental of buildings to support scientific activities performed by the statistical unit in the reference year). Also include expenses of persons who provide ancillary services such as security, cleaning and maintenance work, finance and administration that are proportional to the RSA being conducted. However, the personnel providing these services are not to be included in the in-house personnel counts (see Section 2. Personnel).

The intramural expenditures reported to RSA are those direct costs, including salaries, associated with scientific programs. The cost should include that portion of a program's contribution to employee benefit plans (e.g., superannuation and compensation) which is applicable to the scientific personnel within the program. Also include the costs of self-employed individuals, consultants and researchers who are working on-site on the departments' RSA projects.

8. RSA contracts – contracts to an outside institution or individual to fund RSA performed by the institution or individual. The criterion is: would the performer report the RSA contract as in-house (intramural) RSA that is government-funded? If the answer is yes the activity would be an RSA contract. If no, and the funding is for the purchase of goods and services to support the in-house RSA of the federal government department, it should be reported as In-house RSA (Item 7).

Contracts to other federal government departments should be reported as a transfer of funds in question 3A (i) and 3A (ii) of the questionnaire.

9. RSA grants and contributions – awards to organizations or individuals for the conduct of RSA and intended to benefit the recipients rather than provide the program with goods, services or information. These funds are normally identical to that portion of the budgetary "grants and contributions" line object of expenditure which is devoted to RSA.

In-house RSA, RSA Contracts and RSA grants and contributions can include the following items:

• Scientific data collection – the gathering, processing, collating and analyzing of data on natural phenomena. These data are normally the results of surveys, routine laboratory analyses or compilations of operating records.
  Data collected as part of an existing or proposed research project are charged to research. Similarly, the costs of analyzing existing data as part of a research project are R&D costs, even when the data were originally collected for some other purpose. The development of new techniques for data collection is also to be considered a research activity. Examples of RSA scientific data collection are: routine geological, hydrographic, oceanographic and topographic surveys; routine astronomical observations; maintenance of meteorological records; and wildlife and fisheries surveys.
• Information services – all work directed to collecting, coding, analyzing, evaluating, recording, classifying, translating and disseminating scientific and technological information as well as museum services. Included are the operations of scientific and technical libraries, S&T consulting and advisory services, the Patent Office, the publication of scientific journals and monographs, and the organizing of scientific conferences. Grants for the publication of scholarly works are also included.
  General purpose information services or information services directed primarily towards the general public are excluded, as are general departmental and public libraries. When individual budgets exist, the costs of libraries which belong to institutions otherwise entirely classified to another activity, such as R&D, should be assigned to information services. The costs of printing and distributing reports from another activity, such as R&D, are normally attributed to that activity.
• Sub category under Information services:
  • Museum services – the collecting, cataloguing and displaying of specimens of the natural world or of representations of natural phenomena. The activity involves a systematic attempt to preserve and display items from the natural world; in some ways it could be considered an extension of information services. The scientific activities of natural history museums, zoological and botanical gardens, aquaria, planetaria and nature reserves are included. Parks which are not primarily restricted reserves for certain fauna or flora are excluded. In all cases the costs of providing entertainment and recreation to visitors should be excluded (e.g. restaurants, children's gardens and museums).
    When a museum also covers not only natural history but also aspects of human cultural activities, the museum's resources should be appropriated between the natural and social sciences. However, museums of science and technology, war, etc., which display synthetic or artificial objects and may also illustrate the operations of certain technologies, should be considered as engaged in museum services in social sciences.
  • Special services and studies – work directed towards the establishment of national and provincial standards for materials, devices, products and processes; the calibration of secondary standards; non-routine quality testing; feasibility studies and demonstration projects.
• Sub categories under Special services and studies include:
  • Testing and standardization – concerns the maintenance of national standards, the calibration of secondary standards and the non-routine testing and analysis of materials, components, products, processes, soils, atmosphere, etc. These activities are related scientific activities (RSA). The development of new measures for standards, or of new methods of measuring or testing, is R&D. Exclude routine testing such as monitoring radioactivity levels or soil tests before construction.
  • Feasibility studies – technical investigations of proposed engineering projects to provide additional information required to reach decisions on implementation. Besides feasibility studies, the related activity of demonstration projects are to be included. Demonstration projects involve the operation of scaled-up versions of a facility or process, or data on factors such as costs, operational characteristics, market demand and public acceptance. Projects called "demonstration projects" but which conform to the definition of R&D should be considered R&D. Once a facility or process is operated primarily to provide a service or to gain revenue, rather than as a demonstration, it should no longer be included with feasibility studies. In all demonstration projects, only the net costs should be considered.
  • Education support – grants to individuals or institutions on behalf of individuals which are intended to support the post-secondary education of students in technology and the natural sciences. General operating or capital grants are excluded. The activity includes the support of foreign students in their studies of the natural sciences at Canadian or foreign institutions. Grants intended primarily to support the research of individuals at universities are either R&D grants or research fellowships.
    Awards intended primarily to support the education of the recipients should be reported as "education support".

10. Administration of extramural programs – the costs of identifiable units engaged in the administration of contracts and grants and contributions for scientific activities that are to be performed outside the federal government. These expenditures should be broken down by the type of scientific activity supported, i.e. R&D or RSA.

11. Capital expenditures – the annual gross amount paid for the acquisition of fixed assets that are used repeatedly or continuously in the performance of scientific activities for more than one year. They should be reported in full for the period when they took place, whether acquired or developed in house, and should not be registered as an element of depreciation.

The most relevant types of assets used for capital expenditures are:

• Land and buildings
• Machinery and equipment
• Capitalized computer software
• Other intellectual property products

Question 2: Personnel

Full-time equivalent (FTE) – the ratio of working hours actually spent on scientific activities during a specific reference period divided by the total number of hours conventionally worked in the same period by an individual or a group. For example, an employee who is engaged in scientific activities for half a year has a full-time equivalence of 0.5. Personnel data reported should be consistent with expenditures data.

Scientific and professional – researchers and professionals engaged in the conception or creation of new knowledge. They conduct research and improve or develop concepts, theories, models, techniques instrumentation, software or operational methods. They require at least one academic degree or a nationally recognized professional qualification, as well as those with equivalent experience.

Technical – technicians and equivalent staff are persons whose main tasks require technical knowledge and experience in one or more fields of engineering, the physical and life sciences, or the social sciences, humanities and the arts. They perform scientific and technical tasks involving the application of concepts and operational methods and the use of research equipment, normally under the supervision of researchers.

Other – other supporting staff includes skilled and unskilled craftsmen, and administrative, secretarial and clerical staff participating in science and technology projects or directly associated with such projects.

Question 2: Personnel by gender

Gender – refers to current gender which may be different from sex assigned at birth and may be different from what is indicated on legal documents. Categories include: man, woman, and non-binary person.

Man – this category includes persons whose reported gender is male. It includes cisgender (cis) and transgender (trans) men. 

Woman – this category includes persons whose reported gender is female. It includes cisgender (cis) and transgender (trans) women. 

Non-binary person – this category includes persons whose reported gender is not exclusively male or female.

Question 3: Sources of funds

Question 3A (i). Transfers for natural sciences and engineering activities

Include payments and recipients for contracts, transfers and joint programs from/to other federal government departments. Please identify the amount and names of the origination and recipient programs.

Question 3A (ii). Sources of funds for total scientific and technological activities

This question identifies the sources of funds for expenditures on scientific activities reported for all three years. It will help to ensure that work funded from outside the department is not overlooked.

• Departmental S&T budget – that portion of the total departmental budget which was spent on natural science and engineering activities.
• Revenues to / from other federal departments – money transferred from this program to another federal department or money transferred into this program from another federal department for activities in the natural sciences and engineering.
• Provincial government departments – all funds from the provincial government used for natural science and engineering activities. The funds are referred to as payments, contributions, transfers, etc. Also include provincial portions of federal-provincial cost sharing programs performed by the department program.
• Business enterprises – all funds from business enterprises used for natural science and engineering activities performed by the department.
• Other – all funds for natural sciences and engineering activities from other sources not specified above.

Question 4: Socio-economic objectives

Intramural and extramural scientific and technological expenditures by socio-economic objective for the reporting year by activity (research and experimental development, related scientific activities, and total).

• 1. Exploration and exploitation of the Earth
• 2. Environment 
• 3. Exploration and exploitation of space
• 4. Transport, telecommunication and other infrastructures
• 5. Energy
• 6. Industrial production and technology
• 7. Health
• 8. Agriculture (include forestry and fisheries)
  • 8.1: Agriculture
  • 8.2: Fishing
  • 8.3: Forestry
• 9. Education 
• 10. Culture, recreation, religion and mass media
• 11. Political and social systems, structures and processes
• 12. Defence

1. Exploration and exploitation of the Earth – scientific activities with objectives related to the exploration of the Earth's crust and mantle, seas, oceans and atmosphere, as well as on their exploitation. It also includes climatic and meteorological research, polar exploration (under various headings, as appropriate) and hydrology. It does not include scientific activities related to soil improvement (objective 4), land use or fishing (objective 8), or pollution (objective 2).

Examples:

• General scientific activities
• Mineral, oil and natural gas prospecting
• Exploration and exploitation of the sea-bed
• Earth's crust and mantle excluding sea-bed and studies of soil for agriculture (objective 8)
• Hydrology - excludes scientific activities on: water supplied and disposal (objective 4) and water pollution (objective 2)
• Sea and oceans
• Atmosphere
• Other scientific activities on the exploration and exploitation of the earth

Excludes: scientific activities on pollution (objective 2), soil improvement (objective 4), land-use and fishing (objective 8).

2. Environment - covers scientific activities aimed at improving the control of pollution, including the identification and analysis of the sources of pollution and their causes, and all pollutants, including their dispersal in the environment and the effects on humans, species (fauna, flora, micro-organisms) and the biosphere.

The development of monitoring facilities for the measurement of all kinds of pollution is included, as is scientific activities for the elimination and prevention of all forms of pollution in all types of environment.

3. Exploration and exploitation of space – covers all civil space scientific activities relating to the scientific exploration of space, space laboratories, space travel and launch systems. Although civil space scientific activities is not in general concerned with particular objectives, it frequently has a specific goal, such as the advancement of knowledge (e.g. astronomy) or relates to particular applications (e.g. telecommunications satellites or earth observation). This chapter does not include corresponding scientific activities for defence purposes.

4. Transport, telecommunication and other infrastructures – Transport, telecommunication and other infrastructures - covers scientific activities aimed at infrastructure and land development, including the construction of buildings. More generally, this objective covers all scientific activities relating to the general planning of land use. This includes scientific activities into protection against harmful effects in town and country planning but not research into other types of pollution (objective 2). This objective also includes scientific activities related to transport systems; telecommunication systems; general planning of land use; the construction and planning of buildings; civil engineering; and water supply.

5. Energy – covers scientific activities aimed at improving the production, storage, transportation, distribution and rational use of all forms of energy. It also includes scientific activities on processes designed to increase the efficiency of energy production and distribution, and the study of energy conservation. It does not include scientific activities related to prospecting (objective 1) or scientific activities into vehicle and engine propulsion (objective 6).

Examples:

• Fossil fuels and their derivatives
• Nuclear fission
• Radioactive waste management including decommissioning with regard to fuel/energy
• Nuclear fusion
• Renewable energy sources
• Rational utilization of energy

6. Industrial production and technology – covers scientific activities on the improvement of industrial production and technology. It includes scientific activities on industrial products and their manufacturing processes except where they form an integral part of the pursuit of other objectives (e.g. defence, space, energy, agriculture).

Examples:

• Increasing economic efficiency and competitiveness
• Manufacturing and processing techniques
• Petrochemical and coal by-products
• Pharmaceutical products
• Manufacture of motor vehicles and other means of transport
• Aerospace equipment manufacturing and repairing
• Electronic and related industries
• Manufacture of electrical machinery and apparatus
• Manufacture of non-electronic and non-electronical machinery
• Manufacture of medical and surgical equipment and orthopaedic appliances
• Manufacture of food products and beverages
• Manufacture of clothing and textiles and leather goods
• Recycling

7. Health - covers scientific activities aimed at protecting, promoting and restoring human health broadly interpreted to include health aspects of nutrition and food hygiene. It ranges from preventive medicine, including all aspects of medical and surgical treatment, both for individuals and groups, and the provision of hospital and home care, to social medicine and paediatric and geriatric research.

Examples:

• General scientific activities
• Medical scientific activities, hospital treatment, surgery
• Preventive medicine
• Biomedical engineering and medicines
• Occupational medicine
• Nutrition and food hygiene
• Drug abuse and addition
• Social medicine
• Hospital structure and organization of medical care
• Other medical scientific activities

8. Agriculture (include forestry and fisheries) – covers all scientific activities on the promotion of agriculture, forestry, fisheries and foodstuff production, or further knowledge on chemical fertilizers, biocides, biological pest control and the mechanization of agriculture, as well as concerning the impact of agricultural and forestry activities on the environment. Also covers scientific activities on improving food productivity and technology.

8.1 Agriculture – covers scientific activities on animal products, veterinary medicine, crops, food technology and other scientific activities on agricultural production and technology.

8.2 Fishing – covers scientific activities on fishing, salting, drying, and initial freezing of products (but not on preparation and canning (objective 6)), scientific activities on fish-farming, exploration of new fishing grounds, exploration and development of new and unconventional sources of seafood.

8.3 Forestry – covers scientific activities into the ecological and economic aspects of forestry and timber production.

9. Education – covers scientific activities aimed at supporting general or special education, including training, pedagogy, didactics, and targeted methods for specially gifted persons or those with learning disabilities. Applied to all levels of education as well as to subsidiary services to education.

10. Culture, recreation, religion and mass media – covers scientific activities aimed at improving the understanding of social phenomena related to culture activities, religion and leisure activities so as to define their impact on life in society, as well as to racial and cultural integration and on socio-cultural changes in these areas. The concept of "culture" covers sociology of science, religion, art, sport and leisure, and also comprises inter alia R&D on the media, the mastery of language and social integration, libraries, archives and external cultural policy.

11. Political and social system, structures and processes – covers scientific activities aimed at improving the understanding and supporting the political structure of society, public administration issues and economic policy, regional studies and multi-level governance, social change, social processes and social conflicts, the development of social security and social assistance systems, and the social aspects of the organization of work.

12. Defence – covers scientific activities for military purposes. It also includes basic research and nuclear and space research financed by the Department of National defence. Civil scientific activities financed by ministries of defence, for example, in the fields of meteorology, telecommunications and health, should be classified in the relevant objectives.

Question 5: Expenditures and personnel by region

Scientific and technological expenditures and personnel of federal organizations for the reference year, including current and capital expenditures for intramural R&D and RSA and by scientific and professional and total personnel for R&D and RSA.

Regions include:

• Newfoundland and Labrador
• Prince Edward Island
• Nova Scotia
• New Brunswick
• Quebec (excluding NCR - Quebec)
• National Capital Region (NCR) - Quebec
• Ontario (excluding NCR - Ontario)
• National Capital Region (NCR) - Ontario
• Manitoba
• Saskatchewan
• Alberta
• British Columbia
• Yukon, Northwest Territories and Nunavut
• Canada Total

Presentations

Presenters in invited sessions are allowed approximately twenty-five minutes for their presentations and a period of 5 minutes is allowed for questions and discussion at the end of their presentation.

Presenters in contributed sessions are allowed fifteen minutes for their presentations and a period of fifteen minutes is allowed for questions and discussion at the end of the session.

Presenters in special sessions, please refer to information provided by your session's chair.

We strongly recommend that you submit a Microsoft PowerPoint version of your presentation. Please verify with us in advance if you would like to use any other software. PowerPoint is preferred in order to produce a translated version with the same appearance as the original, especially when the presentation includes tables, graphics or equations. We also ask that you avoid any PowerPoint animation. During translation, the hidden animation control code can sometimes be accidentally deleted, resulting in translated presentations that are out of synch. Please use at least a 24-point font that can easily be read from a distance and that is part of the standard Microsoft suite of fonts. The bilingual presentations will be loaded onto Statistics Canada's laptops. If we do not have the font that you use, we will not be able to show your presentation.

Registration

Please remember that you must register for the conference by September 30, 2024.

Proceedings manuscripts

Proceedings of the conference will be eventually published on our website. Please note that the final version of your manuscript is due by January 10, 2025, in order to be translated and included in the Symposium's Proceedings. Including references and appendices, the manuscript must not exceed:

• eight pages in length for invited sessions (sessions A and special sessions)
• six pages in length for contributed sessions (sessions B)

We strongly encourage you to use Microsoft Word for your manuscript. If planning to use any other software, please check with us first. A Style Guide for Manuscripts is available in the Manuscript Style Guide section of the website.

Please send the final version of your manuscript to statcan.symposium2024-symposium2024.statcan@statcan.gc.ca no later than January 10, 2025.

All times listed in the schedule refer to Eastern Daylight Time (EDT): UTC-4

Wednesday October 30, 2024

08:45 – 09:00
Opening Remarks
Simon Goldberg Room

• Éric Rancourt, Assistant Chief Statistician, Strategic Data Management, Methods and Analysis Field, Statistics Canada, Canada

09:00 – 10:00
Session 1 – Keynote Address
Simon Goldberg Room

• The evolving role of National Statistical Institutes – Challenges and Opportunities
  Pádraig Dalton, Former Director General, Central Statistics Office, Ireland
  • Abstract

    The demand for data continues to grow unabated. The range of subject matter areas on which evidence and insight is required continues to expand while in addition users want more timely, more frequent and more granular data. All of this is happening in a context where National Statistical Institutes (NSIs) are just one part of an ever-growing data market and where fake news and alternative facts present significant risks to decision makers and indeed the general public. National Statistical Institutes must step forward and play a strong leadership role and establish their point of difference from other unregulated data providers and create an understanding of the value-add that can and must be delivered from within the Official Statistical System. To meet the growing range of demands in this challenging environment NSIs will need to be agile, adaptive and innovative while adhering to our fundamental principles and core values. We will also need to exploit all of the opportunities offered by advancements in technology, methodology and the ongoing emergence of new data sources. This presentation will look at the evolving context within which NSIs now find themselves and consider the associated opportunities and challenges this presents.

10:00 – 10:30
Morning Break

10:30 – 12:00
Session 2A – Balancing Disclosure Risk and Analytic Utility with Synthetic Data
Simon Goldberg Room

• Inference from Synthetic Data: Challenges and Solutions
  Anne-Sophie Charest, Université Laval, Canada
  • Abstract

    As concerns over privacy and data security mount, the generation of synthetic data emerges as a promising avenue for mitigating disclosure risks associated with personal data. But while there is a rapidly growing body of literature on methods to generate such synthetic datasets, the focus has predominantly been on generating more complex and accurate data, rather than the implications of synthesis for downstream analysis.

    This presentation aims to address this gap by providing an overview of current research efforts in the field, including some of my own contributions. Two main approaches to obtain accurate uncertainties will be discussed: using combining rules with multiple synthetic datasets as is sometimes done with missing data, and leveraging direct knowledge of the synthesis methodology, which is available for example in the case of differential privacy. We will discuss the advantages and limitations of both and offer some thoughts on practical implications.

• Generating and Analyzing Synthetic Data
  Khaled El Emam, University of Ottawa, Canada
  • Abstract

    Synthetic data can be a privacy protective way for sharing microdata, and are increasingly seen as a more robust form of non-personal information. This presentation will summarize the learnings from a series of real data and simulation studies on the generation and statistical analysis of synthetic data: (a) common metrics to assess the privacy risks of synthetic data are attribution and membership disclosure, (b) valid statistical analysis requires the generation of 10 synthetic dataset and using combining rules to get the parameter estimates and standard errors, (c) data amplification has marginal benefit, (d) understanding the performance of generative models relative to the number of variables in the training dataset, (e) when and how to augment microdata to maximize model performance, (f) using synthetic data generation to mitigate bias in real-world data.

    These results will be illustrated on health datasets across multiple types of generative models: sequential synthesis with decision trees, Bayesian networks, generative adversarial networks, and variational autoencoders.

• Generating Select Synthetic Survey Data
  Minsun Riddles, Westat, USA
  • Abstract

    As the demand for microdata access grows alongside privacy concerns, interest in synthetic data has surged. For example, synthetic data is recognized as offering a promising solution for sharing vast amounts of health data to accelerate research while safeguarding privacy. However, generating synthetic data presents challenges, particularly when it comes to survey data, in balancing reducing disclosure risk with retaining original data integrity. One approach to addressing these challenges is through the 'select' data synthesis approach, which involves synthesizing select variables of select records with high disclosure risks. In this paper, we address these challenges and propose solutions for generating select synthetic data in two U.S. large-scale national surveys. Additionally, we introduce a replication variance estimation method to appropriately measure the additional variation introduced by data synthesis.

10:30 – 12:00
Session 2B – Modern Approaches for Different Data Sources
Jean Talon Conference Room

• Low response rate from merchants? No problem, just ask consumers! An application of indirect sampling to consumer payment diary data
  Joy Wu, Heng Chen, Bank of Canada, Canada
  • Abstract

    Merchant surveys traditionally have very low response rates. An alternative would be to leverage consumer surveys, but there are two issues: the representativeness of consumers and the accuracy of their responses. This paper addresses both issues through applying indirect sampling and survey weight calibration. When survey practitioners face the challenge to directly sample from the target population for which either the sampling frame is difficult to compile, or response rates are very low, indirect sampling can help by leveraging the links between the frame population and the target population. We apply this estimator to generate indirect estimates of (target
    population) Canadian-merchants' cash, debit, and credit acceptance from consumer survey data (frame population), which contains transaction-level details recorded in the diary section of the data. Not only do we leverage the consumer-merchant transaction data to construct the merchant weights through the generalized weight share method (GWSM), but we also construct the payment acceptance variables of these linked merchant from both consumers' revealed and stated payment choices. We do so without needing to interact with merchants, overcoming the challenge of traditionally low response rates.

    We also innovate on the existing GWSM methodology by using an external data set to estimate the total number of visits received by a merchant (a key component in GWSM), which is underestimated in the consumer data due to its structure. Lastly, our GWSM weights are also calibrated so that our final indirect merchant sample is representative of the merchant population. Our results show that the direct and indirect estimates of merchant payment acceptance are very similar.

• The Field Data Collector Labor Force: Considerations for the Future of In-Person Data Collection
  Brad Edwards, Rick Dulaney, Jill Carle, Tammy Cook, Westat, USA
  • Abstract

    In-person data collection is critical for the success of many large government-sponsored surveys. Despite response rate declines and increasing costs, the mode remains the gold standard for meeting the most rigorous survey requirements for national survey programs, particularly as part of a multimode data collection strategy (Schober 2018). However, over the last ten years critical labor market and workforce changes, exacerbated by the pandemic, have made in-person data collection efforts prohibitive for many largest survey organizations. New ideas about job flexibility and job satisfaction coupled with the increasingly technical role and demanding nature of the job have impacted recruitment and retention for survey organizations across the U.S. and Europe (Charman et al 2024; Carle et al 2023). Indeed, some European countries have abandoned in-person data collection altogether for lack of work to sustain a field data collector (FDC) labor force.

    This presentation will summarize trends in U.S. FDC employment over the past decade and outline key challenges in recruiting and retaining high quality FDCs. Through surveys of current and exiting FDCs and a unique administrative dataset of over 27,000 FDCs across more than 80 large survey projects, we will highlight key takeaways from an ongoing research program, including the impact of changing demographics on FDC retention, and how training mode efficacy differs by FDC experience. We will discuss considerations for the future of in-person data collection, including supplementing field data collection with multimode alternatives such as video interviewing, professionalizing the FDC role, and updating value propositions for respondents.

• Constructing a synthetic population to evaluate redesign options through simulation, for a rotating panel survey
  Pauline Summers, Andrew Brennan, Statistics Canada, Canada
  • Abstract

    The methodology of Canada's Labour Force Survey (LFS) undergoes a thorough review every ten years. For the current review, we developed a simulation system that reproduces the complex LFS survey process, from sampling to estimation, for investigating alternative methodologies or identifying places for improvement. The complexity of the LFS – its rotating panel design, regression composite estimator, and other features – made the simulation system both challenging to construct and extremely useful for understanding how the various components interact. Since its development, it has proved to be an indispensable tool, and has helped us generate knowledge specific to the LFS that would otherwise have been very difficult or impossible to obtain.

    This presentation describes the methodology we used to construct the synthetic population that is the basis for those simulations. We faced a series of unique modelling challenges, juggling requirements with respect to variable specification, cross-sectional consistency, and longitudinal consistency, to support simulations of the complex LFS survey process. Our solution is a "rotating panel population," modelled over a six-year period using a combination of cross-sectional and longitudinal modelling techniques.

    The synthetic population consists of six sets of parallel "clones" of a base population, where each "clone" unit is longitudinally modelled for six months, and then reset; this produces the six-month series required for each simulated LFS respondent, while mitigating the drift that arises from projecting a population over an extended period. We developed an innovative methodological procedure to generate the data in multiple stages, using several different statistical tools and techniques, and implemented it in R.

• Improving the automated capture of Survey of Household Spending receipts using advanced machine learning techniques
  Joanne Yoon, Oladayo Ogunnioki, Statistics Canada
  • Abstract

    The Survey of Household Spending (SHS) conducted by Statistics Canada collects paper diaries and shopping receipts as a source of household expenditure data. An auto-capturing algorithm was created for SHS 2023 to reduce statistical clerks' manual work of extracting important information from scanned receipts of common store brands. The algorithm used Tesseract optical character recognition (OCR) to extract text characters from images of receipts, and it identified store and product entities using regular expressions, also known as regex. The goal of this study was to enhance the current auto-capture algorithm by experimenting with more advanced OCR and machine learning methods. As a result, PaddleOCR, an open-source OCR toolkit, was selected as the new default OCR engine due to its overall performance in recognizing texts, especially digits, accurately across receipts of various qualities. Additionally, entity classifiers based on support vector machines were trained on historical SHS records and existing regex patterns. By using classifiers to categorize different elements present on receipts instead of relying solely on regex patterns, product and store recognition improved. It is expected that this new algorithm will be used for SHS 2025 to improve the auto-capture quality and reduce the manual burden associated with capturing receipt variables.

• Using LLMs for Automating the Analysis of Alternative Data for the Physical Flow Account of Plastic Materials
  Alexandre Istrate, Oladayo Oggunnioki, Statistics Canada
  • Abstract

    The Physical Flow Account for Plastic Material (PFAPM) pilot program aims to track the flow of plastic materials throughout the Canadian economy. Within this program, analysts rely heavily on alternative data sources consisting in a diverse array of annual reports sourced from various companies and organizations. These are essential to conduct thorough research and validate activities pertinent to the account.

    Due to their unstructured format and diversity, analyzing annual reports from various companies and organizations is a laborious and inefficient process, requiring significant time and effort from analysts. To address this, the project leverages advanced natural language processing (NLP) techniques, notably Large Language Models (LLMs), to automate two key objectives: sector classification and COVID-19 impact summarization.

    The goal was to develop an algorithmic pipeline that can ingest PDF documents and based on their content, classify companies into distinct sectors (Residential, Commercial, Institutional, Industrial, and Construction) and summarize the impact of the COVID-19 pandemic on plastic-related activities such as collection and recycling rates, logistical disruptions, etc.

    By automating these tasks, the project seeks to enhance the efficiency of data extraction, reduce manual workload, and improve the quality of insights derived from document analysis. The ultimate objective is to contribute to the advancement of environmental-economic research and inform sustainable plastic resource management strategies. By harnessing the power of LLMs, the project aims to unlock the potential of alternative data sources, providing more accurate and effective insights to shape environmental-economic policy and decision-making processes.

12:00 – 13:30
Lunch

13:30 – 15:00
Session 3A – Small Area Estimation: Extensions, Applications and New Developments sponsored by the International Association of Survey Statisticians (IASS)
Simon Goldberg Room

• Hierarchical Bayes small area estimation for county-level health prevalence to having a personal doctor
  Andreea Erciulescu, Westat, USA
  • Abstract

    The complexity of survey data and the availability of data from auxiliary sources motivate researchers to explore estimation methods that extend beyond traditional survey-based estimation. The U.S. Centers for Disease Control and Prevention's Behavioral Risk Factor Surveillance System.

    (BRFSS) collects a wide range of health information, including whether respondents have a personal doctor. While the BRFSS focuses on state-level estimation, there is demand for county-level estimation of health indicators using BRFSS data. A hierarchical Bayes small area estimation model is developed to combine county-level BRFSS survey data with county-level data from auxiliary sources, while accounting for various sources of error and nested geographical levels. To mitigate extreme proportions and unstable survey variances, a transformation is applied to the survey data. Model-based county-level predictions are constructed for prevalence of having a personal doctor for all the counties in the U.S., including those where BRFSS survey data were not available. An evaluation study using only the counties with large BRFSS sample sizes to fit the model versus using all the counties with BRFSS data to fit the model is also presented.

• New Twists on Old Tricks: Applications and Extensions of Traditional Small Area Models
  Emily Berg, Iowa State University, USA
  • Abstract

    The mixed model is a widely accepted tool for small area estimation. The thesis of this talk is that this vetted approach remains well-suited to addressing the challenges that arise in modern small area estimation problems. As evidence of this, we review applications and extensions of area-level and unit-level small area models. We first discuss the use of multivariate Fay-Herriot models for small area estimation of crime victimization rates. This application uses data from the National Crime Victimization Survey and illustrates the value of area-level models in an application of current interest.  We then review approaches to estimating nonlinear small area parameters, such as the median or the quartile, in the context of the unit-level model. In this setting, we discuss methods for informative sampling and extensions to exponential dispersion family models.

    The review encompasses modest innovations to well established procedures. The methods illustrate that the basic construct of the mixed model remains a useful tool for addressing small area problems of recent interest.

• Reverse-Engineering a Hypothetical Raking Process for the Estimation of Mean Squared Error of Raked Small Area Estimates
  François Verret and Braedan Walker, Statistics Canada, Canada
  • Abstract

    Small area estimation (SAE) of total employment and unemployment rate is performed monthly for the Labour Force Survey (LFS) using the Fay-Herriot model. These estimates are required for a mapping of the ten provinces defined by Census Metropolitan Areas, Census Agglomerations and a complementary geography called Self-contained Labour Areas.

    To protect against model inadequacies and for consistency, total employment small area estimates are raked to their provincial direct/published estimate, which are of good quality by design. To get an uncertainty estimate for the raked small area estimates, a parametric bootstrap procedure making the usual assumption of independence between area-level direct estimates results in an MSE for the aggregate of the raked estimates at the provincial level considerably greater than the variance of the provincial direct estimate, especially for smaller provinces. This is because (province-level) LFS weight calibration introduces negative correlations between sub-provincial direct estimates. Ignoring this negative correlation thus results in MSE estimates for the raked estimates that should be artificially inflated.

    Instead, a parametric bootstrap is used with a working covariance matrix of the direct estimates obtained by smoothing the variance components (as in the independence case) and by reverse-engineering a hypothetical raking process to derive the covariance terms. Application of the resulting theory gives a variance of the raked SAE estimates that is consistent with that of the provincial direct estimates. The MSE estimates of the raked SAE estimates obtained are in turn reduced and more reasonable.

13:30 – 15:00
Session 3B – Evaluating and Improving Surveys
Jean Talon Conference Room

• Correcting Selection Bias in a Non-probability Two-phase Payment Survey
  John Tsang, University of Ottawa, Canada
  Heng Chen, Bank of Canada, Canada
• • Abstract

    This presentation extends the Pseudo Maximum Likelihood (PML) estimator to the non-probability two-phase sampling by leveraging the probability sample at the individual level. Using the Bank of Canada 2020 Cash Alternative Survey Wave 2, we compare the performance of our proposed method to alternative methods, which either do not account for a two-phase sampling design or do not explicitly model the selection probability. The results show that the PML-based approach performs better than raking in reducing the selection bias for both phases' payment-related variables, especially for the low-response youth group. Furthermore, the two-phase PML weighting scheme accounting for both phases' selection mechanisms has a smaller bias than Phase-2-Only alternatives of ignoring Phase 1's design and simply treating Phase 2 as a standalone single-phase design. The presentation will end with a discussion about variance estimation for both phases.

• Recruitment and Collection of Web Panels at Statistics Canada
  Krista MacIsaac, Cilanne Boulet, Marnie Thomas, Statistics Canada
  • Abstract

    In 2020, Statistics Canada started to use probabilistic web panels as an alternate method of collecting official statistics. In a web panel, respondents to other surveys are asked for contact information to participate in future short surveys. This presentation will highlight Statistics Canada's experience with panels after 4 years, including what has been learned about the recruitment of panel participants and how to subsequently collect data using panel surveys. For instance, recruitment questions have been displayed in various ways, resulting in very different rates of participation. Moreover, the wealth of auxiliary information available on the recruitment survey can not only be incorporated into the creation of weights, it can also be used to actively manage collection operations, by predicting the probability of response to target follow-up efforts.

• A Bias Evaluation for Probabilistic Web Panels at Statistics Canada
  Anne Mather, Cilanne Boulet, Statistics Canada, Canada
  • Abstract

    Statistics Canada began to implement probabilistic web panels in 2020.

    Participants for these panels are recruited via questions on other Statistics Canada surveys that ask those willing to participate to provide their contact information. Web panels are a timely, cost-effective collection method to meet emerging data needs. However, they have lower response rates than are typically observed with traditional survey methods. Despite the lower response rates, the recruitment surveys provide a lot of auxiliary information for both respondents and non-respondents to the panel, which can be used in non-response adjustments.

    A study was carried out to explore the potential bias associated with these lower response rates and the degree to which it can be corrected during weighting. We will present the highlights of that study.

• Life in the FastText Lane: Harnessing Linear Programming Constrained Machine Learning for Classifications Revision
  Justin Evans, Laura Wile, Statistics Canada, Canada
  • Abstract

    Statistics Canada's Labour Force Survey (LFS) plays an essential role in the estimation of labour market conditions in Canada. Periodically, LFS revises its data to the most recent industry and occupational classification versions. Differences in versions can be extensive, including high-level and unit-group structural changes, creations, deletions, split-offs and combination of classification units (classes). Historically, to reconcile split-off classes - where one class splits into multiple classes - a sample of LFS split-off records would be manually recoded to the new classification version. Based on the split-off proportion observed in the recoded sample, a random allocation method would be applied on all data to reflect the changing Canadian labour market over time. This article proposes using machine learning (fastText), constrained to split-off proportions using linear programming, to revise industry and occupation classifications in LFS.

    The hybrid framework benefits from a text-based revision mechanism while adhering to traditional proportions driven estimates, thus ensuring a minimal impact on the comparability of published labour market indicators.

• Data-Driven Imputation Strategies and their Associated Quality Indicators in Economic Surveys
  Matei Mireuta, Ahalya Sivathayalan, Stephen Styles, Statistics Canada, Canada
  • Abstract

    Majority of economic surveys at Statistics Canada are processed in the Integrated Business Statistics Program (IBSP). The IBSP framework relies on the generalized system BANFF for editing and imputation (E&I) and on the generalized system G-EST for estimation and variance estimation. Currently, variance estimation is carried out analytically using the System for the Estimation of Variance due to Nonresponse and Imputation (SEVANI) which is part of G-EST.

    Classical E&I strategies for economic surveys are typically based on composite linear imputation given the difference in availability of auxiliary data among units. However, this can lead to tens (and often more) of possible imputation models for a given variable which makes implementation, support and analysis of a survey's overall imputation strategy very difficult. As part of recent modernization initiatives within the agency, our team has investigated several machine learning alternatives and examined their application and quality of imputation in the context of economic surveys.

    This presentation will cover some of these results as well as the challenges faced in the estimation of the variance due to imputation of these methods.

    The authors will describe two approximate fit-for-use methods for the estimation of total variance and their advantages/disadvantages from the point of view of a harmonized processing framework such as IBSP.

15:00 – 15:30
Afternoon Break

15:30 – 17:00
Session 4 – Collection Initiatives in Challenging Situations
Simon Goldberg Room

• Collection of Social Data – designing and changing
  Fiona O'Riordan, Central Statistics Office, Ireland
• • Abstract

    Social data is key to a properly functioning society. Our age, our sex, our educational attainment, do we work? do we have a warm coat? have we experienced discrimination? is data that informs government, researchers, and the citizen about our lives. Asked continually, we can see how we are changing and how our requirements are changing.

    The task of collecting social data has changed considerably over the last5-10 years. Field interviewers still have a role but its time now to supplement this mode with other ways of collecting this data. Innovation is key - understanding the respondent and designing campaigns that are efficient and, in some way, appealing is now necessary for success. The Office uses the concept of adaptive design to ensure continued success in the collection of household data, this is where the design of the survey is adapted to suit the requirements of the respondent.

    The Central Statistics Office (Ireland) is moving to a multi-mode environment, the Office has reviewed and continues to review its sample design for all surveys, it is trying to augment and keep the sample frame as current as possible by using admin data; behavioural science, analysis of previous response behaviours and the use of panel surveys are some of the key projects that are in progress at present.

    The Office is adapting to societal changes and societal requirements by using different tools and methods to continue to collect quality social data.

• The challenges of collecting data in remote locations: The example of data collection for the Québec Health Survey of High School Students in Nunavik – UVIKKAVUT QANUIPPAT?
  Catherine Côté, Marcel Godbout, Institut de la statistique du Québec, Canada
  • Abstract

    Since 2010, the Institut de la statistique du Québec (ISQ) has been conducting the Québec Health Survey of High School Students (QHSHSS) every six years for the Ministère de la Santé et des Services sociaux (MSSS). There were editions in 2010/2011, in 2016/2017 and in 2022/2023. This survey collects data on the physical and mental health, lifestyle habits, and social adjustment of high school students in Québec's regions. These three editions of the survey did not cover Nunavik, a region in Québec's Far North that comprises 14 communities, because the health needs and realities are different from those in the southern regions of the province. In 2016, the Nunavik Regional Board of Health and Social Services (NRBHSS), the School Board of Nunavik (Kativik Ilisarniliriniq) and the MSSS indicated to the ISQ that they would like a survey similar to the QHSHSS to be conducted just for Nunavik. The ISQ therefore began planning this survey that same year. However, there were many challenges along the way and it was only conducted in 2022. Collection was done in all communities, and the high school students in each one were enumerated because of their low numbers. The QHSHSS questionnaire was used for this survey, but was largely adapted to reflect the particularities of the region. In this presentation of the survey, called Québec Health Survey of High School Students in Nunavik – UVIKKAVUT QANUIPPAT?, we will examine the various challenges encountered (geographic, logistic, context, etc.) during data collection and how they were overcome.

• Measuring urban Indigenous health using respondent driven sampling
  Lisa Avery and Sara Wolfe, University Health Network (Toronto) and Aboriginal Health and Wellness Centre, Canada
  • Abstract

    Our Health Counts (OHC) uses respondent-driven sampling (RDS) that combines a peer-to-peer recruitment strategy with statistical methods to sample from populations that are difficult to reach because they lack a sampling frame. Embedding the sampling process within a community enables the collection of comprehensive socio-demographic data that might otherwise be underreported in a standard census by leveraging the strong social connections within a group. The survey process gathers information about social connectivity that, alone, or in combination with information about the ties in the recruitment chain, is used to adjust and obtain unbiased estimates of the population parameters by accounting for unequal sampling probability and homophily in the social network. An initial set of 10-12 seeds from the target population is selected to complete the OHC survey, who then refer family and friends. The first wave of recruits is identified through these referrals. Referrals are provided a unique coupon serial number, honourarium, and survey participation is facilitated. The second wave of participants are recruited based on the first wave's referrals, and so on, until the target sample size has been reached. Child recruitment occurs through custodial caregivers who complete the survey. Every OHC project is Indigenous-led, and the data remains community-owned and governed. OHC successfully produces meaningful, culturally relevant health data for Indigenous adults and children and has completed its data collection phase in Winnipeg, Manitoba, led by Aboriginal Health and Wellness Centre of Winnipeg. Key to the OHC approach are the principles of reciprocity, relationality, and local community self-determination.

Thursday October 31, 2024

9:00 – 10:00
Session 5 – Waksberg Award Winner Address
Simon Goldberg Room

• Waksberg Lecture 2024: Sample Design Using Models
  Richard Valliant, Research Professor Emeritus, University of Michigan and Joint Program in Survey Methodology, University of Maryland, USA
  • Abstract

    Joseph Waksberg was an important figure in survey statistics mainly through his applied work in the design of samples. He took a design-based approach to sample design by emphasizing uses of randomization with the goal of creating estimators with good design-based properties. Since his time on the scene, advances have been made in the use of models to construct designs and in software to implement elaborate designs. This paper reviews uses of models in balanced sampling, cutoff samples, stratification using models, multistage sampling, and mathematical programming for determining sample sizes and allocations.

10:00 – 10:30
Morning Break

10:30 – 12:00
Session 6A – Recent Advances in Time Series Modelling
Simon Goldberg Room

• Multilevel times series model for mobility trends in the Netherlands
  Harm Jan Boonstra, Maastricht University, Netherlands
  Jan van den Brakel, Statistics Netherlands, Maastricht University, Netherlands
  • Abstract

    The purpose of the Dutch Travel Survey (DTS) is to produce reliable estimates on mobility of the Dutch population. In this paper a multilevel time-series model is proposed to estimate mobility trends at several aggregation levels. The method is developed to solve different problems. The sample size for many publication domains is so small that direct estimates for target parameters are very noisy and unreliable. The time series model is developed as a form of small area estimation to obtain more precise domain estimates and smoother trend series.

    Another problem are systematic shocks in the sample estimates, which are the result of three major survey process redesigns. These shocks or discontinuities disturb comparability with figures published in the past. The time series model accounts for the discontinuities through an intervention component such that uninterrupted series of trend estimates are obtained. Finally, the coronavirus had a major impact on mobility, which requires additional adjustments of the model.

    The DTS is a multipurpose survey that produces many different output tables. Instead of developing separate models for each individual output table, one multivariate time series model is developed for a breakdown of the population parameter at the most detailed level in about 700 domains. This breakdown is based on the cross-classification of all output tables of interest. Predictions at higher aggregation levels are obtained by aggregation of the predictions of these 700 domains. This result in a numerically consistent set of estimates for all target variables, which are corrected for the different discontinuities.

    Modelling time series at the most detailed level requires random effect components to avoid overfitting of the time series, in particular the discontinuities. Additionally, non-normally distributed random effects such as Laplace and Horseshoe distributions are used as a regularization method to suppress noisy model coefficients and at the same time to allow large effects that are sufficiently supported by the data. The model is developed in hierarchical Bayesian framework and fitted with MCMC simulation. The method is implemented in production for publication of official statistics on mobility.

• The impact of environmental disasters on Canadian personal debt
  Cristina Agatep, Bank of Canada, Canada
  • Abstract

    Canada has been experiencing an increase in the occurrence of natural disasters in recent years, resulting in a growing interest in the effect that weather events have on the personal finances of its citizens. Tracking individual consumer debt incurs a high privacy cost. Instead, the distribution of consumer debt is tracked over time to balance the need for privacy with strong insights into the behaviour of the population.

    The focus of this talk is on the impact of wildfires on debt distribution through a causal inference lens, where the evolution of densities across time is treated as functional data objects. A synthetic control model is used to account for the counterfactual evolution of debt distribution arising from the 2016 Fort McMurray wildfires.

• Privacy Mechanisms That Balance Utility for Time Series Data
  Anindya Roy, University of Maryland Baltimore County and United States Census Bureau, USA
  • Abstract

    Ensuring privacy in released data is of paramount importance for data-producing agencies. Privacy and confidentiality issues in data collection and data release mechanisms have seen revolutionary changes in recent years. The procedures guaranteeing the desired privacy of released data mostly use noise addition to achieve privacy goals. While appealing and appropriate for general databases, noise addition for time series data typically changes the sample autocorrelation structure, thereby compromising data utility for time series data. We propose a privacy mechanism that satisfies the dual objectives of privacy and data utility for time series. The proposed mechanism uses noise convolution instead of noise addition to achieve a privacy-utility trade-off. In the context of our proposal, we investigate filter design that allows us to define quantities that remain invariant under the mechanism, thereby excluding such data functionals from the privacy budget. We also propose generalizations that make the filtering-based privacy mechanism model-agnostic as well as those that are applicable to multiple time series.

10:30 – 12:00
Session 6B – Data Ethics and Confidentiality
Jean Talon Conference Room

• Advancing Equitable Data Collection: Insights from Statistics Canada's Statistical Integration Methods Division Disaggregated Data Action Plan (DDAP) Research Project
  Andrew Pearce, Kenza Sallier, Christiane Laperrière, Statistics Canada, Canada
  • Abstract

    In an era marked by the advocacy for Indigenous rights, racial justice, and economic equity, Statistics Canada has embarked on a transformative journey through the Disaggregated Data Action Plan (DDAP). This initiative aims to modernize data collection methods to better understand and address the challenges faced by diverse population groups, including women, Indigenous peoples, racialized communities, and individuals with disabilities. In this context, the Statistical Integration Methods Division of Statistics Canada has undertaken a comprehensive investigation of the ethical and practical implications inherent in evolving survey designs and data sources.

    The research culminated in the creation of "Guiding Principles: Leveraging the 2021 Census of Populations Data for DDAP Groups of Interest". This document summarizes valuable insights drawn from our investigation and literature review. It explains the organizational framework of DDAP within Statistics Canada, navigates existing data sources, addresses ethical considerations, and rigorously examines sampling methods tailored for DDAP initiatives.

    Drawing upon theoretical frameworks and applications based on Statistics Canada's experience, the findings highlight the importance of accounting for population characteristics such as hiddenness and social connectedness in selecting appropriate sampling methods. Through concrete examples and a detailed analysis of pros and cons, the guiding principles equip decision-makers with a comprehensive toolkit for navigating the intricacies of data collection in DDAP contexts.

    This presentation will discuss the methodological gaps that untraditional sampling methods can fill in the context of DDAP, discuss the importance of clear standards when creating and using such methods as well as the practical considerations to implement them in the context of a National Statistical Organization.

• On the interplay of legal requirements, quality aspects and ethical risks when using ML in official statistics
  Florian Dumpert, Federal Statistical Office of Germany, Germany
  • Abstract

    Ethics makes statements about how we should act. Ethical questions and ethical risks can also arise when machine learning is used in official statistics. More generally speaking: When methods and technologies are used to produce official statistics. The presentation deals with the interplay and the dependencies of such ethical risks, legal requirements and quality aspects and discusses the approach of German official statistics to address the topic "Ethics of Machine Learning".

• Statistical Disclosure Control Analysis for Small Area Estimation
  Cissy Tang, Statistics Canada, Canada
  • Abstract

    Currently, Statistics Canada has no official guidance on confidentiality rules for releasing small area estimates and no official study has yet been conducted on the subject. In recent years, there has been increasing demand from Research Data Centres (RDC) researchers for comprehensive confidentiality guidelines such that they can publish small area estimates in their research. This confidentiality analysis applies to area-level small area estimation.

    A simulation study is conducted in R to create simulated populations from which samples are selected. The simulated population contains an auxiliary variable, a variable of interest, and domain information. The strength of the relationship between the auxiliary variable and the variable of interest is controlled through an "error" variable with a random component.

    Stratified random sample are drawn, and area-level small area estimates are calculated using the "sae" R package (Molina and Marhuenda 2015). The simulation is run for various sampling rates and various auxiliary variable strength levels to identify potential areas of disclosure risk. The risk of disclosure of the small area estimate is compared against the direct Horvitz-Thompson estimate to demonstrate that small area estimates are inherently less risky than direct estimates, especially when sampling rates are extremely low. The results are then analyzed and finally, comprehensive confidentiality guidelines for the release of area-level small area estimates are proposed. The presentation will outline the simulation process and discuss justifications for the proposed confidentiality guidelines.

• Synthetic Data Disclosure Risk Assessment
  Zhe Si Yu, Statistics Canada, Canada
  • Abstract

    The adoption of synthetic data generation as a confidentiality measure is increasing in statistical agencies worldwide, including at Statistics Canada. This approach provides an alternative to the traditional dissemination of anonymized public microdata files, offering both privacy protection and data utility. However, the creation of synthetic data presents challenges in assessing and mitigating disclosure risks. This paper reviews the different types of disclosure risks, that being attribute, membership and identity disclosure, and presents some of the associated methods for measuring risk. Identity disclosure is recognized as a non-issue for fully synthetized data, but remains an issue for partially synthesized data. The paper presents prominent risk assessment metrics and discusses practical methods for disclosure control in data synthesis. Methods for assessing disclosure risks usually produce a metric that can be used to gauge the risk, but there is little consensus on threshold values for these metrics. It is also important to focus on importance of balancing utility and confidentiality, which needs further discussion in context of these methods.

    The paper concludes by offering insights and recommendations about managing disclosure risk while creating synthetic data as well as providing some ideas on future directions for research and practical implications for managing disclosure risks in synthetic data.

• Exploration of Deep Learning Synthetic Data Generation for Sensitive Utility Data Sharing
  Julian Templeton, Benjamin Santos, Rafik Chemli, Statistics Canada, Canada
  • Abstract

    Utilities hold crucial information about energy usage and building characteristics which can be utilized by government agencies to improve their corresponding analytics. However, this data is associated with private customer records and thus the building data and energy usage may be too sensitive to share. Often, high-level aggregated versions of this data are shared through robust contracts, limiting the statistics that can be derived.

    With the advancement of generative machine learning techniques, Statistics Canada and Natural Resources Canada have explored the feasibility of using these models to produce synthetic versions of utility data which may be shared in full to requesting organizations. These synthetic datasets can be created by a utility through a locally run program and the outputs can be approved before being sent. This work has identified that certain generative models can feasibly be used by utilities to generate new versions of a dataset and has identified the issues which must be addressed prior to implementing this in practice. Both tabular and time-series models have been tested for different data sharing scenarios, where the TimeGAN model successfully captured the general energy peaks and valleys over a given day with reasonable computational requirements. Although this process takes days for annual energy amounts over thousands of customer records, this can enable new data sharing initiatives between utilities and National Statistical Offices while managing privacy risks. As work progresses in future phases with real utility partners, trust can be built for these approaches, and they can begin being tested on real data by actual data holders.

12:00 – 13:30
Lunch

13:30 – 15:00
Session 7A – Strategies to mitigate potential nonresponse bias in social surveys
Simon Goldberg Room

• Strategies to battle bias when preparing for digital first collection and a smaller geographical footprint for people surveys in Australia
  Anders Holmberg, Australian Bureau of Statistics, Australia
  • Abstract

    Although non-probability data sources are not new to official statistics, a revived interest in the topic has emerged from pressures due to falling survey response rates, increasing data collection costs and a desire to take advantage of new data source opportunities from the ongoing societal digitalisation. Due to the exclusion of certain segments of the target population, inference derived solely from a non-probability data source is likely to result in bias. This work approaches the challenge of addressing the bias by integrating non-probability data with reference probability samples. We focus on methods to model the propensity of inclusion in the non-probability dataset with the help of the accompanying reference sample, with the modelled propensities then applied in an inverse probability weighting approach to produce population estimates. The reference sample is sometimes assumed as given. In this presentation however, we pursue an objective of finding an optimal strategy, that is, the combination of a data integration-based estimator and sample design for the reference probability sample. We discuss recent work in which we take advantage of the good unit identification possibilities in business surveys to study an estimator based on propensities and derive optimal (unequal) selection probabilities for the reference sample.

• Dealing with non-response and attrition bias in a Transformed LFS
  Petya Kozhuharova, Office for National Statistics, United Kingdom
  • Abstract

    The Office for National Statistics UK is undergoing a transformation of its Labour Force Survey. The key changes include switching to an online first mode, implementing an adaptive survey design and changing the structure of the longitudinal component. Extensive testing of the attrition and non-response biases present in the TLFS quarterly files (at GB level) has been carried out. Prominent non-response biases were detected by tenure, age and geographically less affluent areas. A pre-calibration step was included in the weighting to offset this non-response and adjust distributions before final weighting. The ONS also implemented an Adaptive Survey Design and targeted field forces to areas of known non-response. This step has successfully increased response rates as intended, complimenting methods adjustments.

    Investigations showed different longitudinal attrition patterns in the new survey. Previous employment status in TLFS is a significant predictor of longitudinal attrition even after controlling for other predictors, with employed and self-employed people dropping out significantly more from subsequent waves. Thus, following preliminary calibration as a non-response adjustment for Wave 1, for waves 2-5 we adjust individual design weights by calculating sequential attrition probabilities calculated via logistic regression models. These wave-specific weights are then combined before final calibration. Final calibration is done by combinations of age groups, sex, local authority, regions and country. Without the addition of attrition with included previous economic status, the quarterly estimate was biased towards economically inactive people who are more likely to answer in later waves.

    Therefore, the inclusion of attrition adjustments increases employment compared to weighting just including non-response adjustment.

• Investigations into administrative data for measuring persistent child poverty
  Adam O'Neill, Keith McLeod, Robert Templeton, Statistics New Zealand, New Zealand
  • Abstract

    Using information from the Household Economic Survey (HES) Stats NZ provides yearly estimates of child poverty rates in Aotearoa (New Zealand). To extend this, a new longitudinal survey was developed to inform on rates of persistent child poverty - the Living in Aotearoa Survey.

    Collection challenges associated with increasing non-response, along with keeping to budgeted costs, posed significant risk to the quality of downstream estimates of persistent child poverty. This highlighted a need to explore alternative avenues for estimating poverty persistence.

    Advances in the construction of households using administrative data has been a large focus at Stats NZ. Current admin-based households place 90% of individuals into the right address. At the population-level this still leaves, however, notable room for intra-household discrepancies.

    Leveraging off the high coverage of low-income families observed through administrative welfare data, we show that the formation of these admin-based households can be improved for the purposes of measuring persistent child poverty in Aotearoa. Specifically, family welfare data is coupled with HES households, and high confidence admin-based households. Household income derived from administrative sources allows the poverty status of children to not only be determined for the current year, but previous three years as well.

    Validations of these households along with the resulting poverty rates will also be presented.

13:30 – 15:00
Session 7B – Record Linkage
Jean Talon Conference Room

• Efficient Record Linkage for large datasets by Business Names
  Hanan Ather, Statistics Canada, Canada
  • Abstract

    Record linkage across diverse datasets presents significant challenges in big data applications, particularly when business names serve as unique identifiers. Traditional linkage methods often face challenges with the variability in formatting, abbreviations, and errors within administrative and alternative data sources. Addressing this challenge, the introduced approach is a robust and user-friendly method that effectively links business records from external datasets to SBR, thereby overcoming the computational constraints of previous practices.

    The system utilizes a suite of string-matching algorithms, including edit distance, n-gram, and Jaro-Winkler, to facilitate record linkage and statistical matching. It distinguishes between true matches and false matches by calculating similarity measures, s(x, y), for entities within the SBR and any external list of businesses. By establishing a scalar threshold, t, we refine the linkage criteria, enhancing the precision of match declarations.

    Our method enhances data integration efforts by enabling a precise, yet computationally efficient identification of matches. Moreover, our approach is evaluated on accuracy metrics, balancing between sensitivity to detect true cases and specificity to minimize false positives.

    The strategic advantage of our approach lies in its efficiency, providing rapid processing times without sacrificing the accuracy of the matches. This efficiency is especially advantageous in big data environments, where quick data processing and efficient use of computational resources are critical.

    Our methodology is designed to contribute to improved standards in record linkage and statistical matching, aiming to enhance both the speed and precision of matching across databases.

    Evaluating the linkage accuracy when linking records in waves
    Abel Dasylva, Arthur Goussanou, Statistics Canada, Canada

    At Statistics Canada, many data sets are linked with quasi-identifiers such as the first name, last name, or address. In such cases, linkage errors are a potential concern and must be measured. In that regard, previous studies have shown that the evaluation may be based on modeling the number of links from a given record while accounting for all the interactions among the linkage variables and dispensing with clerical reviews, so long as the decision to link two records does not involve other records. In this communication, the methodology is adapted for a class of practical strategies, which violate this constraint by linking the records in consecutive waves, where a given wave links a subset of the records that are not linked in previous waves. In particular, the linkage may be based on a deterministic wave followed by a probabilistic one.

• Evaluating the accuracy when linking records in waves
  Abel Dasylva, Arthur Goussanou, Statistics Canada, Canada
  • Abstract

    At Statistics Canada, many data sets are linked with quasi-identifiers such as the first name, last name, or address. In such cases, linkage errors are a potential concern and must be measured. In that regard, previous studies have shown that the evaluation may be based on modeling the number of links from a given record while accounting for all the interactions among the linkage variables and dispensing with clerical reviews, so long as the decision to link two records does not involve other records. In this communication, the methodology is adapted for a class of practical strategies, which violate this constraint by linking the records in consecutive waves, where a given wave links a subset of the records that are not linked in previous waves. In particular, the linkage may be based on a deterministic wave followed by a probabilistic one.

• Model Based Threshold Selection for Agricultural Probabilistic Linkages
  Christian Arsenault, Statistics Canada, Canada
  • Abstract

    With the increasing importance of administrative data usage in producing official statistics, conducting quality probabilistic record linkages have become paramount to the success of many programs at Statistics Canada. Under the Fellegi and Sunter methodology, the weight threshold for determining a match is a critical parameter on which the optimality of the procedure depends. Solutions for setting this parameter up to this point have had major limitations, either relying on overly optimistic assumptions, or requiring training data or clerical review. However, a new model was developed which estimates the linkage error based on the number of links from a given record, accounting for all the interactions among the linkage variables. This error model serves as the foundation for evaluating different algorithms for setting the linkage threshold. Between exhaustive search, binary search, or a more sophisticated recursive partitioning procedure, each method offers distinct advantages in terms of runtime and the quality metrics produced. Using real farm data, we were able to validate the results of the error model with goodness-of-fit tests, as well as weigh the practical considerations of each of these methods by experimenting with different datasets. Although automating the selection of linkage thresholds presents challenges with the varying quality, structure, and size of agricultural data, this work provides a practical path forward to navigate these issues.

• The T1 Partnership Process: leveraging clustering and graphing methods
  Shaundon Holmstrom, Statistics Canada, Canada
  • Abstract

    All individuals who own a sole proprietorship or partnership business must complete a statement of business activities when filing their personal income taxes (T1 General Form). A T1 partnership is a collection of filers who form a single business but file their share individually. With the T1 business population it can be challenging to determine if a filer is a sole proprietorship or a partnership, and in most cases, there are no linkage keys available to identify the collection of filers belonging to a given partnership. Therefore, a T1 partnership identification process has been developed with the goal of the performing internal record linkage within T1 business population to identify partnerships. Failing to identify valid partnerships can lead to duplication in the population of T1 businesses (overcoverage) while incorrectly linking individuals as partners can lead to businesses being incorrectly removed from the population of T1 businesses (undercoverage). The T1 processing system is currently undergoing a redesign.

    The new T1 partnership identification process leverages numerical clustering using the DBSCAN algorithm, then compares matching fields to trim down potential clusters in the set of pairwise comparisons. When the final set of pairwise comparisons is complete, graph theory is used to create the set of all finalized partnerships.

• Effects of a two-category gender variable (men+ and women+) in the development of linkage-adjusted weights for the 2021 Canadian Census Health and Environment Cohort (CanCHEC)
  Eric Hortop, Yubin Sung, Statistics Canada, Canada
  • Abstract

    The 2021 CanCHEC consists of the 2021 Census long-form sample records linked to the Derived Record Depository (DRD) with a linkage rate of 96%. The DRD includes persons from Statistics Canada's survey and administrative data, such as the Census and deaths. Thus, the linkage facilitates research examining sociodemographic factors influencing the health of Canadians. The 2021 CanCHEC is highly anticipated because the 2021 Census collected data specifically about gender for the first time, differentiating from sex at birth, enabling an examination of health outcomes among gender diverse persons. Linkage-adjusted record weights allow researchers to estimate and evaluate the variance of summary measures of the Canadian population in the presence of missed links. To create the final weights, we construct response homogeneous groups using the linkage propensity score from a logistic model fitted for the long-form sample records. We then use a cell calibration procedure that further adjusts the weights such that the weighted totals for a multivariate tabulation of the cohort match the weighted totals from the long-form sample. The tabulation variables include the two-category gender variable among other characteristics. We examine slippage on estimates of cisgender, transgender and non-binary populations to evaluate our practical weighting procedure.

    Decisions in the weighting procedure can affect the accuracy of estimates for small population groups such as gender-diverse persons. This presentation will highlight the importance of routinely measuring slippage.  A limitation is that our linkage-adjusted weights only consider the linkage of the cohort to the DRD while many population health analyses would need to account for additional linkages to health administrative data.

15:00 – 15:30
Afternoon Break

15:30 – 17:00
Session 8 – The Future of National Statistical Organizations
Simon Goldberg Room

• The Future of National Statistical Organisations - the Longer-Term Role and Shape of NSOs
  Osama Rahman, Office for National Statistics, United Kingdom
  • Abstract

    The rise of a data-driven world is radically reshaping the context in which National Statistical Offices (NSOs) operate. There is rising demand from both policymakers and wider society to provide information that is more accurate, more timely and more granular compared to previous decades. At the same time, NSOs face increased competition from the emergence of many new sources of analysis and statistics, which is challenging their previously pre-eminent role as one of the most relevant and trusted sources of information. The increasing granularity and velocity of new forms of data and data science techniques are also leading to a reduction in the traditional gaps between policy development, implementation and delivery, and monitoring and feedback. This then leads to question to what extent the gap between statistics/research and operational analysis/use of management information needs to reduce and what role NSOs have here.

    In response, NSOs are investing considerable effort in initiatives to remain relevant to their users. They are innovating by developing new methods and using new sources of data to produce more robust statistics and analysis that better meet the demands of government and society. Some NSOs are also looking to the longer-term, developing their vision for what their work will need to look for their organisations to remain relevant in ten to twenty years' time.

    This session will discuss how NSOs are already adapting and ways they may need to continue to adapt to succeed in an increasingly data-driven world.

    Other members of the panel:

    André Loranger, Chief Statistician of Canada, Statistics Canada

    Francesca Kay, Central Statistics Office, Ireland

    Anders Holmberg, Australian Bureau of Statistics, Australia

Friday November 1, 2024

8:30 – 10:00
Session 9A – Young Statisticians from Statistics Canada's Modern Statistical Methods and Data Science Branch
Simon Goldberg Room

• • Abstract

    The 2024 Statistics Canada International Methodology Symposium on "Shaping the Future of Official Statistics" will feature a special invited session designed to showcase the innovative thinking and strategic vision of young statisticians. Indeed, part of envisioning the future of official statistics demands an investment in tomorrow's statistical leaders. By cultivating a diverse and healthy pool of talent equipped with both technical expertise and essential soft skills, we can ensure a strong succession for the future of official statistics. Selected through a competitive process that took place within Statistics Canada Modern Statistical Methods and Data Science Branch, winners will present their strategic insights on pressing issues facing National Statistical Organizations (NSOs). This session presents a unique opportunity to gain fresh viewpoints with the hope of stimulating strategic thinking, encouraging dialogue, and contributing to the advancement of NSOs. Ultimately, shaping the future of statistical practices, the advancement of statistical methodology, and promoting data driven decision making at both national and global levels.

    Presentation 1: How do you foresee the evolving role and significance of National Statistical Organizations (NSOs) such as Statistics Canada over the next 25 years?". [Assuming the speed of data and IT evolution remains the same as in the last years]
    Namita Chhabra, Johan Fernandes, Craig Hilborn and Joshua Miller, Statistics Canada, Canada

    Presentation 2: What would be the key characteristics, skills, abilities and capacities of the ideal (perfect) future statistician” (or employee of Statistics Canada) in 25 years.
    Neal Jin, Andrew Jay, Andrew Pearce and Abhishek Singh, Statistics Canada, Canada Presentation 3:

    How can Statistics Canada, effectively and explicitly leverage ethical principles and democratic values to all Canadians particularly in the context of social and economic polarization?
    Marc Beauparlant, Bassirou Diagne and Beni Ngabo Nsengiyaremye, Statistics Canada, Canada

    Presentation 4: What are the issues facing Statistics Canada in reconciling the imperative of collecting disaggregated data for minority subgroups with the need to uphold privacy, data ethics, and historical sensitivities?
    David Ahn, Alexandre Istrate, Samuel Sombo and Nicholas Wilker, Statistics Canada, Canada

9:00 – 10:00
Session 9B – Nowcasting for Economics Statistics
Jean Talon Conference Room

• High Frequency Data Collection at the U.S. Census Bureau - the Business Trends and Outlook Survey (BTOS)
  Cory Breaux, Kathryn Bonney, U.S. Census Bureau, USA
  • Abstract

    The Business Trends and Outlook Survey is an experimental data product from the U.S. Census Bureau, intended to capture high-frequency changes in economic conditions, first launched in July 2022. The BTOS draws from a large sample of nearly 1.2 million businesses to provide representative, bi-weekly data on economic conditions and trends. The survey collects information on a wide range of business conditions including current performance, changes in revenue, employment, demand, and prices, operating status, the impact of natural disasters, and Artificial Intelligence usage. Firms are asked about the previous two weeks and for a six-month projection.

    From December 2023 to February 2024, the BTOS added supplemental content which provides a detailed real- time look at U.S. businesses' use of AI.

    During this period, bi-weekly estimates of AI use rose from 3.7% to 5.4%, with an expected use rate of about 6.6% by early Fall 2024. AI usage was found to vary across sector and geography, with the highest use rates occurring in the Information sector and states in the western U.S. Amongst AI-using businesses, the most common applications include marketing automation, virtual agents, natural language processing, and data/text analytics. Many businesses report using AI to replace worker tasks and existing equipment/software, though there is little evidence that AI use is associated with decline in firm employment. Businesses were also asked why they do not expect to use AI; the predominant reason reported was the inapplicability of the technology to their business. Future research can integrate BTOS data with other Census survey and administrative data, exploring the connection between AI use and firm performance.

• Improving Nowcasts for the U.S. Census Bureau Index of Economic Activity (IDEA)
  Elizabeth Marra, Rebecca L Weaver, William R Bell, Tucker S McElroy, Valerie E Pianin, Jose Asturias, Rebecca J Hutchinson, U.S. Census Bureau, USA
  • Abstract

    The U.S. Census Bureau Index of Economic Activity (IDEA) is an experimental data product that was first released in February of 2023. It is constructed from 15 of the Census Bureau's primary monthly economic time series, providing a single time series reflecting the variation of the full set of component series over time. The component series are monthly measures of activity in retail and wholesale trade, manufacturing, construction, international trade, and business formations. One of the challenges of producing a monthly economic indicator from 15 different component series is that not all the series are released on the same day in a month. To account for these varying release dates, the index is calculated daily, incorporating the most recently released values from the component series for the current release month. For component series whose values have not yet been released for the current month, we predict (nowcast) their values using a multivariate autoregressive time series model. We estimate index weights for these 15 series using Principal Components Analysis applied to the standardized monthly growth rates. Series with larger weights will have more influence over the index, compared to those with smaller weights. If nowcasts for a highly weighted series are inaccurate, then when a new monthly estimate for the series is released, the index could exhibit a large revision for that month. This presentation reviews the index, discusses the nowcasting procedure, and presents a potential improvement to the nowcasting.

• Leveraging Transformers for Now-Casting Canadian Labor Indicators
  Luke Budny, Aziz Al-Najjar, Tariq El Bahrawy, Carleton University, Canada
  • Abstract

    In the rapidly advancing data-centric world, the acuity of labor market analytics is pivotal for economic strategy and policy-making. This study explores the application of the Lag-Llama model, a state-of-the-art transformer-based architecture, for nowcasting key Canadian labor indicators such as employment, job vacancies, payroll, and hours worked. Addressing the challenge of delayed or incomplete labor data from Statistics Canada surveys, the study proposes a forecasting methodology that leverages both historical trends and contemporary data inputs. The model is pre-trained on diverse datasets across multiple domains, enhancing its predictive robustness and interpretability. Through systematic fine-tuning of hyperparameters and judicious selection of external variables via forward and backward selection techniques, the Lag-Llama model achieves significant performance gains over classical time series forecasting methods. Experimental results exhibit substantial improvements in Mean Absolute Percentage Error (MAPE) for both point estimates and prediction intervals, especially in the All Industries MAPE for earnings data. The study also identifies certain industry-specific forecasting challenges and discusses potential solutions including separate models. These findings highlight the potential of transformer models like Lag-Llama in macroeconomic forecasting and set a new benchmark for future analyses in this domain.

10:00 – 10:30
Morning Break

10:30 – 12:00
Session 10A – The use of machine learning in official statistics
Simon Goldberg Room

• Statistical Inference in the Presence of Non-Response and Machine Learning Methods: Some Recent Works
  David Haziza, University of Ottawa, Canada
  • Abstract

    In recent years, machine learning methods have generated increasing interest within national statistical institutes. These methods allow for precise predictions by analyzing large datasets and identifying complex patterns and relationships. These predictions can be applied at various stages of a survey, particularly for handling missing data and small area estimation.

    In this presentation, we will present the results of recent or ongoing work on inference in the presence of item non-response. We will begin by discussing statistical inference when random forests are used to impute missing values. Then, we will address doubly robust estimation methods that incorporate predicted response probabilities and imputed values—obtained using any machine learning method—into the construction of the estimators. We will highlight the advantages of doubly robust methods within the framework of machine learning and discuss their practical implementation. We will show how to estimate the variance of doubly robust estimators. Finally, we will present the results of simulation studies aimed at evaluating the performance of point and variance estimators.

• Fitting Classification Trees Accounting for Complex Survey Design
  Minsun Riddles, Westat, USA
  • Abstract

    Survey practitioners have increasingly embraced the benefits of modern machine learning techniques, including classification and regression tree algorithms. These methods, which do not require a predefined functional relationship between outcomes and predictors, offer a practical means of conducting variable selection and deriving interpretable structures that link predictors with a target outcome. However, when applying these algorithms to survey data, it is common to overlook crucial factors like sampling weights, as well as sample design features such as stratification and clustering. To bridge this oversight, we propose an extension of the well-known Chi-square Automatic Interaction Detector (CHAID) approach. Our enhancement incorporates a Rao-Scott correction into the splitting criterion, accounting for the survey design. We discuss the statistical properties of the resulting algorithm under a design-based framework. Using data from the U.S. American Community Survey, we illustrate the use of the method and evaluate its performance through comparisons with existing weighted and unweighted algorithms.

• Tree-Based Algorithms for Official Statistics
  Daniell Toth, US Bureau of Labor Statistics, USA
  • Abstract

    Over the past decade, machine learning algorithms have been increasingly employed to produce official statistics. This trend has been particularly notable following the adaptation of various algorithms for use with survey data collected from an informative sample design. Among these techniques are several tree-based methods such as regression and boosted trees, random forest models, and Bayesian tree models. These models have been utilized in analyzing survey data for purposes such as assessing data quality and nonresponse, as well as estimating official statistics through small area estimation, model-assisted estimators, and data imputation. In this article, we discuss how these tree-based methods have been adapted for use with survey data and explore their significance in the production of official statistics.

10:30 – 12:00
Session 10B – Society and Official Statistics
Jean Talon Conference Room

• A Safe and Inclusive Approach to Disseminating Statistical Information about the Non-binary Population in Canada
  Claude Girard, France-Pascale Ménard, Statistics Canada, Canada
  • Abstract

    In 2022, Canada became the first country to release statistical information about its transgender and non-binary populations based on data collected from the 2021 Census of Population. Moreover, following a recent government-wide directive, Statistics Canada's surveys have begun to collect and disseminate information about gender rather than sex at birth.

    Due to the small size of the transgender and non-binary populations – according to the 2021 Census, these represent 0.3% of individuals aged 15 or older in Canada – disseminating safe statistical information about them at detailed sociodemographic or geographical levels poses a challenge.

    The dissemination strategy adopted for the 2021 Census, which was subsequently adapted and recommended for surveys, is centered on a new two-category gender variable (Men+ and Women+) that include non-binary individuals, and which is to be used at all but the highest dissemination levels. In this talk, we retrace the methodological considerations that have gone into creating and adopting this novel approach, which is deemed both inclusive of non-binary people and statistically safe.

• One-Stop-Shop for AI/ML for Official Statistics - Methodology at the Heart
  Francesca Kay, Brendan O'Dowd, Central Statistics Office, Ireland
  • Abstract

    In a world of constant change, new and improved statistical products and services have become a necessity for official statistics. On the one hand, demand from users is evolving, as they ask for more granular, more timely and better integrated data. From a methodology perspective that means Official Statisticians have to reconsider what users need and how we can provide fit for purpose and methodologically sound information. On the other hand, technical opportunities appear at such a pace that it is very challenging to provide new and robust methodologies that ensure these opportunities can be integrated in the production of official statistics whille maintaining the understanding, transparency and trust in official statistics as a trusted source of information.

    In April 2024, Eurostat awarded a grant to a consortium of 14 countries led by the Central Statistics Office of Ireland to create a One-Stop-Shop for AI/ML in Official Statistics (AIMLOS4). The potential for AI/ML is still being developed and the aim of the One-Stop-Shop is to enable systematic learning, sharing of experiences, identification of good practices and reuse of solutions. At the heart of the consortium is both researching and creating new methodologies to support the application of AI/ML solutions as well as the standardisation of methodologies and best practice to facilitate the scaling up or reuse of existing solutions.

    The presentation will highlight some of the key objectives of the AIMLOS4 project and how it will look to develop innovative new methodologies in AI/ML to meet the evolving needs and challenges in the production of official statistics.

• Citizen-generated data and its impact on official statistics
  Haoyi Chen, United Nations Statistics Division, United Nations, New York, USA
  • Abstract

    Citizen participation throughout the data value chain is increasingly recognized in addressing data gaps for marginalized communities and enhancing data fairness, inclusiveness, openness, accountability and transparency. The global official statistical community has partnered with other data stakeholders including civil society organizations, human rights institutions and academia marching forward with the draft "Copenhagen Framework on Citizen Data", to support the sustainable and use of data generated by citizens and communities.

    The paper discusses how bringing citizen generated data (CGD) into the official statistics community will impact the national official statistics systems and transform the role of national statistical offices as data stewards. The areas that will be covered include: (a) discussing the role of CGD to fill data gap and to improve inclusivity of official statistics; (b) reassessing the relevance of existing quality frameworks for official statistics to allow data to be used fit-for-purpose; (c) challenges and opportunities in integrating CGD into official statistics and (d) discussing how the role of national statistical offices need to evolve in leveraging the power of the citizen generated data.

• Exploration of approaches to small area estimation with measurement errors; and their application to Indonesian household surveys
  Ika Yuni Wulansari, University of Technology Sydney, Australia, Politeknik Statistika STIS, Indonesia, Statistics Indonesia, Indonesia
  Stephen Woodcock, University of Technology Sydney, Australia
  James J Brown, University of Technology Sydney, Australia
  • Abstract

    The UN's SDGs require highly disaggregated data on indicators that are typically available only from household surveys. However, this presents an issue as the required level of dis-aggregation is beyond what surveys can support through direct estimation. Therefore, NSIs are turning to small area approaches. However, that is not without its issues, as often the auxiliary variables that might be used in estimation models are themselves estimated from surveys, introducing the additional complication of measurement errors.

    We aim to apply the approach of Ybarra and Lohr (2008) to adjust for measurement errors in a classic Fay-Herriot area-level model. We use a comprehensive simulation study to explore the impact of measurement error on a single auxiliary variable, and the situation where there are two auxiliary variables, one with and one without measurement error. The results demonstrate the robustness of the standard approach and ignoring measurement error, but show there are specific scenarios where correct adjustment for measurement errors is beneficial. We apply the approach to a case-study example utilising Indonesian household survey data, estimating at the sub-district level. In the case study, we estimate per capita household expenditure from the National Socio-Economic Survey (SUSENAS) as variable of interest and use village potential data (PODES) for auxiliary variables.

12:00 – 13:30
Lunch

13:30 – 15:00
Session 11 – Special Session in Honour of J.N.K. Rao
Simon Goldberg Room

• J.N.K. Rao's Contributions to Survey Research
  Sharon Lohr, Arizona State University, USA
  • Abstract

    J.N.K. Rao has contributed to almost every subdiscipline of survey research. In this nontechnical talk, I will touch on some of Rao's work on unequal-probability and two-phase sampling, variance estimation, regression and categorical data analysis, small area estimation, and data integration.

    For each of these topics, Rao's work anticipated and led future research directions, and I will discuss his contributions in the context of broader trends and current challenges in survey research.

• Celebrating J.N.K. Rao's Legacy in Small Area
  Mahmoud Torabi, University of Manitoba, Canada
  • Abstract

    This talk pays homage to the remarkable contributions of J.N.K. Rao to the field of small area estimation (SAE). Rao's pioneering research has profoundly influenced the development and application of SAE methods, revolutionizing how statisticians tackle inferential challenges in areas with limited data representation. Beginning with an overview of SAE's significance across various domains, from official statistics to public health, the presentation highlights Rao's key methodological advancements.

    These include his instrumental work in model-based approaches, notably the area-level and unit-level models, and estimation of mean squared prediction error of small area parameters. Furthermore, the talk explores Rao's enduring legacy in fostering interdisciplinary collaborations and promoting the practical adoption of SAE techniques in decision-making processes.

    Through an examination of Rao's influential papers and collaborations, the presentation illustrates his pivotal role in shaping the theoretical foundations and real-world applications of SAE. Additionally, building upon Rao's legacy, it discusses contemporary challenges and recent advancements in SAE research. Ultimately, this talk serves as a tribute to J.N.K. Rao's indelible mark on SAE, inspiring continued innovation and impact in the field for generations to come.

• Contributions of J.N.K. Rao to complex survey multilevel models and composite likelihood
  Mary Thompson, University of Waterloo, Canada
  • Abstract

    With H. O. Hartley, J. N. K. Rao was an early contributor to multilevel modeling with survey data, through methods of inference for variance components. In recent years, he has returned to this area of research. With F. Verret and M. Hidiroglou he proposed a weighted composite likelihood approach to inference under a two-level model (Survey Methodology, 2013). This method and its impact, applications and later extensions will be outlined.

15:00 – 15:30
Afternoon Break

15:30 – 17:00
Session 12A – Integration of probability and non-probability sample data
Simon Goldberg Room

• Some Theoretical and Practical Issues in and Strategies for Dealing with Non-Probability Samples
  Changbao Wu, University of Waterloo, Canada
  • Abstract

    We provide an overview of recent developments in statistical inference for non-probability survey samples. We discuss issues arising from methodological developments related to inverse probability weighting and model-based prediction and concerns with practical applications. Three procedures proposed in the recent literature on the estimation of participation probabilities, namely, the method of Valliant and Dever (2011) based on the pooled sample, the pseudo maximum likelihood method of Chen, Li and Wu (2020), and the method of Wang, Valliant and Li (2021) using a two-step computational strategy, are examined under a joint randomization framework. The inexplicit impact of the positivity assumption on model-based prediction approach is examined, and the main issue of undercoverage is highlighted. We discuss potential strategies for dealing with standard assumptions and undercoverage problems in practice.

• Comparison of recent techniques of combining probability and non-probability samples
  Julie Gershunskaya, U.S. Bureau of Labor Statistics, USA
  • Abstract

    We compare several recent quasi-randomization methods for inferences from non-probability samples. The considered techniques are developed under the assumption that the sample selection is governed by an underlying latent random mechanism and that it can be uncovered by combining non-probability survey data with a "reference" probability-based sample, obtained from the same target population. Challenges prompting the development of alternative procedures include (i) non-probability sample participation indicators are available only on the observed sample units and (ii) it is not generally known which units from the underlying population belong to both the non-probability and reference samples. We consider the ways different procedures address these challenges, discuss theoretical properties of the methods and compare them using simulations.

• Propensity Score Estimation and Optimal Sampling Design when Integrating Probability Samples with Non-probability Data
  Anders Holmberg, Australian Bureau of Statistics, Australia
  Lyndon Ang, Australian National University and Australian Bureau of Statistics, Australia
  Robert Clark, Bronwyn Loong, Australian National University, Australia
  • Abstract

    Although non-probability data sources are not new to official statistics, a revived interest in the topic has emerged from pressures due to falling survey response rates, increasing data collection costs and a desire to take advantage of new data source opportunities from the ongoing societal digitalisation. Due to the exclusion of certain segments of the target population, inference derived solely from a non-probability data source is likely to result in bias. This work approaches the challenge of addressing the bias by integrating non-probability data with reference probability samples. We focus on methods to model the propensity of inclusion in the non-probability dataset with the help of the accompanying reference sample, with the modelled propensities then applied in an inverse probability weighting approach to produce population estimates. The reference sample is sometimes assumed as given. In this presentation however, we pursue an objective of finding an optimal strategy, that is, the combination of a data integration-based estimator and sample design for the reference probability sample. We discuss recent work in which we take advantage of the good unit identification possibilities in business surveys to study an estimator based on propensities and derive optimal (unequal) selection probabilities for the reference sample.

15:30 – 17:00
Session 12B – Challenges in Production of Official Statistics
Jean Talon Conference Room

• Using Non-Binary Gender to Calibrate Survey Weights for the Canadian Long-Form Census Sample
  Alexander Imbrogno, Statistics Canada, Canada
  • Abstract

    In 2021, Canada became the first country to collect and publish data on gender in a national census giving Canadians the option to choose male, female, or non-binary. Due to their small sizes, non-binary population totals were excluded from the 2021 long-form sample calibration due to the risk of increasing the variance of estimates. This talk presents an alternative long-form calibration procedure which aggregates sub-provincial non-binary totals into a large provincial total to protect against variance inflation. Artificial sub-provincial non-binary totals are introduced as a tool to decompose the resulting provincial level calibration back into independent sub-provincial problems, maintaining the computational efficiencies of the usual long-form calibration. An algebraic expression for the artificial totals under the chi-squared distance is derived. Simulation results are presented demonstrating the benefits of non-binary calibration on data quality for the non-binary domain.

• A New Origin-to-Destination Table of Canadian Manufacturing Sales: Challenges with Imputing a Distribution from Annual Survey Data
  Nicholas Huliganga, Statistics Canada, Canada
  • Abstract

    Until now, detailed data on the destination of manufacturing sales have not historically been available to Canadians. Through integration of annual survey (ASML) data, a destination of sales table by industry and province of origin was developed for the manufacturing annual and monthly surveys at Statistics Canada.

    While not a question on the monthly survey, the respondents for the annual survey are asked for their distribution of sales as a percentage across 15 destinations. To tackle the difficulty of generating an establishment-level distribution for multi-province respondents, three approaches were compared:
    using the respondents' total distribution for all their establishments, using optimization, and using the distributions of the single-province respondents. The imputed distribution of destination sales from the annual data was then applied to the monthly sales value. Monthly establishments not linked to annual respondents were imputed with a strategy involving the aggregate distribution of their industry-province group in the annual survey.

    Finally, point estimates and a sampling variance (and CV) were successfully generated for the entire origin-destination of sales table and for each industry in the monthly survey.

    This presentation delves into challenges faced with imputing the destination sales (especially for respondents with establishments in multiple provinces), ensuring sales match marginal origin province totals, and allocating a distribution of destinations based on data from the annual program to the monthly estimates.

• The Usage of the ReliefF Algorithm for Edit & Imputation in the Canadian Census of Population
  Irwin Khuu, Statistics Canada, Canada
  • Abstract

    Historically, the Canadian Census of Population Edit & Imputation (E&I) process has operated using a nearest-neighbour donor imputation methodology wherein the distance between a failed unit and a potential donor is obtained through a weighted combination of auxiliary variables. Revision to the model between cycles can be a complicated and time-consuming process given there is no standard approach to variable selection and weighting between topics. This presentation will illustrate the potential of the ReliefF feature selection algorithm to create a machine learning-driven approach to variable selection and weighting that is standardized and comparable between Census cycles and among the many topics of the Census. An overview on how this process may be applied in practice will be presented, followed by results on a diverse set of topics that indicate a general improvement over previous methods.

• Factors affecting response propensity, with an interest in units sampled multiple times – an empirical study using social surveys at Statistics Canada
  Noah Johnson, Catherine Deshaies-Moreault, Cilanne Boulet, Statistics Canada, Canada
  • Abstract

    As the need for data has grown over the past number of years, the effect and burden of repeatedly sampling the same units for multiple surveys has become an increasing concern. Response burden is generally assumed to contribute to decreasing response rates, however there are few empirical studies looking into this question. One such study was undertaken by Statistics Canada, aggregating data on response to social surveys conducted between 2020 and 2023. It investigates factors contributing to the observed response patterns, including the effect of having been previously selected on response propensity. This presentation will describe the study, share its principal results, and address how they can inform decisions about sample coordination among household surveys at Statistics Canada.

17:00 – 17:15
Closing Remarks
Simon Goldberg Room

• Wesley Yung, Director General, Modern Statistical Methods and Data Science Branch, Statistics Canada, Canada