Introduction
The Sexual Risk Avoidance Education (SRAE) grant program-- a federally funded adolescent pregnancy prevention initiative administered by the Administration for Children and Families (ACF), Family and Youth Services Bureau-- teaches youth how to voluntarily refrain from non-marital sexual activity. The program funds the SRAE National Evaluation (SRAENE), led by Mathematica, which provides data capacity building support to SRAE grantees. The SRAENE team developed a video series for grantees on understanding and collecting high-quality data. This video series provides information on a range of data-related topics aimed at helping grantees collect high-quality data on their programs. Each video is about 5 minutes long and is accompanied by a tip sheet that provides more resources on the content.
The series includes —
- Video 1: Objectivity in Data Collection provides an overview of the types of survey error that can happen in data collection and strategies to ensure objectivity.
- Video 2: Consent, Assent, and Pre-Testing to Prepare for Collecting Survey Data discusses how to prepare for survey data collection, including collecting consent from parents or guardians, preparing to obtain assent from youth, and pre-testing survey instruments.
- Video 3: Best Practices for Collecting Survey Data Virtually provides an overview of strategies for conducting virtual surveys, including obtaining youth assent, ensuring privacy, and working to achieve high response rates.
- Video 4: Collecting High-Quality Data Through Observations discusses how to conduct observations consistently to collect high-quality data and reduce potential sources of bias in the resulting data.
- Video 5: Collecting High-Quality Data in Interviews and Focus Groups provides an overview of the procedures to follow when conducting interviews and focus groups to ensure data accurately reflects participants’ perspectives.
- Video 6: Best Practices for Collecting Survey Data in Person discusses how to administer in-person surveys, including collecting youth assent and parent or guardian consent, ensuring privacy while youth take the survey, addressing youths’ questions and concerns, and achieving high response rates.
- Video 7: Preparing to Link Survey Data provides an overview of when and how to link survey data, including using unique identification numbers to link data to individuals and preparing materials to accurately link data and maintain privacy.
- Video 8: Achieving High Response Rates During Follow-up Data Collection reviews strategies to achieve high response rates for follow-up surveys, including collecting multiple contact methods from program participants, maintaining relationships after programs end, deciding on the easiest way to distribute your survey, sending tailored reminders, and incentivizing survey completion.
- Video 9: Best Practices to Safely Store and Share Data provides an overview of how to store and share data securely, including storing and sharing paper and electronic data, destroying data when no longer needed, and addressing mishandled or leaked data.
- Video 10: Monitoring Programs Using Fidelity Logs provides an overview of how to use fidelity logs to help ensure programs are implemented as intended, including deciding which program elements to monitor, identifying or creating a fidelity log for facilitators, deciding how often to complete fidelity logs, and analyzing fidelity log data for program improvement.
- Video 11: Obtaining Institutional Review Board Approval for Data Collection provides an overview of institutional review boards (IRBs), including when IRB approval is needed for data collection, considerations for selecting an IRB to work with, materials required for submission, and the three types of IRB reviews.
- Video 12: Training Data Collectors
provides an overview of how to train data collectors, including selecting people to train, covering relevant training topics, and delivering training in an appropriate and engaging structure to improve the consistency and quality of data collection.
- Training Data Collectors (PDF)
Purpose
This video series is intended to support SRAE grantees’ capacity to collect high-quality data on their programs.
The primary audience for this series includes practitioners and evaluators supporting SRAE and related youth programming. The information presented may also be of interest to policymakers, researchers, and academics engaged in data collection efforts.
Citation
Eddins, K. (2022). SRAENE — Objectivity in Data Collection Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Eddins, K. (2022). SRAENE — Objectivity in Data Collection Tip Sheet (OPRE Report No. #2022-273). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Eddins, K. (2023). SRAENE — Achieving High Response Rates During Follow-up Data Collection Video (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Eddins, K. (2023). SRAENE — Achieving High Response Rates During Follow-up Data Collection Tip Sheet (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Fleischman, B., Eddins, K. (2023). SRAENE — Monitoring Programs Using Fidelity Logs Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Fleischman, B., Eddins, K. (2023). SRAENE — Monitoring Programs Using Fidelity Logs Tip Sheet (OPRE Report No. #2023-217). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Fleischman, B., Eddins, K. (2023). SRAENE — Obtaining Institutional Review Board Approval for Data Collection Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Fleischman, B., Eddins, K. (2023). SRAENE — Obtaining Institutional Review Board Approval for Data Collection Tip Sheet (OPRE Report No. #2023-225). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Venezia, F., Eddins, K. (2022). SRAENE — Collecting High-Quality Data Through Observations Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Venezia, F., Eddins, K. (2022). SRAENE — Collecting High-Quality Data Through Observations Tip Sheet (OPRE Report No. #2022-274). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Venezia, F., Eddins, K. (2022). SRAENE — Collecting High-Quality Data in Interviews and Focus Groups Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Venezia, F., Eddins, K. (2022). SRAENE — Collecting High-Quality Data in Interviews and Focus Groups Tip Sheet (OPRE Report No. #2022-275). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Eddins, K. (2023). SRAENE — Preparing to Link Survey Data Video (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Stapleton, T., Eddins, K. (2023). SRAENE — Preparing to Link Survey Data Tip Sheet (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Tabackman, W., Fleischman, B., Eddins, K. (2023). SRAENE — Training Data Collectors Tip Sheet (OPRE Report No. #2023-218). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Tabackman, W., White, S., Eddins, K. (2023). SRAENE — Best Practices for Collecting Survey Data in Person Video (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Tabackman, W., White, S., Eddins, K. (2023). SRAENE — Best Practices for Collecting Survey Data in Person Tip Sheet (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Tabackman, W., White, S., Eddins, K. (2023). SRAENE — Best Practices to Safely Store and Share Data Video (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Tabackman, W., White, S., Eddins, K. (2023). SRAENE — Best Practices to Safely Store and Share Data Tip Sheet (OPRE Report No. #2023-XXX). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
White, S., Eiffes, B., Scott, M., Eddins, K. (2022). SRAENE — Consent, Assent, and Pre-Testing to Prepare for Collecting Survey Data Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
White, S., Eiffes, B., Scott, M., Eddins, K. (2022). SRAENE — Consent, Assent, and Pre-Testing to Prepare for Collecting Survey Data Tip Sheet (OPRE Report No. #2022-276). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
White, S., Eiffes, B., Scott, M., Eddins, K. (2022). SRAENE — Best Practices for Collecting Survey Data Virtually Video. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
White, S., Eiffes, B., Scott, M., Eddins, K. (2022). SRAENE — Best Practices for Collecting Survey Data Virtually Tip Sheet (OPRE Report No. #2022-277). Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.