Health Profession Opportunity Grants (HPOG) 2.0 Tribal Evaluation: Evaluation Plan

Publication Date: August 22, 2017
Current as of:
Health Profession Opportunity Grants (HPOG) 2.0 Tribal Evaluation: Evaluation Plan

Download Report

Download PDF (1,814.44 KB)
  • File Size: 1,814.44 KB
  • Pages: N/A
  • Published: 2020

Introduction

The Health Profession Opportunity Grants (HPOG) Program is administered by the Administration for Children and Families (ACF), U.S. Department of Health & Human Services. In September 2015, ACF awarded a second round of HPOG grants to 32 organizations, including five tribal organizations. These grant awards support demonstration projects that provide eligible individuals with the opportunity to obtain education and training for occupations in the health care field that pay well and are expected to either experience labor shortages or be in high demand.

NORC at the University of Chicago is leading a comprehensive implementation and outcome evaluation of the five Tribal HPOG 2.0 grantees. The evaluation examines program implementation and participant outcomes at both the individual and systems level in a manner that is grounded in a community-based participatory research approach. The Tribal HPOG 2.0 evaluation design is descriptive; as such, the results will not attribute causality between HPOG programs and outcomes.

Purpose

The purpose of this report is to describe the tribal evaluation team’s approach and methods for the evaluation of the Tribal HPOG 2.0 Program.

Key Findings and Highlights

  • The Tribal HPOG 2.0 evaluation approach is grounded in community-based participatory research and is guided by the seven values outlined in the Roadmap for Collaborative and Effective Evaluation in Tribal Communities.
  • The tribal evaluation team worked closely with each grantee over the first year of the evaluation to learn about their communities and gather input into the evaluation design and data collection protocols to ensure that the evaluation is culturally responsive and relevant to the Tribe and community.
  • The Tribal HPOG 2.0 evaluation will assess the structure, process, and outcomes of the grantees’ programs.
  • The tribal evaluation team will use multiple sources of data, including document reviews; curricula reviews; semi-structured in-person and telephone interviews with grantee and partner administrative staff, program implementation staff, and local employers; focus groups and follow-up interviews with program participants; data collected through the HPOG Participant Accomplishment and Grant Evaluation System (PAGES); and linkage of wage and employment information through the National Directory of New Hires (NDNH) where possible.
  • Results from the Tribal HPOG 2.0 evaluation will be shared through a variety of reports, briefs, and presentations.

Methods

The Tribal HPOG 2.0 evaluation team initiated three knowledge development activities to inform the development of the evaluation design. These activities were: 1) gathering feedback from the grantees and other stakeholders on the evaluation approach and design; 2) consulting with experts that serve on the Tribal HPOG 2.0 Technical Work Group (TWG); and 3) conducting a brief review of the literature related to research in American Indian and Alaska Native (AI/AN) communities. The tribal evaluation team also referred to the Roadmap for Collaborative and Effective Evaluation in Tribal Communities, developed by the Child Welfare Research and Evaluation Tribal Workgroup, which guides the approach to the evaluation.

Citation

Meit, M., Hafford, C., Fromknecht, C., Phillips, E., Miesfeld, N., Nadel, T. (2017). Health Profession Opportunity Grants (HPOG) 2.0 Tribal Evaluation: Evaluation Plan, OPRE Report 2016-37, Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.

Glossary

AI/AN:
American Indian/Alaska Native
HPOG:
Health Profession Opportunity Grants
NDNH:
National Directory of New Hires
PAGES:
HPOG Participant Accomplishment and Grant Evaluation System
TWG:
Technical Work Group