Supporting Partnerships to Advance Research and Knowledge (Project SPARK)

2019-2021

Many TANF and workforce development agencies are interested in becoming better users and producers of high-quality research in order to improve their programs for low-income families. However, many of these agencies currently lack the expertise and capacity to integrate data and evidence into their program practices. ACF has responded to this need through investments to strengthen the evaluation capacity of human services agencies through the provision of evaluation technical assistance (TA). In 2012, OPRE launched the Advancing Welfare and Family Self-Sufficiency Research Project to support state and local human services agencies with research and evaluation activities, and subsequently awarded a follow-on contract to continue this work. These earlier projects developed the “Learn, Innovate, Improve” (LI2) framework, a research-based approach to program improvement that embeds analytic methods in the process of designing, implementing, and iteratively testing program changes.

Building on this work, the ACF Office of Family Assistance launched the ongoing Rapid Cycle Evaluation and Training Technical Assistance (RCE TTA) project. RCE TTA has focused on the first two phases of LI2, “Learn” and “Innovate,” which are centered around assisting agencies with identifying, designing, and implementing evidence-informed program changes.

 

Project SPARK aims to complement these efforts by providing research and evaluation TA to state, tribal, and local TANF programs formerly engaged under RCE TTA. Led by Mathematica, this project supports those agencies in advancing their existing initiatives into the “Improve” phase of LI2, which focuses on evaluating program changes or innovations using pilot tests or other approaches.

 

Further, in recognizing that LI2 is just one method for providing evaluation TA, the project also documents existing evaluation TA approaches and examines whether certain approaches are more promising than others at building evaluation capacity within agencies. This work assesses the landscape of current or previous evaluation TA activities in human services program contexts, asks what can be learned from other fields that have examined this question, and identifies lessons to inform future federal evaluation capacity-building efforts.

 

Point(s) of contact: Emily Ross

 

Information collections related to this project have been reviewed and approved by the Office of Management and Budget (OMB) Office of Information and Regulatory Affairs under ACF’s Generic Clearance for Formative Data Collections for ACF Program Support (OMB #0970-0531). Related materials are available at the Supporting Partnerships to Advance Research and Knowledge page on RegInfo.gov.

Related Resources

Explore this brief to learn about how New York City’s Human Resources Administration (HRA) used evidence-based decision making and reflection to systematically test and refine their upfront assessment process for youth and families receiving TANF, with the goal of helping TANF and other human services agencies generate ideas of how to use data-driven reflection (testing) to make decisions and continuously improve their programs

Explore this brief to learn about how Iowa’s Family Development and Self-Sufficiency (FaDSS) program used evidence-based decision making and reflection to understand how well virtual coaching is meeting the needs of their families, with the goal of helping TANF and other human services agencies generate ideas of how to use data-driven reflection (testing) to make decisions in their own organizations.

This brief from Project SPARK highlights how TANF program leaders might apply the strategies used during the pandemic to address persistent stress and trauma and support wellbeing among staff and participants beyond the end of the public health emergency.

This brief highlights how human service agencies adapted their service delivery and operations during the COVID-19 pandemic.

Explore this toolkit designed to help practitioners of TANF and related programs work through a process for strengthening their organization’s capacity to use data and evidence to strengthen programs and improve participants' outcomes.

Explore the key findings from the final report of OPRE’s Project SPARK on evaluation technical assistance (TA), which describes a proposed definition of evaluation TA, a conceptual framework for evaluation TA, and a review of the approaches and evidence of promise or effectiveness of evaluation TA initiatives.

Explore this final report from OPRE’s Project SPARK on evaluation technical assistance (TA), which describes a proposed definition of evaluation TA, a conceptual framework for evaluation TA, and reviews approaches and evidence of promise or effectiveness of evaluation TA initiatives.