Prepared for:
Children’s Bureau
Administration on Children, Youth, and Families
U.S. Department of Health and Human Services
Prepared By:
James Bell Associates
Arlington, Virginia
June 2005
Public Law 103-432, authorized by Congress in 1994, introduced the concept of Federal waivers to child welfare programs. Conceived as a strategy for generating new knowledge about innovative and effective child welfare practices, waivers grant States flexibility in the use of Federal funds for alternative services and supports that promote safety and permanency for children in the child protection and foster care systems. The Adoption and Safe Families Act (ASFA) of 1997 extended and expanded the authority to use waivers for child welfare programs, authorizing the Secretary of Health and Human Services to approve up to ten new demonstration projects each year.
Through the waivers, States may spend Federal title IV-E funds for supports and services other than foster care maintenance payments that protect children from abuse and neglect, preserve families, and promote permanency. Some States have proposed discrete interventions focused on specific child welfare populations, whereas others are experimenting with the flexible use of funds to produce system-wide reforms. Waiver demonstrations must remain cost-neutral to the Federal government, (i.e., States cannot receive more in Federal reimbursement than the State would have received in the absence of the demonstration) and they must undergo rigorous program evaluation to determine their efficacy. Most States expect to realize title IV-E costs savings through their demonstration projects.
The Department of Health and Human Services typically approves child welfare waivers for up to five years, although at the discretion of the Secretary they may be extended beyond five years. Since 1996, 17 States have implemented 25 child welfare waiver demonstrations. These projects have examined innovative child welfare service strategies in several areas, including:
As of May 2005, nine States are actively implementing 14 different waiver projects. Several States continue to operate their original demonstrations under short-term or longer, five-year waiver extensions. In 2004, two additional States - Minnesota and Wisconsin - received approval for, but have not yet implemented, their child welfare waiver demonstrations. Among the States that have completed their demonstrations, several terminated their projects early because of problems with meeting the Federal cost neutrality requirement or because of other implementation problems. Table 1 provides an overview of the types of demonstration projects and their current status.
| Type of Project | Description of Intervention | ||||||
Active Demonstrations |
Completed |
Approved, Not Yet Implemented |
|||||
Under Original Waiver |
Under Short-Term Ext. |
Under 5-Year Ext. |
Completed As Scheduled |
Terminated Early |
|||
Assisted Guardianship/Kinship Permanence |
Relatives/other caregivers who assume legal custody of children are eligible for a monthly subsidy equal or comparable to foster care payments. |
MT (2006)1 NM (2005) |
Blank Cell | IL (2008) NC (2009) OR (2009) |
DE (2002) MD (2004) |
Blank Cell | MN WI |
Capped IV-E Allocations and Flexibility to Local Agencies |
States give counties or other local entities flexibility in spending child welfare dollars for new services and supports in exchange for a capped per child/per family allocation of title IV-E funds. |
Blank Cell | IN (2005) |
NC (2009) OH (2009) OR (2009) |
Blank Cell | Blank Cell | Blank Cell |
Services to Caretakers with Substance Use Disorders |
States used title IV-E dollars to fund services and supports for caretakers with substance abuse disorders. |
IL (2005) |
NH (2005) |
Blank Cell | DE (2002) |
MD (2002) |
Blank Cell |
Managed Care Payment Systems |
States test alternative managed care financing mechanisms to reduce child welfare costs while improving permanency, safety, and well-being outcomes for targeted families. |
Blank Cell | Blank Cell | Blank Cell | MI (2003) |
CO (2003) CT (2002) MD (2002) WA (2003) |
Blank Cell |
Intensive Service Options |
States increase the variety and intensity of services and supports to reduce out-of-home placement rates and improve other permanency and safety outcomes. |
Blank Cell | CA (2005) |
Blank Cell | Blank Cell | MS (2004) |
Blank Cell |
Adoptions and Post-Permanency Services |
States strengthen existing or provide new post-adoption and post-permanency services and supports. |
Blank Cell | Blank Cell | Blank Cell | ME (2004) |
Blank Cell | MN |
Tribal Administration of IV-E Funds |
Tribes develop administrative and financial systems to administer title IV-E foster care programs independently and claim Federal reimbursement directly. |
NM (2005) |
Blank Cell | Blank Cell | Blank Cell | Blank Cell | Blank Cell |
Enhanced Training for Child Welfare Staff |
Training for public and private-sector child welfare professionals serving children in placement and their families to improve permanency and safety outcomes. |
IL (2007) |
Blank Cell | Blank Cell | Blank Cell | Blank Cell | Blank Cell |
A. Assisted Guardianship/Kinship Permanence
To date, seven States have completed or continue to implement assisted guardianship waiver demonstrations: Delaware, Illinois, Maryland, Montana, New Mexico, North Carolina and Oregon. Montana and New Mexico’s demonstrations offer a guardianship option for children in either Tribal or State custody; procedures for processing the cases of children in Tribal custody are determined by appropriate Tribal government authorities. In two States – North Carolina and Oregon – assisted guardianship is one component of larger, flexible funding waiver demonstrations. Delaware, Illinois, Maryland, North Carolina, and Oregon have completed their initial five-year demonstration projects. Three of these States (Illinois, North Carolina and Oregon) have been granted approval to extend their waiver demonstration projects for an additional five years. Wisconsin recently received approval to implement a guardianship demonstration similar to those of these original seven States. Minnesota also received approval for a new demonstration testing the impact of enhanced permanency services, including the use of Federal funds for assisted guardianship.
B. Capped IV-E Allocations and Flexibility to Local Agencies
A total of four States – Indiana, Ohio, Oregon, and North Carolina – have implemented flexible funding waiver demonstrations. North Carolina, Ohio, and Oregon have recently received five-year extensions of their flexible funding waivers into 2009, and Indiana continues to operate under a short-term extension through June 2005 while completing an application for a five-year extension. Each State’s flexible funding demonstration attempted to establish a new array of services to prevent placement or facilitate permanency with the expectation that the costs of these services would be offset by subsequent savings in foster care expenditures.
C. Services for Caretakers with Substance Use Disorders
Four States have implemented substance abuse waiver demonstrations: Delaware, New Hampshire, Illinois, and Maryland. Delaware completed its demonstration project in December 2002 and submitted its final evaluation report in March 2002. New Hampshire began its effort in 1999 and continues to operate under a short-term waiver extension through November 2005, while Illinois will finish its original five-year demonstration in June 2005. Maryland terminated its demonstration early in December 2002 due to various implementation problems.
D. Managed Care Payment Systems
Five States - Colorado, Connecticut, Maryland, Michigan, and Washington - tested alternative managed care financing mechanisms to reduce child welfare costs while improving permanency, safety, and well-being outcomes for targeted families. As indicated in Table 1, most States terminated their managed care demonstrations early because of problems with maintaining cost neutrality and other implementation problems.
E. Intensive Service Options
Two States - California and Mississippi - implemented demonstration projects that increased the intensity, variety, and availability of child and family services in an effort to improve permanency and safety outcomes.
F. Adoption and Post-Permanency Services
Two States – Maine and Minnesota – received waivers to provide services and supports to promote and strengthen adoption as a permanency option. Maine completed its demonstration in December 2004, while Minnesota plans to begin implementation of its demonstration in October 2005.
G. Tribal Administration of IV-E Funds
Under the second component of its two-part waiver agreement, New Mexico is implementing a unique demonstration that seeks to foster enhanced Tribal independence, efficiency, and effectiveness in the delivery of child welfare services to Native American children. The State may enter into agreements with eligible Tribes and Pueblos to delegate the administration of title IV-E programs to Tribal government authorities. These agreements grant authority to the Tribes to develop foster care licensure standards, license foster homes, determine the IV-E eligibility of individual children, and receive direct Federal reimbursement for foster care maintenance, adoption assistance, subsidized guardianship, independent living, and related administrative expenses.
H. Enhanced Training for Child Welfare Staff
Illinois is implementing an enhanced training demonstration targeted at new public and private-sector child welfare workers to improve their competence in assessing child and family needs, providing appropriate services, and making evidence-based permanency decisions. In addition to enhanced training, child welfare workers from the private sector benefit from structured field support for one year following completion of the classroom training. Field support includes coaching, shadowing, and post-training “booster sessions.”
Part II: Evaluation Designs
As part of their waiver agreements, all States are required to conduct rigorous evaluations of their demonstrations that include process and outcome components. The demonstrations have varied in terms of their evaluation designs, but random assignment designs are employed whenever feasible. Table 2 provides an overview of the evaluation designs that have been implemented or proposed for the waiver demonstrations to date. Eighteen of the demonstrations have used or are being evaluated using random assignment designs. Because some demonstrations involve systemic reforms that make random assignment infeasible, several States are using comparison site designs, with a county or other local geographic entity serving as the unit of analysis. For its evaluation, Indiana used a matched comparison group design in which each child receiving waiver-funded services was matched against a corresponding non-waiver child based on demographic, geographic, and case-related variables. Likewise, Minnesota will employ a matched comparison group design in rural counties participating in its waiver demonstration, while using random assignment in urban areas.
Table 2 - Evaluation Designs of the Title IV-E Waiver Demonstrations
| Type of Demonstration | Research Design | ||
| Random Assignment | Comparison Sites | Matched Comparison Groups | |
Assisted Guardianship/Kinship Permanence |
IL, MD, MT, NM, WI, MN |
NM, NC, OR |
MN |
Capped IV-E Allocations/Flexibility to Local Agencies |
Blank Cell | NC, OH, OR |
IN |
Services to Substance-Abusing Caretakers |
IL, MD, NH |
DE |
Blank Cell |
Managed Care Payment Systems |
CO, CT, MD, MI, WA |
Blank Cell | Blank Cell |
Intensive Services Options |
CA, MS |
Blank Cell | Blank Cell |
Adoption Services |
ME |
Blank Cell | Blank Cell |
Tribal Administration of IV-E Funds |
Blank Cell | NM |
Blank Cell |
Enhanced Training for Child Welfare Staff |
IL |
Blank Cell | Blank Cell |
Part III: Status of the Evaluations
The availability of evaluation data from the States varies depending on the implementation status of their waiver demonstrations. Interim reports usually focus on project implementation and may contain some preliminary data on outcomes, whereas final evaluation reports are expected to provide a comprehensive overview of all process and outcome findings. Table 3 summarizes the status of interim and final evaluation reports submitted by the States as of May 2005. To date, thirteen final evaluation reports have been submitted for the 16 demonstrations completed or terminated early under their original five-year waivers. Final reports are expected from several States that continue to implement demonstrations under their original five-year waivers, including Illinois, Montana, New Hampshire, and New Mexico. In addition, new interim and final reports will be submitted by the four States that have received five-year waiver extensions (Illinois, North Carolina, Ohio, and Oregon). States are usually expected to submit a final evaluation report within six months of the completion or termination of a demonstration.
Table 3 - Status of Evaluation Reports
|
State |
Demonstration Components |
Report Received (checked if yes) or Date Expected |
|||
Original Waiver |
5-Year Extension (where applicable) |
||||
Interim Report |
Final Report |
Interim Report |
Final Report |
||
California |
Intensive Services |
√ |
√ |
Blank Cell | Blank Cell |
Colorado |
Managed Care |
N/A2 |
√ |
Blank Cell | Blank Cell |
Connecticut |
Managed Care |
√ |
√ |
Blank Cell | Blank Cell |
Delaware |
Assisted Guardianship/Substance Abuse Services |
√ |
√ |
Blank Cell | Blank Cell |
Illinois |
Assisted Guardianship |
√ |
√ |
December 2007 |
June 2009 |
Substance Abuse Services |
√ |
December 2005 |
Blank Cell | Blank Cell | |
Enhanced Training |
July 2005 |
June 2008 |
Blank Cell | Blank Cell | |
Indiana |
Flexible Funding |
√ |
√ |
Blank Cell | Blank Cell |
Maine |
Adoption Services |
√ |
√ |
Blank Cell | Blank Cell |
Maryland |
Assisted Guardianship |
√ |
√ |
Blank Cell | Blank Cell |
Managed Care |
√ |
N/A |
Blank Cell | Blank Cell | |
Substance Abuse Services |
√ |
N/A |
Blank Cell | Blank Cell | |
Michigan |
Managed Care |
N/A |
√ |
Blank Cell | Blank Cell |
Minnesota |
Assisted Guardianship/Single Benefit Payment |
May 2008 (est.) |
March 2011 (est.) |
Blank Cell | Blank Cell |
Mississippi |
Intensive Services |
N/A |
June 2005 |
Blank Cell | Blank Cell |
Montana |
Assisted Guardianship |
N/A |
March 2007 |
Blank Cell | Blank Cell |
New Hampshire |
Substance Abuse Services |
√ |
July 2005 |
Blank Cell | Blank Cell |
New Mexico |
Guardianship/Tribal Administration of IV-E Funds |
√ |
December 2005 |
Blank Cell | Blank Cell |
North Carolina |
Flexible Funding/Assisted Guardianship |
√ |
√ |
June 2007 |
December 2009 |
Ohio |
Flexible Funding |
√ |
√ |
August 2007 |
March 2010 |
Oregon |
Flexible Funding/Guardianship |
√ |
√ |
October 2006 |
September 2009 |
Washington |
Managed Care |
N/A |
√ |
Blank Cell | Blank Cell |
Wisconsin |
Assisted Guardianship |
Oct. 2008 (est.) |
August 2011 (est.) |
Blank Cell | Blank Cell |
2 Indicates that the State was exempted from submitting the report if it terminated early or made an alternative reporting arrangement with the Children’s Bureau. Back
Part IV: Overview of Evaluation Findings
As more States have submitted evaluation findings through their interim and final evaluation reports, a clearer picture has emerged regarding the effects of the waiver demonstrations on key child welfare outcomes. Critical evaluation questions focus on the effectiveness of the waiver demonstrations in:
Findings to date suggest that the demonstrations have met with mixed success in affecting positive changes in these child welfare outcomes. Key findings from three clusters of demonstrations addressing (1) assisted guardianship/kinship permanency, (2) capped IV-E allocations/flexible funding, and (3) services for substance abusing caretakers are summarized below.
Assisted Guardianship/Kinship Permanence
Permanency Rates: Illinois found strong, statistically significant evidence that the availability of assisted guardianship increased net permanence, defined as exits from placement to reunification, adoption, or guardianship. By the end of the original demonstration, only 19.7 percent of experimental group children had aged out of or remained in foster care compared with 25.7 percent of control group children. To date, no other State has found conclusive evidence that the availability of assisted guardianship improves permanency outcomes for children.
Placement Duration: Available data from Maryland and New Mexico suggest that the availability of assisted guardianship may decrease the length of out-of-home placements.
Placement Stability: Available data from the Illinois and Maryland evaluations indicate that experimental group children (i.e., those eligible to receive a guardianship subsidy) had comparable rates of placement stability – defined as the number of changes in placement settings over time – as children in the control groups.
Maltreatment Recurrence: Findings from Illinois suggested that children placed with guardians were at least as safe from repeat maltreatment as children in other permanent settings. No other States have reported findings regarding the effects of assisted guardianship on maltreatment recurrence.
Foster Care Re-Entry: Illinois reported low statewide rates of guardianship disruptions and foster care re-entries. Of the 6,820 children statewide who entered subsidized guardianship between May 1997 and March 2002, only 237 (3.5 percent) experienced a disruption of the guardianship placement. Of these, only 117 children (49 percent) required a return to child welfare public agency custody. Based on the State’s evaluation sample, there were no differences in the proportion of disruptions in permanent placements (guardianships and adoptions) between the experimental and control groups (1.2 percent versus 1.1 percent, respectively). Oregon also reported a very low incidence of foster care re-entry, with only four of 133 children (three percent) re-entering substitute care during the first year following entry into guardianship.
Child Well-Being: Data from the Maryland, Montana, and Illinois evaluations suggest that children in guardianship fare as well as those in other permanency settings on several measures of well-being, including school performance, engagement in risky behaviors, and access to community resources.
Capped IV-E Allocations and Flexibility to Local Agencies
Foster Care Placement Rates: In all three States that studied placement avoidance (Indiana, North Carolina, and Oregon), the flexible funding demonstrations were associated with a significantly reduced likelihood of out-of-home placement. In Indiana, 45.6 percent of children assigned to the experimental group never entered placement compared to 38 percent of control group children. In Oregon, children in child welfare branches with access to services paid for using flexible funds were over three times more likely to remain home as children in comparison sites. North Carolina’s evaluation indicated that the probability of entering out-of-home placement among children with a substantiated maltreatment report declined significantly more in experimental counties than in comparison counties or in other counties not participating in the waiver demonstration.
Permanency Rates: In Indiana, access to flexible funds had a significant positive effect on reunification rates, with nearly 77 percent of experimental group children in out-of-home placement reunified either with the original caretaker or a non-custodial parent compared with
66 percent of control group children. The flexible funding demonstrations in North Carolina, Ohio, and Oregon had no discernable impact on permanency rates.
Placement Duration: Indiana observed a significant positive association between the availability of the waiver and reduced length of stay in foster care placement. North Carolina and Ohio observed no statistically significant effects of their waivers on placement duration.
Maltreatment Recurrence: Of the States that studied maltreatment recurrence (Indiana, Ohio, and Oregon), none observed changes in subsequent maltreatment rates in either direction as a result of the flexible funding waiver.
Foster Care Re-Entry: Among the States that studied foster care re-entry (Indiana, North Carolina, and Ohio), access to services paid for using flexible funds had no significant effects in either direction on the likelihood of foster care re-entry.
Child and Family Well-Being: Indiana’s evaluation found a positive association between access to waiver-funded services and school attendance, with a higher percentage of school-age children assigned to the experimental group in school at case closure than children assigned to the matched comparison group.
Services for Caretakers with Substance Use Disorders
Treatment Retention and Completion: Delaware and Illinois collected specific data on the number of enrolled caregivers who remained in or successfully completed substance abuse treatment. Illinois reported modest improvements in substance abuse treatment retention and completion; as of June 2004, 59 percent of active clients in the experimental group had either completed or were actively engaged in treatment. Altogether, 73 percent of experimental group caregivers had participated in treatment at some point in time compared with 50 percent of caregivers assigned to the control group. Delaware experienced more difficulties retaining clients in treatment; by the end of that State’s waiver demonstration, only 24 percent of closed experimental group cases were actively engaged in or had completed treatment.
Foster Care Placement Rates: Both Delaware and New Hampshire studied the effects of their substance abuse demonstrations on foster care placement rates, defined as the proportion of in-home children enrolled in the demonstration who later entered out-of-home placement. Neither State found conclusive evidence that access to enhanced substance abuse services reduced rates of entry into foster care.
Permanency Rates: Illinois and New Hampshire examined the effects of their substance abuse demonstrations on permanency, defined as exits from foster care to reunification, guardianship, or adoption. Neither State has reported significant effects from its demonstration on reunification or other permanency outcomes.
Placement Duration: Three States – Delaware, Illinois, and New Hampshire – studied the effects of their demonstrations on the duration of out-of-home placements. Delaware and Illinois’ demonstrations were associated with reduced time in foster care. In particular, findings from Illinois suggest that children in families with access to intensive substance abuse services spend considerably less time in foster care. According to the State’s latest progress report, children in the experimental group who returned home spent an average of 421 days in out-of-home care compared with 563 days for control group children, a statistically significant difference of 142 days.
Placement Stability: Two States - Illinois and New Hampshire – assessed the effects of their demonstrations on placement stability, defined as the average number of times a child in foster care changes placement settings. To date, neither State has found evidence that access to enhanced substance abuse services improves placement stability.
Maltreatment Recurrence: The latest findings from Illinois indicate that families with access to enhanced substance abuse services may experience less subsequent maltreatment, with a smaller, statistically significant proportion of experimental group caregivers having a repeat maltreatment allegation compared with control group caregivers. To date, New Hampshire has uncovered no effect of its waiver demonstration on subsequent maltreatment referrals .
Child and Family Well-Being: New Hampshire has reported some initial positive well-being findings for families with access to enhanced substance abuse services, including declines in problem child behaviors, reduced public assistance participation, increased parent employment, and increased enrollment in education programs.
Outcome findings reported in this summary are preliminary in nature. As States complete and submit their final evaluation reports, more conclusive evidence regarding the success of the title IV-E waiver demonstrations in effecting positive changes in key child welfare outcomes may come to light.