Table of Contents | Previous | Next |
Appendix D: Supplementary Impact Tables
| Outcome (%) | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | |
|---|---|---|---|---|---|
| Ever employed | Quarter of random assignment | 32.3 | 30.9 | 1.4 | 0.466 |
| Q2 | 36.0 | 31.8 | 4.2 ** | 0.047 | |
| Q3 | 40.8 | 37.6 | 3.1 | 0.161 | |
| Q4 | 41.7 | 40.8 | 0.9 | 0.706 | |
| Q5 | 43.3 | 41.7 | 1.5 | 0.509 | |
| Q6 | 42.8 | 42.5 | 0.3 | 0.892 | |
| Q7 | 45.2 | 43.4 | 1.8 | 0.443 | |
| Earned $2,500 or more | Quarter of random assignment | 7.0 | 6.6 | 0.4 | 0.706 |
| Q2 | 13.2 | 11.0 | 2.2 | 0.151 | |
| Q3 | 15.9 | 16.0 | 0.0 | 0.983 | |
| Q4 | 17.7 | 17.7 | 0.0 | 0.992 | |
| Q5 | 18.7 | 19.6 | -1.0 | 0.603 | |
| Q6 | 20.9 | 22.2 | -1.3 | 0.507 | |
| Q7 | 23.1 | 23.2 | -0.1 | 0.963 | |
| Earned between $500 and $2,499 | Quarter of random assignment | 15.1 | 13.0 | 2.1 | 0.206 |
| Q2 | 13.5 | 13.8 | -0.3 | 0.852 | |
| Q3 | 16.5 | 15.4 | 1.0 | 0.558 | |
| Q4 | 16.5 | 14.8 | 1.7 | 0.329 | |
| Q5 | 17.6 | 14.5 | 3.1 * | 0.081 | |
| Q6 | 15.5 | 15.2 | 0.3 | 0.862 | |
| Q7 | 14.7 | 15.0 | -0.3 | 0.876 | |
| Earned between $1 and $499 | Quarter of random assignment | 10.2 | 11.3 | -1.1 | 0.479 |
| Q2 | 9.3 | 7.0 | 2.3 * | 0.077 | |
| Q3 | 8.3 | 6.2 | 2.1 * | 0.093 | |
| Q4 | 7.5 | 8.4 | -0.9 | 0.508 | |
| Q5 | 7.0 | 7.6 | -0.6 | 0.634 | |
| Q6 | 6.4 | 5.2 | 1.3 | 0.257 | |
| Q7 | 7.4 | 5.3 | 2.1 * | 0.073 | |
| Sample size (total = 1,692) | 845 | 847 | |||
SOURCES: MDRC calculations from UI administrative records from the State of Minnesota. NOTES: See Appendix B. This table includes only employment and earnings in jobs covered by the Minnesota unemployment insurance (UI) program. It does not include employment outside Minnesota or in jobs not covered by UI (for example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). |
| Outcome (%) | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | |
|---|---|---|---|---|---|
| Employed, not receiving TANF | Quarter of random assignment | 2.4 | 2.3 | 0.1 | 0.912 |
| Q2 | 6.5 | 5.5 | 1.0 | 0.356 | |
| Q3 | 10.3 | 10.8 | -0.5 | 0.731 | |
| Q4 | 14.5 | 16.6 | -2.2 | 0.206 | |
| Q5 | 16.0 | 17.6 | -1.6 | 0.362 | |
| Q6 | 19.9 | 22.3 | -2.4 | 0.219 | |
| Q7 | 22.7 | 24.8 | -2.1 | 0.297 | |
| Employed, receiving TANF | Quarter of random assignment | 29.9 | 28.6 | 1.4 | 0.495 |
| Q2 | 29.5 | 26.3 | 3.2 | 0.125 | |
| Q3 | 30.4 | 26.8 | 3.6 * | 0.090 | |
| Q4 | 27.2 | 24.2 | 3.0 | 0.142 | |
| Q5 | 27.3 | 24.1 | 3.2 | 0.128 | |
| Q6 | 22.9 | 20.2 | 2.7 | 0.171 | |
| Q7 | 22.5 | 18.6 | 3.9 ** | 0.046 | |
| Not employed, receiving TANF | Quarter of random assignment | 65.7 | 67.2 | -1.4 | 0.477 |
| Q2 | 59.5 | 63.9 | -4.4 ** | 0.046 | |
| Q3 | 52.8 | 54.3 | -1.6 | 0.505 | |
| Q4 | 47.7 | 48.0 | -0.3 | 0.910 | |
| Q5 | 42.9 | 45.3 | -2.4 | 0.299 | |
| Q6 | 40.6 | 39.9 | 0.7 | 0.756 | |
| Q7 | 36.1 | 35.6 | 0.5 | 0.837 | |
| Not employed, not receiving TANF | Quarter of random assignment | 2.0 | 2.0 | 0.0 | 0.987 |
| Q2 | 4.5 | 4.4 | 0.2 | 0.864 | |
| Q3 | 6.5 | 8.1 | -1.6 | 0.204 | |
| Q4 | 10.6 | 11.2 | -0.6 | 0.693 | |
| Q5 | 13.9 | 13.0 | 0.9 | 0.577 | |
| Q6 | 16.6 | 17.7 | -1.0 | 0.564 | |
| Q7 | 18.8 | 21.0 | -2.2 | 0.239 | |
| Sample size (total = 1,692) | 845 | 847 | |||
SOURCES: MDRC calculations from UI administrative records from the State of Minnesota.
NOTES: See Appendix B.
This table includes only employment and earnings in jobs covered by the Minnesota unemployment insurance (UI) program. It does not include employment outside Minnesota or in jobs not covered by UI (for example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | P-Value for Subgroup Differences | ||
|---|---|---|---|---|---|---|---|
| Late cohort a | Ever employed (%) | Quarter of random assignment | 32.4 | 34.7 | -2.3 | 0.369 | 0.020 |
| Q2 | 33.5 | 30.2 | 3.3 | 0.218 | 0.603 | ||
| Q3 | 38.3 | 36.8 | 1.6 | 0.573 | 0.334 | ||
| Q4 | 40.8 | 41.6 | -0.8 | 0.794 | 0.333 | ||
| Q5 | 43.0 | 43.2 | -0.2 | 0.955 | 0.347 | ||
| Q6 | 42.9 | 44.7 | -1.8 | 0.537 | 0.239 | ||
| Q7 | 47.4 | 46.8 | 0.6 | 0.836 | 0.464 | ||
| Total earnings ($) | Quarter of random assignment | 518 | 517 | 1 | 0.986 | 0.389 | |
| Q2 | 729 | 685 | 44 | 0.621 | 0.426 | ||
| Q3 | 939 | 970 | -31 | 0.771 | 0.410 | ||
| Q4 | 1,081 | 1,036 | 45 | 0.692 | 0.776 | ||
| Q5 | 1,129 | 1,208 | -78 | 0.513 | 0.602 | ||
| Q6 | 1,207 | 1,267 | -60 | 0.606 | 0.866 | ||
| Q7 | 1,328 | 1,410 | -82 | 0.511 | 0.948 | ||
| Sample size (total = 1,044) | 520 | 524 | |||||
| Early cohort b | Ever employed (%) | Quarter of random assignment | 32.1 | 25.0 | 7.2 ** | 0.025 | |
| Q2 | 40.0 | 34.4 | 5.7 | 0.107 | |||
| Q3 | 44.9 | 38.8 | 6.1 * | 0.098 | |||
| Q4 | 43.2 | 39.5 | 3.8 | 0.313 | |||
| Q5 | 43.7 | 39.4 | 4.3 | 0.253 | |||
| Q6 | 42.6 | 38.9 | 3.7 | 0.316 | |||
| Q7 | 41.7 | 37.6 | 4.1 | 0.265 | |||
| Q8 | 39.1 | 41.8 | -2.7 | 0.473 | |||
| Q9 | 40.6 | 40.3 | 0.3 | 0.929 | |||
| Q10 | 42.2 | 42.4 | -0.1 | 0.972 | |||
| Total earnings ($) | Quarter of random assignment | 471 | 383 | 88 | 0.265 | ||
| Q2 | 857 | 699 | 158 | 0.159 | |||
| Q3 | 1,096 | 983 | 114 | 0.412 | |||
| Q4 | 1,165 | 1,068 | 96 | 0.512 | |||
| Q5 | 1,149 | 1,126 | 23 | 0.880 | |||
| Q6 | 1,170 | 1,262 | -91 | 0.569 | |||
| Q7 | 1,180 | 1,273 | -93 | 0.568 | |||
| Q8 | 1,165 | 1,204 | -40 | 0.795 | |||
| Q9 | 1,202 | 1,242 | -40 | 0.804 | |||
| Q10 | 1,424 | 1,258 | 166 | 0.317 | |||
| Sample size (total = 648) | 325 | 323 | |||||
SOURCES: MDRC calculations from UI, TANF, and food stamp administrative records from the State of Minnesota. NOTES: See Appendix B. This table includes only employment and earnings in jobs covered by the Minnesota unemployment insurance (UI) program. It does not include employment outside Minnesota or in jobs not covered by UI (for example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). a Late-cohort sample members were randomly assigned from October 2002 through April 2003. b Early-cohort sample members were randomly assigned from January through September 2002. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | |
|---|---|---|---|---|---|
| Ever received TANF (%) | Quarter of random assignment | 95.7 | 95.7 | -0.1 | 0.940 |
| Q2 | 89.0 | 90.2 | -1.2 | 0.404 | |
| Q3 | 83.2 | 81.1 | 2.1 | 0.251 | |
| Q4 | 75.0 | 72.2 | 2.8 | 0.186 | |
| Q5 | 70.2 | 69.4 | 0.7 | 0.740 | |
| Q6 | 63.5 | 60.1 | 3.4 | 0.138 | |
| Q7 | 58.6 | 54.2 | 4.3 * | 0.067 | |
| Amount of TANF received ($) | Quarter of random assignment | 1,285 | 1,276 | 9 | 0.545 |
| Q2 | 1,148 | 1,153 | -5 | 0.844 | |
| Q3 | 1,029 | 1,010 | 20 | 0.500 | |
| Q4 | 894 | 865 | 29 | 0.344 | |
| Q5 | 780 | 749 | 31 | 0.313 | |
| Q6 | 697 | 637 | 60 * | 0.054 | |
| Q7 | 613 | 577 | 36 | 0.245 | |
| Sample size (total = 1,692) | 845 | 847 | |||
SOURCE: MDRC calculations from TANF administrative records from the State of Minnesota. NOTES: See Appendix B. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | |
|---|---|---|---|---|---|
| Ever received food stamps(%) | Quarter of random assignment | 98.3 | 98.7 | -0.4 | 0.519 |
| Q2 | 94.5 | 94.5 | 0.0 | 0.998 | |
| Q3 | 91.2 | 88.7 | 2.5 * | 0.085 | |
| Q4 | 85.7 | 84.3 | 1.4 | 0.416 | |
| Q5 | 83.6 | 81.8 | 1.8 | 0.322 | |
| Q6 | 81.9 | 77.7 | 4.2 ** | 0.029 | |
| Q7 | 80.3 | 74.7 | 5.6 *** | 0.005 | |
| Amount of food stamps received ($) | Quarter of random assignment | 896 | 902 | -5 | 0.567 |
| Q2 | 841 | 854 | -14 | 0.324 | |
| Q3 | 802 | 798 | 4 | 0.801 | |
| Q4 | 756 | 745 | 11 | 0.563 | |
| Q5 | 733 | 716 | 17 | 0.395 | |
| Q6 | 711 | 685 | 26 | 0.217 | |
| Q7 | 694 | 667 | 27 | 0.215 | |
| Sample size (total = 1,692) | 845 | 847 | |||
SOURCE: MDRC calculations from food stamp administrative records from the State of Minnesota.
NOTES: See Appendix B. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | |
|---|---|---|---|---|---|
| Family received mental health services | 25.4 | 23.5 | 1.9 | 0.613 | |
| Respondent | 20.3 | 15.9 | 4.4 | 0.194 | |
| Other family member | 11.3 | 10.6 | 0.7 | 0.802 | |
| Family received domestic violence services | 8.0 | 6.3 | 1.7 | 0.456 | |
| Respondent | 8.0 | 6.0 | 2.0 | 0.383 | |
| Other family member | 1.2 | 1.2 | 0.1 | 0.931 | |
| Family received substance abuse services | 7.9 | 8.4 | -0.5 | 0.836 | |
| Respondent | 7.5 | 6.1 | 1.4 | 0.538 | |
| Other family member | 0.4 | 2.3 | -1.9 * | 0.075 | |
| Sample size (total = 503) | 251 | 252 | |||
SOURCE: MDRC calculations from responses to the ERA 12-Month Survey.
NOTES: See Appendix C. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | ||
|---|---|---|---|---|---|---|
| Quarters 2-7 | Ever employed (%) | 68.0 | 64.7 | 3.3 | 0.113 | |
| Total earnings ($) | 6,476 | 6,529 | -54 | 0.902 | ||
| Ever received TANF (%) | 93.4 | 93.1 | 0.3 | 0.793 | ||
| Amount of TANF received (%) | 5162 | 4991 | 171 | 0.222 | ||
| Ever received food stamps (%) | 97.5 | 96.8 | 0.7 | 0.383 | ||
| Amount of food stamps received ($) | 4,536 | 4,465 | 71 | 0.429 | ||
| Total measured income a ($) | 16,174 | 15,985 | 189 | 0.626 | ||
| Quarter 7 | Ever employed (%) | 45.2 | 43.4 | 1.8 | 0.443 | |
| For those employed in Quarters 2-7 (%): | Not employed in Quarters 2-7, last quarter | 33.6 | 36.2 | -2.6 | NA | |
| Employed in Quarters 2-7, last quarter (%) | 66.4 | 63.8 | 2.6 | NA | ||
| Total earnings ($) | 1,271 | 1,358 | -87 | 0.377 | ||
| Earned $2,500 or more (%) | 23.1 | 23.2 | -0.1 | 0.963 | ||
| Earned between $500 and $2,499 (%) | 14.7 | 15.0 | -0.3 | 0.876 | ||
| Earned between $1 and $499 | 7.4 | 5.3 | 2.1 * | 0.073 | ||
| For those employed in Quarters 2-7: | Earnings ($) | 2,815 | 3,131 | -316 | NA | |
| Ever received TANF (%) | 58.6 | 54.2 | 4.3 * | 0.067 | ||
| Amount of TANF received ($) | 613 | 577 | 36 | 0.245 | ||
| Ever received food stamps (%) | 80.3 | 74.7 | 5.6 *** | 0.005 | ||
| Amount of food stamps received ($) | 694 | 667 | 27 | 0.215 | ||
| Total measured income a ($) | 2,578 | 2,603 | -25 | 0.789 | ||
| Sample size (total = 1,692) | 845 | 847 | ||||
SOURCES: MDRC calculations from UI, TANF, and food stamp administrative records from the State of Minnesota. NOTES: See Appendix B. This table includes only employment and earnings in jobs covered by the Minnesota unemployment insurance (UI) program. It does not include employment outside Minnesota or in jobs not covered by UI (for example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). a This measure represents the sum of unemployment insurance earnings, TANF, and food stamps. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | |
|---|---|---|---|---|---|
| Ever employed (%) | 60.4 | 56.7 | 3.7 * | 0.092 | |
| Average quarterly employment (%) | 40.4 | 38.0 | 2.4 | 0.162 | |
| Employed 4 consecutive quarters (%) | 20.1 | 18.3 | 1.8 | 0.328 | |
| Earnings ($) | 4,014 | 3,904 | 110 | 0.701 | |
| Earned over $10,000 (%) | 14.1 | 15.2 | -1.2 | 0.476 | |
| For those employed in Year 1: | Average quarterly employment (%) | 66.9 | 67.0 | -0.1 | NA |
| Average earnings per quarter employed ($) | 2,483 | 2,569 | -86 | NA | |
| Ever received TANF (%) | 92.8 | 92.0 | 0.8 | 0.523 | |
| Amount of TANF received ($) | 3,852 | 3,777 | 75 | 0.439 | |
| Ever received food stamps (%) | 97.0 | 95.7 | 1.3 | 0.163 | |
| Amount of food stamps received ($) | 3,131 | 3,113 | 19 | 0.752 | |
| Total measured incomea($) | 10,998 | 10,793 | 204 | 0.420 | |
| Sample size (total = 1,692) | 845 | 847 | |||
SOURCES: MDRC calculations from UI, TANF, and food stamp administrative records from the State of Minnesota.
NOTES: See Appendix B.
This table includes only employment and earnings in jobs covered by the Minnesota unemployment insurance (UI) program. It does not include employment outside Minnesota or in jobs not covered by UI (for example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). a This measure represents the sum of unemployment insurance earnings, TANF, and food stamps. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | P-Value for Subgroup Differences | |
|---|---|---|---|---|---|---|
| Recently employed a | Total earnings ($) | 10,046 | 9,456 | 590 | 0.505 | 0.438 |
| Ever employed (%) | 90.9 | 85.1 | 5.8 * | 0.053 | 0.504 | |
| Average quarterly employment (%) | 62.8 | 56.5 | 6.2 ** | 0.047 | 0.140 | |
| Number of quarters employed | 3.8 | 3.4 | 0.4 ** | 0.047 | 0.140 | |
| Employed 4 consecutive quarters (%) | 28.9 | 23.8 | 5.1 | 0.198 | 0.224 | |
| Earned over $15,000 (%) | 23.4 | 24.5 | -1.1 | 0.768 | 0.911 | |
| Average earnings per quarter employed ($) | 2,668 | 2,787 | -119 | NA | ||
| Sample size (total = 488) | 234 | 254 | ||||
| Not recently employed | Total earnings ($) | 5,095 | 5,289 | -195 | 0.698 | |
| Ever employed (%) | 59.1 | 56.0 | 3.1 | 0.248 | ||
| Average quarterly employment (%) | 33.3 | 32.6 | 0.8 | 0.692 | ||
| Number of quarters employed | 2.0 | 2.0 | 0.0 | 0.692 | ||
| Employed 4 consecutive quarters (%) | 10.2 | 10.4 | -0.1 | 0.940 | ||
| Earned over $15,000 (%) | 11.6 | 12.2 | -0.6 | 0.730 | ||
| Average earnings per quarter employed ($) | 2,548 | 2,708 | -161 | NA | ||
| Sample size (total = 1,204) | 611 | 593 | ||||
SOURCE: MDRC calculations from UI records from the State of Minnesota. NOTES: See Appendix B. This table includes only employment and earnings in jobs covered by the Minnesota unemployment insurance (UI) program. It does not include employment outside Minnesota or in jobs not covered by UI (for example, "off-the-books" jobs, some agricultural jobs, and federal government jobs). a "Recently employed" sample members worked in the quarter before random assignment, based on UI wage data, and sample members who were "not recently employed" did not work in that quarter. |
| Outcome | Tier 2 Program | Tier 1 Program | Difference (Impact) | P-Value | P-Value for Subgroup Differences | ||
|---|---|---|---|---|---|---|---|
| Recently employed a | Any contacts with case manager/employment program since random assignment b (%) | 72.2 | 72.1 | 0.1 | 0.991 | 0.816 | |
| Average number of contacts with staff/case manager | 25.6 | 19.9 | 5.7 | 0.243 | 0.541 | ||
| In person | 9.5 | 8.4 | 1.1 | 0.579 | 0.587 | ||
| By telephone | 16.1 | 11.5 | 4.6 | 0.164 | 0.573 | ||
| Talked with staff/case manager in past 4 weeks (%) | 41.0 | 41.0 | 0.0 | 0.995 | 0.590 | ||
| Ever met with staff/case manager (%) | 61.7 | 68.3 | -6.6 | 0.361 | 0.364 | ||
| At home | 6.9 | -0.3 | 7.2 ** | 0.011 | 0.115 | ||
| At workplace | 7.5 | 6.7 | 0.9 | 0.834 | 0.569 | ||
| At staff/case manager's office | 59.7 | 65.9 | -6.2 | 0.394 | 0.301 | ||
| At school/training program | 11.2 | 13.9 | -2.7 | 0.610 | 0.885 | ||
| At other places | 4.7 | 3.0 | 1.7 | 0.579 | 0.458 | ||
| Staff/case manager talked with respondent's employer (%) | Never | 82.5 | 91.3 | -8.8 * | 0.097 | 0.784 | |
| Once or twice | 9.9 | 4.3 | 5.7 | 0.159 | 0.353 | ||
| More than twice | 2.8 | 3.7 | -0.9 | 0.759 | 0.163 | ||
| Don't know if the case manager talked with an employer | 4.7 | 0.7 | 4.0 | 0.123 | 0.628 | ||
| Sample size (total = 183) | 87 | 96 | |||||
| Not recently employed | Any contacts with case manager/employment program since random assignment b (%) | 75.3 | 77.2 | -1.8 | 0.707 | ||
| Average number of contacts with staff/case manager | 26.7 | 17.3 | 9.4 *** | 0.009 | |||
| In person | 10.1 | 7.6 | 2.5 * | 0.093 | |||
| By telephone | 16.6 | 9.7 | 6.9 *** | 0.006 | |||
| Talked with staff/case manager in past 4 weeks (%) | 42.2 | 37.2 | 5.0 | 0.365 | |||
| Ever met with staff/case manager (%) | 66.7 | 65.2 | 1.5 | 0.775 | |||
| At home | 3.8 | 1.9 | 1.9 | 0.327 | |||
| At workplace | 6.1 | 2.6 | 3.5 | 0.140 | |||
| At staff/case manager's office | 66.2 | 63.1 | 3.1 | 0.561 | |||
| At school/training program | 12.8 | 16.5 | -3.7 | 0.360 | |||
| At other places | 6.7 | 2.1 | 4.6 ** | 0.050 | |||
| Staff/case manager talked with respondent's employer (%) | Never | 86.5 | 93.5 | -7.1 ** | 0.041 | ||
| Once or twice | 5.9 | 4.7 | 1.2 | 0.630 | |||
| More than twice | 4.4 | 0.6 | 3.8 ** | 0.036 | |||
| Don't know if the case manager talked with an employer | 3.1 | 0.6 | 2.5 | 0.108 | |||
| Sample size (total = 320) | 164 | 156 | |||||
SOURCE: MDRC calculations from responses to the ERA 12-Month Survey. NOTES: See Appendix C. a "Recently employed" sample members worked in the quarter before random assignment, based on UI wage data, and sample members who were "not recently employed" did not work in that quarte |

