Arizona WORKs Pilot Program Evaluation: Findings Available

Findings Available

Interim Implementation Findings
Final Implementation Findings
Interim Impact Findings
Final Impact Findings
Final Cost-benefit Findings

Findings

02/02/02: Arizona Works Pilot Program Evaluation: Second Impact Report
Interim Impact Findings:

Arizona Works and EMPOWER Redesign have been about equally successful in encouraging TANF recipients to leave TANF for paid employment and attain self-sufficiency. Some of the calculated performance measures indicate that Arizona Works placed a relatively larger proportion of adults in full-time work. These performance measures do not take into account any pre-existing differences in caseload and neighborhood characteristics of those served by Arizona Works and EMPOWER Redesign in the comparison area, nor do the performance measures take into account employment and earnings obtained after families leave welfare. Once these factors are taken into account, the two programs have a roughly equal effect on employment and average earnings.

 
02/02/02: Arizona Works Pilot Program Evaluation: Second Process Study Report
Interim Implementation Findings:

"Our conclusion is that MAXIMUS has put in place a program that is capable of meeting the requirements of its contract. The Process Study has shown that the Pilot Program is not a clear-cut test of privatization because MAXIMUS has never been truly independent of DES. MAXIMUS remains dependent on the state’s automated systems. MAXIMUS hired such a large number of former DES employees that its operations must have been influenced by previous training received by these employees at DES. The denial of the waivers to operate food stamps and Medicaid meant that MAXIMUS and DES needed to integrate the operations of two organizations in one location. The perceptions of DES staff suggest more subtle ways in which DES and MAXIMUS staff share day to day work burdens: each organization may benefit from the hours spent by staff from the other organization to register applications, process files, enter household information into the state’s automated systems, manage the lobby, and handle numerous other day-to-day tasks."

"Arizona Works and EMPOWER Redesign are nevertheless different in an institutional sense. Many key functions of Arizona Works are run by MAXIMUS, a for-profit company. As long as the findings are interpreted carefully, the Pilot Program still has the potential to provide an interesting test of the effects of a major effort to privatize TANF and many related services. The Process Study has attempted to find ways in which privatization has produced differences in the organization of local offices and in the procedures for delivering public services...The two organizations have staff playing many similar roles, and they provide many similar programs and many similar support services."

 
02/01/03: Arizona WORKs Pilot Program Evaluation: A Three Year Assessment
Final Implementation Findings
  • During the first three years of the program, MAXIMUS, clearly met the requirements of its contract to administer Arizona Works.
  • EMPOWER Redesign [the public program] also featured a well-designed organization and staffing plan.
  • The two work-focused programs had many similar procedures, used identical application forms, and offered a wide array of often similar support services, job search, and readiness programs.
  • The privatization of TANF intake and benefit determination faces numerous difficulties because the federal government requires that public sector staff administer intake and benefit determination for food stamps and medical assistance.
  • Although Arizona Works and EMPOWER Redesign were different in that many TANF-related services were privatized under Arizona Works, the pilot was less than a clear-cut test of privatization. Arizona Works relied on resources and services from the public sector. Similarly, the public program was not entirely public and subcontracted several services.

Final Impact Findings
  • Relative to EMPOWER Redesign, Arizona Works did not increase the percentage of adults who were employed and did not increase the average earnings of adults.
  • Arizona Works increased the proportion of adults who participated in unpaid community service or work experience, GED or ESL programs, job search assistance, and job readiness and training activities.
  • The program had minor effects on TANF receipt.
  • Through the first three years of the Arizona Works Pilot Program, Arizona Works and EMPOWER Redesign were about equally successful in encouraging TANF recipients to leave TANF for paid employment and attain self-sufficiency.
  • Arizona Works increased many measures of employment that were based on data reported by local welfare office staff.
  • The welfare office data provide an incomplete picture of employment, however, because they do not record jobs of some welfare recipients and because they do not record jobs received after persons left welfare.
  • The discrepancies in estimated impacts on employment and earnings obtained from the two data sources (UI wage records and welfare office data) exist mainly because the proportion of adults with employment recorded only employers, and not by welfare office staff, was larger among those subject to EMPOWER Redesign than among those subject to Arizona Works.
  • The Arizona Works program rules also gave recipients a relatively greater incentive to conceal earnings under EMPOWER Redesign.

Final Cost-Benefit Findings
  • The pilot program’s total costs — including contract payments and all categories of costs —probably exceeded the projected costs that would have been incurred under the state program.
  • It is ultimately difficult to assess whether TANF-related programs were relatively more expensive to administer under Arizona Works or EMPOWER Redesign because it is difficult to measure the separate costs of administering TANF-related programs, food stamps and Medicaid under EMPOWER Redesign.
  • It should be recognized, however, that the total cost of Arizona Works also included the cost of professional staff to oversee the pilot, the cost of the independent evaluation, and the substantial increase in average monthly TANF benefits caused by the program rules of Arizona Works.
  • The sum of all of these costs of Arizona Works most likely exceeded the costs that would have been incurred without the pilot.