http://www.researchforum.org/project_general_24.html

Arizona EMPOWER Welfare Reform Demonstration

General Information

View a brief abstract of this project.

View a complete, printer-friendly profile of this project.

Evaluator(s) Abt Associates, Inc.
Investigator(s) Gregory Mills (Abt Associates, Inc.)
Sponsor(s) Arizona Department of Economic Security
Funder(s) Arizona Department of Economic Security
US Department of Health and Human Services, Administration for Children and Families
US Department of Health and Human Services
Subcontractor(s) Lecroy and Milligan Associates
 
Domain Income Security/TANF
Status Completed (final report released)
Duration Jun 1996 - Jun 2002
Type Research and/or Program Evaluation
Goal To evaluate the components of Arizona's EMPOWER (Employing and Moving People off Welfare and Encouraging Responsibility) program.
Program/Policy Description The EMPOWER program expands opportunities to work and save money while strengthening personal responsibility by placing restrictions, such as time limits, on program participation.
Notes No notes reported.
 
Last Updated 03/20/03
Type of Summary Reviewed
External Reviewer(s) Gregory Mills (Abt Associates, Inc.)
Contact(s) Cheryl Roberts (not reported)
Abt Associates, Inc.
55 Wheeler Street
(T) (617)-349-2537
(F) (617)-492-5219
Publications Department Abt Publications (not reported)
Abt Associates, Inc.
4808 Montgomery Lane
(T) not reported
(F) not reported

Populations Studied

Target Population Recipients/participants/clients
Subgroups Analyzed Single parent families
Two-parent families
Sample Size and Unit For EMPOWER:

5,829 welfare recipients.

Random assignment to 2,983 program and 2,846 control group members.

Sites Studied

EMPOWER:
Glendale, Arizona
Maryvale, Arizona
Peoria, Arizona
Chinle, Arizona

EMPOWER comparison sites:
The Royal Palm, East Southern, and Tuba City offices of the Family Assistance Administration

Program Components, Policies, and Activities Evaluated

Employment activities

  • Work supplementation programs

Financial incentives

  • Elimination of 100 hour rule
  • Increased asset limit
  • Individual Development Account (IDA)
  • Financial Incentives - misc.

Financial disincentives/Sanctions

  • Reduced benefits for non-compliance
  • Strengthened JOBS sanctions
  • Multi-program sanctions

Program requirements

  • Mandatory JOBS for younger teens
  • Living arrangements for unwed pregnant or parenting minors

Social/Support services

  • Transitional child care
  • Transitional health benefits
  • Multiple services in single location

Administration/Implementation

  • Changes in welfare office environment/culture
  • Administration/Implementation - misc.

Time limits

  • Time Limits - misc.

Family caps

  • Family Caps - misc.
Variation in program components across sites? No
Notes on program components Employment activities: Work supplementation programs are offered. Family caps: Additional children born to those on welfare will not be covered by welfare. Financial disincentives/sanctions: Program participants experienced reduced benefits for non-compliance, strengthened JOBS sanctions, and multi-program sanctions. Financial incentives: Elimination of the 100 hour rule, increased assets limits, and Individual Development Accounts (IDA) are offered. Program operations/implementation: Changes in the welfare office environment are studied. Program requirements: Required components include mandatory JOBS for younger teens, and living arrangements for unwed pregnant or parenting minors. Social/Support services: Services offered include transitional child care, transitional health benefits, and multiple services located in single location. Time limits Limits are not specified.

Outcomes Assessed

Benefit termination

  • Due to employment
  • Due to sanctions
  • Due to employer-provided health insurance

Family and relationship outcomes

  • Violence in family or other relationships (child abuse and neglect)
  • Births/pregnancies
  • Family formation and stability/Living arrangements

Education

  • School attendance

Employment

  • Job attainment
  • Job retention

Income security

  • Child support payments
  • Earnings
  • Food stamps receipt
  • Medicaid receipt
  • Welfare receipt

Housing

  • Homelessness
  • Housing - misc.

Standard of living

  • Standard of living - misc.

Service utilization

  • Service utilization - misc.

Sanctions

  • Sanctions - misc.

Program implementation

  • Program Implementation - misc.

Financial costs and benefits/cost-effectiveness

  • Financial costs and benefits/cost-effectiveness - misc.

Types of Studies

Type Impact Study (Controlled Experiment)
Aim To examine the myriad of effects that the intervention has on participants.

To determine the overall effects of the EMPOWER demonstration and to provide detailed information about the outcomes attributable to the separate provisions of the EMPOWER demonstration.

 
Type Implementation/Process Study
Aim To provide a comprehensive picture of the developing, planning, start-up and ongoing operations of the EMPOWER components.

To provide information about the replicability of the program and its impacts.

 
Type Cost-Benefit Study
Aim To examine the cost-benefit implications from all relevant perspectives: participants, the federal government; the state government; and society as a whole.

To examine if families were better off with EMPOWER than they would be without the intervention (based on gains in earnings that surpass losses in benefits) and if the government’s budget is better off with EMPOWER (based on declines in assistance payments that offset operating costs).

 

Data Sources

Source Field Research
Title Includes key respondent interviews with state and local office DES staff, other relevant agency staff, state and local advocacy and public interest groups, local employers, and employer and employee organizations.
Observations of program activities will focus on activities during which program policies, rules, and services are communicated to clients.
Sample Characteristics/Data Collection Number of welfare staff, welfare administrators, and employer/work supervisors interviewed not reported.
Type of sample not reported.
Data collected Fall 1996, Spring 1998 and Fall 1999.
Sites EMPOWER research offices and designated EMPOWER comparison offices.
Response Rate/Attrition Notes Response rate not yet available.
Additional Execution Notes Site visits to research and comparison sites will be a half-day visit within 45 days after submitting evaluation plan.
 
Source Survey
Title Primary follow-up telephone and in-person survey with EMPOWER clients, Waves 1 and 2
Sample Characteristics/Data Collection Wave 1:
1,000 welfare recipients participating in the EMPOWER program.
Random assignment of 500 in control group, 500 in experimental group.
Collected Spring 1998. Wave 2:
400 welfare recipients who enter as new cases January-June, 1998, participating in the EMPOWER program.
Collected Spring 2001.
Sites Glendale, Arizona
Maryvale, Arizona
Peoria, Arizona
Chinle, Arizona
Response Rate/Attrition Notes Response rate not yet available.
Additional Execution Notes In Waves 1 and 2, a larger initial sample (2,000) participants) will be interviewed to allow for attrition, estimated at 10% each year for 2 ½ years, and a projected response rate of 78%. For Redesign implementation project, 60%. Wave 1 consists of "existing cases", or EMPOWER participants randomly assigned in 10/95. Wave 2 consists of four sub-samples of cases, defined by their existing/new status (based on a separate cross-section for "new" cases) and their experimental/control status (selected from a panel of existing cases interviewed in Wave 1).
 
Source Survey
Title Small-scale, supplemental client telephone surveys
Sample Characteristics/Data Collection 25 welfare recipients in each of two EMPOWER experimental subgroups affected by particular provisions (see Execution Notes).
Non-random assignment of respondents within the non-experimental treatment group.
Data collected Spring 1998, Spring 2001.
Sites Maricopa County, Arizona
Response Rate/Attrition Notes Response rate not yet available.
Additional Execution Notes Participants are divided into subgroups based on particular provisions, including the 100-hour rule, IDAs, extended TMA/TCC benefits, time-limited eligibility, family benefit cap, teen parents affected by solo unwed minor parent limitation and/or mandatory JOBS participation, and JOBS sanction at first non-compliance. Each group will be oversampled to achieve the 25 interviews.
 
Source Focus Group
Sample Characteristics/Data Collection 3 groups of 8-10 welfare recipients in EMPOWER subgroups affected by particular provisions (see Execution Notes).
Type of assignment not reported.
Data collected Spring 1998 and Spring 2001.
Sites Glendale, Arizona
Maryvale, Arizona
Peoria, Arizona
Chinle, Arizona
Response Rate/Attrition Notes Response rate not yet available.
Additional Execution Notes Participants are divided into subgroups based on particular provisions, including the 100-hour rule, IDAs, extended TMA/TCC benefits, time-limited eligibility, family benefit cap, teen parents affected by solo unwed minor parent limitation and/or mandatory JOBS participation, and JOBS sanction at first non-compliance. Participants from both experimental and non-experimental cases will be over-recruited by 50% to achieve adequate participation.
 
Source Interview
Title Telephone interview with employers using extended TMA/TCC benefits, to examine employer-provided health care and cost and coverage of child care plans
Sample Characteristics/Data Collection Number of employers not reported.
Type of sample not reported.
Data collection schedule not reported.
Sites Not reported.
Response Rate/Attrition Notes Response rate not yet available.
Additional Execution Notes No notes reported.
 
Source Administrative data
Title Program documents, data from automated systems and statistical reports, records on public benefits, JOBS program, child support enforcement, unemployment earnings, chil care, child protective services, IDAs, and other records
Sample Characteristics/Data Collection All program participants (welfare recipients), including welfare applicants denied benefits because they were solo unwed teen parents assigned to the experimental group or they were TPEP cases with more than 100 hours per month of employment assigned to the control group.
Sites EMPOWER:
Glendale, Arizona
Maryville, Arizona
Peoria, Arizona
Chinle, Arizona
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 

Findings Available

Interim Implementation Findings
Interim Impact Findings

Findings

05/01/99: Arizona EMPOWER Welfare Reform Demonstration: Impact Study Interim Report
Interim Impact Findings:

  • EMPOWER served to increase employment among those who were TMA recipients when the reforms were first implemented.
  • EMPOWER succeeded in moving people off cash assistance and food stamps, but unintentionally reduced Medicaid rates for those receiving cash assistance when the reforms were first implemented.
  • However, the reduced participation in welfare programs was not achieved through increased employment, as the reforms had intended.
  • EMPOWER decreased the proportion of families in which unwed minors gave birth.
 
08/22/97: Arizona EMPOWER Welfare Reform Demonstration: Interim Implementation Status Report
Interim Implementation Findings:

  • The first-round site visits conducted in the fall of 1996 found that EMPOWER was being implemented largely as intended and largely in a consistent fashion across the four original research sites.
  • The most important finding regarding the implementation of EMPOWER in the original research sites is the increasingly blurred distinction in the policies that applied respectively to the experimental and control groups.
  • Another important finding regarding the implementation of EMPOWER was that the “office culture” in the four research sites had not changed since the first-round visits. That is, these offices had not implemented the “Work First” philosophy intended by Redesign.
  • Much of this has changed in the Redesign offices. The Work First philosophy is being implemented in the four Redesign offices, although not to the same degree in each of the four offices. The large centers in Phoenix are not implementing the philosophy as well as the Fort Lowell and Tempe sites. This may be due to their large size. However, communication among the three agencies (FAA, JOBS, and CCA) has been helped by the fact that the workers are all in the same location.
  • The Redesign offices are more effective in conveying to clients that they need to get out and find a job, however. The factors that are having the greatest influence in accomplishing this are the new, more stringent sanctions; fewer exemptions from mandatory participation in JOBS; and the change in the way clients are processed, from seeing an eligibility interviewer before being sent to a JOBS office, to first seeing a JOBS case manager or Job Service worker and participating in Job Search. This is the essence of the Work First policy, and it is working according to EIs, unit supervisors, and JOBS staff.
  • The Navajo reservation is an entirely separate situation. They are implementing EMPOWER and Redesign quite differently than the other sites. A major difference on the reservation is that they are exempt from the two-year time limit.
  • At the time of the site visit to the Chinle office, the JOBS workers were less likely to impose sanctions for clients who did not comply with JOBS than in the Phoenix offices. Another difference is that JOBS workers in Chinle seemed to be more genuinely concerned with clients’ needs. The reservation staff were moving toward implementing welfare reform themselves. Therefore they would not become Redesign offices similar to the Phoenix and Tucson area offices. Finally, because of the lack of jobs on the reservation, and the high unemployment rate, moving people off welfare is much more difficult there.
 
09/01/01: Arizona EMPOWER Welfare Reform Demonstration: Arizona EMPOWER Welfare Reform Demonstration: Final Report
Final Impact Findings

  • Job quality increased in the Phoenix sites, with increased percentages employed full-time, at high wages (> $7.50/hr), and at jobs providing health insurance and dental benefits. In contrast, the employment gains in the Navajo site were predominantly at lower wage jobs ($6.50 or less per hr).
  • In the Phoenix sites and Navajo site, there was reduced dependence on public benefits: cash assistance, food stamps, Medicaid, and housing assistance.
  • Total household income showed little net change between follow up months 30 and 48; reduction in monthly cash assistance and food stamp benefits offset the modest gains in income.
  • Substantial improvements have been made in the delivery of program services in local welfare offices as perceived by clients recently approved for cash assistance.
  • Clients seemed generally well informed on key program rules. Some rules however such as school attendance and child immunization requirements, appeared inadequately explained.
  • Clients reflected an awareness of the importance of finding employment, so that cash assistance could indeed be transitional. The use by clients of employee related services appeared low.
  • Personal interviews and focus group sessions with selected former recipients of cash assistance provided additional insight that, although not generalizable, were nonetheless instructive in confirming other evidence and raising other questions.
 

Recommendations

Arizona EMPOWER Welfare Reform Demonstration: Interim Implementation Status Report (08/22/97)
Recommendations not yet available.
 

Existing Publications

08/22/97 Arizona EMPOWER Welfare Reform Demonstration: Interim Implementation Status Report Abt
08/28/96 Arizona EMPOWER Welfare Reform Demonstration: Evaluation Plan Abt
05/01/99 Arizona EMPOWER Welfare Reform Demonstration: Impact Study Interim Report Abt
06/01/99 Arizona EMPOWER Welfare Reform Demonstration: Process Study Interim Report Abt
09/01/01 Arizona EMPOWER Welfare Reform Demonstration: Arizona EMPOWER Welfare Reform Demonstration: Final Report Abt
10/01/98 Arizona EMPOWER Welfare Reform Demonstration: Nonexperimental Impact Analysis Abt