Project Summary Protocol Fields and Definitions

The following protocol is used in the development of reviewed and unreviewed project summaries in the Research Forum database. Reviewed summaries include all fields shown. Unreviewed summaries use only selected fields, which are indicated in blue.

  1. General Information
  2. Populations Studied
  3. Sites Studied
  4. Program Components, Policies, and Activities
  5. Outcomes Assessed
  6. Types of Studies
  7. Data Sources
  8. Findings
  9. Recommendations
  10. Major Publications

General Information

Evaluator(s) Organization(s) or research group responsible for carrying out the study. Include acronym or abbreviated name, if any.
Investigator(s) The primary person(s) involved in the research project.
Sponsor(s) Organization responsible for overseeing the research project and with whom the evaluator has a contractual relationship. Include acronym or abbreviated name, if any, for organization.
Funder(s) Names of organizations, foundations, or agencies funding the research project.
Consultant(s) Individual or organization used provide guidance and/or advice concerning the project to the sponsor or evaluator.
Subcontractor(s) Organization(s), if any, contracted by evaluator to conduct components of the research project.
 
Domain Broad subject area in which this study may be classified. Options include:
  • Income Security/TANF
  • Child/Family
  • Community/Neighborhood
Status Current status of project. Can include:
  • Completed
  • Operational
  • Operational with Findings
  • In Development
Duration Dates when research project was begun and completed.
Type General research objective of project. Options include research/program evaluation or policy analysis
Goal Overall, broad goal of the research project.
Program/Policy Description Brief description of program or policy evaluated, if any.
Notes General comments regarding research project.
 
Last Updated Most recent date that research project was entered or updated in database.
Type of Summary Indicates whether a project is "reviewed" or "unreviewed".

Reviewed projects are selected according to specific criteria defined by Research Forum staff. Reviewed Project Summaries are prepared by Research Forum staff using a standarized protocol and, except where noted otherwise, approved by an appropriate project contact person. Unreviewed projects are those that either were entered by web site users using the Add A Project Form or did not meet the Research Forum's criteria for Reviewed Projects. A subset of these projects will be considered for detailed review if they are large-scale or multi-site and conducted by organizations with experience relevant to the income sercurity/TANF domain.
External Reveiwer(s) Person in organization who reviewed database entry.
Contact(s) Person in organization who will provide additional information about the project.
Publications Department Information about the evaluating organization's publications department.
Submitter(s) Indicates the name of the person or group who submitted the project to the Forum database (unreviewed projects only)

Populations Studied

Target Population Provides a list of the target populations studied. Options include:
  • Adolescents
  • Applicants
  • Caseworkers/Managers
  • Child care providers
  • Child-only cases
  • Children
  • Children younger than 1 (infants)
  • Domestic violence victims
  • Employers
  • Fathers
  • Federal government
  • Former recipients ("leavers")
  • Foster care candidates/participants
  • General population
  • Immigrants
  • Local government
  • Low-income households
  • Minority Populations
  • Native Americans
  • Neighborhood key informants
  • Neighborhood-based organizations
  • Neighborhoods
  • Non-custodial parents
  • Other
  • Persons diverted from welfare
  • Persons with mental/physical health problems
  • Persons with substance abuse problems
  • Pregnant/parenting teens
  • Recipients/participants/clients
  • Rural Populations
  • Single parent families
  • Social/Community service agencies
  • Teachers
  • Two-parent families
Subgroups Analyzed Provides a list of the subgroups studied. Options include:
  • Applicants
  • Caseworkers/managers/administrators
  • Child care providers
  • Child-only cases
  • Children 1-6
  • Children 7-18
  • Children in Foster Care
  • Children younger than 1 (infants)
  • Domestic violence victims
  • Employers
  • Fathers
  • Federal government
  • Former recipients ("leavers")
  • General population
  • Housing Assistance Recipients
  • Immigrants
  • Local government
  • Low-income households
  • Low-wage workers
  • Minority populations
  • Native Americans
  • Neighborhood key informants
  • Neighborhood-based community organizations
  • Neighborhoods
  • Non-custodial parents
  • None
  • Other
  • Persons diverted from welfare
  • Persons with mental/physical health problems
  • Persons with substance abuse problems
  • Pregnant/parenting teens
  • Recipients/participants/clients
  • Rural Populations
  • Single parent families
  • Social/Community service agencies
  • Teachers
  • Two-parent families
Sample Size and Unit Information about the primary population studied in the project. Includes sampling method (how individuals were selected), total number in sample, and population characteristics.

If project includes an impact study, the total number of individuals in the program/experimental and comparison/control groups. Include sampling method (how individuals were selected).

Sites Studied

Sites Studied Areas in which project is carried out. Specify city, county, and state. For counties, largest city may be added in parentheses.

Program Components, Policies, and Activities Evaluated

Program Components, Policies and Activities evaluated Specific program, policy or activities evaluated.

Options include:
  • Educational activities Adult Basic Education (ABE) courses
    English as a Second Language (ESL)
    GED courses
    High school completion
    Post-secondary education
    School readiness activities
    Educational Activities - misc.
    Literacy education
    Early Childhood Education (e.g. Head Start)
    Parent groups/classes


  • Financial incentives Cash bonus for program completion
    Earnings disregards
    Earnings supplements/work subsidies
    Elimination of 100 hour rule
    Excluding the value of one vehicle
    Coverage for work-related expenses
    Increased asset limit
    Individual Development Account (IDA)
    Increase in income benefits for program enrollment
    Increase in income benefits for program participation
    Tax reduction/rebate (e.g. Earned Income Tax Credit)
    Transitional income benefits
    Lower benefit reduction rate
    Deductions for business investments leading to self-employment
    Direct payment of rent to recipient (not landlord)
    Utility allowance
    Shelter allowance
    Financial Incentives - misc.
    Higher base grant


  • Food stamps Cash out
    Work requirements
    Simplified program
    Food Stamps - misc.


  • Administration/Implementation Changes in welfare office environment/culture
    Simplification of program rules and procedures
    Development of partnerships with private organizations
    Program enforcement of sanctions
    Development of new welfare policies
    Administration/Implementation - misc.
    Development of partnerships with city, state, and local governments


  • Social/Support services Child care
    Transitional child care
    Health benefits
    Transitional health benefits
    Transportation
    Case management
    Employment support for job retention
    Multiple services in single location
    Life Skills and Opportunities Classes (LSO)
    Parenting classes/training
    Family planning education and services
    Counseling
    Enhanced social and health services
    Substance abuse/dependence treatment
    Social/Support Services - misc.
    Child protection agencies
    Community/social services
    Treatment for problems such as domestic violence or mental health
    Home visits
    Child development centers
    Access to computer lab
    Access to family service workers
    Budgeting assistance
    Coaching in community centers
    Community service exchange program
    Emergency financial/material assistance
    Expanded hours in community centers
    Peer support sessions
    Referrals to other service organizations


  • Diversionary activities Diversionary activities - misc.


  • Eligibility Eligibility - misc.


  • Employment activities
    Educational activities
    Financial incentives
    Financial disincentives/Sanctions
    Program requirements
    Time limits
    Family caps
    Eligibility
    Child support
    Food stamps
    Social/Support services
    Administration/Implementation
    Other
    Diversionary activities
    Post-Program activities
    Foster Care Services
    Housing


  • Family caps Family Caps - misc.


  • Foster Care Services Foster Care Services - misc.


  • Employment activities Job skills training
    Job readiness activities
    Job search
    Job placement
    On the job training
    Work supplementation programs
    Job development
    Micro-business development
    Self-employment
    Career transition centers
    Employment policies linked to treatment
    Employment Activities - misc.


  • Post-Program activities Post-Program Activities- misc.


  • Financial disincentives/Sanctions Reduced benefits for non-compliance
    Strengthened JOBS sanctions
    Multi-program sanctions
    Lower basic benefit level
    Denial of benefits to persons convicted of felonies
    Reduction/termination of benefits for substance abuse
    Financial Disincentives/Sanctions - misc.


  • Housing Section 8 voucher program
    Other housing assistance program (e.g. no-interest loans)
    Housing - misc.


  • Child support Support paid directly to parent
    Increased efficiency in collection
    Child support - misc.
    Services to non-custodial parents


  • Time limits Time Limits - misc.


  • Other To Be Determined
    Not Applicable


  • Program requirements Work requirement
    Community or alternative work
    Child support order
    Enrollment in substance abuse program
    Mandatory JOBS for younger teens
    Parenting or social contract
    Paternity identification
    School attendance
    Living arrangements for unwed pregnant or parenting minors
    Workshop attendance
    Immunizations for children
    Broadened JOBS participation requirement
    Drug testing
    Program Requirements - misc.


Variation in program components across sites? Indicates if there is variation in the program components across research sites within a single project.
Notes on program components Specific information about program components evaluated, such as number of months for time limits and dollar amounts for financial incentives/disincentives.

Outcomes Assessed

Outcomes Assessed The primary dependent variable, i.e., what the study seeks to explain.

Options include:
  • Attitudes towards work, welfare, and program
    Benefit termination
    Education
    Employment
    Family and relationship outcomes
    Financial costs and benefits/cost-effectiveness
    Housing
    Income security
    Program implementation
    Sanctions
    Service utilization
    Standard of living
    Substance abuse
    Compliance with federal requirements
    Policy changes
    Adult outcomes
    Caseload Dynamics
    Child Outcomes
    Community Outcomes


  • Attitudes towards work, welfare, and program Attitudes towards work, welfare, and program - misc.


  • Child Outcomes Child social/emotional/behavioral outcomes
    Child cognitive (attention, problem solving, memory, language, and vocabulary) outcomes
    Child academic outcomes
    Child overall development
    Child mental/physical health outcomes
    Child outcomes - misc.


  • Income security Child support payments
    Earnings
    Food stamps receipt
    Medicaid receipt
    Welfare receipt
    Income security - misc.
    Welfare application rates
    Overall income
    Unemployment Insurance (UI) receipt


  • Community Outcomes Community economic development (e.g. labor market outcomes)
    Community Outcomes - misc.
    Community interpersonal relationships (“neighborhood effects”)
    Community poverty rates
    Community safety (e.g. crime rates and/or general perceptions of safety)
    Distribution of community services (equity)
    Reaction of low-poverty neighborhoods to entry of high-poverty voucher recipients
    School quality (e.g. SAT scores)


  • Compliance with federal requirements Data reporting requirements
    Compliance with federal requirements - misc.


  • Benefit termination Due to employment
    Due to marriage
    Due to time limit
    Due to sanctions
    Due to substance abuse
    Due to employer-provided health insurance
    Due to - misc.
    Benefit Termination-misc.


  • Adult outcomes Emotional well-being
    Health/ physical well-being (including prenatal health)
    Social functioning/social relationships
    Planning for future
    Adult outcomes - misc.


  • Emotional well-being Emotional well-being - misc.


  • Caseload Dynamics Entry effects
    Exit effects
    Caseload dynamics - misc.
    Recidivism


  • Entry effects Entry effects - misc.


  • Exit effects Exit effects-misc.


  • Financial costs and benefits/cost-effectiveness Financial costs and benefits/cost-effectiveness - misc.


  • Health/ physical well-being (including prenatal health) Health/ physical well-being - misc.


  • Education High school graduation/GED receipt
    School attendance
    Adult literacy levels
    Education - misc.


  • Employment Job readiness/training
    Job attainment
    Job retention
    Job promotion
    Number of hours worked for wages
    Job creation
    Employment - misc.
    Community service
    Wage-based community jobs
    Workfare


  • Substance abuse Patterns and severity of substance use
    Legal problems related to substance use
    Substance abuse - misc.


  • Policy changes Policy changes-misc.


  • Program implementation Program Implementation - misc.
    City-State relations
    Volunteer sector actions
    Capacity of management systems to meet priorities


  • Housing Residential mobility
    Homelessness
    Housing - misc.
    Home ownership


  • Sanctions Sanctions - misc.


  • Service utilization Service utilization - misc.


  • Standard of living Standard of living - misc.


  • Family and relationship outcomes Violence in family or other relationships (child abuse and neglect)
    Births/pregnancies
    Fatherhood
    Parent-child interactions
    Family formation and stability/Living arrangements
    Foster care
    Family and relationship outcomes - misc.
    Adoption
    Parenting attitudes
    Parenting skills
    Kinship care


Study Types

Type Type of study conducted within the research project. Can include:
  • Cost/Benefit Study
    Designed to estimate the cost of a program or intervention. Can include cost-effectiveness and efficiency analyses.
  • Impact Study
    Designed to estimate whether or not interventions/programs produce their intended effects.

    Types of Impact Studies include:
    • Controlled experiment:

      Impact study with random assignment to intervention and control groups.
    • Quasi-experiment with non-equivalent groups:

      Impact study with non-random assignment to comparison group.
    • Quasi-experiment with pre/post time series:

      Impact study with assessments made before and after an intervention or participation in activities.
  • Implementation/Process Study
    Designed to examine day-to-day operation of program, program coverage, delivery of services.
  • Descriptive/Analytical Study:
    Designed to report on variations in program content, concomitants, and possible consequences, across time, locations or persons. Can include hypothesis-generating, exploratory, explanatory, comparative, or trend analysis studies.
  • Longitudinal/Prospective Study:
    Designed to follow populations across periods of time.
Aim The descriptive aims or hypotheses of each type of study.

Data Sources

Source The means of gathering information, such as:
  • Survey
  • Interview
  • Focus group
  • Case study
  • Field Research
  • Developmental assessments/screenings (e.g. Bailey)
  • Observation of child interactions
  • Administrative Data (Aggregate level data of transactions)
  • Program descriptions and documents
  • Secondary data
  • Other
Title Include the following information in regards to a particular data source
  • Sample size, Populations studied and Population characteristics (or Number of records, for administrative data)
    • Sample size:
      Number of persons/institutions/records fielded - give total N, Ns for subgroups, if any.
    • Unit of observation:
      Group to which generalizations are to be made.
    • Records
    • Population Characteristics:
  • Descriptive information about populations studied, if different than "total population studied".
  • Type of sample and sample sizes and populations for program and control groups (if applicable)
    • Type of sample:
      Sampling method or type.
  • Data collection schedule
    Information about time frame for obtaining information using data source.
Sites Site(s) of data collection for particular data source.
Response Rate/Attrition Notes Attrition rate reported by the principle investigator(s), if available, and any available information about the numerator and denominator used to calculate this rate.

Response rate reported by principle investigator(s), if available. Includes the number and characteristics of units/persons in the denominator (i.e., those deemed eligible for inclusion) and the numerator (I.e., those from whom data were obtained), if available.
Execution notes Notes on issues related to adequacy of data (e.g., determination of eligibility, completeness of interview data, success in matching administrative records, reliability and validity of measurements). (Unreviewed projects only)

Findings

Findings Available Lists the types of findings currently available.
Findings Description of major findings, including citation to source, type of study described by the finding (if noted), and type of finding (interim or final).

Recommendations

Recommendations Major recommendations suggested by evaluators, including citation to source.

Major Publications

Existing Publications Major publications related to project, including dates available (if noted).
Forthcoming Publications Forthcoming publications related to project, including dates available (if noted).