B: Addressing Core Challenges
Policy Statement 6: Measuring Outcomes and Evaluating Impact
Recommendation B: Develop performance measures so that program administrators can continuously monitor staff performance, program components, and overall program progress.
As discussed in the introduction, another element of a process evaluation is performance measurement, a regular assessment of a re-entry program's various operations. Such an evaluation of a program's effectiveness and efficiency can enable service providers, funders, and policymakers to determine which program goals are being met and which require more attention. Performance measurement can also shed light on possible explanations for the success or failure of program participants by identifying gaps in service and program activities or management practices that require improvement.
In addition, performance measurement can help balance the need for accountability to funders and the community against providers' need for information about their participants and programs. Politicians and the general public have a vested interest in whether they have made a sound investment in a particular prisoner re-entry initiative. Gathering knowledge about program progress and outcomes enables organizations to continually measure and articulate how well given services are producing the desired result, and therefore providing real public value. With this information, managers can better develop program or agency budgets, allocate resources, and improve service provision, while funders can decide whether a particular initiative is cost-effective.
While agencies and service providers will find different uses for program measures, the following list provides some guidance for their development:
Consider specific programmatic goals. When developing measures that will determine whether a program has been successful, make sure to give careful consideration to the program's stated objectives.
Seek consensus from partners, funders, and stakeholders. Service providers and funders should reach a consensus on what measures will be used and what data should be collected.
Assess all agencies participating in the initiative. Each service provider participating in the re-entry initiative should have its own performance measures to ensure that its efforts are accurately assessed, independent of other providers.
Develop multiple performance measures for a diverse population. Many re-entry initiatives target a diverse population, and thereby can have a disparate impact on participants. In such a case, program administrators might consider presenting different performance measures for various groups of re-entering individuals.
Examine participant satisfaction. Participant satisfaction is a strong indicator of whether the complex needs of returning individuals, their families, and communities are being met.
Test program measures in a trial period. This preliminary period allows for problems to be identified and corrected. During this time, the data collected from service providers should be reviewed for accuracy, reliability, and utility. Appropriate modifications, if needed, can then be made.