Program Evaluation Toolkit for Harm Reduction Organizations

Internal Focus: Using Evaluation Data for Program Improvement

Internal Focus: Using Evaluation Data for Program Improvement

Identifying areas of program strengthening is often the primary focus of an evaluation. This is why most harm reduction program evaluations include process and outcome data. These data sets often help answer the questions: “Are we doing the right things?” and, “Are we achieving our program goal?” When programs use evaluation data to adjust how their program operates, they are using their data for program improvement. Evaluation results that are used for program improvement can help:

  • Expand the scope or reach of those elements of the program that are working well and producing desired outcomes.
  • Increase program team awareness of program accomplishments.
  • Expand capacity.
  • Identify additional service or program areas that would benefit clients.
  • Fix or deprioritize elements of the program that are not working as intended.

An internal focus typically means that your audience will be an internal audience such as staff, board of directors, etc. Sharing information with an internal audience for the purposes of program improvement means that you can be more straightforward and transparent about what is shared and how it is shared. That said, when sharing your data, it may be helpful to organize the way that it is presented to emphasize the following:

…What did we collect?
  • What did we plan to do and how?
  • What was gathering information like?
  • What data came out?
…What are we seeing?
  • What activities have been implemented to date?
  • What increases or decreases have we seen?
  • What trends have emerged?
…What does it mean?
  • Has the program led to any changes – among clients? within the organization? within the community?
…What are the implications for improvement?
  • What is important to sustain?
  • What needs to change or be altered?
  • What needs to be discontinued?
  • How and when should the improvements take place?

Sharing program evaluation data with an internal audience can be informal, but it should always be intentional and provide space for reflection, questions, and suggestions. Using Microsoft PowerPoint, Canva or Google Slides to present the results of the evaluation is a good way to not only visually capture the main elements of the evaluation results, but also celebrate your team’s accomplishments through the use of pictures and quotes.

To be successful, program improvement efforts require the full participation of all members of the program team. This is why inviting all members of this audience group in to discuss the implementation changes to strengthen the overall effort is a worthwhile strategy.

In instances where all members of your internal audience group were involved in the evaluation data collection and analysis process, consider reframing the evaluation results overview as an opportunity for reflection and brainstorming on how best to integrate program improvement measures.

Table (5.3). Sharing program evaluation data with an internal audience:

Types of data to include: Communication considerations:
  • Data that shows how the program has been operating.
  • Data that indicates whether program goals are being met.
  • Data that demonstrates impact within the community.
  • Data that highlights best practices
  • Data that shows the impact on cost
  • Can take an informal tone.
  • Should be visually appealing and factual.
  • Should be organized in a way that easily ties back to program activities and deliverables.
  • Don’t be afraid to share the good news as well as the difficult news.
  • Create opportunities for feedback, questions, and insights.
  • Create space for collective problem solving and program improvement strategy development.

“We also try to share information about evaluation findings with participants and support our participants engaging in advocacy themselves – both by providing educational support about how they can share their feedback directly with people who need to hear it and giving opportunities for them to review our presentations for educational sessions.”
—Sam Armbruster