Thursday, October 30, 2014

Don't Be Spooked by Evaluation




Are you suddenly panicked when you hear the word evaluation? Does the thought of having to participate in an evaluation make you feel like you’re about to star in a horror movie? Well – we are here to tell you – you don’t have to get spooked by evaluation! 

One of the most common things we hear when meeting with new clients, particularly those new to evaluation, is that they have negative perceptions of the field of evaluation. Often times we are simply called in because our clients had to have an evaluator.  Much of this fear or apprehension stems from misconceptions about the purpose of evaluation and the role of an evaluator. 
Below are some common myths we’ve heard over the years.
  •  Evaluators are here to cut our program(s)
  •  Evaluators are evil and will make us look bad
  •  Evaluators will just judge us, and the work we do
  •  Evaluation won’t tell us anything we don’t already know
The fact is there are various types and phases of evaluation, and very rarely do programs ever get cut.  For instance, in addition to conducting outcome evaluations (i.e., changes that occurred as a result of the program) we often work with organizations to conduct process evaluations that help identify how the program is/was carried out including challenges, barriers, and lessons learned. At EVALCORP we take a holistic approach to evaluation meaning that we take into account multiple factors that impact a program (e.g., like political environment, level of funding, staffing changes, etc.) to help explain outcomes achieved. 

Most evaluators aren’t there to make your lives harder but rather to work with you to assess your processes, measure what changes have resulted due to your hard work, and provide you with recommendations for getting you were you’d like to go next. So don’t be spooked by evaluation – in fact, you might even be surprised at the numerous benefits it can provide.
On that note, we wish you a Spooktacular Halloween!

Tuesday, October 21, 2014

Feeling Inspired After the AEA Conference


AEA Conference Logo
Photo From AEA Website
Hi everyone! We just came back from the annual American Evaluation Association (AEA) Conference that was held in Denver, Colorado. And boy are we newly energized and filled with inspiration! The theme this year was, “Visionary Evaluation for a Sustainable, Equitable Future” accomplished through integrating systems thinking, building relationships, and understanding sustainable and equitable living. This theme really resonated with us, as so much of what we do requires taking a systems approach to evaluation, building relationships for effective data collection and participant buy-in, and ensuring the framework will be sustainable and equitable to the often various parties involved.

We were fortunate enough to present the great work some of our clients are doing and how we’ve been able to build an evaluation framework to help support their efforts and enhance evaluation capacity for sustainability during two roundtable sessions. During the first session, we presented on Developing Comprehensive Evaluations of Complex Programs:  Prevention and Early Intervention for Mental Health, and focused on providing the audience with challenges experienced and lessons learned around developing a comprehensive large-scale evaluation plan with multiple stakeholders. Much of this included strategies for systems-level thinking, establishing a baseline of what is, how to elevate data collection to ensure all necessary metrics are captured, and ways to include key stakeholders in the process.  

Similarly, the second round table, Using Evaluation to Help Build and Sustain a HIV/AIDS and Substance Abuse Prevention Program for High Risk Young Adults, provided lessons learned around developing an evaluation framework to ensure the necessary data are collected even amid challenging circumstances. Through the development of the evaluation and the implementation of a data feedback loop with key partners, relationships were able to be developed and fostered leading to a more sustainable long-term evaluation.

Check out the link to conference at:  http://www.eval.org/p/cm/ld/fid=226

We always find the AEA conference a great way to stay current on evaluation practices and to catch up with colleagues and friends.
Did anyone else attend the conference? What did you think and what insights did you gain from the presentation(s) you attended?