To evaluate your program success, use the logic framework that you have developed during program planning as your conceptual framework. This can allow you to break your program down into different parts, and to evaluate the relationship between them.
Using the data collected, evaluate your activity strategies and targets:
- Were your actual inputs the same as planned? What was different in practice? If the program is not carried out as designed, then it might not be reasonable to expect that the desired program objectives will be accomplished.
- Were your activities carried out as intended?
- Were there any shifts in program strategies, and for what reasons? e.g. any barriers or practical considerations.
- What, if anything, was added and/or left out, and for what reasons?
Evaluate whether the “if-then” conditional logic in your logic framework were met. This can help you identify gaps and ways to improve the program.
In your logic model, components should be linked to the next in a conditional logic “if–then” relationship:
- If you have access to resources, then you can carry out planned activities.
- If you carry out activities (inputs), then you can deliver results (outputs).
- If you have a positive effect on refugee work rights implementations, then refugee livelihoods will be strengthened and improves (outcomes).
- If refugees are capable of accessing lawful employment, then they become self-sufficient, and independent from humanitarian aid (impact).
- Did your planned work lead to the intended results? Refer to your program goals and SMART objectives for intended results.
- If your activities did not lead to your intended results, what were the barriers? What were the gaps in the “if-then” logic? For example, according to your logic framework, you might have assumed that participants will be able to seek employment (intended outcome) once they have completed vocational training (output). However, you realize that participants cannot find employers that are willing to hire them in your post-program evaluation. In such case, you might need to conduct another assessment to identify additional barriers to employment, and design new activities accordingly to tackle the new ‘gap’ in your logic framework. e.g. job matching activities or conduct employer information sessions.
Progress, Problems and Lessons Learned
For each component of the evaluation tool, record the successes, challenges experienced and lessons learnt during program implementation. What specific things that went well and not so well as a result of implementing this program? Which areas require extra attention?
Recording the successes and challenges of a program can help you to:
- Reflect on barriers, obstacles and challenges to a program presents the opportunity to make improvements.
- Record challenges and successes helps to avoid pitfalls in future implementation of similar programs, both for your organization and others that might use you program
|Components||Evaluation Questions||Successes, Challenges &
|Program Plan||Did the program follow the basic implementation plan?
If not, where did it deviate and why?
|Stakeholders||Were the stakeholders correctly defined and identified for the individual program?
Who were the stakeholders that were addressed and involved?
|Target Group||Was the target group adequate for the program?
What was the participants’ satisfaction?
|Output||What individual activities were completed?
Did more activities need to be added?
What was the output of each activity?
|Resources||Were the allocated resources sufficient?
If not, what was lacking?