Theory-based Evaluation

It is an approach that based on theory or theories that explains the issues, or programme in question. It "has similarities to the logic model but allows a much more in-depth understanding of the workings of a programe or activity - the 'programme theory' or 'programme logic' (World Bank, 2004: 10). As its name suggestes, a theory (or theories) underlying the causal relationship between outputs and outcomes and between outcomes on different levels in an outcome chain plays important roles in it. In my understanding, it is not looking directly at the ultimate outcomes, instead at one step or two steps back-ward of it (in the outcome chain or an logical framework explained by the theory). It would be easier to understand it if we discuss it with some real life examples.


Example (1)

The World Bank, in the World Development Report 2004, argues that there are four roots of the service delivery problem. Among them, the third roots cause is, according to the World Bank (2003), the lack of (or weak) incentive to the service providers. The theory states that the service delivery will be low and poor when there is no or weak incentive to the service providers. To solve this problem, the World Bank recommends establishing an effective mechanism of monitoring and holding the service providers accountable.

This theory has three parts: (1) the service delivery will be low and poor; (2) if the service providers do not have incentive to deliver (or even if they have, it is weak), (3) it can be solved by means of holding the service providers accountable through an effective mechanism of monitoring.

In applying the theory-based evaluation, the evaluators do not look at the level and quality of service delivery (which is the ultimate outcome of the programme or policy), instead it looks either at the level and quality of incentive to the service providers (one step back-ward of the outcome), or at the mechanisms of accountability that can hold the service providers accountable, or at the mechanism of monitoring (two steps back-ward of the outcome).

It should be aware that there are still other factors that affect the level and quality of service delivery. But theory-based evaluation focuses on a theory that explains about just one factor.


Example (2)
An education theory states that educational outcomes will be improved, if learner-teacher contact time is increased. Then, the first step to improve the educational outcomes is, according to the theory, to increase learner-teacher contact time. It should be noted that this is not the only determinant of education outcomes, there are also several other factors that cause the level and quanlity of economic outcome.

To evaluate the effectiveness of the intervention (aiming to improve the eduational outcomes) the theory-based evalutation approach will be used to look at effectiveness of the intervention on increasing the learner-teacher contact time (which is the first step to improve the eduational outcomes), instead of looking at the actual improvement of educational outcomes (which is the overall objective of the programme or project). 

This is what I have learnt and understood this morning. My understanding will be improved as I have read and studied more.


Reference

World Bank (2003) World Development Report 2004: Making Services Work for Poor People. Oxford: Oxford University Press. Retrieved on April 01, 2012 on http://www-wds.worldbank.org/external/default/WDSContentServer/IW3P/IB/2003/10/07/000090341_20031007150121/Rendered/PDF/268950PAPER0WDR02004.pdf.

World Bank (2004) Monitoring and Evaluation. Some tools, methods and approaches. Washington, D.C.: World Bank. Retrieved on April 19, 2012 on http://siteresources.worldbank.org/EXTEVACAPDEV/Resources/4585672-1251481378590/MandE_tools_methods_approaches.pdf