Evaluation of Development Programs : Randomized Controlled Trials or Regressions?
Can project evaluation methods be used to evaluate programs: complex interventions involving multiple activities? A program evaluation cannot be based simply on separate evaluations of its components if interactions between the activities are impor...
Main Authors: | , |
---|---|
Language: | English en_US |
Published: |
World Bank, Washington, DC
2013
|
Subjects: | |
Online Access: | http://documents.worldbank.org/curated/en/2013/09/18192682/evaluation-development-programs-randomized-controlled-trials-or-regressions-evaluation-development-programs-randomized-controlled-trials-or-regressions http://hdl.handle.net/10986/16038 |
Summary: | Can project evaluation methods be used
to evaluate programs: complex interventions involving
multiple activities? A program evaluation cannot be based
simply on separate evaluations of its components if
interactions between the activities are important. In this
paper a measure is proposed, the total program effect (TPE),
which is an extension of the average treatment effect on the
treated (ATET). It explicitly takes into account that in the
real world (with heterogeneous treatment effects) individual
treatment effects and program assignment are often
correlated. The TPE can also deal with the common situation
in which such a correlation is the result of decisions on
(intended) program participation not being taken centrally.
In this context RCTs are less suitable even for the simplest
interventions. The TPE can be estimated by applying
regression techniques to observational data from a
representative sample from the targeted population. The
approach is illustrated with an evaluation of a health
insurance program in Vietnam. |
---|