ArticlePDF Available

Abstract and Figures

Although frequently discussed in the evaluation literature and general agreement on what a theory of change is conceptually, there is actually little agreement beyond the big picture of just what a theory of change comprises, what does it show, how it can be represented and how it can be used. This article outlines models for theories of change and their development that have proven quite useful for both straightforward and more complex interventions. The models are intuitive, flexible, well-defined in terms of their components and link directly to rigorous models of causality. The models provide a structured framework for developing a theory of change and analysing the intervention it represents
Content may be subject to copyright.
Useful Theory of Change Models
John Mayne
Ottawa, Ontario
Abstract: Although theories of change are frequently discussed in the evaluation
literature and there is general agreement on what a theory of change is conceptually,
there is actually little agreement beyond the big picture of just what a theory of change
comprises, what it shows, how it can be represented, and how it can be used.  is
article outlines models for theories of change and their development that have proven
quite useful for both straightforward and more complex interventions.  e models
are intuitive,  exible, and well-de ned in terms of their components, and they link
directly to rigorous models of causality.  e models provide a structured framework
for developing useful theories of change and analyzing the intervention they represent.
Keywords: causal links, complex intervention, impact pathways, logic model, results
chain, theory of change, theory of reach
Résumé: Bien que les théories du changement soient souvent débattues dans la
littérature portant sur l’évaluation et qu’il y ait un consensus sur ce qu’est, concep-
tuellement, la théorie du changement, il n’y a, en réalité, aucun accord au-delà de
la dé nition générale de ce que la théorie du changement comprend, de ce qu’elle
démontre ainsi que de la manière dont elle peut être représentée et utilisée. Cet article
donne un aperçu de modèles de théories du changement, ainsi que leur développe-
ment, lesquels se sont montrés très utiles lors d’interventions tant simples que com-
plexes. Les modèles sont intuitifs,  exibles et bien dé nis en matière de composantes.
De plus, ils sont liés à de rigoureux modèles de causalité. Les modèles fournissent un
cadre structuré au développement de théories du changement utiles et à l’analyse de
l’intervention qu’ils représentent.
Mots clés: liens de causalité, intervention complexe, cheminement d’impact, modèle
de logique, chaîne des résultats, théorie du changement, théorie de la portée
Models depicting how interventions are meant to work are frequently discussed
and used in evaluation. See, for example, Patton (2008) ; Chen (2015) ; Rossi,
Lipsey, and Freeman (2004) ; Morra Imas and Rist (2009) ; and Funnell and Rog-
ers (2011) . Some of the earlier discussions are by Suchman (1967) and Bick-
man (1987) . However, the terms used to describe these models vary widely,
and include program theory , logic model , theory of change , results chain , out-
come pathway , action theory , implementation theory , and more, with no general
© 2015 Canadian Journal of Program Evaluation / La Revue canadienne d'évaluation de programme
30.2 (Fall / automne), 119–142 doi: 10.3138/cjpe.230
Corresponding author: John Mayne, john.mayne@rogers.com
120 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
agreement on terms or meaning. Funnell and Rogers (2011 , pp. 15–34) discuss
the range of terms used for these models and their histories, as does Patton (2008 ,
pp. 336–340).
I will be using the term theory of change . eories of change have a wide range
of possible uses in developing, managing, and evaluating interventions. Mayne
and Johnson (2015) discuss using theories of change in
Designing/planning interventions
1. Designing interventions
2. Understanding and agreeing on interventions with stakeholders
3. Identifying and addressing equity, gender, and empowerment issues
4. Ex ante evaluation of proposed interventions
Managing interventions
5. Designing monitoring systems
6. Understanding implementation, managing adaptively, and learning
Assessing interventions
7. Designing evaluation questions, methods, and tools
8. Making causal claims about impact
9. Reporting performance
Scaling
10. Generalizing to the theory, to other locations and for scaling up and out.
In Part 5 of their book, Funnell and Rogers (2011) discuss using theories
of change (program theories) in monitoring and evaluation and offer many
examples. Some good examples of using theories of change, especially in a
planning and designing mode, can be found in Johnson, Guedenet, and Saltz-
man (2014) .
e use of theories of change has been reviewed by James (2011) , Vogel
(2012b) , and Stein and Valters (2012) , who all note that while there is general
agreement on the big picture about theories of change—models depicting how
interventions are supposed to work—there is a proliferation of di erent inter-
pretations of just what in practice a theory of change entails, how to develop one,
and how to depict it.
is article presents and describes a robust and useful model for theories of
change for simple and more complex interventions. It  rst outlines a basic generic
theory of change, followed by a discussion of causation in relation to theories of
change. Models for more complex multifaceted interventions are then presented,
along with a discussion of nested theories of change.  e article discusses three
possible useful versions of a theory of change, discusses simplifying the models,
and o ers a few comments about building theories of change. It concludes by
summarizing why the models discussed are useful.
Useful Theory of Change Models 121
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
THEORIES OF CHANGE AND IMPACT PATHWAYS
Let me  rst de ne a few key terms.  e term results is used to include outputs,
outcomes, and impacts, where impacts are the  nal outcomes a ecting well-being.
e term intervention is used here to describe speci c activities undertaken to
make a positive di erence in outcomes and impacts of interest. It covers policies,
programs, and projects.
To understand how and if an intervention is working, we need to understand
how the activities of the intervention are expected to lead to the desired results—
both (a) the causal pathway from activities to outputs to a sequence of outcomes
to impacts and (b) the causal assumptions showing why and under what condi-
tions the various links in the causal pathway are expected to work. A variety of
terms are used in the literature to describe the causal pathways, including results
chains, logic models,
1 and impact pathways. I will use the term impact pathways.
Impact pathways describe causal pathways showing the linkages between the
sequence of steps in getting from activities to impact. A theory of change adds
to an impact pathway by describing the causal assumptions behind the links in
the pathway—what has to happen for the causal linkages to be realized. Patton
(2008 , p. 336) makes the same distinction between logic models and theories of
change: “Specifying the causal mechanisms transforms a logic model into a theory
of change. Chen (2015) , in Chapter 3, makes a similar distinction.  eories of
change are models of how change is expected to happen ( ex ante case) or how
change has happened ( ex post case).
ere are many ways to depict impact pathways and theories of change.
Funnell and Rogers (2011) illustrate the broad range. Figure 1 illustrates a basic
generic theory of change that has proven useful in several settings.  e sequence
of boxes in the  gure is the associated impact pathway (the results chain), which
is discussed  rst. Figure 1 is a further re nement and improvement of the theory
of change model discussed in Mayne (2014) .
2
Components of an Impact Pathway
Bene ciaries are the target groups whose well-being the intervention intends to
improve.  ese groups might be segmented by income, gender, ethnicity, and/or
geographical area. Consider as an example an intervention aimed at improving
the nutritional diets of children; the children are the intended bene ciaries. Note
that the target groups could include organizations.
In the theory of change model, the activities and results (o en labelled as
outputs, outcomes, and impacts) are depicted in the boxes:
Activities are actions undertaken by those involved in the intervention.
Goods and services produced are the direct outputs resulting from the
activities undertaken. In the nutrition example mentioned above, these
might be the innovative education and training material on the bene ts
of a nutritious diet. In this article, the term output is used to refer to t hese
direct goods and services.
122 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Behaviour changes
Goods & services
produced (outputs)
External
influences
Capacity changes in
knowledge, attitudes,
aspirations, skills, &
opportunities
Reach &
reaction
Direct
benefits
Direct benefits
assumptions
Behaviour change
assumptions
Capacity change
assumptions
Reach
assumptions
Well-being
changes
Well-being change
assumptions
Activities
Timeline
Unanticipated
results
Figure 1. A Basic Generic Theory of Change
Reach and reaction are the target groups who are intended to receive
the intervention’s goods and services and their initial reaction. In the
nutrition example, the reach group would be mothers with children
in some geographical region. Reach is important to include as a com-
ponent in causal pathways. As has been argued, “A lack of explicit
thinking about reach in logic models can lead to problems such as
narrow/constricted understanding of impact chains, favoring of ‘nar-
row and efficient’ initiatives over ‘wide and engaging’ initiatives and
biased thinking against equity considerations” ( Montague & Porte-
ous, 2013 , p. 177). I have discussed the usefulness of including reach
in Mayne (2014) .
Capacity changes are the changes in knowledge, attitudes, skills, as-
pirations, and opportunities of those who have received or used the
Useful Theory of Change Models 123
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
intervention’s goods and services. As discussed later, all of these changes
are needed for new action to be taken.
3
Behavioural changes are the changes in actual practices that occur, that is,
those in the target reach group do things di erently or use the intervention
products. In our example, this could be the changes in feeding practices of
mothers that occur as a result of the improved knowledge from the train-
ing.  ere typically is feedback between capacity and behavioural changes
(such as with acquiring new knowledge and skills by doing).
Direct bene ts are the improvements in the state of individual bene -
ciaries.  ese could be such things as increased income, increased use
of health services, more productive farming, more empowerment, or, in
the example, children consuming a more nutritious diet.
Well-being 4 changes are the longer-term cumulative improvement in
overall well-being of individual bene ciaries, such as better health,
reduced poverty, and better food security. In our example, the improved
diet would contribute to better nutritional and health status.
Note that the causal pathway model in Figure 1 explicitly does not label
the sequence of results as immediate, intermediate, and  nal outcomes (or
impacts)—a much more frequently used model, although these labels could be
added. Because these commonly used terms have little intuitive meaning, on their
own they do not provide much guidance in setting out an impact pathway and,
if used, the result is o en wasted debate about, for example, whether a result is
an immediate or an intermediate outcome. And while I had thought that outputs
was a well-de ned (as I de ne above) and widely accepted term, the recent United
Nations Development Group handbook (2011) confuses that term as well, de n-
ing outputs as goods and services or capacity changes. I am arguing that Figure1
is a more useful representation of an impact pathway than the more common
outcomes-based generic model.
External in uences are events and conditions unrelated to the intervention
that could contribute to the realization of the intended results.  ese could include
other interventions with similar aims, and/or general economic or social trends.
ey are not part of the intervention theory of change per se. For example, in the
nutrition example, a reduction of the price of vegetables could also account for a
portion of an increase in vegetable consumption that is unrelated to the training
intervention. Industrial forti cation of foods such as sugar or  our could also
contribute to explaining an improvement in micronutrient status.
Figure 1 includes unintended e ects : positive or—more usually—negative
unanticipated e ects that occur as a result of the interventions activities and
results. If these are known possibilities they should be noted. Ex post, unantici-
pated e ects should be actively looked for. Note also that although Figure 1 looks
linear, it explicitly allows for nonlinearity via the feedback between the various
stages. Figure 1 also illustrates a timeline of when the anticipated changes can
be expected to occur. Timelines even with rough dates are useful addition to
impact pathways.
124 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
From an Impact Pathway to a Theory of Change
In developing a theory of change, the  rst step is to develop the impact path-
way. But an impact pathway, results chain, or a logic model is not a theory of
change. Only when we add the assumptions to the causal links in the impact
pathway do we get a theory of change.  e causal link assumptions shown in the
dotted boxes in Figure 1 identify what salient events and conditions have to oc-
cur for each link in the causal pathway to work as expected. What is necessary
for the causal link to work? What factors are critical to these causal processes?
For practical reasons, we only need to consider salient assumptions , that is,
those that stand out for some reason, that are striking and relevant to the situ-
ation. Others, such as the sun rising each day or a revolution not occurring,
are not relevant—although ex post, a revolution would easily explain why the
intervention did not work! Articulating causal link assumptions would entail
a mix of prior evidence, stakeholder experience, and social science theory. For
example, an assumption in the child nutrition example would be that husbands
and mothers-in-law are supportive about what children eat, letting mothers
make those decisions.
ese causal link assumptions cover all the risks associated with the causal
link; each of the assumptions is a risk to the realization of the ToC.
5 In the nutri-
tion example, risks concerning the availability and a ordability of nutritious
food would be captured by an assumption that nutritious food is available and
a ordable.
Reach assumptions : e assumptions are the events and conditions
needed to occur if the outputs delivered are to reach and be positively
received by the reach groups.  ese could include such things as that
the delivery of outputs actually reaches the intended audience and the
outputs are seen as acceptable and worth considering. A key risk here is
that the reach group is not the “right” group, as in the case of the child
nutrition intervention directed at mothers when they do not in fact
make decisions about who gets what food, as well as actually reaching
all of the intended target group and not, for example, just those who
self-select.
Capacity change assumptions : ese assumptions are the events that
need to occur and the conditions that need to change if the outputs that
reachthe target populations are to result in changes in their knowledge,
attitudes, skills, aspirations, and opportunities, that is, their capacity
to do things di erently. ese could include such things as the outputs
being understood, realistic, culturally acceptable, seen as useful, com-
mensurate with the prior abilities and values of the target population,
seen as relevant to the reach group, and so on.
Behaviour change assumptions : ese assumptions are the events and
conditions needed to occur if the changes in the capacities of the target
groups are to result in actual changes in their practices.  ese could
Useful Theory of Change Models 125
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
include such things as  nancial capacity to make the practice changes,
acceptance by others (such as peers, social, cultural and religious leaders,
family) to make the changes, the practice changes shown to be useful,
the policy or natural environment allowing the practices to be adopted,
access to needed assets and supplies, and so on.
Direct bene ts assumptions : ese assumptions are the events and con-
ditions needed to occur if the practice changes are to be realized as a
direct bene t to the conditions of the targeted bene ciaries.  ese could
include such things as change practices result in a net increase in income,
routine use of health services, involvement in decision-making, and so
on. In the nutrition example, there may be an assumption that the only
change in the diet is the one recommended by the training program. If
the improved practices (e.g., more vegetables) are incorporated but then
other foods are reduced, the expected bene t may not occur.
Well-being change assumptions : e assumptions are the events and
conditions that need to occur if the direct bene ts are going to lead to
changes in the well-being of the bene ciaries. For example, if children
consume a better diet and if they have access to basic health care and
improved sanitation, they will improve their nutritional and health sta-
tus. If as a result of the intervention women begin to play a greater role
in food consumption decisions and if the intervention is seen as success-
ful, this could contribute to a change in gender norms that empowers
women.
Note that these causal link assumptions are not descriptions of the causal link.
A description of a causal link in Figure 1 (the solid arrows) would be, for exam-
ple, that the changes in knowledge skills and so on (capacity) will result in the
expected behaviour changes in actual practices. Causal link assumptions explain
how and why the causal link works.
Bringing about changes in behaviour can be quite challenging and has been
the subject of much research. Darnton (2008) reviews much of this literature.
A typical model is the NOA (needs, opportunities, and abilities) model in
Gatersleben and Vlek (1998) . It posits that behaviour change is brought about
by motivation and behaviour control (agency). In turn, motivation results
from needs and opportunities, and agency from opportunities and abilities.
All these elements are captured in the generic theory of change (knowledge,
skills, aspirations, attitudes, and opportunities) with di erent terms, albeit not
in as much causal detail. But the research suggests that the causal package for
behaviour change needs to include each of these components. Some are what
the intervention aims to change in terms of capacity. Others would be captured
as relevant in the behaviour change causal link assumptions. In the nutrition
example, it can be safely assumed that mothers do want to improve the health
of their children (motivation) and that the intervention aims to provide the
opportunities and abilities.
126 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
It can be useful to recognize two di erent types of capacity and behavioural
changes.  e rst are incremental or additional changes to the current state,
such as learning new techniques and skills or adopting new practices.  ese are
relatively easier to bring about than more fundamental changes , such as think-
ing about problems di erently or changing current practices. In the nutrition
example, if what is required is acquiring new food products for children, this is
an additional practice that is relatively straightforward. On the other hand, if the
practice change required is a redistribution of food among household members,
then this changes how food was distributed previously and raises power issues.
It is a fundamental change and likely considerably more di cult to bring about;
thus the associated causal link assumptions would need to be more robust and
challenging.
e discussion so far has been in deterministic terms (e.g., an assumption
is either necessary or it is not). However, we may want to re ect the probabil-
istic nature of causality. Mahoney (2008 , p. 421) argues that “a treatment is a
cause when its presence raises the probability of an outcome occurring in any
given case.” He introduces the useful ideas of probabilistically necessary causes—
“factors that usually or almost always have to be present for the outcome to
occur”—and probabilistically su cient causes—“a cause that much of the time
on its own will produce the e ect” (pp. 425–426). For many interventions being
evaluated, these are more realistic interpretations of necessity and su ciency.
us the causal link assumptions can be thought of as likely necessary assump-
tions, events and conditions that almost always have to occur for the causal link
to work.
Setting out assumptions for a theory of change can be confusing because
there are di erent types of assumptions associated with an intervention. In par-
ticular, in addition to the causal link assumptions discussed above, there are also
rationale assumptions that identify the underlying hypothesis or premise on which
the intervention is founded, such as the assumption that informing household
decision-makers about the bene ts of nutrition for their children will change
their behaviour and result in children getting a better diet. It would be expected
that the rationale for most interventions would be based on some prior evidence
and experience.
Figure 2 sets out the theory of change for the nutrition example.
6 A l t h o u g h
the nutrition example is not based on an actual case, see White (2009) for a discus-
sion of just such an intervention in Bangladesh.
I am arguing that in most interventions each of these components of the
generic theory of change—activities, outputs, capacity changes, behavioural
changes, direct bene ts, and well-being change, along with the associated causal
link assumptions—can be, and should be, identi ed and thought through when
developing impact pathways and theories of change.  e structure of the model
forces one to consider just how it is expected that the intended results will be
brought about: What is the causal process at work and what does it take to make
it happen? e model is a framework for analyzing how an intervention works.
Useful Theory of Change Models 127
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
THEORIES OF CHANGE AND CAUSAL PACKAGES
eories of change represent how and why it is expected that an intervention will
contribute to an intended result. But it is clear that rather more than the inter-
vention activities are needed; also needed is the realization of the causal assump-
tions.  e intervention activities are rarely the sole cause of a result.  e theory
of change depicts a causal package of activities plus assumptions that together
are expected—are su cient—to contribute to the intended results. Cartwright
and Hardie (2012) call these assumptions support factors : events and conditions
needed to bring about a contribution to the e ect of a cause.  e expectation is
also that the intervention activities in particular are an essential—a necessary—
part of this su cient causal package.  at is, without the intervention activities,
realization of the causal link assumptions would not be su cient to make a
contribution.  e intervention activities can then be said to be a contributory
Figure 2. A Nutrition Intervention Theory of Change
Mothers adopt
new feeding
practices
Innovative workshops
and information
External influences
Lower prices for food
Other staples become
more nutritious
Mothers acquire new
knowledge about
nutrition benefits and
feeding practices
Mothers reached
Children
consume a more
nutritious diet
Capacity change assumptions
Nutrition beneits understood
Feeding practices understood
and relevant
Reach assumptions
Targeted mothers with young
children reached
Approach & material seem
appropriate
Children’s
nutrition status &
health improve
Training & informing
on nutrition benefits &
feeding practices
Timeline
Unanticipated
results
Mothers become
more empowered
Husbands become
resentful
Behavioural change assumptions
Mothers want to improve the
health of their children
Mothers make decisions about
children’s food
New practices supported by
husbands and mothers-in-law
Nutritious food available and
affordable
Direct benefits assumptions
Practices prove practical
No reduction in other nutritious
food intake
Well-being change assumptions
Children have access to health
care
r
oth
r
s
a
o
M
o
do
n
s
s
&
r
a
m
u
n
e
d
i
n
g
p
r
a
c
th
o
n
M
ot
he
o
g
d
a
a
d
Nested Theory
of Reach for
Mothers
p
t
the
ot
th
Ch
n
u
Nested
Theories of
Reach for Girls
& Boys
128 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
cause to the results. In these terms, a theory of change is a model of the interven-
tion as a contributory cause ; it is a model of the causal package showing just how
the contribution to the results are to be brought about. Mayne (2012) discusses
contributory causes and causal packages in the context of theories of causation,
and in particular INUS causes.
7
e theory of change is a model of the contribution to and not cause per
se of the intended result, because there may be other external factors also con-
tributing to the intended results, as noted in the external in uences box. Only
if there are no external in uences at work is the theory of change a model of
causation. As with an intervention, an external in uence usually does work just
on its own, but rather as part of another causal package that might include some
of the supporting factors in the intervention causal package. External in uences
can have positive or negative e ects on the level of results attained. Depending
on the strengths of the intervention, the external in uences may explain some
or all of the observed results. Signi cant negative e ects, that is, risks that could
undermine the intervention’s theory of change, are included in the causal link
assumptions.
In probabilistic terms, we can speak of likely su cient to describe the suf-
ciency of the intervention causal package, meaning that, in this case, the causal
package most likely produced a contribution to the observed result. To show that
the intervention is a contributory cause is to show that the interventions causal
package is likely su cient, and that the intervention is itself a likely necessary
element of the su cient package.
In discussing theories of change, it is useful to distinguish the ex ante from
the ex post case . Ex ante, there is a need to speak of probabilistic causes and likely
su ciency. Ex ante, one has a postulated or prior theory of change setting out the
argument that if the intervention is implemented as designed and if the assump-
tions associated with the ToC hold, then the intended contribution to the results
will be realized. It sets forth the assumed reality and complexity of the interven-
tion. It is a prediction of e ectiveness.
Ex post, you are verifying that the theory of change did occur with evidence
on the results and assumptions that were realized. When you make a causal claim,
you know which factors were at work and whether something in addition was at
play. If you conclude that the package was likely su cient, here it means that you
recognize that you may have missed something in your analysis, but that reason-
able people would conclude that the causal package was indeed su cient. Ex post
you are testing the ex ante causal hypothesis. As noted, ex post you are likely to be
able to identify if there were other external in uences at work. If there were none,
then the intervention causal package can be said to have caused the observed
result, not just contributed to it.
e intervention itself is one among several causal factors in the causal pack-
age necessary to bring about change. In that sense, all are equal. Yet our interest
is on the intervention as an instrument of change—activities deliberately done
to get or continue change happening where adequate change was not happening
Useful Theory of Change Models 129
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
before. We can ask ex post what role the intervention played in bringing about the
changes. We may expect that at a minimum the intervention acts as a trigger to
start the causal chain. In such cases, an intervention can be said to be a principal
contributory cause. In other cases, the intervention might see itself as playing
a more modest supporting role, joining others in an already ongoing process,
enhancing a change process already underway so that better or more timely results
are achieved ( Mayne, 2008 ).
MULTIFACETED SUFFICIENT INTERVENTIONS
Although there is a lot in Figure 1 , it was referred to as a “basic” generic theory
of change.  is is because it only shows one actor undertaking activities, and the
model may su ce for many straightforward interventions. But for many, more
complicated interventions, this is generally not the case. To make a di erence, an
intervention needs to engage and work with a variety of other intermediaries—
delivery partners, governments, the private sector, and NGOs—and in uence
their behaviour.  e theory of change shown in Figure 1 identi es a possibly
wide range of causal link assumptions that need to occur if the direct bene ts
and well-being changes are to be realized. Leaving these to chance may not be an
option, and the intervention should work with relevant intermediaries, including
delivery partners, to try to make sure that the intermediaries undertake actions
to ensure (or go a long way to ensuring) that the numerous causal link assump-
tions are brought about.  ese supporting activities carried out by the intervention
actors are in addition to its main or core activities. We can thus speak of the core
intervention and the overall intervention . In an agriculture research for develop-
ment intervention, the core intervention is the research activities, while those
plus engagement supporting activities that are carried out to get the research
used constitute the overall intervention. In other cases, there are no identi able
core or main activities, and the intervention works with a variety of partners to
collectively deliver a su cient set of activities.
Typically, these causal link assumptions can cover a range of events or condi-
tions that create an enabling environment for the intervention activities to contrib-
ute to well-being.  is results in a much more multifaceted overall intervention
but with the aim of ensuring that it is su cient : that the collection of (core) inter-
vention e orts, its engagement activities, and the resulting actions by intermedi-
aries are su cient to contribute to the expected bene ts and well-being changes.
at is, the set of engagement activities are aimed at ensuring that the causal link
assumptions—the support factors—are realized.
We can still ask if the core intervention was a principle contributory cause,
that is, did it play a trigger role in getting change started. And in the multifaceted
su cient contexts, the intervention will also involve other subsequent support-
ing actions taken along the causal pathway to sustain the causal pathway.  us,
we would like to assess whether the core intervention is a triggering contributory
cause and a sustaining contributory cause.
130 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
A strong causal claim about a multifaceted su cient intervention would be
that the intervention was a principal contributory cause of the relevant observed
results.  at is,
e intervention was a necessary component of a package of causal factors that to-
gether were su cient to contribute to an observed result. In other words, the interven-
tion made a di erence . In addition, the intervention played a key role; it was the trigger
that initiated the chain of events and through its supporting activities sustained the
chain of events that contributed to the observed results.
Figure 3 illustrates the generic theory of change for this more complex,
indeed multifaceted su cient intervention . 8
In building a ToC, it can be useful to identify the degree of control one has
or might have over the causal link assumptions. Assumptions can be labelled as
[O], over which the intervention has no or very little in uence; [I], where the
intervention can (should) have an in uence, direct or indirect; or [C], where
the intervention should be able to directly control.  is helps to identify where
additional supporting actions might be useful to better ensure the assumptions
are realized and hence the risks to the intervention minimized, perhaps leading
to a multifaceted intervention.
Using the nutrition example, Table 1 illustrates the type of ex ante causal link
analysis that can be undertaken. Each of the assumptions in Figure 2 is assessed
Figure 3. A Basic Theory of Change for Multifaceted Su cient Interventions
Reach &
reaction
Capacity changes
Behaviour changes
Well-being changes
Direct benefits
assumptions
Behavioural
change
assumptions
Capacity
change
assumptions
Reach
assumptions
External
influences
Engagement activities and outputs
Direct benefits
Well-being
change
assumptions
Timeline
Core activities and outputs
Timeline
Reach, Capacity change
Behavioural change of intermediaries
Useful Theory of Change Models 131
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
Table 1. Analysis of Nutrition Intervention Causal Link Assumptions
Causal link assumptions Degree of
control Supporting actions needed
beyondcore activities
A1 Reach Assumptions
Targeted mothers with
young children reached Medium [I] Intervention needs to know its target
population and how to reach them.
Action: Likely requires outreach e orts.
Approach and material
seems appropriate High [C] Requires good planning and knowing
the speci c context.
A2 Capacity Change Assumptions
• Nutrition bene ts
understood High [C] Requires good planning and knowing
the speci c context.
• Feeding practices
understood and relevant High [C] Requires good planning and knowing
the speci c context.
A3 Behavioural Change Assumptions
Mothers want to
improvethe health of their
children
n/a Can be assumed.
Mothers make decisions
about children’s food Unknown Would require knowledge of the
speci c context.
New practices supported
by husbands and
mothers-in-law
Low [I] Action: Need for engagement with
husbands/mothers-in-law on need for
better nutritional diets for children.
• Nutritious food
availableand a ordable High [C] A prerequisite for the intervention.
Ifnot likely available, need a
di erenttype of intervention such
assubsidies.
A4 Direct Bene ts Assumptions
Practices prove practical Medium [I] Action: Could require monitoring to see if
practices do prove practical in the speci c
context.
No reduction in other
nutritious food intake High? [C] Should be part of the training: don’t
stop consuming other nutritious food.
But, risk exists that husbands and
mothers-in-law in the poor households
will insist on substituting.
Action: Need to engage with husbands/
mothers-in-law.
A5 Well-being Change Assumptions
Children have access to
health care ?? [O] Would probably just be assumed. If
health is a major problem, then might
question the intervention.
132 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Figure 4. A Multifaceted Nutrition Intervention
An
Mothers adopt
new feeding
practices
Innovative workshops
and information
External influences
Lower prices for food
Other staples become
more nutritious
Mothers acquire new
knowledge about
nutrition benefits and
feeding practices
Mothers reached
Children
consume a more
nutritious diet
Children’s
nutrition status &
health improves
Training & informing
on nutrition benefits &
feeding practices
Time line
Unanticipated
results
Mothers become
more empowered
Husbands become
resentful
A1
A4
A
A3
A5
A2
Engagement
with NGO
Husbands /
mothers-in-
law
appreciate
the need for
nutritious
diets
NGO
engages with
husbands/
mothers-in-
law
Research and outreach
efforts undertaken to
well-identify target
groups and best
means for engaging
with them
NGO establishes
appropriate M&E
on practices tried
Intervention activities
Efforts supporting an
assumption
Causal link
assumptions
Legend
Nested Theory
of Change for
NGO
as to the degree to which the intervention could undertake e orts to strengthen
the likelihood that the assumption will materialize.
In the example, it may be that husbands and/or mothers-in-law are not likely
to support their wives making decisions about who gets what food.  en, in order
for the intervention to work, some form of education of husbands and mothers-
in-law about the bene ts of a nutritious diet for their children is needed.  e
intervention agency may need to get others, perhaps an NGO, more accustomed
to dealing with culture and gender issues to engage with husbands and mothers-
in-law to in uence their behaviour. Figure 4 illustrates the resulting multifaceted
nutrition intervention.
Ex ante causal link analysis can also be used to a priori assess the extent
to which there is empirical evidence to support each link in a ToC. In many
Useful Theory of Change Models 133
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
cases it is likely that indeed there are supporting prior research and evaluation
ndings that support some of the causal links, and equally it is o en the case
that such prior evidence is weak or not existing.  e latter case would suggest
that some new research be undertaken to better con rm the causal link before
implementing the initiative and/or that the assumptions for these links be care-
fully monitored as the intervention is implemented.  is type of causal link
analysis is discussed by Mayne and Johnson (2015) and by Johnson, Mayne,
Grace, and Wyatt (2015) .
As interesting, of course, is ex post causal link analysis of a theory of change,
determining the extent to which a causal link and its assumptions have occurred
and a credible causal claim be made.  is is the essence of contribution analysis
( Mayne, 2008 ; Mayne, 2012 ).
DEALING WITH MESSY INTERVENTIONS
Figures 1 and 3 could be seen as targeting one group of bene ciaries, such as chil-
dren in the nutrition example ( Figure 2 ). However, interventions o en have sever-
al target groups in mind (such as mothers and children) and/or subgroups within
a general group (such as boys and girls). For multifaceted su cient interventions
( Figure 3 ), there are usually several di erent intermediaries (governments, or-
ganizations, and partners) targeted. For these multitargeted interventions, one
approach would be to try to develop a theory of change that captures all these ac-
tivities on the various target groups and the resulting result sequences, capturing
the links among the various pathways. However, developing and setting out such
a model other than as an overview—which is helpful —can be quite challenging,
and the resulting quite messy theory of change model can become cumbersome
and hard to work with, either in terms of explaining the intervention or for help-
ing design the evaluation.
Nested Theories of Change
Instead, it would be much more useful to develop a subtheory of change for each
key target group—a nested theory of change or theory of reach 9 —recognizing that
these theories of reach may interact with each other in bringing about the desired
results. Figure 2 shows nested theories of reach (the oval shapes) for mothers and
for girls and boys—boys might be treated di erently than girls, and having theo-
ries of reach for each would ensure a focus on these di erences.
Figure 4 identi es the nested theory of change for NGOs in the nutri-
tion example, which is illustrated in Figure 5 .  e assumptions in the NGO
theory of change ( Figure 5 ) are ones that the NGO should be able to control or
strongly in uence. Figure 6 illustrates nested theories of reach for the generic
multifaceted su cient intervention. Nested theories of change o er a way to
break down a more messy theory of change into something more understand-
able and practical.
134 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Figure 5. Nested NGO Theory of Change
Support for mothers
managing children’s
diets
Engagement material
and information
Changes in knowledge
& attitudes toward
nutrition & diets for
children
Husbands and
mothers-in-law
reached
Behaviour Change Assumptions
No loss of prestige seen
Beneits seen from mothers
deciding on diets
Capacity Change Assumptions
Support from community
leaders and peers
Reach Assumptions
Engagement is culturally
sensitive
NGO activities
Intervention
engaging with NGO
Figure 6. Nested Theories of Change
Reach and
reaction
Capacity changes
Behaviour changes
Well-being changes
Direct
benefits
assumptions
Behavioural
change
assumptions
Capacity
change
assumptions
Reach
assumptions
External
influences
Supporting activities and outputs
Direct benefits
Well-being
change
assumptions
Timeline Activities and outputs
Timeline
Reach, Capacity change
Behavioural Change
Different
Beneiciary
Nested ToC
Different
Intermediary
Nested ToC
A
A
A
AA
A
A
A
A
A
A
A causal link with
assumptions
Useful Theory of Change Models 135
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
Causal Link Analysis
Another way to handle a messy theory of change is to discuss the di erent major
causal links in the theory of change separately, such as discussing the link “get-
ting from capacity changes to behavioural changes.” In addition, discussion of, for
example, the di erent causal link assumptions can be done in an accompanying
narrative that could also provide suitable references to prior research and evalu-
ation that support the underlying assumptions, as done in Table 1 . Mayne and
Johnson (2015) illustrate this approach.
Uncertainty and Emerging Results
Interventions vary in their “messiness”—from more complicated, such as the
multifaceted su cient interventions discussed earlier, to truly complex interven-
tions exhibiting uncertainty and emergent properties. In evaluating truly complex
interventions, using evaluation for incremental learning and adapting over time
is usually suggested ( Ling, 2012 ; Mayne, 2011 , pp. 82–84; Rogers, 2011 ; Sander-
son, 2000 ). Consistent with that thinking would be developing initial theories of
change such as the ones discussed here, which are then revised and adapted as
new knowledge is acquired. Rogers (2008) and Ling (2012) discuss using program
theories/theories of change in complex settings.
DIFFERENT VERSIONS OF A THEORY OF CHANGE
FORDIFFERENT PURPOSES
ere are clearly limits to how much detail can be usefully depicted in a theory
of change model, especially of a large and multifaceted intervention. Something
more manageable is needed, both to work with and for communication purposes.
It can be useful to have at least three versions of each theory of change.
e rst is a text version, describing in a sentence or two how the speci c
intervention being planned or implemented is intended to work, a theory of change
narrative . is version explains in a straightforward manner how the intervention
is supposed to work and can identify the underlying rationale assumptions behind
the intervention.  is is the basic description or “story line” given by managers
(or politicians) when asked to describe why they think the intervention will work,
or set out in a policy-type documentation, usually entailing a few sentences. An
example might be the simple theory for an anti-smoking TV ad intervention: by
describing on TV the dangers of smoking, smokers will stop smoking. In the child
nutrition example, the theory of change narrative would be something like: “By
educating and informing mothers about the importance of a nutritious diet for
their children, mothers will change their past behaviour and seek to improve the
diets of their children.”  e rationale assumption here is that better information
will change behaviour.
e theory of change narrative plays an important role, because it sets out
how the intervention will be publicly described and defended. It is in essence the
public theory of change.
136 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
e second theory of change version is a simpli ed overview theory of change
to show the big picture for a multifaceted intervention.  is is especially useful
for multifaceted su cient interventions.  e overview theory of change can just
be a simpli ed impact pathway showing as relevant any nested theories of change,
along with the rationale assumptions. Figure 7 illustrates the nutrition example
with the theory of change for engaging with husbands and mother-in-law noted
in the triangle.
e third and more detailed version of a causal theory of change is usually a
diagram model such as those shown in Figures 1 through 5 , showing the impact
pathways and the causal link assumptions details of the theory of change. Each
of these versions of a theory of change has its uses, and o en all three are helpful
to have at hand.
A further way to simplify a theory of change model by dropping “boxes”
and including their essence in the causal link assumptions—essentially rear-
ranging the causal package for the link. For many interventions, displaying all
the elements of their impact pathway or theory of change in a single diagram
can be cumbersome, resulting in a too-complex diagram of arrows and boxes.
Figure 8 shows a “simpli ed” version of Figure 1 in which the Reach and Capac-
ity Change boxes have been dropped.  is is o en tempting to do since it is the
behavioural changes that are thought to be the key outcomes along the impact
pathway.
Figure 8 still shows the essence of the impact pathway, but in developing
it as a theory of change, it needs to be remembered that the reach and capacity
change aspects are not explicitly shown. In this case, the assumptions behind
the arrows leading from activities and outputs to Behavioural Changes need to
include assumptions about reach and capacity change.  at is, the causal pack-
ages associated with each link remain intact , just positioned di erently. Ignoring
the reach and capacity change issues will signi cantly weaken the theory of
change.
Figure 7. Overview of Nutrition Intervention
Mother adopts new
feeding practices
Mother acquires new
knowledge about nutrition
benefits and feeding practices
Children’s nutrition
status & health
improves
ToC for
engaging with husbands &
mothers-in-law (Fig 6)
Useful Theory of Change Models 137
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
BUILDING IMPACT PATHWAYS AND THEORIES OF CHANGE
10
e concept and application of theories of change can appear complicated, but
only because “theory of change” is not one thing per se.  is is similar to the con-
cept of “evaluation” that can be many things, depending on a variety of situations.
eories of change
are time dependent—can vary over time
have di erent purposes
need to recognize uncertainties and nonlinearities
can be ex ante and ex post.
ere are now numerous sources available for guidance on developing theo-
ries of change. Vogel (2012a) and Barnett and Gregorowski (2013) discusses theo-
ries of change in relation to research interventions.  ere is an extensive website
on theories of change at www.theoryofchange.org with references to many other
guides and relevant literature.
In getting to a robust prior theory of change, initial versions should be tested
against the logic and assumptions set out, as well as against any available evidence
from previous research or evaluations that might (or might not) support the way
the theory of change is being depicted.  is challenging of a theory of change
is what Brousselle and Champagne (2011) and Kautto and Silila (2005) discuss,
arguing the value of this type of theory of change analysis even before testing it
in the  eld against the actual results of the speci c intervention in question.  e
Figure 8. A Simpli ed Generic Theory of Change
Behaviour
changes
Outputs
External
influences
Direct
benefits
Direct benefits
assumptions
Behavioural change
assumptions
Assumptions about
reaching target groups
Assumptions about
bringing about capacity
change
Well-being
changes
Well-being change
assumptions
Activities
Timeline
Unanticipated
results
138 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
analysis undertaken to develop the theory of change may uncover weaknesses in
initial ideas and assumptions about how the intervention is supposed to work.
As noted at the outset, a theory of change can also be used as a framework for
designing the intervention, developing a monitoring regime, and developing an
evaluation plan.
In developing impact pathways and theories of change, several points should
be kept in mind:
ey are probably best developed in a participatory manner, but this is
not always possible.
In a participatory process, one can start with a blank page and build
from soliciting views or, perhaps more e ciently, with a straw impact
pathway/theory of change that is developed by a few people and then
used as the basis for comment, challenge, and revision.
In discussion with stakeholders, more than one version of an interven-
tion’s theory of change may emerge ( Hansen & Vedung, 2010 ; Weiss,
1997 ). It may then be useful to test both versions against reality.
It is important to explicitly or implicitly include all the theory of change
elements.
Developing impact pathways and theories of change should be seen as a
process, evolving over time as more insight is gained.
Aim for a “good enough” impact pathway/theory of change, rather than
the perfect one.
e capacity and behavioural changes are o en key.
To the extent possible, impact pathways and theories of change should
be based on prior research in addition to stakeholder views.
Nested impact pathways and theories of change/theories of reach can be
quite useful, developed around the types of intervention strategies being
used and/or target groups.
eories of change can be displayed in a variety of ways and can be set
out at di erent levels of detail.
Generic impact pathways and theories of change can be quite useful as
building blocks when similar interventions occur at di erent locations.
CLOSING REMARKS
Credible theories of change are essential for undertaking theory-based evalu-
ations.  e models discussed here are meant to be  exible enough to apply to
a wide range of interventions.  e article argues that the model of a theory of
change illustrated generically in Figures 1 and 3 are “useful.”  ey are useful for
several reasons:
e models are o en a “good enough” representation of a theory of
change and not overly complex.  ey lay the basis for a logical perfor-
mance story ( Mayne, 2004 ).
Useful Theory of Change Models 139
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
e models deliberately avoid explicit labelling of results along the im-
pact pathway as di erent levels of outputs and especially outcomes, such
as immediate, intermediate, and  nal outcomes.  ese output and out-
come labels have no inherent meaning and are not helpful in developing
a theory of change—indeed they o en lead to wasted debate. Rather, it
is the sequence that is important.  e goods and services, reach, capac-
ity change, behavioural change, and other labels in Figures 1 and 3 have
intuitive meaning and provide a good analytical structure for developing
a theory of change.
Causal link assumptions can be well de ned, describing what is necessary
for the link to work, and they are front and centre in a theory of change.
e use of the causal link assumption boxes allows for a more straight-
forward looking representation. Otherwise, many more boxes and ar-
rows would be needed.
e theory of change model can be o en simpli ed somewhat by drop-
ping a “result box” and including it as an assumption instead.
More complicated theories of change can be simpli ed by using the idea
of nested theories of change and reach to focus on key nested impact
pathways.
e model with assumptions as support factors links directly with the
concepts of causal packages and contributory causes, providing a rigor-
ous basis for making causal claims.
NOTES
1
e term “logic model” is sometimes used synonymously with program theory or
theory of change ( Funnell and Rogers, 2011 ), but o en is identi ed with only the
causal pathway.  us, for example, the Canadian federal government de nes logic
model as “a depiction of the causal or logical relationships between activities inputs,
outputs and the outcomes of a given policy, program or initiative, e.g., Results Chain”
( Treasury Board Secretariat, 2012 ).
2 e main revisions were to simplify the representation of the model by dropping
explicit references to “risks,” “other explanatory factors,” and “incentives” and making
explicit reference to unanticipated results.
3 Knowledge pertains to learned information or accepted advice; attitudes focus on
beliefs, opinions, feelings, or perspectives; skills refer to mental and physical abilities
to use new or alternative practices; aspirations refer to ambitions, hopes, objectives,
or desires. Adapted from Bennett and Rockwell (1995 , p. 6).
4 Well-being is the broad term used here for the end result aimed for. Livelihood is
another term that could be used.
5 In previous articles, I had o en explicitly included “risks” in the assumption boxes,
noting that some assumptions are more easily understood and written as risks.  is
can be useful, but does clutter the boxes somewhat.
6 e nested theories of reach in Figure 2 are discussed later.
7 INUS stands for an Insu cient but Necessary part of a condition that is itself Unneces-
sary but Su cient for the occurrence of the e ect ( Mackie, 1974 ).
140 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
8 Figure 3 illustrates one type of complicated and complex intervention, with core and
supporting activities. Another (not shown) would be a multicomponent su cient in-
tervention made up of a number of quite separate and distinct component activities,
which together are expected to lead to improved well-being. Here the components
would be nested theories of change within a larger overview theory of change.
9 eories of reach are discussed in Mayne (2014) .
1 0 e points in this section are further elaborated on in Mayne and Johnson (2015) .
REFERENCES
Barnett , C. , & Gregorowski , R. ( 2013 ). Learning about theories of change for the monitoring
and evaluation of research uptake (IDS Practice Paper in Brief, ILT Brief 14: Insti-
tute of Development Studies). Retrieved from http://opendocs.ids.ac.uk/opendocs/
bitstream/handle/123456789/2995/PP%20InBrief%2014%20FINAL.pdf;jsessionid=
4E0FEAAE919534B1B2A65F654E121023?sequence=1
Bennett , C. , & Rockwell , K. ( 1995 ). Targeting outcomes for programs: A hierarchy for tar-
geting outcomes and evaluating their acheivement (University of Nebraska). Retrieved
from ftp://bsesrv214.bse.vt.edu/grisso/Program_Logic/Targeting_Outcome_
Programming.pdf
Bickman , L. (Ed.). ( 1987 ). Using program theory in evaluation (New Directions for Evalu-
ation, no. 35). San Francisco, CA : Jossey-Bass .
Brousselle , A. , & Champagne , F. ( 2011 ). Program theory evaluation: Logic analysis . Evalu-
ation and Program Planning , 34 , 69 – 78 .
Cartwright , N. , & Hardie , J. ( 2012 ). Evidence-based policy: Doing it better. A practical guide
to predicting if a policy will work for you . Oxford, UK : Oxford University Press . http://
dx.doi.org/10.1093/acprof:osobl/9780199841608.001.0001
Chen , H. T. ( 2015 ). Practical program evaluation:  eory-driven evaluation and the inte-
grated evaluation perspective ( 2nd ed. ). ousand Oaks, CA : Sage .
Darnton , A. ( 2008 ). Practical guide: An overview of behaviour change models and their
uses. Retrieved from http://www.civilservice.gov.uk/wp-content/uploads/2011/09/
Behaviour-change_practical_guide_tcm6-9696.pdf
Funnell , S. , & Rogers , P. ( 2011 ). Purposeful program theory: E ective use of theories of change
and logic models . San Francisco, CA : Jossey-Bass .
Gatersleben , B. , & Vlek , C. ( 1998 ). Household consumption, quality of life and environ-
mental impacts . In K. Noorman and A. Schoot-Uiterkamp , Eds., Green households?
Domestic consumers, environment and sustainability (pp. 141–183). London, UK :
Earthscan .
Hansen , M. B. , & Vedung , E. ( 2010 ). eory-based stakeholder evaluation. American
Journal of Evaluation , 31 ( 3 ), 295 – 313 . http://dx.doi.org/10.1177/1098214010366174
James , C. ( 2011 ). eory of change review (Report commissioned by Comic Relief).
Retrieved from http://mande.co.uk/blog/wp-content/uploads/2012/03/2012-Comic-
Relief- eory-of-Change-Review-FINAL.pdf
Johnson , N. , Guedenet , H. , & Saltzman , A. ( 2014 ). What will it take for bioforti cation to
have impact on the ground?  eories of change for three crop-country combinations
Useful Theory of Change Models 141
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
(IFPRI discussion paper). Washington, DC : International Food Policy Research Insti-
tute . Retrieved from http://ebrary.ifpri.org/cdm/singleitem/collection/p15738coll2/
id/129089/rec/1
Johnson , N. , Mayne , J. , Grace , D. , & Wyatt , A. ( 2015 ). How will training traders con-
tribute to improved food safety in informal markets for meat and milk? A theory of
change analysis (IFPRI discussion paper 1451). Washington, DC : International Food
Policy Research Institute . Retrieved from http://ebrary.ifpri.org/cdm/ref/collection/
p15738coll2/id/129293
Kautto , P. , & Silila , J. ( 2005 ). Recently introduced policy instruments and intervention
theories . Evaluation , 11 ( 1 ), 55 – 68 .
Ling , T. ( 2012 ). Evaluating complex and unfolding interventions in real time. Evaluation ,
18 ( 1 ), 79 – 91 . http://dx.doi.org/10.1177/1356389011429629
Mackie , J. L. ( 1974 ). e cement of the universe: A study of causation . Oxford, UK : Oxford
University Press .
Mahoney , J. ( 2008 ). Toward a uni ed theory of causality. Comparative Political Studies ,
41 ( 4-5 ), 412 436 . http://dx.doi.org/10.1177/0010414007313115
Mayne , J. ( 2004 ). Reporting on outcomes: Setting performance expectations and telling
performance stories. Canadian Journal of Program Evaluation , 19 ( 1 ), 31 – 60 .
Mayne , J. ( 2008 ). Contribution analysis: An approach to exploring cause and e ect , (ILAC
Brief No. 16).  e Institutional Learning and Change Initiative. Retrieved from http://
www.cgiar-ilac.org/ les/publications/briefs/ILAC_Brief16_Contribution_Analysis.pdf
Mayne , J. ( 2011 ). Contribution analysis: Addressing cause and e ect . In R. Schwartz , K.
Forss , & M. Marra (Eds.), Evaluating the complex (pp. 53 – 96 ). New Brunswick, NJ :
Transaction .
Mayne , J. ( 2012 ). Contribution analysis: Coming of age? Evaluation , 18 ( 3 ), 270 – 280 . http://
dx.doi.org/10.1177/1356389012451663
Mayne , J. ( 2014 ). Using theories of reach to enhance equity considerations in evaluation .
In K. Forss & M. Marra (Eds.), Speaking justice to power: Ethical and methodological
challenges for evaluators (pp. 133 – 152 ). New Brunswick, NJ : Transaction .
Mayne , J. , & Johnson , N. ( 2015 ). Using theories of change in the Agriculture for Nutrition
and Health CGIAR research program . Evaluation , 21 ( 4 ), 407–428.
Montague , S. , & Porteous , N. ( 2013 ). e case for including reach as a key element of
program theory. Evaluation and Program Planning , 36 ( 1 ), 177 – 183 . http://dx.doi.
org/10.1016/j.evalprogplan.2012.03.005
Morra Imas , L. G. , & Rist , R. C. ( 2009 ). e road to results: Designing and conducting e ec-
tive development evaluations . Washington, DC : World Bank .
Patton , M. Q. ( 2008 ). Utilization-focused evaluation ( 4th ed. ). ousand Oaks, CA : Sage .
Rogers , P. ( 2008 ). Using programme theory to evaluate complicated and complex aspects of
interventions. Evaluation , 14 ( 1 ), 29 – 48 . http://dx.doi.org/10.1177/1356389007084674
Rogers , P. ( 2011 ). Implications of complicated and complex characteristics for key
tasks in evaluation . In K. Forss , M. Marra , & R. Schwartz (Eds.), Evaluating the
complex: Attribution, contribution and beyond (pp. 33 – 52 ). New Brunswick, NJ :
Transaction .
142 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Rossi , P. H. , Lipsey , M. W. , & Freeman , H. E. ( 2004 ). Evaluation: A systematic approach ( 7th
ed. ). ousand Oaks, CA : Sage .
Sanderson , I. ( 2000 ). Evaluation in complex policy systems. Evaluation , 6 ( 4 ), 433 – 454 .
http://dx.doi.org/10.1177/13563890022209415
Stein , D. , & Valters , C. ( 2012 ). Understanding ‘theory of change’ in international develop-
ment: A review of existing knowledge . Asian Institute and the Justice and Security
Research Programme. Retrieved from http://www.theoryofchange.org/wp-content/
uploads/toco_library/pdf/UNDERSTANDINGTHEORYOFChangeSteinValtersPN.
pdf
Suchman , E. D. ( 1967 ). Evaluative research: Principles and practice in public service & social
action programs . New York, NY : Russell Sage Foundation .
Treasury Board Secretariat . ( 2012 ). Results-based management lexicon . Ottawa: Author.
Retrieved from http://www.tbs-sct.gc.ca/cee/pubs/lex-eng.asp
United Nations Development Group . ( 2011 ). Results-based management handbook: Har-
monizing RBM concepts and approaches for improved development results at country
level . Retrieved from https://undg.org/wp-content/uploads/2015/01/UNDG-RBM-
Handbook-2012.pdf
Vogel , I. ( 2012a ). ESPA guide to working with theory of change for research projects . Ecosys-
tem Services for Alleviation of Poverty. Retrieved from http://www.espa.ac.uk/ les/
espa/ESPA- eory-of-Change-Manual-FINAL.pdf
Vogel , I. ( 2012b ). Review of the use of ‘theory of change’ in international development .
Department for International Development. Retrieved from http://www.oxfamblogs.
org/fp2p/wp-content/uploads/DFID-ToC-Review_VogelV4.pdf
Weiss , C. H. ( 1997 ). How can theory-based evaluation make greater headway? Evaluation
Review , 21 ( 4 ), 501 – 524 . http://dx.doi.org/10.1177/0193841X9702100405
White , H. ( 2009 ). Theory-based impact evaluation: Principles and practice (Work-
ing Paper 3). International Initiative for Impact Evaluation (3ie). Retrieved
from http://www.3ieimpact.org/admin/pdfs_papers/48.pdf . http://dx.doi.
org/10.1080/19439340903114628
AUTHOR INFORMATION
John M ayne is an independent advisor on public sector performance. Over the last 11 years
he has focused largely on international development evaluation and results-based manage-
ment work. He has been working with a number of government, NGOs, and international
organizations. He has authored numerous articles and reports, including several on con-
tribution analysis, and co-edited eight books on program evaluation and performance
monitoring. In 1989 and in 1995, he was awarded the Canadian Evaluation Society Aw ar d
for Contribution to Evaluation in Canada . In 2006, he was made a Canadian Evaluation
Society Fellow. Dr. Mayne’s current research interests are on approaches for strengthening
impact evaluation, useful theories of change, and dealing with attribution.
... In this context, impact pathways can be defined as "causal pathways showing the linkages between a sequence of steps in getting from activities to impact", whereas a ToC "adds to an impact pathway by describing the causal assumptions behind the links in the pathway -what has to happen for the causal linkages to be realized" (Mayne, 2019, p. 172). Mayne (2015Mayne ( , 2017 recommends robust and useful ToC models, which he defines as "structurally sound and plausible" (Mayne, 2017, p. 159) and defines criteria to assess the robustness and quality of ToCs. His claim is that only a robust ToC is useful in contribution analysis, while "confirming a weak theory of change -one poorly structured with evident logical gaps -in contribution analysis cannot lead to credible causal contribution claims" (Mayne, 2017, p. 170). ...
... -the concept of generative causality instead of the counterfactual perspective on causality, seeing causality as a series or several series of causal steps between the activities of the intervention and the desired impacts (Mayne, 2019), -the idea of nested ToCs as a way to break down a complicated ToC into something more understandable and practical (Mayne, 2015;Koleros & Mayne, 2019), -the idea that the intervention was one of several factors in a causal package that together brought about or contributed to the changes observed (Mayne, 2019;Schmitt, 2020), -starting the analysis by observing relevant changes and working backwards to search for the combination of causal factors, including other related interventions, and events and conditions external to the intervention that 'made a difference' (Mayne, 2019), -the chance of addressing and visualising the various causal factors, related to the interventions and to other external influences (Mayne, 2019), -the possibility to involve stakeholders in the development of ToCs and impact pathways, discussing with them contribution claims (Delahais, 2023), -the use of impact stories supported by evidence, providing a pragmatic framework for organizing a wealth of information within each impact dimension of the SBI (Koleros & Mayne, 2019). ...
... This is a solution to avoid too messy theory of change models in the case of multifaceted and multitargeted interventions. However, in this case, contrary to what is proposed by Mayne (2015) as well as Koleros and Mayne (2019), the sub theories of change were not actor-based developed around the different target groups but linked to different impact dimensions. One trade-off of this was that connections and additional causal linkages between the different ToC could not be easily integrated and visualised. ...
Article
This article addresses the question of how complex interventions can be adequately assessed with limited resources. In 2011, the European Commission presented the Social Business Initiative (SBI), a framework initiative to develop a favourable environment for social enterprises and the social economy. The complexity of the programme stems from its numerous components and the long timeframe for its implementation. The evaluation of the impact of the SBI was commissioned in 2019 and the final report was presented in November 2020. The article presents the study and the evaluation methodology used to analyse the impact contribution influenced by the SBI. A theory-based evaluation approach was chosen, inspired by contribution analysis. The article describes the implementation of the evaluation and discusses the suitability of the chosen method, identifying both its strengths and shortcomings in this specific context.
... Semistructured interviews were held with a small sample of participants or former participants and EPWP officials to clarify issues identified as requiring follow up. In order to elicit sufficient understanding on how EPWP has responded to these challenges, this article strove to deploy these investigative constructs in the field [17,[32][33][34]. A single method does not allow for sufficient investigative depth and breadth on the critical drivers of unemployment among women and youth in South Africa. ...
... It remains critical to ask whether the desired outcomes of EPWP were incorporated in its design. Due to the complexity of the programme and the challenge at hand, understanding the underlying assumptions is crucial to explaining these programmes [32,51]. This also enables one to be able to draw linkages within the ecosystem. ...
Article
Full-text available
This paper presents an analysis of the Expanded Public Works Programme (EPWP), one of the key South African government policy initiatives that are meant to ease the burden of poverty or unemployment on the poor and unskilled. Historically, such programmes have been used as a relief during short-term crises. Of late, countries have adopted them for long-term structural challenges. In South Africa the programme is meant to protect women and youth. This paper uses a mixed methodology approach to determine the active participation of women and youth in the EPWP and their chances of transitioning into the labour market. The study also solicited the views of the EPWP participants (active and former) and officials to get information which is not captured in the programme’s official reports. The analytical procedure involved document analysis, focusing on EPWP reports from phases One (1) to Three (3) of the programme. The study makes two propositions: the need for public private partnerships to solve the country’s unemployment challenge because independent policies for government or markets are inadequate; a new programme design which separates job seekers from social protection beneficiaries. In its current form, the EPWP is designed as a lower tier poverty trap.
... In terms of methodology, ToC was used to prepare the CRIS and implement the necessary changes (Dhillon & Vaca, 2018;Mayne, 2015). This theory requires the identification of long-term goals to level the effects of retirement risks. ...
Article
Full-text available
The aim of the paper is to propose a new comprehensive retirement insurance solution (CRIS) that, by offering appropriate modules, can be flexibly adapted to customers’ needs during the accumulation of funds and entitlements and during retirement. Technically, the product is life-insurance-based and includes insurance for sickness and incapacity, long-term care (LTC), work activation expenses, hospital stays, and tontine and Luxembourg policies. Due to consumers’ changing expectations and needs, the technical dimension of this solution is based on a three-layer insurance product in which individual parts of the protection are supplemented by several additional benefits (types of assistance) that improve the quality of life of insurance participants and allow the ongoing use of the product.
... To develop a robust theory of change, the evaluation team used a construct of capabilities, opportunities, and motivation (Mayne, 2015(Mayne, , 2017Michie et al., 2011); this helps the evaluator describe the behavior change and articulate assumptions the intervention was making to achieve these behavior outcomes. Using the Kirkpatrick Model as a reference, the practicum team was able to draft a visual theory of change. ...
... A stories approach potentially could also provide greater opportunities for engagement of stakeholders. Indeed, John Mayne (2015) has observed that a good theory of change makes for a good story. ...
Chapter
Full-text available
... What they have in common is the idea that public intervention is a particular kind of a theory of change. However, it is far more than a simple logic model or a result chain that is so prevalent in evaluation practice, as it identifies causal assumptions as to why and under what conditions each of the link in the impact pathway is expected to work (Mayne, 2015) 4 . Thus, a robust theory of change describes not only a sequence of steps in getting from activities to impact (how does it happen), but also the contextual factors (internal and external) that should be taken into account to make change work. ...
Article
Full-text available
Objectives: The aim of the article is to consider the evaluation of public interventions through the prism of evidence-based policy (EBP) as well as, more specifically, its potential to address the problem of how to produce in the process of impact evaluation usable knowledge that can help improve policymaking and policy implementation which can be accumulated over time, where evaluations will not be single endeavours and one-off studies, but will contribute to the growing body of knowledge. Research Design & Methods: The article provides a critical overview of the research literature on evaluation approaches and methods as tools for gathering and apprising evidence relevant for policymaking and policy implementation. Findings: Building upon the identified limitations of the traditional input/output approach to impact evaluation of public interventions, alternative approaches to evaluation are considered that make use of a theory that properly explicates the causal mechanisms linking programme activities with programme outcomes, confronting the mechanisms with empirical observations. As a strategy for synthesising the gained knowledge, the realist synthesis is considered as being more appropriate for reviewing research on complex social interventions (rather than traditional meta-analysis). Implications / Recommendations: The article demonstrates how theory-based evaluation with mechanistic explanation and realist synthesis can contribute to growing evidence for policy needs, identifying also their limitations and practical problems related to their implementation. Contribution / Value Added: The article contributes to the existing pool of knowledge by providing important insights into how to use mechanism-based explanations in impact evaluation to make stronger causal claims and enhance policy-learning.
... Barzelay (2007, pp. 523-524) helpfully suggests a two-step assessment procedure that can be used, supplemented with methods drawn from recent work on extrapolation (Khosrowi, 2019;Steel, 2008) and process-related evaluation methods (Mayne, 2015(Mayne, , 2017Wauters & Beach, 2018;Woolcock, 2022). In the first step, a causal lesson is drawn from a source case (here a dramatic policy failure) by analyzing the process leading to the failure (Barzelay, 2007, p. 524) using process tracing methods (e.g., Wauters & Beach, 2018). ...
Article
Full-text available
Why do smart policy makers who try to learn from policy failure end up overgeneralizing these lessons when facing new crises? This article focuses on the policy learning that can come in the wake of perceived policy failure, and the consequences that lesson learning has for diagnosing and tackling subsequent crises. We argue, in contrast to much of the existing literature, that failure can result in policy learning when the policy area is highly complex and there are recognized experts that have epistemic authority in the issue. At the same time, lessons tend to become overgeneralized in which policy makers facing a new crisis extrapolate the lessons learned from the past failure with little consideration of whether the circumstances are similar enough to be applicable. Our argument is assessed empirically using a process-tracing analysis of how the EU responded to the Spanish banking crisis in 2012.
Article
Full-text available
The critical literature review discusses the principles of Participation and Interconnectedness underlying the Triple Helix Model and Learning and Adaptation in the Sustainable Transition Model for their relevance in governing urban climate change adaptation. In this new framing, a secondary literature analysis of Barcelona’s struggle against air pollution is exemplified as a wicked problem caused by diverse stakeholder interests and their different sustainability concepts in socio-economic and environmental development. The paper offers a new perspective on sustainable, transformative pathways in cities which run on participative and adaptive governance principles. The backwards integration into the underlying principles of the meta-theories illustrates the value of triple helix and transition research and the benefit of their integration for examining and designing sustainable transition pathways.
Article
Academic startups have a considerable economic impact, which is why public support programmes for them are considered an important component of innovation and technology policy. In this context, university support programmes can be an important part of the policy toolkit by aiming to improve universities’ startup environment and thus promote startup activity at those institutions. Assessing the effectiveness of these programmes is a key evaluation task inasmuch as it provides an evidence base for decision-makers and broadens the discourse on promoting startup culture at universities. This study reports on the background, methodology, and results of the evaluation of the effectiveness of a large university support programme in the academic startup sector in Germany, ‘EXIST—Leverage of potentials’. This programme supports universities which have little experience in building a startup culture and startup-supportive structures. Reliable data are available for two indicators that can be employed to assess intervention effects by means of a difference-in-differences design, namely for the number of applications universities submitted and the number of grants they received in what is Germany’s largest funding programme for prospective startups. The findings indicate that funding by ‘EXIST—Leverage of potentials’ positively affects universities’ activities in the area of startup support.
Article
Over the past 20 years, cash transfers have become increasingly widespread within international development and global social policy. Often, their roll out is preceded by a trial or pilot phase aiming to check feasibility and effectiveness. These pilots can involve thousands of people. However, there is limited discussion within the literature (and even less in practice) of how and whether cash transfer trials and the research that they involve can respect ethical standards. This paper represents an initial step towards filling that gap. It does so by reviewing the latest literature pertaining to the ethics of cash transfers and social experimentation. It concludes by advancing a series of proposals that could support cash transfer trials to take place with greater respect for research ethics norms and in the best interests of participants. The paper’s findings have relevance for policymakers and development practitioners working with cash transfers and also for the smaller cognate world of Unconditional Basic Income (UBI) piloting.
Article
Full-text available
Theories of change are increasingly being discussed and referenced in development evaluation even while the elements of what a theory of change consist of differ widely among applications. Equally, examples of actual use of theories of change other than as overview illustrations of interventions are rare. In this article, we present generic models of theories of change for both straightforward and more complex interventions. A number of examples of evidence-based theories of change in the area of agriculture research for nutrition and health are discussed, as is the need for different versions of a theory of change for different purposes. We also discuss the use and analysis of these models in the planning, managing and assessing of research-related interventions, illustrating the practical usefulness of well-developed theories of change.
Book
Full-text available
Between good intentions and great results lies a program theory—not just a list of tasks but a vision of what needs to happen, and how. Now widely used in government and not-for-profit organizations, program theory provides a coherent picture of how change occurs and how to improve performance. Purposeful Program Theory shows how to develop, represent, and use program theory thoughtfully and strategically to suit your particular situation, drawing on the fifty-year history of program theory and the authors' experiences over more than twenty-five years. "From needs assessment to intervention design, from implementation to outcomes evaluation, from policy formulation to policy execution and evaluation, program theory is paramount. But until now no book has examined these multiple uses of program theory in a comprehensive, understandable, and integrated way. This promises to be a breakthrough book, valuable to practitioners, program designers, evaluators, policy analysts, funders, and scholars who care about understanding why an intervention works or doesn't work." —Michael Quinn Patton, author, Utilization-Focused Evaluation "Finally, the definitive guide to evaluation using program theory! Far from the narrow 'one true way' approaches to program theory, this book provides numerous practical options for applying program theory to fulfill different purposes and constraints, and guides the reader through the sound critical thinking required to select from among the options. The tour de force of the history and use of program theory is a truly global view, with examples from around the world and across the full range of content domains. A must-have for any serious evaluator." —E. Jane Davidson, PhD, Real Evaluation Ltd. Preview of 61 pages available here https://books.google.com.au/books/about/Purposeful_Program_Theory.html?id=zBoGbWnVsFsC&printsec=frontcover&source=kp_read_button&redir_esc=y#v=onepage&q&f=false
Article
Full-text available
In comparative research, analysts conceptualize causation in contrasting ways when they pursue explanation in particular cases (case-oriented research) versus large populations (population-oriented research). With case-oriented research, they understand causation in terms of necessary, sufficient, INUS, and SUIN causes. With population-oriented research, by contrast, they understand causation as mean causal effects. This article explores whether it is possible to translate the kind of causal language that is used in case-oriented research into the kind of causal language that is used in population-oriented research (and vice versa). The article suggests that such translation is possible, because certain types of INUS causes manifest themselves as variables that exhibit partial effects when studied in population-oriented research. The article concludes that the conception of causation adopted in case-oriented research is appropriate for the population level, whereas the conception of causation used in population-oriented research is valuable for making predictions in the face of uncertainty.
Article
Full-text available
In this introductory article, a brief history and introduction to contribution analysis is provided to lay the stage for the articles that follow. At the heart of contribution analysis is the aim to be able to make credible causal claims about the contribution an intervention is making to observed results. The key role that theories of change play is noted, and what a useful theory of change ought to contain is discussed. The article then makes a link between the philosophical discussions on causality and contribution analysis through a discussion of contributory causes. It is argued that such causes, which on their own are neither necessary nor sufficient, represent the kind of contribution role that many interventions play: where there are a number of other influencing events and conditions at work in addition to the intervention of interest. Contribution analysis is an approach to confirming that an intervention is a contributory cause.
Article
Full-text available
This article discusses an approach to managing the evaluation of complex interventions. Complex interventions pose significant challenges to the role and conduct of evaluations. In particular, they combine with reflexive learning and change to produce significant uncertainties making it hard to describe in advance what the intervention will do or what the outcomes might be. These uncertainties vary in nature and addressing these uncertainties leads to different evaluation approaches. That such evaluations often take place in ‘real time’ and have a strong formative dimension adds to the challenge. This article proposes a way of approaching this problem by incorporating the concepts of uncertainty and complexity into a Theory of Change-based approach.
Article
Full-text available
Introduces a new approach to the general evaluation field called theory-based stakeholder evaluation (TSE model). Combinations of program theory approach and stakeholder orientation are very rare in literature and practice. Furthermore, in those existing evaluators aims to fuse the various stakeholder ideas into on common unitary program theory. On this account the TSE-model is different. The TSE model keeps the program theories of the diverse stakeholder groups apart from each other and from the program theory embedded in the institutionalized intervention itself. This is an important clarification and extension of standard theory-based evaluation. The TSE model is elaborated to enhance theory-based evaluation of interventions characterized by conflicts and competing program theories. Especially in evaluations of complex and complicated multilevel and multisite interventions where the presence of competing theories is likely, the TSE model may prove useful. The article define the concept of intervention theory, an expression the authors prefer to program theory. The five steps of the TSE-model are presented.
Book
Over the last twenty or so years, it has become standard to require policy makers to base their recommendations on evidence. That is now uncontroversial to the point of triviality—of course, policy should be based on the facts. But are the methods that policy makers rely on to gather and analyze evidence the right ones? In Evidence-Based Policy, Nancy Cartwright, an eminent scholar, and Jeremy Hardie, who has had a long and successful career in both business and the economy, explain that the dominant methods which are in use now—broadly speaking, methods that imitate standard practices in medicine like randomized control trials—do not work. They fail, Cartwright and Hardie contend, because they do not enhance our ability to predict if policies will be effective. The prevailing methods fall short not just because social science, which operates within the domain of real-world politics and deals with people, differs so much from the natural science milieu of the lab. Rather, there are principled reasons why the advice for crafting and implementing policy now on offer will lead to bad results. Current guides in use tend to rank scientific methods according to the degree of trustworthiness of the evidence they produce. That is valuable in certain respects, but such approaches offer little advice about how to think about putting such evidence to use. Evidence-Based Policy focuses on showing policymakers how to effectively use evidence. It also explains what types of information are most necessary for making reliable policy, and offers lessons on how to organize that information.
Book
In this book, J. L. Mackie makes a careful study of several philosophical issues involved in his account of causation. Mackie follows Hume's distinction between causation as a concept and causation as it is ‘in the objects’ and attempts to provide an account of both aspects. Mackie examines the treatment of causation by philosophers such as Hume, Kant, Mill, Russell, Ducasse, Kneale, Hart and Honore, and von Wright. Mackie's own account involves an analysis of causal statements in terms of counterfactual conditionals though these are judged to be incapable of giving a complete account of causation. Mackie argues that regularity theory too can only offer an incomplete picture of the nature of causation. In the course of his analysis, Mackie critically examines the account of causation offered by Kant, as well as the contemporary Kantian approaches offered by philosophers such as Bennett and Strawson. Also addressed are issues such as the direction of causation, the relation of statistical laws and functional laws, the role of causal statements in legal contexts, and the understanding of causes both as ‘facts’ and ‘events’. Throughout the discussion of these topics, Mackie develops his own complex account of the nature of causation, finally bringing his analysis to bear in regard to the topic of teleology and the question of whether final causes can be justifiably reduced to efficient causes.