ArticlePDF Available

Abstract and Figures

Although frequently discussed in the evaluation literature and general agreement on what a theory of change is conceptually, there is actually little agreement beyond the big picture of just what a theory of change comprises, what does it show, how it can be represented and how it can be used. This article outlines models for theories of change and their development that have proven quite useful for both straightforward and more complex interventions. The models are intuitive, flexible, well-defined in terms of their components and link directly to rigorous models of causality. The models provide a structured framework for developing a theory of change and analysing the intervention it represents
Content may be subject to copyright.
Useful Theory of Change Models
John Mayne
Ottawa, Ontario
Abstract: Although theories of change are frequently discussed in the evaluation
literature and there is general agreement on what a theory of change is conceptually,
there is actually little agreement beyond the big picture of just what a theory of change
comprises, what it shows, how it can be represented, and how it can be used.  is
article outlines models for theories of change and their development that have proven
quite useful for both straightforward and more complex interventions.  e models
are intuitive,  exible, and well-de ned in terms of their components, and they link
directly to rigorous models of causality.  e models provide a structured framework
for developing useful theories of change and analyzing the intervention they represent.
Keywords: causal links, complex intervention, impact pathways, logic model, results
chain, theory of change, theory of reach
Résumé: Bien que les théories du changement soient souvent débattues dans la
littérature portant sur l’évaluation et qu’il y ait un consensus sur ce qu’est, concep-
tuellement, la théorie du changement, il n’y a, en réalité, aucun accord au-delà de
la dé nition générale de ce que la théorie du changement comprend, de ce qu’elle
démontre ainsi que de la manière dont elle peut être représentée et utilisée. Cet article
donne un aperçu de modèles de théories du changement, ainsi que leur développe-
ment, lesquels se sont montrés très utiles lors d’interventions tant simples que com-
plexes. Les modèles sont intuitifs,  exibles et bien dé nis en matière de composantes.
De plus, ils sont liés à de rigoureux modèles de causalité. Les modèles fournissent un
cadre structuré au développement de théories du changement utiles et à l’analyse de
l’intervention qu’ils représentent.
Mots clés: liens de causalité, intervention complexe, cheminement d’impact, modèle
de logique, chaîne des résultats, théorie du changement, théorie de la portée
Models depicting how interventions are meant to work are frequently discussed
and used in evaluation. See, for example, Patton (2008) ; Chen (2015) ; Rossi,
Lipsey, and Freeman (2004) ; Morra Imas and Rist (2009) ; and Funnell and Rog-
ers (2011) . Some of the earlier discussions are by Suchman (1967) and Bick-
man (1987) . However, the terms used to describe these models vary widely,
and include program theory , logic model , theory of change , results chain , out-
come pathway , action theory , implementation theory , and more, with no general
© 2015 Canadian Journal of Program Evaluation / La Revue canadienne d'évaluation de programme
30.2 (Fall / automne), 119–142 doi: 10.3138/cjpe.230
Corresponding author: John Mayne, john.mayne@rogers.com
120 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
agreement on terms or meaning. Funnell and Rogers (2011 , pp. 15–34) discuss
the range of terms used for these models and their histories, as does Patton (2008 ,
pp. 336–340).
I will be using the term theory of change . eories of change have a wide range
of possible uses in developing, managing, and evaluating interventions. Mayne
and Johnson (2015) discuss using theories of change in
Designing/planning interventions
1. Designing interventions
2. Understanding and agreeing on interventions with stakeholders
3. Identifying and addressing equity, gender, and empowerment issues
4. Ex ante evaluation of proposed interventions
Managing interventions
5. Designing monitoring systems
6. Understanding implementation, managing adaptively, and learning
Assessing interventions
7. Designing evaluation questions, methods, and tools
8. Making causal claims about impact
9. Reporting performance
Scaling
10. Generalizing to the theory, to other locations and for scaling up and out.
In Part 5 of their book, Funnell and Rogers (2011) discuss using theories
of change (program theories) in monitoring and evaluation and offer many
examples. Some good examples of using theories of change, especially in a
planning and designing mode, can be found in Johnson, Guedenet, and Saltz-
man (2014) .
e use of theories of change has been reviewed by James (2011) , Vogel
(2012b) , and Stein and Valters (2012) , who all note that while there is general
agreement on the big picture about theories of change—models depicting how
interventions are supposed to work—there is a proliferation of di erent inter-
pretations of just what in practice a theory of change entails, how to develop one,
and how to depict it.
is article presents and describes a robust and useful model for theories of
change for simple and more complex interventions. It  rst outlines a basic generic
theory of change, followed by a discussion of causation in relation to theories of
change. Models for more complex multifaceted interventions are then presented,
along with a discussion of nested theories of change.  e article discusses three
possible useful versions of a theory of change, discusses simplifying the models,
and o ers a few comments about building theories of change. It concludes by
summarizing why the models discussed are useful.
Useful Theory of Change Models 121
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
THEORIES OF CHANGE AND IMPACT PATHWAYS
Let me  rst de ne a few key terms.  e term results is used to include outputs,
outcomes, and impacts, where impacts are the  nal outcomes a ecting well-being.
e term intervention is used here to describe speci c activities undertaken to
make a positive di erence in outcomes and impacts of interest. It covers policies,
programs, and projects.
To understand how and if an intervention is working, we need to understand
how the activities of the intervention are expected to lead to the desired results—
both (a) the causal pathway from activities to outputs to a sequence of outcomes
to impacts and (b) the causal assumptions showing why and under what condi-
tions the various links in the causal pathway are expected to work. A variety of
terms are used in the literature to describe the causal pathways, including results
chains, logic models,
1 and impact pathways. I will use the term impact pathways.
Impact pathways describe causal pathways showing the linkages between the
sequence of steps in getting from activities to impact. A theory of change adds
to an impact pathway by describing the causal assumptions behind the links in
the pathway—what has to happen for the causal linkages to be realized. Patton
(2008 , p. 336) makes the same distinction between logic models and theories of
change: “Specifying the causal mechanisms transforms a logic model into a theory
of change. Chen (2015) , in Chapter 3, makes a similar distinction.  eories of
change are models of how change is expected to happen ( ex ante case) or how
change has happened ( ex post case).
ere are many ways to depict impact pathways and theories of change.
Funnell and Rogers (2011) illustrate the broad range. Figure 1 illustrates a basic
generic theory of change that has proven useful in several settings.  e sequence
of boxes in the  gure is the associated impact pathway (the results chain), which
is discussed  rst. Figure 1 is a further re nement and improvement of the theory
of change model discussed in Mayne (2014) .
2
Components of an Impact Pathway
Bene ciaries are the target groups whose well-being the intervention intends to
improve.  ese groups might be segmented by income, gender, ethnicity, and/or
geographical area. Consider as an example an intervention aimed at improving
the nutritional diets of children; the children are the intended bene ciaries. Note
that the target groups could include organizations.
In the theory of change model, the activities and results (o en labelled as
outputs, outcomes, and impacts) are depicted in the boxes:
Activities are actions undertaken by those involved in the intervention.
Goods and services produced are the direct outputs resulting from the
activities undertaken. In the nutrition example mentioned above, these
might be the innovative education and training material on the bene ts
of a nutritious diet. In this article, the term output is used to refer to t hese
direct goods and services.
122 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Behaviour changes
Goods & services
produced (outputs)
External
influences
Capacity changes in
knowledge, attitudes,
aspirations, skills, &
opportunities
Reach &
reaction
Direct
benefits
Direct benefits
assumptions
Behaviour change
assumptions
Capacity change
assumptions
Reach
assumptions
Well-being
changes
Well-being change
assumptions
Activities
Timeline
Unanticipated
results
Figure 1. A Basic Generic Theory of Change
Reach and reaction are the target groups who are intended to receive
the intervention’s goods and services and their initial reaction. In the
nutrition example, the reach group would be mothers with children
in some geographical region. Reach is important to include as a com-
ponent in causal pathways. As has been argued, “A lack of explicit
thinking about reach in logic models can lead to problems such as
narrow/constricted understanding of impact chains, favoring of ‘nar-
row and efficient’ initiatives over ‘wide and engaging’ initiatives and
biased thinking against equity considerations” ( Montague & Porte-
ous, 2013 , p. 177). I have discussed the usefulness of including reach
in Mayne (2014) .
Capacity changes are the changes in knowledge, attitudes, skills, as-
pirations, and opportunities of those who have received or used the
Useful Theory of Change Models 123
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
intervention’s goods and services. As discussed later, all of these changes
are needed for new action to be taken.
3
Behavioural changes are the changes in actual practices that occur, that is,
those in the target reach group do things di erently or use the intervention
products. In our example, this could be the changes in feeding practices of
mothers that occur as a result of the improved knowledge from the train-
ing.  ere typically is feedback between capacity and behavioural changes
(such as with acquiring new knowledge and skills by doing).
Direct bene ts are the improvements in the state of individual bene -
ciaries.  ese could be such things as increased income, increased use
of health services, more productive farming, more empowerment, or, in
the example, children consuming a more nutritious diet.
Well-being 4 changes are the longer-term cumulative improvement in
overall well-being of individual bene ciaries, such as better health,
reduced poverty, and better food security. In our example, the improved
diet would contribute to better nutritional and health status.
Note that the causal pathway model in Figure 1 explicitly does not label
the sequence of results as immediate, intermediate, and  nal outcomes (or
impacts)—a much more frequently used model, although these labels could be
added. Because these commonly used terms have little intuitive meaning, on their
own they do not provide much guidance in setting out an impact pathway and,
if used, the result is o en wasted debate about, for example, whether a result is
an immediate or an intermediate outcome. And while I had thought that outputs
was a well-de ned (as I de ne above) and widely accepted term, the recent United
Nations Development Group handbook (2011) confuses that term as well, de n-
ing outputs as goods and services or capacity changes. I am arguing that Figure1
is a more useful representation of an impact pathway than the more common
outcomes-based generic model.
External in uences are events and conditions unrelated to the intervention
that could contribute to the realization of the intended results.  ese could include
other interventions with similar aims, and/or general economic or social trends.
ey are not part of the intervention theory of change per se. For example, in the
nutrition example, a reduction of the price of vegetables could also account for a
portion of an increase in vegetable consumption that is unrelated to the training
intervention. Industrial forti cation of foods such as sugar or  our could also
contribute to explaining an improvement in micronutrient status.
Figure 1 includes unintended e ects : positive or—more usually—negative
unanticipated e ects that occur as a result of the interventions activities and
results. If these are known possibilities they should be noted. Ex post, unantici-
pated e ects should be actively looked for. Note also that although Figure 1 looks
linear, it explicitly allows for nonlinearity via the feedback between the various
stages. Figure 1 also illustrates a timeline of when the anticipated changes can
be expected to occur. Timelines even with rough dates are useful addition to
impact pathways.
124 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
From an Impact Pathway to a Theory of Change
In developing a theory of change, the  rst step is to develop the impact path-
way. But an impact pathway, results chain, or a logic model is not a theory of
change. Only when we add the assumptions to the causal links in the impact
pathway do we get a theory of change.  e causal link assumptions shown in the
dotted boxes in Figure 1 identify what salient events and conditions have to oc-
cur for each link in the causal pathway to work as expected. What is necessary
for the causal link to work? What factors are critical to these causal processes?
For practical reasons, we only need to consider salient assumptions , that is,
those that stand out for some reason, that are striking and relevant to the situ-
ation. Others, such as the sun rising each day or a revolution not occurring,
are not relevant—although ex post, a revolution would easily explain why the
intervention did not work! Articulating causal link assumptions would entail
a mix of prior evidence, stakeholder experience, and social science theory. For
example, an assumption in the child nutrition example would be that husbands
and mothers-in-law are supportive about what children eat, letting mothers
make those decisions.
ese causal link assumptions cover all the risks associated with the causal
link; each of the assumptions is a risk to the realization of the ToC.
5 In the nutri-
tion example, risks concerning the availability and a ordability of nutritious
food would be captured by an assumption that nutritious food is available and
a ordable.
Reach assumptions : e assumptions are the events and conditions
needed to occur if the outputs delivered are to reach and be positively
received by the reach groups.  ese could include such things as that
the delivery of outputs actually reaches the intended audience and the
outputs are seen as acceptable and worth considering. A key risk here is
that the reach group is not the “right” group, as in the case of the child
nutrition intervention directed at mothers when they do not in fact
make decisions about who gets what food, as well as actually reaching
all of the intended target group and not, for example, just those who
self-select.
Capacity change assumptions : ese assumptions are the events that
need to occur and the conditions that need to change if the outputs that
reachthe target populations are to result in changes in their knowledge,
attitudes, skills, aspirations, and opportunities, that is, their capacity
to do things di erently. ese could include such things as the outputs
being understood, realistic, culturally acceptable, seen as useful, com-
mensurate with the prior abilities and values of the target population,
seen as relevant to the reach group, and so on.
Behaviour change assumptions : ese assumptions are the events and
conditions needed to occur if the changes in the capacities of the target
groups are to result in actual changes in their practices.  ese could
Useful Theory of Change Models 125
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
include such things as  nancial capacity to make the practice changes,
acceptance by others (such as peers, social, cultural and religious leaders,
family) to make the changes, the practice changes shown to be useful,
the policy or natural environment allowing the practices to be adopted,
access to needed assets and supplies, and so on.
Direct bene ts assumptions : ese assumptions are the events and con-
ditions needed to occur if the practice changes are to be realized as a
direct bene t to the conditions of the targeted bene ciaries.  ese could
include such things as change practices result in a net increase in income,
routine use of health services, involvement in decision-making, and so
on. In the nutrition example, there may be an assumption that the only
change in the diet is the one recommended by the training program. If
the improved practices (e.g., more vegetables) are incorporated but then
other foods are reduced, the expected bene t may not occur.
Well-being change assumptions : e assumptions are the events and
conditions that need to occur if the direct bene ts are going to lead to
changes in the well-being of the bene ciaries. For example, if children
consume a better diet and if they have access to basic health care and
improved sanitation, they will improve their nutritional and health sta-
tus. If as a result of the intervention women begin to play a greater role
in food consumption decisions and if the intervention is seen as success-
ful, this could contribute to a change in gender norms that empowers
women.
Note that these causal link assumptions are not descriptions of the causal link.
A description of a causal link in Figure 1 (the solid arrows) would be, for exam-
ple, that the changes in knowledge skills and so on (capacity) will result in the
expected behaviour changes in actual practices. Causal link assumptions explain
how and why the causal link works.
Bringing about changes in behaviour can be quite challenging and has been
the subject of much research. Darnton (2008) reviews much of this literature.
A typical model is the NOA (needs, opportunities, and abilities) model in
Gatersleben and Vlek (1998) . It posits that behaviour change is brought about
by motivation and behaviour control (agency). In turn, motivation results
from needs and opportunities, and agency from opportunities and abilities.
All these elements are captured in the generic theory of change (knowledge,
skills, aspirations, attitudes, and opportunities) with di erent terms, albeit not
in as much causal detail. But the research suggests that the causal package for
behaviour change needs to include each of these components. Some are what
the intervention aims to change in terms of capacity. Others would be captured
as relevant in the behaviour change causal link assumptions. In the nutrition
example, it can be safely assumed that mothers do want to improve the health
of their children (motivation) and that the intervention aims to provide the
opportunities and abilities.
126 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
It can be useful to recognize two di erent types of capacity and behavioural
changes.  e rst are incremental or additional changes to the current state,
such as learning new techniques and skills or adopting new practices.  ese are
relatively easier to bring about than more fundamental changes , such as think-
ing about problems di erently or changing current practices. In the nutrition
example, if what is required is acquiring new food products for children, this is
an additional practice that is relatively straightforward. On the other hand, if the
practice change required is a redistribution of food among household members,
then this changes how food was distributed previously and raises power issues.
It is a fundamental change and likely considerably more di cult to bring about;
thus the associated causal link assumptions would need to be more robust and
challenging.
e discussion so far has been in deterministic terms (e.g., an assumption
is either necessary or it is not). However, we may want to re ect the probabil-
istic nature of causality. Mahoney (2008 , p. 421) argues that “a treatment is a
cause when its presence raises the probability of an outcome occurring in any
given case.” He introduces the useful ideas of probabilistically necessary causes—
“factors that usually or almost always have to be present for the outcome to
occur”—and probabilistically su cient causes—“a cause that much of the time
on its own will produce the e ect” (pp. 425–426). For many interventions being
evaluated, these are more realistic interpretations of necessity and su ciency.
us the causal link assumptions can be thought of as likely necessary assump-
tions, events and conditions that almost always have to occur for the causal link
to work.
Setting out assumptions for a theory of change can be confusing because
there are di erent types of assumptions associated with an intervention. In par-
ticular, in addition to the causal link assumptions discussed above, there are also
rationale assumptions that identify the underlying hypothesis or premise on which
the intervention is founded, such as the assumption that informing household
decision-makers about the bene ts of nutrition for their children will change
their behaviour and result in children getting a better diet. It would be expected
that the rationale for most interventions would be based on some prior evidence
and experience.
Figure 2 sets out the theory of change for the nutrition example.
6 A l t h o u g h
the nutrition example is not based on an actual case, see White (2009) for a discus-
sion of just such an intervention in Bangladesh.
I am arguing that in most interventions each of these components of the
generic theory of change—activities, outputs, capacity changes, behavioural
changes, direct bene ts, and well-being change, along with the associated causal
link assumptions—can be, and should be, identi ed and thought through when
developing impact pathways and theories of change.  e structure of the model
forces one to consider just how it is expected that the intended results will be
brought about: What is the causal process at work and what does it take to make
it happen? e model is a framework for analyzing how an intervention works.
Useful Theory of Change Models 127
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
THEORIES OF CHANGE AND CAUSAL PACKAGES
eories of change represent how and why it is expected that an intervention will
contribute to an intended result. But it is clear that rather more than the inter-
vention activities are needed; also needed is the realization of the causal assump-
tions.  e intervention activities are rarely the sole cause of a result.  e theory
of change depicts a causal package of activities plus assumptions that together
are expected—are su cient—to contribute to the intended results. Cartwright
and Hardie (2012) call these assumptions support factors : events and conditions
needed to bring about a contribution to the e ect of a cause.  e expectation is
also that the intervention activities in particular are an essential—a necessary—
part of this su cient causal package.  at is, without the intervention activities,
realization of the causal link assumptions would not be su cient to make a
contribution.  e intervention activities can then be said to be a contributory
Figure 2. A Nutrition Intervention Theory of Change
Mothers adopt
new feeding
practices
Innovative workshops
and information
External influences
Lower prices for food
Other staples become
more nutritious
Mothers acquire new
knowledge about
nutrition benefits and
feeding practices
Mothers reached
Children
consume a more
nutritious diet
Capacity change assumptions
Nutrition beneits understood
Feeding practices understood
and relevant
Reach assumptions
Targeted mothers with young
children reached
Approach & material seem
appropriate
Children’s
nutrition status &
health improve
Training & informing
on nutrition benefits &
feeding practices
Timeline
Unanticipated
results
Mothers become
more empowered
Husbands become
resentful
Behavioural change assumptions
Mothers want to improve the
health of their children
Mothers make decisions about
children’s food
New practices supported by
husbands and mothers-in-law
Nutritious food available and
affordable
Direct benefits assumptions
Practices prove practical
No reduction in other nutritious
food intake
Well-being change assumptions
Children have access to health
care
r
oth
r
s
a
o
o
d
do
n
s
s
&
r
a
m
u
n
e
d
i
n
g
p
r
a
c
th
o
n
M
ot
he
o
g
d
a
a
d
Nested Theory
of Reach for
Mothers
p
t
the
ot
th
Ch
n
u
Nested
Theories of
Reach for Girls
& Boys
128 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
cause to the results. In these terms, a theory of change is a model of the interven-
tion as a contributory cause ; it is a model of the causal package showing just how
the contribution to the results are to be brought about. Mayne (2012) discusses
contributory causes and causal packages in the context of theories of causation,
and in particular INUS causes.
7
e theory of change is a model of the contribution to and not cause per
se of the intended result, because there may be other external factors also con-
tributing to the intended results, as noted in the external in uences box. Only
if there are no external in uences at work is the theory of change a model of
causation. As with an intervention, an external in uence usually does work just
on its own, but rather as part of another causal package that might include some
of the supporting factors in the intervention causal package. External in uences
can have positive or negative e ects on the level of results attained. Depending
on the strengths of the intervention, the external in uences may explain some
or all of the observed results. Signi cant negative e ects, that is, risks that could
undermine the intervention’s theory of change, are included in the causal link
assumptions.
In probabilistic terms, we can speak of likely su cient to describe the suf-
ciency of the intervention causal package, meaning that, in this case, the causal
package most likely produced a contribution to the observed result. To show that
the intervention is a contributory cause is to show that the interventions causal
package is likely su cient, and that the intervention is itself a likely necessary
element of the su cient package.
In discussing theories of change, it is useful to distinguish the ex ante from
the ex post case . Ex ante, there is a need to speak of probabilistic causes and likely
su ciency. Ex ante, one has a postulated or prior theory of change setting out the
argument that if the intervention is implemented as designed and if the assump-
tions associated with the ToC hold, then the intended contribution to the results
will be realized. It sets forth the assumed reality and complexity of the interven-
tion. It is a prediction of e ectiveness.
Ex post, you are verifying that the theory of change did occur with evidence
on the results and assumptions that were realized. When you make a causal claim,
you know which factors were at work and whether something in addition was at
play. If you conclude that the package was likely su cient, here it means that you
recognize that you may have missed something in your analysis, but that reason-
able people would conclude that the causal package was indeed su cient. Ex post
you are testing the ex ante causal hypothesis. As noted, ex post you are likely to be
able to identify if there were other external in uences at work. If there were none,
then the intervention causal package can be said to have caused the observed
result, not just contributed to it.
e intervention itself is one among several causal factors in the causal pack-
age necessary to bring about change. In that sense, all are equal. Yet our interest
is on the intervention as an instrument of change—activities deliberately done
to get or continue change happening where adequate change was not happening
Useful Theory of Change Models 129
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
before. We can ask ex post what role the intervention played in bringing about the
changes. We may expect that at a minimum the intervention acts as a trigger to
start the causal chain. In such cases, an intervention can be said to be a principal
contributory cause. In other cases, the intervention might see itself as playing
a more modest supporting role, joining others in an already ongoing process,
enhancing a change process already underway so that better or more timely results
are achieved ( Mayne, 2008 ).
MULTIFACETED SUFFICIENT INTERVENTIONS
Although there is a lot in Figure 1 , it was referred to as a “basic” generic theory
of change.  is is because it only shows one actor undertaking activities, and the
model may su ce for many straightforward interventions. But for many, more
complicated interventions, this is generally not the case. To make a di erence, an
intervention needs to engage and work with a variety of other intermediaries—
delivery partners, governments, the private sector, and NGOs—and in uence
their behaviour.  e theory of change shown in Figure 1 identi es a possibly
wide range of causal link assumptions that need to occur if the direct bene ts
and well-being changes are to be realized. Leaving these to chance may not be an
option, and the intervention should work with relevant intermediaries, including
delivery partners, to try to make sure that the intermediaries undertake actions
to ensure (or go a long way to ensuring) that the numerous causal link assump-
tions are brought about.  ese supporting activities carried out by the intervention
actors are in addition to its main or core activities. We can thus speak of the core
intervention and the overall intervention . In an agriculture research for develop-
ment intervention, the core intervention is the research activities, while those
plus engagement supporting activities that are carried out to get the research
used constitute the overall intervention. In other cases, there are no identi able
core or main activities, and the intervention works with a variety of partners to
collectively deliver a su cient set of activities.
Typically, these causal link assumptions can cover a range of events or condi-
tions that create an enabling environment for the intervention activities to contrib-
ute to well-being.  is results in a much more multifaceted overall intervention
but with the aim of ensuring that it is su cient : that the collection of (core) inter-
vention e orts, its engagement activities, and the resulting actions by intermedi-
aries are su cient to contribute to the expected bene ts and well-being changes.
at is, the set of engagement activities are aimed at ensuring that the causal link
assumptions—the support factors—are realized.
We can still ask if the core intervention was a principle contributory cause,
that is, did it play a trigger role in getting change started. And in the multifaceted
su cient contexts, the intervention will also involve other subsequent support-
ing actions taken along the causal pathway to sustain the causal pathway.  us,
we would like to assess whether the core intervention is a triggering contributory
cause and a sustaining contributory cause.
130 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
A strong causal claim about a multifaceted su cient intervention would be
that the intervention was a principal contributory cause of the relevant observed
results.  at is,
e intervention was a necessary component of a package of causal factors that to-
gether were su cient to contribute to an observed result. In other words, the interven-
tion made a di erence . In addition, the intervention played a key role; it was the trigger
that initiated the chain of events and through its supporting activities sustained the
chain of events that contributed to the observed results.
Figure 3 illustrates the generic theory of change for this more complex,
indeed multifaceted su cient intervention . 8
In building a ToC, it can be useful to identify the degree of control one has
or might have over the causal link assumptions. Assumptions can be labelled as
[O], over which the intervention has no or very little in uence; [I], where the
intervention can (should) have an in uence, direct or indirect; or [C], where
the intervention should be able to directly control.  is helps to identify where
additional supporting actions might be useful to better ensure the assumptions
are realized and hence the risks to the intervention minimized, perhaps leading
to a multifaceted intervention.
Using the nutrition example, Table 1 illustrates the type of ex ante causal link
analysis that can be undertaken. Each of the assumptions in Figure 2 is assessed
Figure 3. A Basic Theory of Change for Multifaceted Su cient Interventions
Reach &
reaction
Capacity changes
Behaviour changes
Well-being changes
Direct benefits
assumptions
Behavioural
change
assumptions
Capacity
change
assumptions
Reach
assumptions
External
influences
Engagement activities and outputs
Direct benefits
Well-being
change
assumptions
Timeline
Core activities and outputs
Timeline
Reach, Capacity change
Behavioural change of intermediaries
Useful Theory of Change Models 131
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
Table 1. Analysis of Nutrition Intervention Causal Link Assumptions
Causal link assumptions Degree of
control Supporting actions needed
beyondcore activities
A1 Reach Assumptions
Targeted mothers with
young children reached Medium [I] Intervention needs to know its target
population and how to reach them.
Action: Likely requires outreach e orts.
Approach and material
seems appropriate High [C] Requires good planning and knowing
the speci c context.
A2 Capacity Change Assumptions
• Nutrition bene ts
understood High [C] Requires good planning and knowing
the speci c context.
• Feeding practices
understood and relevant High [C] Requires good planning and knowing
the speci c context.
A3 Behavioural Change Assumptions
Mothers want to
improvethe health of their
children
n/a Can be assumed.
Mothers make decisions
about children’s food Unknown Would require knowledge of the
speci c context.
New practices supported
by husbands and
mothers-in-law
Low [I] Action: Need for engagement with
husbands/mothers-in-law on need for
better nutritional diets for children.
• Nutritious food
availableand a ordable High [C] A prerequisite for the intervention.
Ifnot likely available, need a
di erenttype of intervention such
assubsidies.
A4 Direct Bene ts Assumptions
Practices prove practical Medium [I] Action: Could require monitoring to see if
practices do prove practical in the speci c
context.
No reduction in other
nutritious food intake High? [C] Should be part of the training: don’t
stop consuming other nutritious food.
But, risk exists that husbands and
mothers-in-law in the poor households
will insist on substituting.
Action: Need to engage with husbands/
mothers-in-law.
A5 Well-being Change Assumptions
Children have access to
health care ?? [O] Would probably just be assumed. If
health is a major problem, then might
question the intervention.
132 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Figure 4. A Multifaceted Nutrition Intervention
An
Mothers adopt
new feeding
practices
Innovative workshops
and information
External influences
Lower prices for food
Other staples become
more nutritious
Mothers acquire new
knowledge about
nutrition benefits and
feeding practices
Mothers reached
Children
consume a more
nutritious diet
Children’s
nutrition status &
health improves
Training & informing
on nutrition benefits &
feeding practices
Time line
Unanticipated
results
Mothers become
more empowered
Husbands become
resentful
A1
A4
A
A3
A5
A2
Engagement
with NGO
Husbands /
mothers-in-
law
appreciate
the need for
nutritious
diets
NGO
engages with
husbands/
mothers-in-
law
Research and outreach
efforts undertaken to
well-identify target
groups and best
means for engaging
with them
NGO establishes
appropriate M&E
on practices tried
Intervention activities
Efforts supporting an
assumption
Causal link
assumptions
Legend
Nested Theory
of Change for
NGO
as to the degree to which the intervention could undertake e orts to strengthen
the likelihood that the assumption will materialize.
In the example, it may be that husbands and/or mothers-in-law are not likely
to support their wives making decisions about who gets what food.  en, in order
for the intervention to work, some form of education of husbands and mothers-
in-law about the bene ts of a nutritious diet for their children is needed.  e
intervention agency may need to get others, perhaps an NGO, more accustomed
to dealing with culture and gender issues to engage with husbands and mothers-
in-law to in uence their behaviour. Figure 4 illustrates the resulting multifaceted
nutrition intervention.
Ex ante causal link analysis can also be used to a priori assess the extent
to which there is empirical evidence to support each link in a ToC. In many
Useful Theory of Change Models 133
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
cases it is likely that indeed there are supporting prior research and evaluation
ndings that support some of the causal links, and equally it is o en the case
that such prior evidence is weak or not existing.  e latter case would suggest
that some new research be undertaken to better con rm the causal link before
implementing the initiative and/or that the assumptions for these links be care-
fully monitored as the intervention is implemented.  is type of causal link
analysis is discussed by Mayne and Johnson (2015) and by Johnson, Mayne,
Grace, and Wyatt (2015) .
As interesting, of course, is ex post causal link analysis of a theory of change,
determining the extent to which a causal link and its assumptions have occurred
and a credible causal claim be made.  is is the essence of contribution analysis
( Mayne, 2008 ; Mayne, 2012 ).
DEALING WITH MESSY INTERVENTIONS
Figures 1 and 3 could be seen as targeting one group of bene ciaries, such as chil-
dren in the nutrition example ( Figure 2 ). However, interventions o en have sever-
al target groups in mind (such as mothers and children) and/or subgroups within
a general group (such as boys and girls). For multifaceted su cient interventions
( Figure 3 ), there are usually several di erent intermediaries (governments, or-
ganizations, and partners) targeted. For these multitargeted interventions, one
approach would be to try to develop a theory of change that captures all these ac-
tivities on the various target groups and the resulting result sequences, capturing
the links among the various pathways. However, developing and setting out such
a model other than as an overview—which is helpful —can be quite challenging,
and the resulting quite messy theory of change model can become cumbersome
and hard to work with, either in terms of explaining the intervention or for help-
ing design the evaluation.
Nested Theories of Change
Instead, it would be much more useful to develop a subtheory of change for each
key target group—a nested theory of change or theory of reach 9 —recognizing that
these theories of reach may interact with each other in bringing about the desired
results. Figure 2 shows nested theories of reach (the oval shapes) for mothers and
for girls and boys—boys might be treated di erently than girls, and having theo-
ries of reach for each would ensure a focus on these di erences.
Figure 4 identi es the nested theory of change for NGOs in the nutri-
tion example, which is illustrated in Figure 5 .  e assumptions in the NGO
theory of change ( Figure 5 ) are ones that the NGO should be able to control or
strongly in uence. Figure 6 illustrates nested theories of reach for the generic
multifaceted su cient intervention. Nested theories of change o er a way to
break down a more messy theory of change into something more understand-
able and practical.
134 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Figure 5. Nested NGO Theory of Change
Support for mothers
managing children’s
diets
Engagement material
and information
Changes in knowledge
& attitudes toward
nutrition & diets for
children
Husbands and
mothers-in-law
reached
Behaviour Change Assumptions
No loss of prestige seen
Beneits seen from mothers
deciding on diets
Capacity Change Assumptions
Support from community
leaders and peers
Reach Assumptions
Engagement is culturally
sensitive
NGO activities
Intervention
engaging with NGO
Figure 6. Nested Theories of Change
Reach and
reaction
Capacity changes
Behaviour changes
Well-being changes
Direct
benefits
assumptions
Behavioural
change
assumptions
Capacity
change
assumptions
Reach
assumptions
External
influences
Supporting activities and outputs
Direct benefits
Well-being
change
assumptions
Timeline Activities and outputs
Timeline
Reach, Capacity change
Behavioural Change
Different
Beneiciary
Nested ToC
Different
Intermediary
Nested ToC
A
A
A
AA
A
A
A
A
A
A
A causal link with
assumptions
Useful Theory of Change Models 135
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
Causal Link Analysis
Another way to handle a messy theory of change is to discuss the di erent major
causal links in the theory of change separately, such as discussing the link “get-
ting from capacity changes to behavioural changes.” In addition, discussion of, for
example, the di erent causal link assumptions can be done in an accompanying
narrative that could also provide suitable references to prior research and evalu-
ation that support the underlying assumptions, as done in Table 1 . Mayne and
Johnson (2015) illustrate this approach.
Uncertainty and Emerging Results
Interventions vary in their “messiness”—from more complicated, such as the
multifaceted su cient interventions discussed earlier, to truly complex interven-
tions exhibiting uncertainty and emergent properties. In evaluating truly complex
interventions, using evaluation for incremental learning and adapting over time
is usually suggested ( Ling, 2012 ; Mayne, 2011 , pp. 82–84; Rogers, 2011 ; Sander-
son, 2000 ). Consistent with that thinking would be developing initial theories of
change such as the ones discussed here, which are then revised and adapted as
new knowledge is acquired. Rogers (2008) and Ling (2012) discuss using program
theories/theories of change in complex settings.
DIFFERENT VERSIONS OF A THEORY OF CHANGE
FORDIFFERENT PURPOSES
ere are clearly limits to how much detail can be usefully depicted in a theory
of change model, especially of a large and multifaceted intervention. Something
more manageable is needed, both to work with and for communication purposes.
It can be useful to have at least three versions of each theory of change.
e rst is a text version, describing in a sentence or two how the speci c
intervention being planned or implemented is intended to work, a theory of change
narrative . is version explains in a straightforward manner how the intervention
is supposed to work and can identify the underlying rationale assumptions behind
the intervention.  is is the basic description or “story line” given by managers
(or politicians) when asked to describe why they think the intervention will work,
or set out in a policy-type documentation, usually entailing a few sentences. An
example might be the simple theory for an anti-smoking TV ad intervention: by
describing on TV the dangers of smoking, smokers will stop smoking. In the child
nutrition example, the theory of change narrative would be something like: “By
educating and informing mothers about the importance of a nutritious diet for
their children, mothers will change their past behaviour and seek to improve the
diets of their children.”  e rationale assumption here is that better information
will change behaviour.
e theory of change narrative plays an important role, because it sets out
how the intervention will be publicly described and defended. It is in essence the
public theory of change.
136 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
e second theory of change version is a simpli ed overview theory of change
to show the big picture for a multifaceted intervention.  is is especially useful
for multifaceted su cient interventions.  e overview theory of change can just
be a simpli ed impact pathway showing as relevant any nested theories of change,
along with the rationale assumptions. Figure 7 illustrates the nutrition example
with the theory of change for engaging with husbands and mother-in-law noted
in the triangle.
e third and more detailed version of a causal theory of change is usually a
diagram model such as those shown in Figures 1 through 5 , showing the impact
pathways and the causal link assumptions details of the theory of change. Each
of these versions of a theory of change has its uses, and o en all three are helpful
to have at hand.
A further way to simplify a theory of change model by dropping “boxes”
and including their essence in the causal link assumptions—essentially rear-
ranging the causal package for the link. For many interventions, displaying all
the elements of their impact pathway or theory of change in a single diagram
can be cumbersome, resulting in a too-complex diagram of arrows and boxes.
Figure 8 shows a “simpli ed” version of Figure 1 in which the Reach and Capac-
ity Change boxes have been dropped.  is is o en tempting to do since it is the
behavioural changes that are thought to be the key outcomes along the impact
pathway.
Figure 8 still shows the essence of the impact pathway, but in developing
it as a theory of change, it needs to be remembered that the reach and capacity
change aspects are not explicitly shown. In this case, the assumptions behind
the arrows leading from activities and outputs to Behavioural Changes need to
include assumptions about reach and capacity change.  at is, the causal pack-
ages associated with each link remain intact , just positioned di erently. Ignoring
the reach and capacity change issues will signi cantly weaken the theory of
change.
Figure 7. Overview of Nutrition Intervention
Mother adopts new
feeding practices
Mother acquires new
knowledge about nutrition
benefits and feeding practices
Children’s nutrition
status & health
improves
ToC for
engaging with husbands &
mothers-in-law (Fig 6)
Useful Theory of Change Models 137
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
BUILDING IMPACT PATHWAYS AND THEORIES OF CHANGE
10
e concept and application of theories of change can appear complicated, but
only because “theory of change” is not one thing per se.  is is similar to the con-
cept of “evaluation” that can be many things, depending on a variety of situations.
eories of change
are time dependent—can vary over time
have di erent purposes
need to recognize uncertainties and nonlinearities
can be ex ante and ex post.
ere are now numerous sources available for guidance on developing theo-
ries of change. Vogel (2012a) and Barnett and Gregorowski (2013) discusses theo-
ries of change in relation to research interventions.  ere is an extensive website
on theories of change at www.theoryofchange.org with references to many other
guides and relevant literature.
In getting to a robust prior theory of change, initial versions should be tested
against the logic and assumptions set out, as well as against any available evidence
from previous research or evaluations that might (or might not) support the way
the theory of change is being depicted.  is challenging of a theory of change
is what Brousselle and Champagne (2011) and Kautto and Silila (2005) discuss,
arguing the value of this type of theory of change analysis even before testing it
in the  eld against the actual results of the speci c intervention in question.  e
Figure 8. A Simpli ed Generic Theory of Change
Behaviour
changes
Outputs
External
influences
Direct
benefits
Direct benefits
assumptions
Behavioural change
assumptions
Assumptions about
reaching target groups
Assumptions about
bringing about capacity
change
Well-being
changes
Well-being change
assumptions
Activities
Timeline
Unanticipated
results
138 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
analysis undertaken to develop the theory of change may uncover weaknesses in
initial ideas and assumptions about how the intervention is supposed to work.
As noted at the outset, a theory of change can also be used as a framework for
designing the intervention, developing a monitoring regime, and developing an
evaluation plan.
In developing impact pathways and theories of change, several points should
be kept in mind:
ey are probably best developed in a participatory manner, but this is
not always possible.
In a participatory process, one can start with a blank page and build
from soliciting views or, perhaps more e ciently, with a straw impact
pathway/theory of change that is developed by a few people and then
used as the basis for comment, challenge, and revision.
In discussion with stakeholders, more than one version of an interven-
tion’s theory of change may emerge ( Hansen & Vedung, 2010 ; Weiss,
1997 ). It may then be useful to test both versions against reality.
It is important to explicitly or implicitly include all the theory of change
elements.
Developing impact pathways and theories of change should be seen as a
process, evolving over time as more insight is gained.
Aim for a “good enough” impact pathway/theory of change, rather than
the perfect one.
e capacity and behavioural changes are o en key.
To the extent possible, impact pathways and theories of change should
be based on prior research in addition to stakeholder views.
Nested impact pathways and theories of change/theories of reach can be
quite useful, developed around the types of intervention strategies being
used and/or target groups.
eories of change can be displayed in a variety of ways and can be set
out at di erent levels of detail.
Generic impact pathways and theories of change can be quite useful as
building blocks when similar interventions occur at di erent locations.
CLOSING REMARKS
Credible theories of change are essential for undertaking theory-based evalu-
ations.  e models discussed here are meant to be  exible enough to apply to
a wide range of interventions.  e article argues that the model of a theory of
change illustrated generically in Figures 1 and 3 are “useful.”  ey are useful for
several reasons:
e models are o en a “good enough” representation of a theory of
change and not overly complex.  ey lay the basis for a logical perfor-
mance story ( Mayne, 2004 ).
Useful Theory of Change Models 139
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
e models deliberately avoid explicit labelling of results along the im-
pact pathway as di erent levels of outputs and especially outcomes, such
as immediate, intermediate, and  nal outcomes.  ese output and out-
come labels have no inherent meaning and are not helpful in developing
a theory of change—indeed they o en lead to wasted debate. Rather, it
is the sequence that is important.  e goods and services, reach, capac-
ity change, behavioural change, and other labels in Figures 1 and 3 have
intuitive meaning and provide a good analytical structure for developing
a theory of change.
Causal link assumptions can be well de ned, describing what is necessary
for the link to work, and they are front and centre in a theory of change.
e use of the causal link assumption boxes allows for a more straight-
forward looking representation. Otherwise, many more boxes and ar-
rows would be needed.
e theory of change model can be o en simpli ed somewhat by drop-
ping a “result box” and including it as an assumption instead.
More complicated theories of change can be simpli ed by using the idea
of nested theories of change and reach to focus on key nested impact
pathways.
e model with assumptions as support factors links directly with the
concepts of causal packages and contributory causes, providing a rigor-
ous basis for making causal claims.
NOTES
1
e term “logic model” is sometimes used synonymously with program theory or
theory of change ( Funnell and Rogers, 2011 ), but o en is identi ed with only the
causal pathway.  us, for example, the Canadian federal government de nes logic
model as “a depiction of the causal or logical relationships between activities inputs,
outputs and the outcomes of a given policy, program or initiative, e.g., Results Chain”
( Treasury Board Secretariat, 2012 ).
2 e main revisions were to simplify the representation of the model by dropping
explicit references to “risks,” “other explanatory factors,” and “incentives” and making
explicit reference to unanticipated results.
3 Knowledge pertains to learned information or accepted advice; attitudes focus on
beliefs, opinions, feelings, or perspectives; skills refer to mental and physical abilities
to use new or alternative practices; aspirations refer to ambitions, hopes, objectives,
or desires. Adapted from Bennett and Rockwell (1995 , p. 6).
4 Well-being is the broad term used here for the end result aimed for. Livelihood is
another term that could be used.
5 In previous articles, I had o en explicitly included “risks” in the assumption boxes,
noting that some assumptions are more easily understood and written as risks.  is
can be useful, but does clutter the boxes somewhat.
6 e nested theories of reach in Figure 2 are discussed later.
7 INUS stands for an Insu cient but Necessary part of a condition that is itself Unneces-
sary but Su cient for the occurrence of the e ect ( Mackie, 1974 ).
140 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
8 Figure 3 illustrates one type of complicated and complex intervention, with core and
supporting activities. Another (not shown) would be a multicomponent su cient in-
tervention made up of a number of quite separate and distinct component activities,
which together are expected to lead to improved well-being. Here the components
would be nested theories of change within a larger overview theory of change.
9 eories of reach are discussed in Mayne (2014) .
1 0 e points in this section are further elaborated on in Mayne and Johnson (2015) .
REFERENCES
Barnett , C. , & Gregorowski , R. ( 2013 ). Learning about theories of change for the monitoring
and evaluation of research uptake (IDS Practice Paper in Brief, ILT Brief 14: Insti-
tute of Development Studies). Retrieved from http://opendocs.ids.ac.uk/opendocs/
bitstream/handle/123456789/2995/PP%20InBrief%2014%20FINAL.pdf;jsessionid=
4E0FEAAE919534B1B2A65F654E121023?sequence=1
Bennett , C. , & Rockwell , K. ( 1995 ). Targeting outcomes for programs: A hierarchy for tar-
geting outcomes and evaluating their acheivement (University of Nebraska). Retrieved
from ftp://bsesrv214.bse.vt.edu/grisso/Program_Logic/Targeting_Outcome_
Programming.pdf
Bickman , L. (Ed.). ( 1987 ). Using program theory in evaluation (New Directions for Evalu-
ation, no. 35). San Francisco, CA : Jossey-Bass .
Brousselle , A. , & Champagne , F. ( 2011 ). Program theory evaluation: Logic analysis . Evalu-
ation and Program Planning , 34 , 69 – 78 .
Cartwright , N. , & Hardie , J. ( 2012 ). Evidence-based policy: Doing it better. A practical guide
to predicting if a policy will work for you . Oxford, UK : Oxford University Press . http://
dx.doi.org/10.1093/acprof:osobl/9780199841608.001.0001
Chen , H. T. ( 2015 ). Practical program evaluation:  eory-driven evaluation and the inte-
grated evaluation perspective ( 2nd ed. ). ousand Oaks, CA : Sage .
Darnton , A. ( 2008 ). Practical guide: An overview of behaviour change models and their
uses. Retrieved from http://www.civilservice.gov.uk/wp-content/uploads/2011/09/
Behaviour-change_practical_guide_tcm6-9696.pdf
Funnell , S. , & Rogers , P. ( 2011 ). Purposeful program theory: E ective use of theories of change
and logic models . San Francisco, CA : Jossey-Bass .
Gatersleben , B. , & Vlek , C. ( 1998 ). Household consumption, quality of life and environ-
mental impacts . In K. Noorman and A. Schoot-Uiterkamp , Eds., Green households?
Domestic consumers, environment and sustainability (pp. 141–183). London, UK :
Earthscan .
Hansen , M. B. , & Vedung , E. ( 2010 ). eory-based stakeholder evaluation. American
Journal of Evaluation , 31 ( 3 ), 295 – 313 . http://dx.doi.org/10.1177/1098214010366174
James , C. ( 2011 ). eory of change review (Report commissioned by Comic Relief).
Retrieved from http://mande.co.uk/blog/wp-content/uploads/2012/03/2012-Comic-
Relief- eory-of-Change-Review-FINAL.pdf
Johnson , N. , Guedenet , H. , & Saltzman , A. ( 2014 ). What will it take for bioforti cation to
have impact on the ground?  eories of change for three crop-country combinations
Useful Theory of Change Models 141
CJPE 30.2, 119–142 © 2015doi: 10.3138/cjpe.230
(IFPRI discussion paper). Washington, DC : International Food Policy Research Insti-
tute . Retrieved from http://ebrary.ifpri.org/cdm/singleitem/collection/p15738coll2/
id/129089/rec/1
Johnson , N. , Mayne , J. , Grace , D. , & Wyatt , A. ( 2015 ). How will training traders con-
tribute to improved food safety in informal markets for meat and milk? A theory of
change analysis (IFPRI discussion paper 1451). Washington, DC : International Food
Policy Research Institute . Retrieved from http://ebrary.ifpri.org/cdm/ref/collection/
p15738coll2/id/129293
Kautto , P. , & Silila , J. ( 2005 ). Recently introduced policy instruments and intervention
theories . Evaluation , 11 ( 1 ), 55 – 68 .
Ling , T. ( 2012 ). Evaluating complex and unfolding interventions in real time. Evaluation ,
18 ( 1 ), 79 – 91 . http://dx.doi.org/10.1177/1356389011429629
Mackie , J. L. ( 1974 ). e cement of the universe: A study of causation . Oxford, UK : Oxford
University Press .
Mahoney , J. ( 2008 ). Toward a uni ed theory of causality. Comparative Political Studies ,
41 ( 4-5 ), 412 436 . http://dx.doi.org/10.1177/0010414007313115
Mayne , J. ( 2004 ). Reporting on outcomes: Setting performance expectations and telling
performance stories. Canadian Journal of Program Evaluation , 19 ( 1 ), 31 – 60 .
Mayne , J. ( 2008 ). Contribution analysis: An approach to exploring cause and e ect , (ILAC
Brief No. 16).  e Institutional Learning and Change Initiative. Retrieved from http://
www.cgiar-ilac.org/ les/publications/briefs/ILAC_Brief16_Contribution_Analysis.pdf
Mayne , J. ( 2011 ). Contribution analysis: Addressing cause and e ect . In R. Schwartz , K.
Forss , & M. Marra (Eds.), Evaluating the complex (pp. 53 – 96 ). New Brunswick, NJ :
Transaction .
Mayne , J. ( 2012 ). Contribution analysis: Coming of age? Evaluation , 18 ( 3 ), 270 – 280 . http://
dx.doi.org/10.1177/1356389012451663
Mayne , J. ( 2014 ). Using theories of reach to enhance equity considerations in evaluation .
In K. Forss & M. Marra (Eds.), Speaking justice to power: Ethical and methodological
challenges for evaluators (pp. 133 – 152 ). New Brunswick, NJ : Transaction .
Mayne , J. , & Johnson , N. ( 2015 ). Using theories of change in the Agriculture for Nutrition
and Health CGIAR research program . Evaluation , 21 ( 4 ), 407–428.
Montague , S. , & Porteous , N. ( 2013 ). e case for including reach as a key element of
program theory. Evaluation and Program Planning , 36 ( 1 ), 177 – 183 . http://dx.doi.
org/10.1016/j.evalprogplan.2012.03.005
Morra Imas , L. G. , & Rist , R. C. ( 2009 ). e road to results: Designing and conducting e ec-
tive development evaluations . Washington, DC : World Bank .
Patton , M. Q. ( 2008 ). Utilization-focused evaluation ( 4th ed. ). ousand Oaks, CA : Sage .
Rogers , P. ( 2008 ). Using programme theory to evaluate complicated and complex aspects of
interventions. Evaluation , 14 ( 1 ), 29 – 48 . http://dx.doi.org/10.1177/1356389007084674
Rogers , P. ( 2011 ). Implications of complicated and complex characteristics for key
tasks in evaluation . In K. Forss , M. Marra , & R. Schwartz (Eds.), Evaluating the
complex: Attribution, contribution and beyond (pp. 33 – 52 ). New Brunswick, NJ :
Transaction .
142 Mayne
© 2015 CJPE 30.2, 119–142 doi: 10.3138/cjpe.230
Rossi , P. H. , Lipsey , M. W. , & Freeman , H. E. ( 2004 ). Evaluation: A systematic approach ( 7th
ed. ). ousand Oaks, CA : Sage .
Sanderson , I. ( 2000 ). Evaluation in complex policy systems. Evaluation , 6 ( 4 ), 433 – 454 .
http://dx.doi.org/10.1177/13563890022209415
Stein , D. , & Valters , C. ( 2012 ). Understanding ‘theory of change’ in international develop-
ment: A review of existing knowledge . Asian Institute and the Justice and Security
Research Programme. Retrieved from http://www.theoryofchange.org/wp-content/
uploads/toco_library/pdf/UNDERSTANDINGTHEORYOFChangeSteinValtersPN.
pdf
Suchman , E. D. ( 1967 ). Evaluative research: Principles and practice in public service & social
action programs . New York, NY : Russell Sage Foundation .
Treasury Board Secretariat . ( 2012 ). Results-based management lexicon . Ottawa: Author.
Retrieved from http://www.tbs-sct.gc.ca/cee/pubs/lex-eng.asp
United Nations Development Group . ( 2011 ). Results-based management handbook: Har-
monizing RBM concepts and approaches for improved development results at country
level . Retrieved from https://undg.org/wp-content/uploads/2015/01/UNDG-RBM-
Handbook-2012.pdf
Vogel , I. ( 2012a ). ESPA guide to working with theory of change for research projects . Ecosys-
tem Services for Alleviation of Poverty. Retrieved from http://www.espa.ac.uk/ les/
espa/ESPA- eory-of-Change-Manual-FINAL.pdf
Vogel , I. ( 2012b ). Review of the use of ‘theory of change’ in international development .
Department for International Development. Retrieved from http://www.oxfamblogs.
org/fp2p/wp-content/uploads/DFID-ToC-Review_VogelV4.pdf
Weiss , C. H. ( 1997 ). How can theory-based evaluation make greater headway? Evaluation
Review , 21 ( 4 ), 501 – 524 . http://dx.doi.org/10.1177/0193841X9702100405
White , H. ( 2009 ). Theory-based impact evaluation: Principles and practice (Work-
ing Paper 3). International Initiative for Impact Evaluation (3ie). Retrieved
from http://www.3ieimpact.org/admin/pdfs_papers/48.pdf . http://dx.doi.
org/10.1080/19439340903114628
AUTHOR INFORMATION
John M ayne is an independent advisor on public sector performance. Over the last 11 years
he has focused largely on international development evaluation and results-based manage-
ment work. He has been working with a number of government, NGOs, and international
organizations. He has authored numerous articles and reports, including several on con-
tribution analysis, and co-edited eight books on program evaluation and performance
monitoring. In 1989 and in 1995, he was awarded the Canadian Evaluation Society Aw ar d
for Contribution to Evaluation in Canada . In 2006, he was made a Canadian Evaluation
Society Fellow. Dr. Mayne’s current research interests are on approaches for strengthening
impact evaluation, useful theories of change, and dealing with attribution.
... Addressing these questions provides a basic indication of the degree of certainty around whether the programme can solve the problem it has set out to address and whether the stakeholders are in agreement about this. In complex situations, such as with development programming, the key value of undertaking a participatory and iterative ToC process is that it helps the stakeholders to learn and adapt to be able to achieve their planned impact (Ling, 2012;Mayne, 2015). ...
... In fact, it may not be possible to articulate all of this, in the usually comfortable level of detail, before the programme begins; hand in hand with becoming increasingly complexity-aware is getting comfortable with the concept of emergence (Eguren, 2011;Jenal, 2016;Mayne, 2015;Reeler, 2007;Rogers, 2008). ...
... If this product is unclear, it is of limited value. Nested ToCs (Mayne, 2015) can be very useful for capturing both the overview level and the detail for complex programmes. These can be of particular value if only specific key links in a programme's IH and logframe are being explored and tested (Vogel, 2012) as the overall ToC can then be supplemented by the relevant detail for those specific causal links or programme components. ...
Article
Full-text available
The purpose of this briefing note is to review opportunities for using complexity- aware approaches to Theory of Change (ToC) to inform the SDC approach. It provides an overview of complexity-aware approaches and then focuses on demonstrating how complexity thinking can support programming by building on the framework
... Given the value of thinking through and developing ToCs when planning an intervention, this article looks at using what I have called Useful ToCs (Mayne, 2015) and takes a sustainability lens to help in explicitly planning and evaluating for the sustainability of interventions. In their article, Sridharan and Nakaima (2019) argue 'for the inclusion of sustainability considerations in theories of change (ToCs), both for program planning and for evaluative purposes in assessing programs.' ...
... As an example of carrying out analysis for sustainable benefits, consider an intervention aimed at improving the nutritional diets of young pre-school children in a particular region by providing knowledge and training to mothers. I have used this example earlier in Mayne (2015) and Mayne (2017). Here I will extend the analysis to look at the sustainability of the intervention. ...
... The bigger the challenge the more likely sustainability will be at risk. See the discussion in (Mayne, 2015) where a nested ToC for such an NGO engagement is discussed. ...
Preprint
Full-text available
Theories of change (ToCs) are models of how an intervention is expected to bring about desired changes in results of interest. Robust ToCs spell out the conditions under which the intervention should 'work', i.e., bring about or contribute to the desired results. But rarely does the ToC address issues of the future sustainability of the benefits from the intervention. We discuss how ToCs can adopt a sustainability lens and, along with the intervention, become sustainability-aware, by undertaking a sustainability analysis, exploring the sustainability of the various key ToC elements and seeking to identify and support sustainability mechanisms.. Theories of change (ToCs) are now widely used in evaluation and intervention planning for a variety of purposes. They can help design interventions, serve as a basis for theory-based evaluations, help manage interventions and be a framework for reporting on performance (Silva, Breuer, Lee, Asher, Chowdhary, Lund and Patel, 2014; Mayne and Johnson, 2015). A key expectation of many interventions is that the benefits realized continue once the intervention itself ends. However, as Sridharan and Nakaima (2019) point out, planning for sustainability in interventions is rarely done and in developing ToCs for interventions, identifying sustainability concerns is rarely undertaken. More often, towards the end of an intervention, questions may be asked about sustainability, perhaps to be addressed in an evaluation. Given the value of thinking through and developing ToCs when planning an intervention, this article looks at using what I have called Useful ToCs (Mayne, 2015) and takes a sustainability lens to help in explicitly planning and evaluating for the sustainability of interventions. In their article, Sridharan and Nakaima (2019) argue 'for the inclusion of sustainability considerations in theories of change (ToCs), both for program planning and for evaluative purposes in assessing programs.' This article looks at using robust and sustain ability-aware ToCs to help design sustainability-aware interventions. The article first sets out the kind of sustainability being addressed and introduces a behaviour change ToC model. It then discusses how to apply a sustainability lens to the ToC to identify the kinds of actions needed to achieve benefits sustainability. Finally it applies the sustainability analysis to an example intervention, identifying the findings of the sustainability analysis and linking them to the ToC model.
... Issues of lack of clarity, poor sequencing, omissions and misalignment of project statements frequently occur when documenting a project narrative. A number of tools have been developed to facilitate this task but challenges still exist ( [8], [9], [10]). The logical framework, one of the project design tools especially in the development sector, for example, has been modified several times over its 40-year history, but challenges are still being reported arising from its application ( [9], [10]). ...
... A number of tools have been developed to facilitate this task but challenges still exist ( [8], [9], [10]). The logical framework, one of the project design tools especially in the development sector, for example, has been modified several times over its 40-year history, but challenges are still being reported arising from its application ( [9], [10]). ...
Article
Full-text available
This article discusses the project domain framework (PDF) which was developed as a project management tool to facilitate the documentation of a concept at the initiation phase of a project into a business case. Most importantly, the PDF incorporates measurable results into the business case to facilitate effective monitoring and evaluation (M&E) of project results. The PDF development was prompted by the authors’ experiences which often indicated that project champions have challenges in systematically and logically linking project statements to produce a well-articulated business case. Action research strategy was used as the research approach. It involved a synthesis of lessons learnt from client project assignments spanning a period of ten years in Botswana and South Africa. PDF consists of three sub-tools, the project domain map (PDmap), project domain matrix (PDmat) and the project narrative guide (PDnarr). The PDmap systematically guides the design of a project concept and logically links the project components. These are then translated into brief statements which are entered in the PDmat. From the PDmat entries and guided by the PDnarr, a project’s business case is written. The article uses a real-life example as a case study to discuss the application of the PDF.
... A single theory of change diagram is often unable to communicate the rationale of a development policy or programme. For complex interventions, Mayne (2015) suggests using an overview theory of change with the rough rationale of the support, accompanied by various nested theories of change diagrams that relate to the different impact pathways, geographical contexts or target groups. ...
... Anderson (2004), apud Breuer, et al, (2016:2), argumenta que a TOC utiliza "ferramentas de mapeamento retroativo, que começam pelo resultado de longo prazo e, em seguida, mapeiam o processo de mudança e os resultados de curto e médio prazo necessários para alcançar esse objetivo". Além disso, a TOC envolve design, planeamento, gerenciamento, dimensionamento e avaliação de intervenções (Mayne, 2015). ...
Article
Full-text available
Resumo: Este artigo apresenta um estudo de caso sobre a utilização do Mapa da Transformação (Teoria da Mudança), uma ferramenta para auxiliar o planeamento e a gestão de projectos, por parte do Programa de Desenvolvimento do Campus Fiocruz Mata Atlântica (PDCFMA), Instituição Pública Brasileira, no período de agosto de 2018 a maio de 2019. O Mapa da Transformação é um documento sucinto que apresenta os pressupostos, estratégias, resultados esperados e impactos da atuação institucional para um determinado período, assim como os principais dados quantitativos e qualitativos a respeito da situação que o projecto pretende modificar e os indicadores de resultados escolhidos para monitoramento e avaliação. Os dados obtidos durante o processo de utilização da ferramenta pelo PDCFMA permitiram constatar que o Mapa da Transformação é uma ferramenta comprovadamente eficaz no sentido de facilitar o planeamento e a gestão dos projectos. O mapa também possibilita uma melhor identificação visual dos principais dados relativos ao projecto. Além disso, o facto de ser elaborado de forma coletiva favorece a integração entre os colaboradores e permite identificar as possibilidades de intersecção com outras áreas da organização. As informações apresentadas pela pesquisa podem servir como contributo às demais organizações que executam projectos, em especial às de caráter público.
... Logic models capture the complexity of programs and illustrate the pathways between outputs and outcomes; however, they do not include the assumptions needed to illustrate the theory of change that underpins the relationship between outputs and outcomes. 23 The theory of change assumptions are described in Table 1. In combination, the information in Figure 1 and Table 1 outline the components, outcomes and theory of YPP. ...
Article
Issue addressed: Young parents (<25years) have lower engagement with health and community services and are more likely to experience negative outcomes in the perinatal period compared to older parents. The aim of this study was to evaluate the short to medium term outcomes of the young parent program (YPP), specifically designed to engage and support young parents, using responsive and co-design strategies in a community setting. Methods: A qualitative case study used data from interviews with participating parents (n=20) and a focus group with YPP facilitators (n=5). Results: The findings report on the following short to medium term YPP outcomes for parents and children. Young parents: are engaged in early parenting services that are welcoming, non-judgemental and holistic; build parenting skills, knowledge, confidence and are tuned into their infants’ needs; are empowered to co-design program activities to meet their parenting and non-parenting needs; have developed friendships and a social support network in their local community; and, are linked into community services and resources. Their children are cared for and stimulated with age appropriate interactions and play. Conclusion: Flexible, responsive and co-designed programs for young parents are effective means of connecting parents to services, social support networks, and can provide learning opportunities, which enhance both child and parent attachment and development. So what? Qualitative evaluation provides an understanding of contextual factors – required to inform effective design and delivery of young parent community programs.
... In addition to developing the ToC, the contribution analysis requires to make the assumptions and risks associated with the different links explicit and to identify external influencing factors [24]. Assumptions can be understood as conditions that must occur for the causal links to materialise, while risks are factors that can hinder the expected development [25]. External factors, on the other hand, are circumstances beyond the influence of the energy project that can either positively or negatively influence the impact pathways or provide alternative explanations for observed outcomes and impacts [18]. ...
Article
Full-text available
It is widely recognised that access to sustainable and affordable energy services is a crucial factor in reducingpoverty and enhancing development. Accordingly, various positive effects beyond simple access to energy are associated with the implementation of sustainable energy projects. One of these assumed positive outcomes is the productive use of energy, which is expected to create value – for example in the form of increased local availability of goods or higher incomes – thereby having a positive impact on local livelihoods. Many projects and programmes are based on such expectations regarding the productive use of energy but systematic evidence of these outcomes and impacts is still limited. This study analyses the results of an impact evaluation of 30 small-scale energy development projects to better understand whether and how the supply of sustainable energy services supports productive use activities and whether these activities have the expected positive impacts on local livelihoods. A contribution analysis is applied to systematically evaluate the impact pathways for the productive use of energy. The results show that access to sustainable energy does not automatically result in productive activities and that energy is only one of the input factors required to foster socio-economic development. Furthermore, the results demonstrate that activities, materials and information to support the productive use of energy – such as training, equipment or market research – need to be an integrated part of the energy project itself to allow for productive activities to develop on a wider scale.
Article
Full-text available
During the COVID-19 crisis, the oil and gas industry is among industries that face challenges in selling their products and struggling to manage their cash flow. The pressure to improve financial discipline within the oil and gas industry started even before the COVID-19 crisis. This paper validates the feasibility of adopting work-from-home (WFH) as a permanent practice for oil and gas companies in Indonesia and how it will help to reduce costs, enhance employee productivity, and improve their organizational agility. The survey was conducted two weeks after the start of the forced WFH “experiment.” One hundred nine executives from various oil and gas companies in Indonesia took part in the survey. The result of this study resulted in most of the large and established companies in Indonesia, in particular, the oil and gas companies, being slow in adopting this practice. The COVID-19 crisis could be the turning point for a wider and lasting adoption of WFH in the oil and gas industry. The survey results validate that business can still run even when their employees are working from home. Also, the survey results showed that a shift of opinion toward accepting WFH as the new normal exists. The survey indicates that many companies have crossed psychological and mental blocks and are receptive to the idea of making WFH part of normal HR practices.
Book
Full-text available
Táto monografia vznikla vďaka podpore projektu Behaviorálna politika pre mesto starajúce sa o svojich občanov, ktorý bol podporený z Operačného programu Efektívna verejná správa. Cieľom projektu bolo priniesť prvýkrát na Slovensko trend aplikovania behaviorálnych poznatkov na zlepšovanie verejnej správy. Monografia vznikla aj vďaka finančnej podpore Agentúry na podporu výskumu a vývoja v rámci projektu Behaviorálne intervencie v miestnej samospráve: zvyšova-nie účinnosti miestnych verejných politík (APVV-18-0435), ktorého zámerom je v praxi overiť potenciál behaviorálnych poznatkov na zvyšovanie jedného z kľúčo-vých indikátorov kvality verejných politík. Autori © Mgr. Matúš Sloboda, PhD. (kapitola 1) Patrik Pavlovský, MA (kapitola 2) prof. Ing. Emília Sičáková-Beblavá, PhD. (kapitola 3) Fakulta sociálnych a ekonomických vied UK, Ústav verejnej politiky Recenzenti doc. JUDr.
Article
Full-text available
Background: This article addresses two problems. The first is the Flexibility Problem: If we are to use a more flexible format for theories of change than for traditional logic models, one in which we can no longer assume that we only value things which are at the end of causal chains, nor that we intervene on all the things at the beginning of causal chains, how then can we show which things we value, and which things we intervene on? The second is the Definition Problem: What is the difference between a theory showing the causal influences within and around a project and, more specifically, a theory of change for the project?
Article
Full-text available
Theories of change are increasingly being discussed and referenced in development evaluation even while the elements of what a theory of change consist of differ widely among applications. Equally, examples of actual use of theories of change other than as overview illustrations of interventions are rare. In this article, we present generic models of theories of change for both straightforward and more complex interventions. A number of examples of evidence-based theories of change in the area of agriculture research for nutrition and health are discussed, as is the need for different versions of a theory of change for different purposes. We also discuss the use and analysis of these models in the planning, managing and assessing of research-related interventions, illustrating the practical usefulness of well-developed theories of change.
Book
Full-text available
Between good intentions and great results lies a program theory—not just a list of tasks but a vision of what needs to happen, and how. Now widely used in government and not-for-profit organizations, program theory provides a coherent picture of how change occurs and how to improve performance. Purposeful Program Theory shows how to develop, represent, and use program theory thoughtfully and strategically to suit your particular situation, drawing on the fifty-year history of program theory and the authors' experiences over more than twenty-five years. "From needs assessment to intervention design, from implementation to outcomes evaluation, from policy formulation to policy execution and evaluation, program theory is paramount. But until now no book has examined these multiple uses of program theory in a comprehensive, understandable, and integrated way. This promises to be a breakthrough book, valuable to practitioners, program designers, evaluators, policy analysts, funders, and scholars who care about understanding why an intervention works or doesn't work." —Michael Quinn Patton, author, Utilization-Focused Evaluation "Finally, the definitive guide to evaluation using program theory! Far from the narrow 'one true way' approaches to program theory, this book provides numerous practical options for applying program theory to fulfill different purposes and constraints, and guides the reader through the sound critical thinking required to select from among the options. The tour de force of the history and use of program theory is a truly global view, with examples from around the world and across the full range of content domains. A must-have for any serious evaluator." —E. Jane Davidson, PhD, Real Evaluation Ltd. Preview of 61 pages available here https://books.google.com.au/books/about/Purposeful_Program_Theory.html?id=zBoGbWnVsFsC&printsec=frontcover&source=kp_read_button&redir_esc=y#v=onepage&q&f=false
Article
Full-text available
In comparative research, analysts conceptualize causation in contrasting ways when they pursue explanation in particular cases (case-oriented research) versus large populations (population-oriented research). With case-oriented research, they understand causation in terms of necessary, sufficient, INUS, and SUIN causes. With population-oriented research, by contrast, they understand causation as mean causal effects. This article explores whether it is possible to translate the kind of causal language that is used in case-oriented research into the kind of causal language that is used in population-oriented research (and vice versa). The article suggests that such translation is possible, because certain types of INUS causes manifest themselves as variables that exhibit partial effects when studied in population-oriented research. The article concludes that the conception of causation adopted in case-oriented research is appropriate for the population level, whereas the conception of causation used in population-oriented research is valuable for making predictions in the face of uncertainty.
Article
Full-text available
In this introductory article, a brief history and introduction to contribution analysis is provided to lay the stage for the articles that follow. At the heart of contribution analysis is the aim to be able to make credible causal claims about the contribution an intervention is making to observed results. The key role that theories of change play is noted, and what a useful theory of change ought to contain is discussed. The article then makes a link between the philosophical discussions on causality and contribution analysis through a discussion of contributory causes. It is argued that such causes, which on their own are neither necessary nor sufficient, represent the kind of contribution role that many interventions play: where there are a number of other influencing events and conditions at work in addition to the intervention of interest. Contribution analysis is an approach to confirming that an intervention is a contributory cause.
Article
Full-text available
This article discusses an approach to managing the evaluation of complex interventions. Complex interventions pose significant challenges to the role and conduct of evaluations. In particular, they combine with reflexive learning and change to produce significant uncertainties making it hard to describe in advance what the intervention will do or what the outcomes might be. These uncertainties vary in nature and addressing these uncertainties leads to different evaluation approaches. That such evaluations often take place in ‘real time’ and have a strong formative dimension adds to the challenge. This article proposes a way of approaching this problem by incorporating the concepts of uncertainty and complexity into a Theory of Change-based approach.
Article
Full-text available
Introduces a new approach to the general evaluation field called theory-based stakeholder evaluation (TSE model). Combinations of program theory approach and stakeholder orientation are very rare in literature and practice. Furthermore, in those existing evaluators aims to fuse the various stakeholder ideas into on common unitary program theory. On this account the TSE-model is different. The TSE model keeps the program theories of the diverse stakeholder groups apart from each other and from the program theory embedded in the institutionalized intervention itself. This is an important clarification and extension of standard theory-based evaluation. The TSE model is elaborated to enhance theory-based evaluation of interventions characterized by conflicts and competing program theories. Especially in evaluations of complex and complicated multilevel and multisite interventions where the presence of competing theories is likely, the TSE model may prove useful. The article define the concept of intervention theory, an expression the authors prefer to program theory. The five steps of the TSE-model are presented.
Book
Over the last twenty or so years, it has become standard to require policy makers to base their recommendations on evidence. That is now uncontroversial to the point of triviality—of course, policy should be based on the facts. But are the methods that policy makers rely on to gather and analyze evidence the right ones? In Evidence-Based Policy, Nancy Cartwright, an eminent scholar, and Jeremy Hardie, who has had a long and successful career in both business and the economy, explain that the dominant methods which are in use now—broadly speaking, methods that imitate standard practices in medicine like randomized control trials—do not work. They fail, Cartwright and Hardie contend, because they do not enhance our ability to predict if policies will be effective. The prevailing methods fall short not just because social science, which operates within the domain of real-world politics and deals with people, differs so much from the natural science milieu of the lab. Rather, there are principled reasons why the advice for crafting and implementing policy now on offer will lead to bad results. Current guides in use tend to rank scientific methods according to the degree of trustworthiness of the evidence they produce. That is valuable in certain respects, but such approaches offer little advice about how to think about putting such evidence to use. Evidence-Based Policy focuses on showing policymakers how to effectively use evidence. It also explains what types of information are most necessary for making reliable policy, and offers lessons on how to organize that information.