Professional Documents
Culture Documents
Governance and
Transparency Fund
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
GTF 301
Christian Aid
Start date
12 August 2008
End date
11 August 2013
4,999,795
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
Lead Contact
Uganda Debt Network (UDN) Magdalene Aguti and her family benefited from the work of the community-based monitors around
improved policy and delivery of the NAADS (National Agricultural Advisory Services) programme in Uganda. UDNs advocacy has
led to many improvements in NAADS, including a much-needed revision of the programmes guidelines to re-focus delivery towards
marginalised groups. With UDNs support, 668 community members participated in the revision of NAADS through community-based
monitoring and evaluation groups. Changes included making the beneficiary selection process more transparent and the service
less controlling and more enabling, for example through helping farmers to choose their own enterprises. UDNs awareness-raising
programme encouraged Magdalene and her community to get involved with NAADS. Now, Magdalene has access to the advice and
support she needs to manage her own land. She says: With my improving income levels as a result of citrus farming, I am now in a
position to send our children to school.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
2. List of acronyms
ARS
GHS
Ghanaian Cedis
ASATU
GIFNET
GSFP
GTF
HKC
CA
Christian Aid
Community-based monitors
CBO
Community-based organisation
CDF
CEB
CEDLA
CESE
COMEN
CSO
DCMC
DFID
DR
Dominican Republic
DV
Domestic violence
EA
East Africa
EAC
FER
FGM
FoM
Freedom of movement
ICH
IDEG
IDS
INESC
IWASCO
JDPC
Kenyan Shillings
KHRC
KPMG
KRG
KWIGN
LAC
M&E
MoU
Memorandum of Understanding
MSR
MTR
Mid-term review
NAADS
NAID
Northern Aid
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
NGO
Non-governmental organisation
NHIS
ODI
OPM
P2P
PC
Public Chamber
PCR
PM&E
PSM
PWD
R&P
SADA
SEND
SGBV
SMS
THU
TOC
Theory of Change
UDN
UGX
Ugandan Shilling
UNIPOP
VAT
VFM
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
CESE Chief Damio Paridzan, leader of the Xavante indigenous people of Mariwatsd, Brazil. This group had their land rights
ratified in 1998, but they were not enforced and illegal settlers continued to live on the land. Following GTF funded campaigns at
the Rio+20 Summit (2012) where the community lobbied, marched and received wide media coverage, the authorities agreed to the
removal of the settlers from 165,000 hectares of their land, enforced by 2013.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
4. Key findings
Management Response
4. T
he very fact of working together should not be enough
to score here but the global logframe is completed
by evidence of collaboration which is not necessarily
supported by additional results from the collaboration.
[33]
4. A
gain this is context specific, and while we would agree
that collaboration with evidence of action is desirable, we
would also challenge that collaboration cannot be a result
in itself, as in many challenging contexts it is.
6. A
lot of the reporting of, for example, contact with media
does not appear to be in the spirit of the indicator since
the media are only playing a dissemination role. [37]
6. T
his is true, and we have found across the programme
that it has been very difficult to engage the media on a
deeper, more analytical level, which is a lesson in itself.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
10. T
he development and operationalisation of the Power
Analysis took time and this may have limited its impact
on some parts of the programme. [47]
10. P
ower analysis did indeed take longer than we had
planned, but as this was the first real attempt to
mainstream this in a programme we had no frame of
reference. This is a learning point for our work on power.
12. N
ot updating the logframe allowed it to become a
less accurate description of the P2P programme and
perhaps led to a missed opportunity to examine the
effectiveness of global-level logframes in management
of diverse projects in very different situations. [53]
12. T
his was a key decision, the trade-off being a potentially
stronger logframe versus allowing partners and staff to
focus on their work after very heavy M&E requirements.
We chose the latter and were supported by our MTR
evaluators. We would challenge that it became less
accurate: at outcome level it remained very accurate,
with projects adapting the indicators to suit their
contexts.
15. It could be argued that holding a government to account 15.This is a somewhat circular argument, saying holding
is not the clearest way of expressing the overall purpose
authorities to account may not be sufficient, but then
of this part of the P2P. The point is that citizens are
suggesting that the ideal would be that communities use
empowered and become better able to engage with the
their skills and confidence to engage leaders on services,
authorities that they seek to change. The empowerment
which to us sounds like holding them to account.
in terms of skills, information and confidence is what
matters as it enables people at community level to
continue to engage with the authorities for longer term
improvements in the services and protection they
receive. [60]
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
18. A
ttribution becomes an important aspect of working
with longer-term partners where impacts are observed
and seen to be the result of work started some time
before the GTF funding became available. [66]
18. A
ttribution is important per se, and in some cases it
may be easier to show this over the long term. In others
it will be much harder as a far larger set of factors will
come into play.
20. In the latter stages of the programme, this did happen,
so that partners in LAC focused on the media; in west
Africa they looked at gender; and in east Africa at
citizenship. Potentially we could have done this from
the start, but there is no guarantee that this would have
worked, and this way enabled a more evolutionary
development of themes that speak strongly to the work
the projects were doing.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
22. We see the point being made, but havent really
resolved this. On one hand there could have been
benefit in including capacity building, knowing that it is
a valid and useful part of how we work; on the other it
would have then become something we were bound
to deliver, which could have reduced the benefit of the
flexible, implicit capacity building that we ended up
providing throughout the programme.
25. We did try hard to balance the need to make sure
partners were following through their activities to
outputs and outcomes, while at the same time allowing
them the space to be more creative. We may not have
succeeded. Our power learning work was an attempt
to allow them time, space and money to explore things
creatively, though of course this came with additional
reporting requirements too.
26. The approach of developing indicators with each partner 26. We are glad that this participatory approach is validated,
has been a strength in the P2P programme and has
as we felt it was and is important.
helped some partners to appreciate the logframe and
better understand the overall programme. It is difficult
It would be good to get more clarity on the problem
however to make sense of very different performance
of making sense of performance. It sounds as if this
on very different types of observation in terms of
means its hard to aggregate across the programme,
attainment of indicators and achievement of outputs.
which we would agree with, but point out that we
[100]
would not strive to do this except where clearly possible
and of value.
27. M&E was launched with some interesting scorecard
approaches and these were abandoned during the
MTR and this seems a shame as their continued use
might have led to some useful insights both into how
governance projects can work and also into how they
can be assessed. [100]
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
28. This may be true, but the difficulty was not just one of
funds (as a number of countries did not use all of their
support budgets) but the time and capacity to do more,
with staff and partners usually working on numerous
other projects.
30. T
he global logframe for the GTF itself was not
developed until after the grants had been approved and
this was probably not helpful. [104]
30. T
his is a historic GTF issue covered in previous reports
and evaluations, which all have noted this as being a
problem.
31. The fact that Christian Aid did not update the logframe
and KPMG did not object means that the learning by
staff and partners on how to make governance projects
work is not recorded in the logframe structure and the
logframe as a management tool of a global programme
was not put to the test. [105]
32. We are glad that our model of working has been
affirmed.
34. T
he regional and global learning events have produced
important improvements in programme quality and
created links between partner agencies that could not
have been created by other means. [115]
34. W
e affirm this, and would set this against the
observation above that there needs to be a clearer
statement of the value of the learning events.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
10
4. S
elect a smaller number of initiatives so that
management and support is easier. [124]
4. W
e would suggest that its not necessarily about
selecting a smaller number of initiatives, but about
making sure that the appropriate number is selected,
balancing ambition with evaluability and delivery.
5. We agree.
6. S
tick with those projects where engagement is positive
even where progress is limited. [125]
6. D
epending on what engagement is positive means,
we agree, recognising of course that a lack of progress
cannot always be excused.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
11
-
Political restructure - In Uganda, constituency
boundaries were redrawn during the GTF period,
so community-based monitors have had to monitor
different budgets and forge new relationships with
LGA officials. New systems were also required for
monitoring programme impact.
-
Political will - In Brazil, Dilma Rousseffs administration
has proven less supportive of indigenous and
Quilombola groups than the previous government, and
the last five years have seen the mainstream media
depict these groups as criminals. This has meant fewer
lands have been entitled and there has been little
enforcement for entitled groups from authorities. Again,
partners have achieved key successes through adapting
their strategies by winning international popular support
and harnessing social media networks.
Many internal risks, and risks of working in partnership
with delivering organisations, are mitigated by our
embedded policies and organisational processes. These
include regular performance management, partner
monitoring visits and assessments, and partner reports
submitted biannually and reviewed by country and UK
office staff. Each partner has developed mechanisms for
downward accountability to target groups embedded
within their programmes, which in most cases have
provided effective transparent channels for communities
and marginalised groups to raise issues. And in turn,
Christian Aid has open formal and informal channels
of communication which ensures its own accountability
to partners.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
12
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
13
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
14
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
15
continue after the GTF. KHRC in Kenya will also continue with
their work with school children and on issues of citizenship.
We are confident that our programme represents very
good value for money. Within the budget that was agreed,
each of the projects and the programme as a whole used
the relatively small funding available to deliver very strong
results that have had significant changes on the lives of
very marginalised women and men, at least meeting the
expected outcomes in the original programme plan.
As this was not a programme of direct implementation, and
was focused on mobilising voice via civil society groups and
movements, there was little actual procurement that we can
use as a basis for core economy assessments. Instead, we
must tie economy to efficiency, effectiveness and equity, as
what we were buying was changes in power and capacity
of individuals and groups, and indirectly the use of this
power and capacity to hold leaders to account and demand
rights and change.
Our management costs have been kept to a minimum, almost
excessively so as several independent evaluations have noted
(an interesting example in itself of where striving for economy
can negatively impact upon effectiveness). Country teams
often gave above and beyond what was expected of them.
As agreed with GTF management, when we had underspent
funds, we were able to use these to our discretion to best
support emerging impact across the programme, which is a
key example of enhancing the value that the programme was
delivering with no additional overall cost.
Aside from the measurement of VFM, there is also the
management of VFM, that is, the quotidian, often informal
processes and decisions that determine how things are
implemented and how best to deliver work given specific
contextual knowledge and circumstances. Again, we would
strongly contend that all our country office staff, working
with partners, have consistently shown that they are able
to make such decisions, ranging from decisions to close
stalled partnerships to how best to use additional funds to
enhance impact.
Our first evaluation report noted that we have focused
strongly on learning, and we feel that this is an important
factor of our VFM. This programme is generating a significant
weight of analysis which is, and will continue to be, collated
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
and fed back into Christian Aid and into the sector with the
aim of improving knowledge and performance.
In summary, therefore, this programme has shown that it is
economical, that it is both efficient and effective and that it
has delivered equitable change.
4.5 Innovation
We are aware that recently there has been a greater focus
on closing feedback loops in service delivery using new
technology, but it would have been very difficult to bring
such things into our programme artificially, and it is unlikely
that there would have been capacity to manage such things
effectively. In Sierra Leone, a mass-SMS system was put
in place, but only had limited use. The Platform of Social
Movements in Brazil was very active on new media, but how
far this can be considered innovative is up for debate.
16
SEND Posters of women candidates standing in the 2012 elections. Kailahun was the only district in Sierra Leone which exceeded
its 30% target of women candidates in local and national elections, following partner awareness raising and empowerment activities.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
17
5. Recommendations
DFID/KPMG
1. Learning is not an add-on.
We feel very strongly that the lack of a clear, operational
learning strategy for the GTF is a significant missed
opportunity, and one that can only have a negative effect on
the programmes overall value for money, as well as on the
international network of grantees, who have hardly had any
opportunity to engage with one another or share learning
from each others programmes. The few learning events that
were organised have not fed back into the programme in a
meaningful way. There was no place online where grantees
could interact, which could have been a very easy win. In
future programmes it is essential that the learning strategy is
agreed and ready by the end of inception, so that all grantees
can benefit from and plan for it.
2. Lessons from the Most Significant Results
a) This was an interesting exercise in drawing out and
reflecting on the key results from across the programme
and interrogating the scale, depth and sustainability
of change. The template was well thought out and
comprehensive.
b) The VFM analysis was particularly interesting. Although, as
described above, we feel that our programme offers very
good value for money, only some MSRs ticked the right
boxes and were clearly measurable against the defined
criteria. Moreover, this VFM evaluability did not necessarily
indicate the most impactful results. This was particularly
the case where partners were involved in widespread
movements leading to top level change, such as INESCs
Ficha Limpa result.
c) As a last-minute new requirement with tight deadlines for
the levels of analysis required, the process was difficult
to manage. Our partners were already working on final
annual reports, participating in the external evaluation and
working towards project completion as well as finishing
activities. This meant that gathering the results and drafting
the analyses were largely top-down exercises, with
Christian Aid staff communicating with partners principally
to verify facts and ensure coherence of how success is
perceived. It would be interesting to have had the chance
to properly interrogate communities perceptions of each
projects most significant result and to know whether the
statements submitted would have looked different. Time
and budget did not allow for this, but from recent reports
received and conversations with partners, it is interesting
to note that less tangible improvements in empowerment
and subtle changes to discriminatory attitudes are
perceived as the most significant changes in the lives of
marginalised groups. These impacts do not neatly fit into
results statement templates.
d) Without a clearly communicated vision of how these
results and the rest of the achievements fed in through
our Project Completion Report and Achievement Rating
Scale will be used, it is a concern that our whole
programme may be boiled down to mean only these MSR
statements. It is our feeling that this would not sufficiently
capture the empowerment successes of our programme,
and other results and stories of change that cannot be
easily aggregated may slip through the net.
3. Better assess trade-offs between and within M&E and
effectiveness.
Reporting is of course necessary, but how and when it is
done can be adapted and achieved in a variety of ways. A
clearer idea of how to do this earlier in the programme would
help to reduce later stress and focus on gathering results in
a way that actually draws attention away from delivery.
DFID
4. Be more involved.
We understand that programmes need to be managed by
intermediaries, but this doesnt mean that there has to be
such a degree of remove from DFID. That this was the case
actually gave the impression that there was a lack of interest
in the programme, and certainly didnt help when it came to
managing aspects of the programme such as learning.
CSOs/NGOs
5. Be more assertive about what works, and how best to
implement programmes.
We should push back when we are confident we know how
things could best operate and that our contextual knowledge
is important.
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
18
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
Annexes
Annex 1
Annex 2
Annex 3
Annex 4
Annex 5
Annex 6
Annex 7
19
20
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
Annex 3 Final
Financial Report
This report presents actual expenditure against our agreed detailed budget (not the summary budget used for Funding
Requests). Expenditure variances in excess of 10% of the agreed budget have been submitted as separate notes to our
financial report.
GTF-301
2. Organisation Name
Christian Aid
01 April 2013
2. End of Period
31 Oct 2013
Payment No.
Date Received
Amount
Payment 1
03/04/2013
120,194.73
Payment 2
16/07/2013
10,360.00
130,554.73
Actual Expenditure
for Period
Variance
Variance %
99,471.64
89,849.03
-9,622.61
-9.67%
-6,295.64
-6,295.64
Output 1 Knowledge,
awareness and organisation
0.00
0.00
-4,907.743
-4,907.74
0.00
-2,430.804
-2,430.80
Output 4 Experience
sharing activities
70,366.12
51,615.385
-18,750.74
-26.65%6
0.00
0.00
0.00
0.00%
169,837.76
127,830.23
-42,007.53
-24.73%
Power to the People: Making Governance Work for Marginalised Groups Project Completion Report
21
Total Agreed
Programme Budget
Total Expenditure
Variance
Variance %
462,218.55
452,595.94
-9,622.61
-2.08%
Output 1 Knowledge,
awareness and organisation
1,476,656.46
1,470,360.82
-6,295.64
-0.43%
1,458,884.75
1,453,977.01
-4,907.74
-0.34%
1,013,013.17
1,010,582.37
-2,430.80
-0.24%
Output 4 Experience
sharing activities
485,586.45
466,835.71
18,750.74
3.86%
103,435.62
103,435.62
0.00
0.00%
4,999,795.00
4,957,787.47
-42,007.53
-0.84%
Annex 7
There is no politically sensitive information.
christianaid.org.uk
christianaid.ie
UK registered charity number 1105851 Company number 5171525
Scotland charity number SC039150
Northern Ireland charity number XR94639 Company number NI059154
Republic of Ireland charity number CHY 6998 Company number 426928
The Christian Aid name and logo are trademarks of Christian Aid
Poverty Over is a trademark of Christian Aid.
Christian Aid November 2013 14-122-J1873
Cover image: R&P The deputy Ombudsman from Dushanbe opens the
first Public Chamber jointly established by Christian Aid partner Rights &
Prosperity and the National Ombudsman for Human Rights. R&Ps Public
Chambers initiative has been so successful that the Ombudsmen is keen
to establish many more throughout the country to reduce corruption,
help people access their rights, benefits and entitlements and hold
the government to account. The Ombudsman recently committed to
financing and sustaining the network of nine Public Chambers across
Tajikistan established through the GTF from January 2014.
Credit: Christian Aid/Amanda Farrant, UDN/Walter Akwat, OPAN/Adriano
Gambarini, SEND, KHRC