Documents

10 April 2019

EAC Mtg Minutes 10-11 April 2019


EAC -2019 -Mtg -02 1




G avi Alliance E valuation Advisory Committee Meeting
10-11 April 201 9
Gavi Alliance, Geneva , Switzerland


1. Chair ?s report

1.1 The meeting commenced at 09 .01 Geneva time on 10 April 201 9. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting.

1.2 The Chair extended a particular welcome to Anuradha Gupta, Gavi Deputy CEO .

1.3 He highlighted that this would be his last meeting in his capacity as Chair of the
EAC , and informed the members that the recruitment process for his successor is
ongoing and being overseen by the Governance Committee.

1.4 Standing declarations of interest were tabled to the Committee (Doc 01a). During
the course of the meeting, Dr Johri indicated that she is involved in projects funded
by the Government of India and the Bill & Melinda Gates Foundation.

1.5 Committee members noted the minutes of its meeting on 15 February 201 9 which
had been approve d by no -objection on 9 April 201 9.

1.6 The Chair referred to the written summary of the November Board meeting which
he had shared with the EAC . He mentioned in particular the survey the Board had
been asked to complete on the EAC by the Governance Committee and which
was being used to inform the revision of the Evaluation Policy and the EAC Terms
of Reference. He expressed his encouragement with the Board?s increasing
interest in Gavi?s evaluation function, noting in particular that the im portance of
evaluation is being stressed in the context of the Gavi 5.0 discussions .

------

2. Update from Secretariat

2.1 Anuradha Gupta, Gavi Deputy CEO, referring to the fact that this would be the
Chair?s last meeting thanked him warmly for his fruitful and positive relationship
with the Alliance.

2.2 Ms Gupta informed the EAC that the Board , at its retreat in March in Ottawa, had
been able to reflect on key findings from evaluations on various thematic areas to
consider how they could inform not only the ongoing implementation of Gavi 4.0
but also the development of Gavi 5.0 (the Alliance?s 2021 -20 25 Strategy) .


Minutes

15 February 2019

EAC Mtg Minutes 15 February 2019

EAC -201 9-Mtg -01 1
1



G avi Alliance E valuation Advisory Committee Meeting
15 February 201 9
Teleconference


1. Chair ?s report

1.1 The meeting commenced at 14.39 Geneva time on 15 February 20 19. Rob
Moodie, Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.3 Committee members noted the minutes of its meeting on 16 -17 October 2018
(Doc 01b) as well as the minutes of the joint meeting with the Programme and
Policy Committee (PPC) on 17 October 2918 which had been approved by no -
objection on 7 December 2018 and 20 December 2018 respectively .

------

2. Uganda Country Programme Evaluation

2.1 Emmanuella Baguma, Programme Officer, Evaluation, presented this item to the
Committee (Doc 02) highlighting the process leading to the submission of this
proposal and providing information in relation to the key evaluation themes
namely urban immunisation, private sector and leadership, management and
coordination.

Discussion

? EAC members provided a number of comments in relation to the proposal, with
some members noting in particular that they would have found it useful if the data
analysis component had been described in better detail.

? There was lack of clarity on how the mixed methods had been balanced out and it
was also unclear as to how the sample size for the household survey had been
arrived at. The Secretariat noted in relation to the latter that the team wanted to
leverage some of the work carried out during Phase 1 of the Full Country
Evaluations (F CE) project and that they would be asked to build this out more
specifically in light of input from EAC members.

? EAC members agreed that DTP1 should be included in the outcomes.

? It was suggested that it would be good to link how the evaluation fits into or could
learn from ongoing activities in Bangladesh, Mozambique and Zambia. The

Minutes

16 October 2018

EAC Mtg Minutes 16-17 October 2018

EAC -2018 -Mtg -04
1




G avi Alliance E valuation Advisory Committee Meeting
16-17 October 2018
Gavi Alliance, Geneva , Switzerland


1. Chair ?s report

1.1 The meeting commenced at 09 .00 Geneva time on 16 October 201 8. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting.

1.2 The Chair extended a particular welcome to Anuradha Gupta, Gavi Deputy CEO ,
and thanked her for taking time to present to the Committee and share her views
on their meeting agenda .

1.3 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.4 Committee members noted the minutes of its meetings on 11 -12 April 2018 (Docs
01b and 01c ), 18 May 2018 (Doc 01d) and 26 June 2018 (Doc 01e) which had
been approved by no -objection on 20 June 2018, 9 July 2018 and 23 August 2018
respectively .

1.5 Th e Chair upda ted the Committee on the Gavi Board meeting in Geneva in June
which included some very fruitful discussions on evaluations , and a request from
the Board Chair to have a presentation at the next Board meeting on how
evaluations have been utilised .

1.6 The Chair proposed a short closed session of the Committee members at the end
of the day , as per a request from the Committee at a previous meeting .

------

2. Update from Secretariat

2.1 Anuradha Gupta, Gavi Deputy CEO, started by informing EAC members that at
its meeting the previous week the Governance Committee had agreed to
recommend to the Board that it exceptionally extend Rob Moodie?s term as EAC
chair to end June 2019.

2.2 Ms Gupta recalled that Gavi is nearing the mid -point of its current strategic period
and that it is therefore time to step back and reflect on progress to date.

2.3 She highlighted that there has been a paradigm shift in the way Gavi works and
outlined the four principles that are embedded into Gavi?s approach namely (i)
country -centric; (ii) differentiation; (iii) transparency; and (iv) accountability.
2.4 Ms Gupta i ndicated that Gavi has also been increasing its focus on risk assurance
through its three lines of defence model. In this context, Senior Country Manag ers

Minutes

26 June 2018

EAC Mtg Minutes 26 June 2018

EAC -2018 -Mtg -03
1




G avi Alliance E valuation Advisory Committee Meeting
26 June 2018
Teleconference


1. Chair ?s report

1.1 The meeting commenced at 13.07 Geneva time on 26 June 201 8. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting , which was co -
chaired by Mira Johri at the request of the Chair.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a).

------

2. Review of Evaluation Policy

2.1 Abdallah Bchir, Head, Monitoring and Evaluation, briefly introduced this item,
recalling the process which had been undertaken to develop the proposed revised
Evaluation Policy for review by the EAC (Doc 02).

2.2 Anna Hen ttinen, Peer Review Panel Member, outlined some of the main points
from the proposed new policy - i) it will cover all Gavi evaluations (centralised and
decentralised); ii) it is proposed that the Operational Evaluation Guidance (OEG)
becomes a working manual for all evaluations; iii) ther e is a proposed new process
in relation to quality assurance of Gavi evaluations with the proposed creation of
an independent quality assessment panel (IQAP), managed by the Secretariat
Evaluation Unit, which would review reports before they are presented to the EAC;
and iv) it is proposed that all evaluations would have a Steering Committee (SC)
whose role and scope would depend on each evaluation.

2.3 She also referred to the proposed ethical principles for Gavi evaluations as well as
to the description of the roles and responsibilities of the different actors in Gavi?s
evaluation function .

Discussion

? EAC members expressed concerns around what appeared to be the addition of a
number of layers in the overall process with the introduction the IQAP, and
questioned in particular in relation to the lat ter, what role would remain for the EAC
in relation to qu ality assurance of the evaluations. It was unclear as to what exactly
was meant when it was stated that the EAC would play a more strategic role.

? It was suggested that give n the different size and nature of Gavi evaluations it
might be more appropriate to have a more flexible approach whereby some

Minutes

11 April 2018

EAC Mtg Minutes 11 -12 April 2018

EAC -2018 -Mtg -01
1




G avi Alliance E valuation Advisory Committee Meeting
11 -12 April 2018
Gavi Alliance, Geneva , Switzerland


1. Chair ?s report

1.1 The meeting commenced at 09 .05 Geneva time on 11 April 201 8. Rob Moodie,
Evaluat ion Advisory Committee (EAC) Chair , chair ed the meeting.

1.2 The Committee Chair welcomed new EAC member Craig Burgess whose
membership became effective from 1 January 2018 . Craig is the Alternate Board
member for the Civil Society Organisations (CSO) constituency.

1.3 The Chair extended a particular welcome to Seth Berkley , Gavi CEO and thanked
him for taking time to present to the Committee and share his views on their
meeting agenda .

1.4 The Chair made the members aware that the meeting w ould be recorded to aid
minute taking.

1.5 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.6 Committee members noted the minutes of its joint meeting with the PPC on 24
October 2017 (Doc 01b ) which had been approved by no -objection on 8 February
2018 and the minutes of its meeting on 24 -25 October 2017 (Doc 01 c) which had
been approved by no -objection on 8 February 2018 . The members also noted a
unanimous consent decision which was approved on 1 December (Doc 01d ) and
re viewed the action sheet (Doc 01e ).

1.7 Th e Chair upda ted the Committee on the Gavi Board meeting in V ientiane in
November which included some very fruitful discussions on evaluations. He
reported that t here was a strong conse nsus from the Board around learning and
a strong ap petite to hear about what is and is not working well within Gavi .

1.8 The Chair proposed a short closed session of the Committee members at the end
of the day , as per a request from the Committee at the previous meeting .

------



Minutes

24 October 2017

EAC Mtg Minutes 24 -25 October 2017

EAC -2017 -Mtg -04
1




G avi Alliance E valuation Advisory Committee Meeting
24 -25 October 2017
Gavi Alliance, Geneva , Switzerland

1. Chair?s report

1.1 The meeting commenced at 09 .05 Geneva time on 24 October 2017 . Rob
Moodie, Evaluat ion Advisory Committee (EAC) Chair , chaired the meeting.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.3 Committee members noted the minutes of its meeting on 29 May 2017
(Doc 01 b) which had been approved by no -objection on 2 August 2017 , as well
as a unanimous consent decision which was approved on 8 June 2017 (Doc 01c) .
They also reviewed the action sheet (Doc 01d).

1.4 The Chair reported to the EAC on his participation at the Gavi Board meeting in
June 2017 . He informed members that he had had an opportunity to meet the
Chair of the Programme and Policy Committee (PPC) , with whom he discussed
the agenda for the joint ses sion of the EAC and PPC , which was to follow the
next day, on 25 October.

1.5 The Chair welcomed the members of the EAC whose membership , effective
1 January 2018 , had been approved by the Board , namely Craig Burgess, and
Mira Joh ri. It was noted that while Craig Burgess was not present, Dr Joh ri was
attending the EAC meeting as an observer. The Chair also welcomed Nick York,
who had chaired the panel that conducted the peer review of the Gavi Evaluation
function, to the meeting.

------

2. Update from Secretariat

2.1 Seth Berkley, CEO, thanked the EAC for its great work and provided an overview
of the key developments in the global landscape.

2.2 Dr Berkley referred to the work recently undertaken by the newly appointed
Director General o f WHO in terms of presenting a bold workplan, with a focus on
Universal Health Coverage (UHC), as well as having announced his new
leadership team. He informed the EAC that WHO had strongly signalled the
importance it gave to collaborating with Gavi on imm unisation.

2.3 He updated the EAC on the work done by the Alliance to ensure that a more
appropriate indicator for immunisation as part of the Sustainable Development
Goals (SDGs) (that factored the coverage of DTP3, last dose of PCV, MR and
HPV2) was recommended by SAGE , which is considering the suggestion .

Minutes

15 March 2017

EAC Mtg Minutes 15 -16 March 2017

EAC -2017 -Mtg -02
1





G avi Alliance E valuation Advisory Committee Meeting
15 -16 March 2017
Gavi Alliance, Geneva , Switzerland

1. Chair?s report

1.1 The meeting commenced at 09 .05 Geneva time on 15 March 2017 . Rob Moodie,
Evaluat ion Committee Chair , chaired the meeting.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a). It was
noted that Nina Schwalbe had a contractual obligation for consultancy services
for the Country Programmes team, which did not represent any conflict with the
proceedings of the EAC meeting.

1.3 Committee members noted the minutes of its meeting on 4-5 October 2016
(Doc 01 b) which had been approved by no -objection on 5 December 2016 .

1.4 The Chair reported to the EAC on his participation at the Gavi Board meeting in
December 2016. He informed members that he had had an opportunity to meet
the Chair of the Programme and Policy Committee (PPC) , with whom he agreed
on having a joint session of the EAC and PPC in October.

1.5 The Chair welcomed new members of the EAC , namely Anna Hamrell, Nina
Schwalbe and Viroj Tangcharoensathien .

1.6 The Chair informed the Evaluation Advisory Committee members that in order to
deal with the commercial sensitivities under Item 07, the representatives from
UNICEF, WHO and BMGF, who had been invited to join for the FCE annual report
session and the presen tation from PATH on their technical proposal, would be
requested to leave the meeting during PATH?s presentation of the financial
proposal. PATH would then also leave the meeting so that the EAC continues its
own deliberations to arrive at a decision in li ne with its Charter .

------

2. Update from Secretariat

2.1 Seth Berkley, CEO, expressed his appreciation to the EAC for their work and
highlighted the importance of evaluations for Gavi , as it increasingly transforms
into a learning organisation. H e highlighted the importance of being able to
mea sure and learn, and thereby make evidence -based decisions . He noted that
the monitoring and evaluation (M&E) work was not always visible and referred to
a recent donor review that highlighted a lack of M&E w ork at Gavi which
emphasi sed this point.

Minutes

7 October 2016

EAC Decision 7 October 2016

.......
Gavi Alliance
Board and Committee Decisions
2015

EAC-201 6-UC -02




G avi Alliance Evaluation Advisory Committee Decision
7 Octo ber 201 6



1. Full Country Evaluations ? Future Approach

In accordance with article 2.7.3 and 4.8 of the By -Laws, on a unanimous consent basis
the Gavi Evaluation Advisory Committee :

a) Assessed the proposed principles, approach and timeline for the future of the Full
Country Evaluations (FCE) project and agreed on a two year continuation of the FCE
project with targeted priorities by country for Mozambique, Zambia and Uganda with
the following components - resource tracking, process evaluation, second HFS and
HHS, HMIS, SAE.

b) Agreed that collaboration with the G lobal Fund should be explored.

c) Requested the Secretariat to finalise the draft Terms of Reference (ToR) for the
second phase of the FCE project and bring them back to the Evaluation Advisory
Committee for approval.

d) Noted that following approval of the Terms of Reference the EAC will consider options
in relation to the contractual arrangements for the FCE project going forward.







Mrs Joanne Goetz
Secretary to the Committee

Minutes

4 October 2016

EAC Mtg Minutes 4-5 October 2016

EAC -2016 -Mtg -02 1




G avi Alliance E valuation Advisory Committee Meeting
4-5 October 2016
Gavi Alliance, Geneva , Switzerland

1. Chair?s report

1.1 The meeting commenced at 09 .07 Geneva time on 4 October 2016 . Rob Moodie,
Evaluat ion Committee Chair , chaired the meeting.

1.2 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.3 Committee members noted the minutes of its meeting on 15 -16 March 201 6
(Doc 01b) which had been approved by no -objection on 24 May 2016 .

1.4 The Chair reported to the EAC on his participation at the Gavi Board meeting in
June 2016, and commented on the positive evolution in the role of the EAC , in the
use of eval uation findings within the Gavi Secretariat and in the way in which the
evaluation work is featured at Board meetings.

1.5 The Chair welcomed Zulfiqar Bhutta as a new member of the EAC.

------

2. Update from Secretariat

2.1 Anuradha Gupta, Deputy CEO, expressed her appreciation to the members of the
EAC for their work and highlighted the importance for Gavi of continued investment
in evaluations. She noted that it is critical that evaluations keep pace with the
evolving business needs of the Alliance an d also that the business embraces the
evaluation agenda and uses the findings to implement changes where appropriate.
She stressed the importance of the timeliness of evaluations . She highlighted the
importance of moving to p rospective evaluations rather t han retrospective
evaluations, and utilising the findings in joing appraisals.

2.2 She referred to examples of evaluation findings which have recently been used to
inform programme and policy reviews and encouraged EAC members to continue
to guide the evaluation agenda so that appropriate changes can be made in
programme and policy design to improve the work of the Alliance.

2.3 Finally, she referred to potential collaboration with the Global Fund in the
evaluation field and that this would of cou rse be welcome , where there is clear
added value for both organisations .




Minutes

15 March 2016

EAC Mtg Minutes 15-16 March 2016

EAC -2016 -Mtg -01 1




G avi Alliance E valuation Advisory Committee Meeting
15-16 March 2016
Radisson Blu Hotel, Maputo, Mozambique

1. Chair?s report

1.1 The meeting commenced at 14.40 Maputo time on 15 March 2016 . Rob Moodie,
Evaluat ion Committee Chair , chaired the meeting. He reflected on the work that
had gone into preparing the meeting, the visit which had taken place that morning
to the Manhi ?a Health Research Centre and the Mozambi que Full Country
Evaluations dissemination meeting which would take place on 18 March and which
had been scheduled to coincide with the EAC meeting so that EAC members could
attend . In this context he regretted that there would not be a quorum for the EAC
meeting. Following consultation with the Secretariat, and in particular in light of the
events arranged around the EAC meeting, it had been agreed to go ahead with
the meeting but any proposed decision s arising from the discussions would have
to be circulated to the full committee for approval by unanimous consent, in line
with the Gavi Statutes and By -Laws.

1.2 Participants had very much appreciated the visit to the Manhi ?a Health Research
Centre where th ey had been presented with the preliminary results of the
Mozambique PCV effectiveness study as well as the process evaluation of the
routinisation of PCV in Mozambique.

1.3 Standing declarations of interest were tabled to the Committee (Doc 01a).

1.4 Committee members noted the minutes of its meeting on 18 -19 March 2015
(Doc 01b) which had been approved by no -objection on 2 9 May 2015 .

1.5 Committee members noted that it would not be possible to discuss Agenda Items
7 (Final assessment of Albania evaluation repo rt) and 8 (Final assessment of AMC
evaluation report) at this meeting as not all of the EAC members who had
volunteered to review and assess the quality and usefulness of the reports had
done so. The Chair expressed concern that this work was not being done in a
timely manner and encouraged Committee members to volunteer to do the work
only when certain that they could commit to doing so. It was noted that once the
Secretariat has received suffici ent information to compile a final review on the
quality and usefulness of the reports these will be circulated to the full Committee
for information.

------





Minutes

Last updated: 8 Jul 2020

Subscribe to our newsletter