REFERENCE: IC/PNG/019/2022

TERMS OF REFERENCE

Consultancy: Project Evaluation

Location: Port Moresby, with travel to other locations in Papua New Guinea

Type of Contract: Individual Contract (IC) – International and National

Project: Building Resilience to Climate Change in PNG

Languages Required: English

Starting Date: 21st March 2022

Duration of Contract: 40 working days – March - April 2022

Closing date: 4th March 2022

Please access the UNDP Jobsite and look for IC with reference IC/PNG/019/2022 to apply for National or International Prject Evaluation consultancy announcement

Background and Context

Despite impressive economic growth over the last decade, Papua New Guinea has struggled to translate this increased opportunity into comparable increases in its development indicators. High transaction costs, limited supply chain options and outdated infrastructure and climate risks and climate hazards are the main development challenges that large parts of Papua New Guinea’s population are experiencing.

Considering these issues, Papua New Guinea was selected as one of the pilot countries to participate in the Pilot Program for Climate Resilience (PPCR).  The programme aims to help countries transform to a climate resilient development path, consistent with national poverty reduction and sustainable development goals. This Project aims to increase Papua New Guinea’s resilience to the impacts of climate change at the community level.

PNG has already witnessed a warming with annual and seasonal average air temperatures over the last sixty years (1950-2009). Climate change projections include an increase in the intensity and frequency of days with extreme heat and extreme rainfall. Inter-annual variability in PNG’s rainfall is strongly influenced by the El Niño Southern Oscillation (ENSO) phenomenon. During El Niño years, droughts affect the normally wet tropical climate of the country. The 1997 and 2016 ENSO events brought intense drought conditions and subsequent food shortages in parts of PNG, among them island and atoll areas. This affected over 500,000 people in 1997 and over 2.5 million people in 2016 (EM-DAT). As a result of continued climate change, such past extreme El Niño events are projected to increase in frequency, increasing the likelihood of more frequent droughts and frosts, and associated impacts on local agricultural production and food shortages in multiple regions of PNG. Many remote and subsistence communities in atoll and the islands of PNG are particularly vulnerable to these consequences of climate variability and change. In addition, majority of the infrastructure, urban centres, rural populations and businesses are situated in zones of high exposure to climate change impacts - flood prone valleys and river basins, coastal areas and low-lying islands or steep highlands susceptible to landslides.

During the 21st century, PNG is expected to experience increasing impacts due to climate change, including an increase in annual and seasonal mean rainfall levels, higher land and sea surface temperatures and higher mean sea levels. These changes in climate are expected to cause the following multiple hazards and impacts in PNG:

• More intense rainfall periods leading to higher risks of landslides and riverine flooding
• Elevated convective environments which lead to hazardous sea conditions
• Warming temperatures and more intense rainfalls affecting existing food production systems
• Higher storm surges, coastal flooding, and saltwater intrusion due to sea level rise
• More frequent and/or stronger droughts (and accompanying frosts) driven by a higher frequency and/or more intense El Niño events.

In this context, these 24 island and atoll communities identified in the four target provinces of East New Britain, Milne Bay, Madang, Morobe, Manus and the Autonomous Region of Bougainville (AROB) for this project are amongst those most vulnerable to natural climate induced hazards. From the 24 sites, UNDP covers 21 sites while CCDA covers 3 sites known as batch zero sites. According to PNG’s National Compatible Climate Development Management Policy (NCCDMP), the four target provinces and AROB are amongst those most vulnerable to natural and climate induced hazards almost making them uninhabitable.

To increase Papua New Guinea’s resilience to the impacts of climate change at the community level this project will support efforts to improve the access of target communities to the resources and knowledge that will assist them to develop fit-for-purpose adaptation measures. These measures will not only aim to build disaster preparedness, but they will also support efforts to improve food and water security, as well as the general health and wellbeing of communities. In doing so, reduction in vulnerability to the impacts of climate change will be achieved, including ultimately improved socio-economic mobility of beneficiaries.

Among the key impediments that this Project will endeavour to address are:

• The lack of climate adaptation assessments, planning and resilience measures accessible to communities, particularly those most remote.
• Initiatives that will assist communities build their resilience to climate change and the increase in associated natural disasters and hazards.
• Improved management of in-shore fisheries, and mangrove and reef ecosystems, all critical components for food security and the natural defences against climate change available to island and atoll communities.
• Addressing capacity limitations through greater access to training and knowledge and the mobilization of the organic community structures, associations, and committees.
• Funding constraints to address relevant community action by supporting communities develop appropriate plans and proposals that Government, development partners and other stakeholders can finance.

To manage the impediments, the project proposes the interconnected outcomes, that aim to effectively support resilient initiatives for vulnerable communities.

OUTCOME: Improved capacities of vulnerable islands/atoll communities, government agencies, and civil society to plan and respond to the impacts of Climate Change

Output 1: Climate change and vulnerability assessments carried out and adaptation plans developed for target communities (21 islands and atolls for all Output 1 project activities and 19 islands and atolls for CCVA alone.

Output 2: Sustainable fishery eco-systems and food security investments piloted in 9 vulnerable island and atoll communities

Evaluation Objective

The objective of the evaluation is two-fold:

•    to evaluate the effectiveness of the project as implemented and as agreed to by ADB, GoPNG and UNDP; and

•    to use the findings of the evaluation to inform ADB’s support to further initiatives to enhance or scale up community resilience in Papua New Guinea, to determine whether the project, as currently designed and being implemented, remains fit-for-purpose.

The evaluation is timely given that the project is set to conclude at the end of June.

The evaluation will further determine and identify whether current project objectives and outcomes remain relevant given PNG’s unique geo-climatic conditions and experiences.

More broadly, the project will ensure close ongoing alignment with CCDAs Climate Change Development Strategy (CCDS) which is aligned to the national development frameworks being Vision 2050, Development Strategic Plan (2010 – 2030), MTDP III and STaRs. 

The review will be conducted through close cooperation with UNDP and the GoPNG through the CCDA. This is to ensure that the review fully utilises UNDP and CCDA’s current extensive local knowledge and networks.

Evaluation Approach and Methodology

The evaluation will utilise a combination of desk review and in-depth interviews (Key Informant Interviews – KII) and Focus Group Discussions (FGDs) with key stakeholders in Port Moresby and the project priority provinces of East New Britain, Manus, Milne Bay, Morobe and the Autonomous Region Of Bougainville (ARoB).

The evaluation will be conducted over approximately one month with fieldwork between March and April. The team will consult with relevant stakeholders, including but not limited to   various levels of Government (National and Sub – National), target community leaders and beneficiaries, Non-Government Organizations, civil society, faith-based organizations, and other development partners.

Desk Review

The evaluation team will review all sources of relevant information including, but not limited to, the following:

• Project documents for the Building Resilience to Climate Change (BRCC) in PNG Project;
• Annual Project Workplans for 2020, 2021 and 2022 on implementation of BRCC Project
• M&E Plan and Results Framework
• Reports: Monthly, Quarterly and Annual Project Progress reports (2020 - 2022)
• Mission Reports
• Risks Logs
• Other Key Documents

Evaluation design

The evaluation will utilise a non-experimental design, which examines the project progress before and after the referendum, in line with the OECD DAC evaluation criteria and then also makes forward looking recommendations for UN implementation in ARoB. Beyond document review, data collection will include key informant interviews andfocus group discussions (FGDs) with partners, and stakeholders (government, non-government, UN and other donors and development partners) as well as both project direct and indirect beneficiaries.

Clear ethical guidelines should be followed and implemented, obtaining consent from any individuals interviewed or included in FGDs. The evaluation should be gender and youth responsive, as outlined in the evaluation objectives, using a participatory methodology. Any limitations in the design should be clearly stated and data should be triangulated to enhance the robustness of the data.

Evaluation Scope

This final review will assess and provide recommendations on overall project performance based on the following five key areas:

Relevance:

• To what extent was the project in line with national development priorities, country programme outputs and outcomes, UNDP Strategic Plan and SDGs?
• Assess whether the objectives remained relevant over the course of the project, and whether adjustments were made.
• To what extent were the lessons learnt from other projects including perspectives of men, women, and young people, taken into account during the project design and implementation?

Effectiveness:

• In which areas has the project had greatest achievements? Why and what have been the supporting factors? How can the project build on or expand these achievements?
• To what extent did the project empower women, men, youth and other vulnerable groups, as intended?
• Did the project realise its theory of change?
• What were the main factors of success and challenges to the project’s achievements? What could have been done better?

Efficiency:

• Assess whether the project can be considered as having been delivering value for money given its resources and scale of impact? To what extent were financial and human resources used effectively? Were resources (funds, male and female staff, time, expertise, etc.) allocated strategically to achieve outcomes?
• Assess to what extent were project management and implementation participatory, including of men, women, youth and any other targeted groups?
• Assess the quality of Internal and External Communication, including relationships within the team, partners, stakeholders, donors and beneficiaries.
• How well did the projects monitor and address risk during design and implementation?

Sustainability:

• To what extent are the major project achievements likely to be sustained after the project end?
• To what extent will targeted men, women, youth and other vulnerable people benefit from the project interventions in the long-term?
• To what extent will financial and economic resources be available to sustain the benefits achieved by the project?
• What are any evidence to suggest that the project interventions and achievements will be sustained replicated whether through the Government, NGOs, communities or other partners?

Did the projects have an exit strategy and did they actively look for opportunities for catalytic effects, financial or otherwise?​

Gender Equality, Disability and Human Rights:

• To what extent have gender equality and the empowerment of women been addressed in the design, implementation and monitoring of the project and has the project contributed to any change in gender equality?
• Is the gender marker assigned to this project representative of reality?
• Were persons with disabilities consulted and meaningfully involved in programme planning and implementation?
• How did the project work to support people with disabilities and help to remove barriers did persons with disabilities face?
• To what extent have the two projects contributed to the protection of human rights, including through opportunities for  poor, indigenous and physically challenged, women, men, boy, girls and other disadvantaged and marginalized groups as part of project implementation?

Evaluation Deliverables

The following deliverables are required as outlined:

Inception Report

• Conduct a desk review of the project document, annual work plans, monthly, quarterly, annual progress reports, mission reports, Results Framework and other documents
• Develop a methodology for the collection of data
• Develop questionnaire against the key evaluation questions
• Develop a field evaluation schedule

Presentation of Findings through PowerPoint

• Conduct Field Missions
• Data collection and analysis

Draft Report

• Develop a report of the methodology and findings against the key questions
• Circulation of draft report for comments

Final Report

• Incorporate comments and final report submitted
• The review report should be up to 45 pages, including executive summary, clear review outcomes focusing on a balanced analysis of relevant issues and recommendations for scale up. Relevant Annexes should be included.

The whole exercise is estimated to take 4 weeks but there is always flexibility to adjust as and when necessary.

Evaluation Management

The Project Evaluation will be executed under the management of the Evaluation Manager to be appointed by UNDP. Further support will be given by the reference group comprised of the representative of UNDP, UNDP BRCC Project and CCDA.

Reporting

The evaluator hired will report directly to the UNDP Evaluation Manager and the Reference Group.

Institutional Arrangement

(i)          Team Composition

A team of two independent evaluators will conduct the evaluation. One is an International who will play a team leader role with experience and exposure to evaluating Climate Resilience Projects across Asia and the Pacific Region. The other is the team expert, who is a national. The Team Leader will be responsible for the overall assessment of the project starting with the preparation for the evaluation, presentation of the findings, development of the draft report and the final report. The Team expert will report to the team leader and support the Team Leader in the entire assignment.

The individuals must be specialized in evaluation, research and surveys (design, tools, data collection & analysis), preferably in the field  of  climate change adaptation or climate resilience with good knowledge of and networks in Papua New Guinea.

(ii). Education, Experience & Competencies of International Consultant

Education:

• Holds   a   University   Degree (Masters) in  Environmental Science or Social   Sciences covering Climate Resilience or Climate Change Adaptation, Natural Resources Management or Sustainable Development.

Experience:

• Have at least a minimum of 10 years experience in monitoring and evaluation and research, including survey design and conduct, data analysis and report writing on climate resilience or climate change adaptation projects;
• Experience working in the Asia Pacific Region on issues relating to climate change adaption and climate resilience.

Competencies:

• Good understanding of issues on climate change and climate resilience are highly desirable.
• High level planning, organizational and time management skills, including flexibility, attention to detail and the ability to work under pressure to meet challenging deadlines;
• Excellent interpersonal skills, including ability to establish strong cooperative relationships with senior government officials, civil society and donors;
• Ability to quickly adapt to change, and to remain calm under pressure; and
• Proven cross-cultural communication and the ability to function effectively in an international, multicultural environment.

(iii). Education, Experience & Competencies of National Consultant

Education:

• Holds   a   University   Degree (Masters) in  Environmental Science or Social   Sciences covering Climate Resilience or Climate Change Adaptation, Natural Resources Management or Sustainable Development.

Experience:

• Have at least a minimum of 5 years experience in monitoring and evaluation and research, including survey design and conduct, data analysis and report writing on climate resilience or climate change adaptation projects.
• Experience working in Papua New Guinea especially in East New Britain, Manus, Milne Bay, Morobe and the Autonomous Region of Bougainville on issues relating to climate change adaption and climate resilience.

Competencies:

• Good understanding of issues on climate change and climate resilience are highly desirable.
• High level planning, organizational and time management skills, including flexibility, attention to detail and the ability to work under pressure to meet challenging deadlines;
• Excellent interpersonal skills, including ability to establish strong cooperative relationships with senior government officials, civil society and donors;
• Ability to quickly adapt to change, and to remain calm under pressure; and
• Proven cross-cultural communication and the ability to function effectively in an international, multicultural environment.

(iv)       Reporting

The Team Expert will report to the Team Leader. The Team Leader and the Team Expert will report directly to the Evaluation Manager who is in consultation with the Evaluation Reference Group.

Deliverables, Price Proposal & Payment Schedule

Duration of work

The contract days are 40 working days which is 8 weeks for the Team Leader and 35 working days or 7 weeks for the Team Expert . The work schedule proposes the duration of work within this timeframe immediately after the contract is signed. The work is estimated to commence no later than 21 March 2022.

The contract price is a fixed price based on the results, with the length of service being approximate. The budget submission should include all costs to allow the implementation of activities provided for in Sections C and F, such as professional fees for team members, travel expenses, attachments, multiplication of survey questionnaires, etc.

The payment schedule will be directly related to the deliverable submissions as illustrated in the table below:

Evaluation

Cumulative analysis

The proposals will be evaluated using the cumulative analysis method with a split 70% technical and 30% financial scoring. The proposal with the highest cumulative scoring will be awarded the contract. Applications will be evaluated technically, and points are attributed based on how well the proposal meets the requirements of the Terms of Reference using the guidelines detailed in the table below:

When using this weighted scoring method, the award of the contract may be made to the individual consultant whose offer has been evaluated and determined as:

a) Responsive/compliant/acceptable, and

b) Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.

* Technical Criteria weighting; 70%

* Financial Criteria weighting; 30%

Only candidates obtaining a minimum of 49 points in the Technical Evaluation would be considered for the Financial Evaluation. Documents to be included when submitting Consultancy Proposals

The following documents may be requested:

a)  Duly executed Letter of Confirmation of Interest and Availability using the template provided by UNDP.

b)  Signed P11, indicating all experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references.

c)    Brief description of why the individual considers him/herself as the most suitable for the assignment. Highlights of the relevant expertise and understanding of the TORs. Details of approach and a draft methodology proposed for the overall data collection based on the evaluation questions and work plan outline with composition of the proposed team.

1. Financial Proposal that indicates the all-inclusive fixed total contract price, supported by a breakdown of costs, as per template provided. If an Offeror is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under Reimbursable Loan Agreement (RLA), the Offeror must stipulate that arrangement at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP.

Lump-sum contracts

The financial proposal shall specify a total lump-sum amount, and payment terms around specific and measurable (qualitative and quantitative) deliverables (i.e. whether payments fall in instalments or upon completion of the entire contract). Payments are based upon output, i.e. upon delivery of the services specified in the TOR. To assist the requesting unit in the comparison of financial proposals, the financial proposal will include a breakdown of this lump-sum amount (including travel, living expenses, and number of anticipated working days).

Note:

Applications without i) financial offer, ii) P11 form and iii) Documents mentioned under Technical Proposal will NOT be considered for evaluation.

Financial proposal should be on provided format (i.e. Annex 3- OFFEROR’S LETTER TO UNDP);

Firms are not eligible for this consultancy assignment (open only for national individual consultants).

Incomplete application will not be considered, it will be disqualified automatically.

Please complete the Statement of Health form and submit along with proposal

ANNEX

ANNEX 1- TERMS OF REFERENCES (TOR) [This Document]

ANNEX 2 - INDIVIDUAL CONSULTANT GENERAL TERMS AND CONDITIONS

ANNEX 3- FINANCIAL PROPOSAL TEMPLATE

ANNEX 4- STATEMENT OF HEALTH- INDIVIDUAL CONTRACTOR

Interested individual consultants must submit the following documents/information to demonstrate their qualifications. Please group them into one (1) single PDF document as the application only allows to upload maximum one document