Terms of Reference for the Terminal Evaluation of Sustainable
Land Management Project, Nauru
Title: Team Leader for UNDP/GEF Project Evaluation
Project: Building Capacity and Mainstreaming Sustainable Land Management in Nauru
Duration: 30 days to be completed by no later than June 20th, starting no later than May 21st
Supervisor(s): UNDP Multi Country Office in coordination with national executing agency (Department of Commerce, Industry and Environment)
Duty Station: Nauru
Project Background
The Medium Sized Project (MSP) on Building Capacity and Mainstreaming Sustainable land management in Nauru is a Global Environment Facility (GEF) funded project through the United Nations Development Program (UNDP). The project is implemented by the Department of Commerce, Industries and Environment (DCIE). The project duration commenced on March 26th, 2008 and completed March 26th 2011. Following a mid-term review the project was granted an extension until June 2012.
Despite the growing official recognition of the problem of land degradation in the Nauru, SLM objectives have not been adequately mainstreamed into policies, regulations, strategies, plans and educational systems. There is a lack of understanding of decision makers that land degradation is significant barrier to sustainable development. Although integrated farming systems are a way of life for local communities, the planning of local resource utilization is mostly guided by more specific sectoral objectives and policies. This suggests a strong need to create awareness and build capacity for integrative dialogue and land use planning among all stakeholders.
The capacity gaps in land degradation include: i) individual level –lack of technical capacity (district level and community level for implementation); ii) institutional level – financial and human resources, monitoring capacity for enforcement of its rules and regulations); iii) lack of baseline data state and national level); iv) systematic level – there is a lack of common understanding and mechanisms to coordinate and address common land management issues.
Project Objectives and Expected Outputs
Objectives : Objectives of the MSP are to enhance and develop the individual, institutional, and systemic capacity for Sustainable Land Management (SLM), to mainstream SLM considerations into national development strategies and policies, to improve the quality of project design and implementation in the development arena, to develop a National Action Plan for SLM, as well as a medium term investment plan, while ensuring that all relevant stakeholder views are reflected and integrated into the process.
Objectives of the Terminal Evaluation
The Monitoring and Evaluation (M&E) policy at the project level in UNDP/GEF has four objectives: i) to monitor and evaluate results and impacts; ii) to provide a basis for decision making on necessary amendments and improvements; iii) to promote accountability for resource use; and iii) to document, provide feedback on, and disseminate lessons learned. A mix of tools is used to ensure effective project M&E. These might be applied continuously throughout the lifetime of the project – e.g. periodic monitoring of indicators, or as specific time-bound exercises such as mid-term reviews, audit reports and independent evaluations.
In accordance with UNDP/GEF M&E policies and procedures, all regular and medium-sized projects supported by the GEF should undergo a terminal evaluation upon completion of implementation. A final evaluation of a GEF-funded project (or previous phase) is required before a concept proposal for additional funding (or subsequent phases of the same project) can be considered for inclusion in a GEF work program. However, a final evaluation is not an appraisal of the follow-up phase.
Terminal evaluations are intended to assess the relevance, performance and success of the project. It looks at early signs of potential impact and sustainability of results, including the contribution to capacity development and the achievement of global environmental goals. It will also identify/document lessons learned and make recommendations that might improve design and implementation of other UNDP/GEF projects.
The overall objective of this TE is to review progress towards the project’s objectives and outcomes, assess the efficiency and cost-effectiveness of how the project has moved towards its objectives and outcomes, identify strengths and weaknesses in project design and implementation, and provide recommendations on design modifications that could have increased the likelihood of success, and on specific actions that might be taken into consideration in designing future projects of a related nature.
Scope of the Terminal Evaluation
Overall evaluation of the project
The terminal evaluation will address the following specific issues:
Project design
The terminal evaluation will assess the extent to which the overall project design remains valid. The evaluation team will review the project’s concept, strategy and approach within the context of effective capacity development and sustainability. Specifically, the evaluation will:
§ assess the extent to which the underlying assumptions remain valid;
§ assess the approach used in design and whether the selected intervention strategy addressed the root causes and principal threats in the project area;
§ assess the plans and potential for replicating or scaling up the site-based experiences;
The evaluation team will also attempt to ascertain the current level of comprehension of the project concept, focusing on three specific sets of actors: (i) project management team; (ii) field officers; and (iii) local communities.
Project implementation
The terminal evaluation will assess the extent to which project management and implementation has been effective, efficient and responsive. Specifically, it will:
§ assess overall institutional arrangements for the execution, implementation, management, monitoring and review of the project. This covers a number of issues,
including: the appropriateness of joint implementation and coordination; whether there has been adequate periodic oversight of activities; the effectiveness of government counterparts; and the effectiveness of relationships between key stakeholders;
§ assess the use of logical framework as a management tool during implementation;
§ assess indicators of adaptive management;
§ assess the quality and relevance of project reporting;
§ assess the mechanisms for information dissemination (advocacy and awareness raising) in project implementation and the extent of stakeholder participation in management;
§ analyze the project financing, specifically how the project has materialized/leveraged co-financing for various components (this is preferably presented in a matrix form).
§ review the effectiveness and the methodology of the overall Programme structure, how effectively the Programme addressed responsibilities especially towards capacity building and challenges, its main achievements and overall impact as well as the remaining gaps.
§ assess the extent to which programme design, implementation and monitoring have taken the following cross cutting issues into consideration: Human rights, Equity, Institutional strengthening and Innovation or added value to national development
Results
The Evaluation will examine the relevance, efficiency, effectiveness and sustainability of operational activities and results achieved by the project to-date, by showing how the component(s) processes and outcomes have contributed (or have the potential to contribute) to the achievement of project and GEF environmental goals. The Evaluation will:
Assess the extent to which the project achieved the global environmental objectives
Assess the effectiveness with which the project addressed the root causes and imminent threats identified by the project
§ assess, quantitatively and qualitatively, the achievements and impact in terms of outputs and its contribution to outcomes as defined in the project document;
§ assess to what extent the project has made impacts on promoting local participatory decision-making and local governance;
§ assess to what extent the project has or will contribute to the strengthened enabling environment for conservation;
§ assess the sustainability of project results (describe the key factors that will require attention to improve prospects for sustainability of project outcomes)
The terminal evaluation team will use a project logical framework to determine the overall contribution of project outcomes to development and global environmental goals. The terminal evaluation team is also invited to highlight contributions which are strictly beyond the project scope.
Governance and capacity-building
The Project promotes participatory processes and behavior that affect the way land use management is done at the local and national levels. This is principally achieved through the wide participation of local communities, capacity-building, and the promotion of accountability and transparency at different levels of government. In this regard, the terminal evaluation will look at how the project contributed to improved governance at local and national levels, and examine how governance issues have impacted on the achievement of project goals and outputs.
One of the specific areas the evaluation team is asked to assess in this area is how and to what extent the project has built management, planning and operational capacity among the project’s stakeholders, particularly at the community levels. This should include an overview of capacity-building techniques employed by the project as well as of the monitoring mechanisms involved.
Lessons learned
The terminal evaluation will also highlight lessons learned and best and worst practices in addressing issues relating to relevance, performance and success. Describe the main lessons that have emerged in terms of:
Country ownership/drivenness;
Stakeholder participation;
Adaptive management processes;
Efforts to secure sustainability; and
The role of M&E in project implementation.
In describing all lessons learned, an explicit distinction needs to be made between those lessons applicable only to this project, and lessons that may be of value more broadly to other similar projects
Methodology
The evaluation methodology will be determined by the evaluation team, guided by the requirements of GEF and UNDP as articulated in various guidelines, policies and manuals on the conduct of evaluations for GEF projects as well as key project documents such as the approved GEF project brief, the final UNDP project document, the inception workshop report, the project log-frame and annual budgets and work plans, the annual Project Implementation Review, Project Board, and PMT meeting minutes as available, and other technical reports and documents as relevant. The evaluation methodology should be clearly documented in the final evaluation report including comprehensive details of the following:
- documents reviewed
- interviews conducted
- consultations held with all stakeholders
- project sites visited
- techniques and approaches used for data gathering, verification and analysis
Conduct of the Evaluation
The evaluation team will work independently but will liaise closely with UNDP MCO, and Executing Agency. The consultant will also liaise periodically with the UNDP ensure that UNDP-GEF and GEF requirements are being met.
The evaluation team will visit the project site to ensure adequate consultation with all key stakeholders. Towards the end of the field evaluation, presentation will be made to all key stakeholders in country. After the presentation the evaluation team consultant will take note of verbal and/or written responses to its presentation and consider these in preparing an interim draft evaluation report that will be provided to Executing Agency/UNDP before the team leaves for distribution to stakeholders. The executing agency and UNDP will circulate the draft report to all stakeholders requesting written feedback and finalized by the evaluators within the dates reflected in the evaluation schedule.
While the evaluation team is free to determine the actual layout of the terminal evaluation report, this must include the minimum content requirements mentioned earlier. The Team leader will forward the final report by e-mail to UNDP for onward distribution to all stakeholders. The Team Leader will be responsible for the contents, quality and veracity of the report.
Deliverables
The evaluation team will produce the following deliverables to UNDP/GEF:
(i) Draft copy of terminal evaluation report ;
(ii) Final copy of comprehensive terminal evaluation report;
The final TE report will include: i) findings and conclusions in relation to the issues to be addressed identified under sections 2 and 3 of this TOR; ii) assessment of gaps and/or additional measures needed
that might justify future GEF investment in the country, and iii) guidance for future investments (mechanisms, scale, themes, location, etc).
The report should also include the evaluators’ independent final rating on the following:
Sustainability;
Achievement of objectives/outcomes (the extent to which the project's environmental and development objectives and outcomes were achieved);
Implementation Approach;
Stakeholder Participation/Public Involvement; and
Monitoring & Evaluation.
The rating should be within a 6-point scale as follows: Highly Satisfactory (HS), Marginally Satisfactory (MS), Satisfactory (S), Marginally Unsatisfactory (MU), Unsatisfactory (U) and Highly Unsatisfactory (HU). The final report together with the annexes shall be written in English and shall be presented in electronic form in MS Word format as well as a hard copy
The final terminal report together with the annexes shall be written in English and shall be presented in electronic form in MS Word format.
Products expected from evaluation
The main products expected from the terminal evaluation are:
presentation(s) to key stakeholders to solicit feedback/validations on preliminary findings of evaluation ;
an interim draft terminal evaluation report;
a final comprehensive terminal evaluation report
Products expected from evaluation
The main products expected from the evaluation are:
presentation(s) to key stakeholders on preliminary findings of the terminal evaluation;
an interim draft terminal evaluation report;
a final comprehensive terminal evaluation report
Qualifications of Team Leader
§ Substantive experience in reviewing and evaluating similar technical assistance projects, preferably those involving UNDP/GEF or other United Nations agencies, development agencies and major donors;
§ International/regional consultant with academic and/or professional background in natural resource management or related fields with experience in land management, with in-depth understanding of land issues as well as community-based natural resource management. A minimum of 10 years of working experience is required;
§ Experience in leading multi-disciplinary and multi-national teams to deliver quality products in high stress an short deadline situations;
§ Familiar with SLM approaches in Nauru/Pacific and /or developing countries either through management and/or implementation or through consultancies in evaluation of land related projects. Understanding of local actions contributing to global benefits is crucial;
§ Highly knowledgeable of participatory monitoring and evaluation processes;
§ Excellent English writing and communication skills
Proposed Methodology and Timelines
Two consultants shall be engaged jointly to undertake the evaluation working concurrently according to a planned schedule to be completed by June 20th, 2012. The Team Leader will have the overall responsibility of organizing and completing the review, submitting the final report as well as supervising the local consultant.
The team leader is expected to propose a work layout, plan, budget and timelines to achieve the expected outputs with the appropriate methodology.
Proposal Requirements:
Proposals should contain the following information:
i) Technical proposal including a P11 form (available on the UNDP website <www.undp.org.fj>), an updated current CV, contact details of at least three referees and a cover letter setting out:
How the applicant meets the selection criteria
Evaluation approach and methodology
ii) Financial Proposal
The consultant is requested to provide a proposal or quotation of the fees/cost for the services which will be rendered using the following format and should be separate from the technical proposal. Daily consultancy rates
A daily consultancy rate proposed by the consultant
Air Ticket
To and from home country
Air Ticket
(including at least one travel to Fiji for preliminary briefings)
Living allowances
Based on the number of days spent at the respective duty station1
Other miscellaneous expenses
(please state)
1 If consultant is based in Nauru, living expenses for Nauru are not applicable
Payment Schedule
a) Twenty per cent (20%) of the maximum payable Consultancy Fee [Professional Service] will be paid immediately following the signing of this Agreement by May 22nd (includes travel to Nauru);
b) Ten per cent (10%) of the maximum payable Consultancy Fee [Professional Service] will be paid immediately following the acceptance of a work plan and report lay out by UNDP by May 23rd May ;
c) Twenty per cent (20%) will be paid within eight (8) working days of receipt and acceptance by the United Nation Development Program of a draft report by June 1st;
d) The remaining fifty (50%) will be paid within eight (8) working days of the acceptance by the United Nations Development Program of the final Evaluation Report by June 20th;
Evaluation Method
The proposals will be evaluated using the UNDP cumulative analysis method whereby the total score is obtained upon the combination of weighted technical and financial attributes.
The highest combined weighted score which provides the best value for money will be awarded the contract. A
Technical (70%)
1Academic and/or professional background in natural resource management projects or related fields with experience in land management, with in-depth understanding of land issues (in country). A minimum of 5 years of working experience is required 10%
2Knowledgeable and experienced in facilitating participatory monitoring and evaluation processes
15%
3Well established networks and relations with local, district, community and national stakeholders
1%
4Previous experience as a consultant and/or team of consultants evaluating national, community based national and/or regional projects and national stakeholders 10%
5 Good English writing and communication skills 10%
6Understanding of customary protocols. Demonstrated ability to converse, communicate in local language/dialects is advantageous
15%
BFinancial (30%)
Total (100%)
Reporting Requirements:
The consultant will be monitored, overseen and supervised by UNDP Multi Country Office in coordination with national executing agency (Department of Commerce, Industries and Environment)
The consultant is expected to submit a report upon successful completion of activities according to the agreed schedules. The consultant is expected to provide for his/her own laptop.
Progress and final reports submitted to UNDP shall be in English.
Application Submission
All applications must include a Curriculum Vitae with full contact details of three referees and P-11 form to be submitted by 9th May, 2012 5:30PM Fiji Time either electronically to david.lumutivou@undp.org or addressed under confidential cover to:
Terminal Evaluation Nauru SLM Project - Consultancy (Team Leader)C/- UNDP Resident Representative
UNDP
Private Mail Bag
Suva.
Incomplete applications will not be considered and only candidates for whom there is further interest will be contacted.
Further Information: For further information concerning this Terms of Reference, Mr. Floyd Robinson, Environment Program Associate, UNDP-MCO, Suva, on email
floyd.robinson@undp.org / telephone (679) 3312500 or Claudette Wharton, Project Officer, Email:
claude.s.wharton@gmail.com, (Department of Commerce, Industries and Environment), Phone (+674) 444 3133. Women candidates are encouraged to apply.
*The Fiji Office covers Fiji, Kiribati, Marshall Islands, Micronesia, Nauru, Palau, Solomon Islands, Tonga, Tuvalu and Vanuatu
Иногда даже Тур Хейердал напивался и переедал.
