TOR: END TERM EVALUATION OF THE SCALING INVESTMENT FOR THE RESILIENCE OF EAST AFRICA COFFEE PRODUCERS PROGRAMME
Solidaridad strives to be an organization that understands the signs of modern times, seeking to be a Civil Society Organization (CSO) with its own place and role in society, while simultaneously interacting with Governments and markets. The organization envisions a world in which all we produce, and all we consume can sustain us while respecting the planet and the next generations. Solidaridad embraces the public-private and people partnerships (PPPP) in order to test innovations, speeding up change, and take success to scale. Globally, Solidaridad works around coffee and other 12 commodities/sectors (http://www.solidaridadnetwork.org)
The Coffee Resilience Program 2018-2022 dubbed Practice for Change (PFC) is a multi- country program with 2 main result areas as per Solidaridad’s Strategic vision: Good practices (GP) and Robust Infrastructure. The program supports small and medium scale coffee farmers/producers across 3 East African countries; Tanzania, Uganda, and Kenya. The program was designed to address a myriad of challenges facing East African Coffee farmers which include; high costs of production, poor governance at the cooperative level, decreasing coffee productivity, poor quality of coffee, erratic weather conditions, low income earned by coffee farmers, limited access to finance for coffee farmers and the need for a data-driven sector
Despite the above issues, smallholder farming is a resilient practice and has a strong future for East African coffee producers. Smallholder farming has stood strong despite the tribulations that some of these countries have undergone since the ’70s. It is, however, imperative that the sector players should continue to work in a more coordinated and collaborative manner. Solidaridad East and Central Africa in a consortium with the public and private sector players work towards driving an inclusive, resilient, and economically viable coffee production region that moves from slow and small to speed and scale. In the first phase of the program (2018-2020), 23,500 farmers were reached in Kenya, Uganda, and Tanzania. In the extension phase (2021-2022), an additional 27,000 farmers will also be reached in the same countries.
Program expected Outcomes:
- Increase productivity to 4 kg of cherry per tree (from a national average of 2 kg per tree) for smallholder coffee farmers and 6 kg of cherry per tree (from a national average of 3 kg per tree) for medium-scale farmers as a result of Good practices (GP) by 2023.
- Increase quality by 25% (premium grades reaching 70% from 45%) as a result of GAP’s package by 2022.
- 20% increase in income for farmers as a result of increased coffee productivity & diversification.
- 10% women membership and direct access to knowledge and income from coffee by 2022.
- Economic and farming performance data available to farmers, cooperatives, and financial institutions through ICT solutions.
- Farmers’ access to finance to invest in good practices and/or new technologies.
- Increased access to blended finance from financial institutions or investors to implement good practices and robust infrastructure by 2022.
- Improved governance, efficiency, and accountability in coffee cooperatives involved in the project.
Endline Survey Objectives:
The main objective of the project endline survey is to present findings and impact of the project activities/interventions of the target beneficiaries as per the indicators of the project objectives and expected results specified in the project document and the project’s results framework.
The specific objectives of the endline survey are:
- Assess the PFC Coffee Project’s achievements in both phases against the outcomes and output indicators set at the start of the project.
- Capture lessons learnt and provide information on the project approaches identifying what has worked and what has not worked for learning.
The evaluation has the following objectives:
- To assess to what extent the project achieved its formulated results (especially at output and outcome level) with households, smallholder farmers, companies and institutions benefiting from the project.
- To assess wider relevance & contribution of the project to Climate Resilience in Coffee Farming amongst small-holder and medium estate farmers and increased incomes in the following regions
i) Kenya- Kirinyaga, Meru, Nyeri, Machakos Embu, Kericho, Nandi, Kisii, Nyamira and Transnzoia Counties
ii) Uganda – Kapchorwa, Kiruhura Districts,
iii) Tanzania – Kilimanjaro, Moshi DC and Arusha Regions
- To assess the relevance and contribution of the project to the coffee sector: adoption of Good Agricultural Practices, climate resilient practices, innovations and technologies by coffee farmers and cooperatives/AMCOS that were both direct and indirect beneficiaries of the PFC Project.
- To also provide a full discussion of the research questions concerning relevance, Additionality and sustainability.
- To assess the appropriateness and effectiveness of strategies, approaches and modalities used in the project to realize the intended results.
- To assess the integration of innovation themes of gender (inclusion of women and youth), climate change and ICT.
- To identify major bottlenecks and lessons learnt and document them to take into consideration for possible follow-up projects. Also assess risks of pulling out at this moment, especially for the sustainability and durability of the interventions and investments.
The methodology for this study will include both direct and indirect data collection, analysis and cross-referencing, and formulating recommendations thematically and as area/site-specific. This evaluation requires a mixed method approach that allows methodological triangulation to increase the validity and credibility of data. Participatory methods shall be used to collect both qualitative and quantitative data. These methods shall include the following, but not limited to;
● Household survey using survey questionnaire (a representative sample of the total beneficiary population will be used)
● Literature review of existing documents and review of context and income trends including the project proposal and other documents, annual and quarterly reports, monitoring and evaluation reports
● Carry out field visits in the implementation areas for data collection, observations, and triangulation.
● Key informant interviews (KII) with project management team, local authorities and local development institutions
● Reflection and feedback sessions with project management team. The final methodology to be adopted shall be discussed and agreed with consultants/firm during the inception meeting.
● Special emphasis will be put on women spaces, youth engagement, and people with disabilities participation, so as to understand the impact the project has had as well as recommend interventions on issues concerning these interest groups from a gender, youth, and people with disability inclusion’s perspective for future programming.
The Consultant will finalize the methodology to undertake this study in line with the scope of the assessment, presented and refined with the management during the inception meeting.
Responsibilities of Consultants/Scope of Work:
The composition of the survey team is left up to the consultant/ organization based on their internal system, ideas, and logic. However, Solidaridad recommends that the team comprise one Team Leader (TL) to coordinate/conduct the overall study and liaise with Solidaridad. To collect information from the field using an adequate number of Field Enumerators (FEs). Supervision of the fieldwork and quality (reliability and validity) of the data/information collected from the field is the primary responsibility of the TL. The TL will work closely with Solidaridad M&E Officers and the project team. In each step and process, consultation with the Project Manager and the M&E Officer are vital. The survey will be conducted in the following locations;
- Kenya- Kirinyaga, Meru, Nyeri, Machakos, Embu, Kericho, Nandi, Kisii, Nyamira and Transnzoia Counties
- Uganda – Kapchorwa, Bulambuli, Sironko, Wakiso, Masaka and Kiruhura Districts,
- Tanzania – Kilimanjaro, Moshi DC and Arusha Regions
The consultancy/consultant team will be primarily responsible for:
- Develop/design endline survey tools including questionnaires for HH survey and checklist and tools for group interaction including FGD with target beneficiaries at village levels. – Share the study design including process, methods, and questionnaires/checklist with the project team, collect feedback and finalize the study design. – Pre‐test questionnaires and other tools in one of the project sites. – Submit an inception report. – Debrief/discuss with the project team about effectiveness of questionnaire, checklists, and other tools used in the pre‐test, collect feedback and finalize them.
- Carry out fieldwork together with enumerators. – Ensure the quality of information collected from fields, cross-check with the validity of information collected and verify/revise where needed. – Update progress of the study on a weekly basis to the M&E Officer. – Analyse data and prepare quality reports. – Give a presentation of the draft report to Solidaridad, and; – Submit a final report (a compiled version of the report ‐ both hard copy and electronic version in word format) to the project after incorporating the feedback and suggestions from Solidaridad.
- Work plan and expression of interest (EOI) for the Endline survey, outlining;
- A detailed methodology for implementation of the survey, including proposed sample sizes. – Draft data collection tools (The Consultant shall refine proposed standard indicators in reference to the proposed program indicators and other guidelines provided by Solidaridad) – A detailed work plan for the survey
- Presentation of survey methodology to Solidaridad team in an inception meeting and later incorporate suggestions in the final inception report.
- A draft report of the survey for feedback and comments from Solidaridad and partners involved.
- Presentation on the main findings of the survey for validation involving project teams, and other stakeholders as agreed with the project team.
- A final report in English with a maximum of not more than 40 pages, excluding annexes and consisting both hard and soft (CD ROM/USB) copies, with the following sections:
- Executive Summary – Introduction – Literature review – Methodology – Findings of the survey. – Conclusions and recommendations as per the project’s outcomes, outputs, activities, and indicators – Electronic annexes with the site-by-site raw data used for the analysis.
Consultancy firms/companies with verifiable research work in the coffee sector are encouraged to express their interests.
- Relevant degree(s) in social sciences or development studies, – Strong experience with and knowledge of qualitative and quantitative research methods and sampling strategies – Experience in designing and conducting studies using experimental or quasi- experimental techniques. Experience with longitudinal study designs desired.
- Statistical analysis skills and strong proficiency with data analysis packages. – Proven experience in conducting endline study surveys, impact studies and evaluations, preferably on the coffee industry – Research experience with coffee farmers is an added advantage – Excellent communication and written skills in English and Swahili.
How to apply
Applications should be submitted by 14/10/2022. All applicants must meet the minimum requirements described above, those unable to meet the requirement will not be considered. Remember that Solidaridad is an equal opportunity employer. Each application package should include the following:
The budget should cover the consultant’s fees, per Diem, travel, visa costs (if any), and accommodation costs.
- A brief proposal of the survey with methodology and work plan (not more than 15 pages). The financial proposal should have a budget with breakdowns of different costs involved, to the finer detail. A budget with aggregated figures will not be accepted. – A sample/samples of previous related work. – Updated CVs for the team leader and team members – Contact details of 3 references with complete contact information.
The overall time frame of the survey will be around 30 working days, which will include inception meetings, finalizing the survey methodology, training of enumerators, data collection, data analysis, report writing, and presenting the findings of the survey.
All applications should be sent using the contact below: [email protected]
With the subject below;
Expression of Interest to conduct a Endline Survey: Scaling Investment for Resilience of East Africa Coffee Producers Project (The PfC Coffee Resilience) Project
NB; Only successful candidate will be contacted