Uganda: TRAIL PROGRAM EVALUATION CONSULTANCY

Overview

Mercy Corps is a leading global organization powered by the belief that a better world is possible. In disaster, in hardship, in more than 40 countries around the world, we partner to put bold solutions into action — helping people triumph over adversity and build stronger communities from within. With funding from SIDA, Mercy Corps is implementing a private sector led sustainable agriculture Program called the Transforming Agriculture for Improve Livelihoods (TRAIL). Mercy Corps seeks to engage an experienced consultant to undertake the final evaluation survey of the Program which completed program activities on 30^th November 2017.

The final evaluation will determine the effectiveness and efficiency of the private sector led model of Program intervention and draws areas that needs further engagements as guided by the program Theory of Change stated below;

“If agriculture productivity in East Acholi through a private sector-led partnership increases in a sustainable way; AND key commodity markets that is pro-poor function efficiently, AND communities have inclusive access to appropriate and affordable financial services and products tailored to farmers and small agribusiness THEN communities adopt new agronomic practices and technologies leveraging on good business environment with engaged financial institutions throughout the agricultural systems, smallholder farmers will directly have increased incomes and greater food security leading to enhance economic growth” (Source: Adopted from the Design for Impact Guide (DIG))

Program Objectives and Results

TRAIL is based on scaling a private sector partnership with an entrepreneurial buying company, Gulu Agricultural Development Company (GADC). TRAIL aimed to reach a total of 60,000 smallholder farmers over three years in Lamwo, Kitgum, Pader and Agago districts of East Acholi. GADC achieved this by recruiting 250 Field Officers who trained 2,000 Lead Farmers. GADC aimed to build a gender balance across the administrative and field extension networks. The approach was strengthened by the new and updated trainings that include organic techniques, tillage and cultivation, yield-enhancing inputs, integrated pest management (IPM), post-harvest handling techniques, financial literacy and business skills. These trainings increased production and productivity of five targeted commodities namely; sesame, soybeans, sunflower, chili, and cotton leading to growth of local entrepreneurs from the farming communities. The Program is built on five pillars;

1. Economic growth: Increasing farmers productivity while increasing their incomes and profits

2. Environmental protection: Education and modern, sustainable agriculture practices and on-going technical support

3. Gender and youth focus: Viable livelihoods and new job creation

4. Technology and innovation: Integration of technology innovation to scale operations, enable efficiencies and smallholder farmers to access services and impact reporting

5. Conflict sensitivity and Do No Harm: Analysis of potential or existing tension in the operational areas and application of conflict sensitivity and Do No Harm lens.

TRAIL conducted a gender and youth, and conflict sensitivity assessment to inform the intervention sectors. Using the Making Market Work for the Poor (M4P) approach, TRAIL has worked to improve performance of supporting markets: inputs, skills, financial services, tillage, output, postharvest handling and key rules and regulations under the respective sectors. The program principally works with service providers; input supply companies, distributors and agents; big output market actors, intermediaries and produce aggregators; tillage service providers; financial institutions (Banks and SACCOs); equipment suppliers; relevant government agencies; and consultancy firms.

Objectives and Results

The Program goal is to enhance economic growth and food security in northern Uganda by improving the performance of agricultural services and commodity markets. The Program has the following three strategic objectives with respective intermediate results;

· SO1: Improved production and productivity of targeted commodities for smallholder farmers

1. IR1.1: Increased access to quality input and tillage

2. IR1.2: Adoption of improved farming and agronomic practices

· SO2: Improved performance of the key commodity markets in targeted areas

1. IR2.1: Established network of commodity aggregation agents

2. IR2.2: Established technology platforms that support information flow and financial transactions in the supply chain

· SO3: Improved access to financial services and products to farmers and small agribusinesses

1. IR3.1: Established partnership with Financial Institution for provision of improve financial services

2. IR3.2: Improved financial management

Scope of Evaluation: Purpose and Objective

The main purpose is to evaluate achievements towards meeting the objectives and targets and assess relevance, effectiveness, impact, efficiency and sustainability at program end. Emphasis should be placed on whether interventions, especially gender-focused and environmental/green growth strategies, will be sustained. TRAIL tested various innovative approaches and strategies to increase potential to achieve impacts at scale, with focus on sustainability. The evaluation will examine if the means by which such interventions were gender inclusive, enabled expansion production volume and increased incomes to program beneficiaries. Below are key innovations, followed by specific objectives of the evaluation:

· Tillage sector technologies (Ox-drawn): Scalability, replicability and adaptation to enhance business growth and expansion production and productivity

· Buying agent network: GADC business acumen and its effect into the business growth of buying agents

· Agriculture Extension Services Network:

· VSLA models as an alternative approach to enhance financial inclusions:

· PHH technologies (Pre-cleaners, tarpaulin and solar dryers):

· Climate smart agriculture: Permaculture, environment protection and tree planting:

· Agricultural technologies such as solar powered irrigations equipment:

· Technologies as alternatives for agricultural extensions approach:

· Gender integration: The models and approaches used by GADC to enhance training and productivity

· Private sector led programming and its effects on crowding in or out of different private sector players

1.Determine the extent to which program outcomes and their targets were achieved.

The evaluator will first begin with existing data that has been collected during the course of program implementation by Mercy Corps and GADC. The evaluator will be expected to identify gaps and then collect and analyze quantitative and qualitative data and report on the outcomes and results of the program on beneficiary households. Outcome refers to immediate tangible benefits and includes access to services such as; inputs and finance, increased incomes, and improved performance of agribusinesses in the input and output (buyer) markets. The key program outcome indicators include % increase in yield (production & productivity); % increase in income at farm household level; % reduction in postharvest losses; % increase in sales and profit by agribusinesses agents; % increase in investment on assets and businesses expansion; % of male and female farmers who have access to financial services and products; % of male and female farmers who have access to mobile financial services; # of male and female agents with active accounts with financial institution;% of female and male farmers reporting increase proportion in capital or asset baseand % defaults rates on loans. The following Gender Alpha indicators should also be measured;

· Percentage of women that reported meaningful participation in decision making bodies at household and community level

· Average score on the relevant household decision making index

1. Determine the effectiveness of programmatic activities and alternative implementation approaches.

The evaluation is expected to examine how well the program attained its overall goal and strategic objectives and whether the achievements were efficient, relevant and sustainable.

3.Evaluate the extent to which the program’s cross-cutting themes such as gender, environmental protection strategies and conflict have been addressed, integrated and will be sustained.

The consultant will also be expected to evaluate how well the program has addressed and integrated cross-cutting themes such as Gender, environmental protection and conflict as it relates to all three objectives, community-driven development, and Environmental Compliance.

4.Examine the potential sustainability of established mechanisms and activities.

This refers to how program activities will continue after the program ends. TRAIL aimed to initiate interventions and incorporate them into GADC’s business model, so these interventions would be sustained. This includes the degree to which established GADC business network or the contribution of GADC business acumen are likely to continue; gender equity and green growth interventions; and beneficiaries will sustain relationships with the private sector. The evaluation needs to establish whether beneficiaries will continue to have positive benefits resulting from the program, including GADC.

5.Identify key lessons learned and best practices for replication.

The evaluation is expected to draw lessons learned. The evaluator should illustrate best practices for replication in future programs. Areas of interest may include comparison using technology trainings (Video screening, 1-6-1/Wanji games platform) vs the traditional “Under the Mango Tree” or classroom training; PHH technologies such as Solar drier and Pre-cleaners; Tillage Services Provision technologies such as Ox-drawn etc. At least one key recommendation should include how NGOs can best contract with private sector partners in future.

Methodology

The evaluation will be executed in four districts (Kitgum, Agago, Pader and Lamwo). A theory-based, mixed methods approach will be used as it is the best effective method for evaluating market systems programs according to DCED Standard, and recent research by USAID/LEO and BEAM Exchange. The consultant will lead the collection of both qualitative and quantitative data and information collection to determine whether program outcomes and targets were achieved, and to determine the effectiveness of programmatic activities. The same questionnaire as developed for the baseline will be used, but with slight adjustments to capture modifications in performance management plan that happened mid implementation. Additional modifications will be included to allow for proper measurement of factors that affect activity outcomes, both promoting and inhibiting factors. A scientific sampling frame will be developed by the MC Uganda team to address the sample size and sample locations and allow for comparison to baseline. The consultant will be responsible for collecting qualitative information by reviewing documents, direct observations and using standard qualitative methods like focus group discussions, key informant interviews as well as results validation workshop with beneficiaries and other stakeholders. Stakeholders will include business operators (small, medium and large), donor representatives, partners, associations, business forums, sub-country and district-level government officials and Mercy Corps team

Data Analysis and Results Dissemination Plan

For quantitative data collected via the household survey and appropriate analysis procedure done by the consultant and well stated in the methodology such as use of required statistical test will be documented. Qualitative information collected by the consultant will be synthesized with supporting quotations, to highlight conclusions. Qualitative information will provide insights to quantitative results and is expected to uncover if, why and how program activities led to varying levels of outcomes as well as unintended and unexpected results.

The evaluator will present initial findings from both quantitative and qualitative data collection and analysis in a half-day debrief workshop attended by district and local council leaders, donors and, other NGOs, Mercy Corps staff. Feedback from the workshop will guide the finalization of the second draft report that will be circulated to Mercy Corps and SIDA. Feedback from this will culminate in the final report. The consultant will be responsible for sharing of findings and lessons learned with Mercy Corps, and if and when requested by Mercy Corps, the consultant will share findings and lessons learned with the donor and government representatives. Hard and soft copies will be shared with SIDA and Mercy Corps for internal utilization.

Evaluation Team

The consultant will be an external evaluator, and will be responsible for coordinating the overall final evaluation and compiling both quantitative and qualitative data and information. The Mercy Corps in country team will take responsibility in coordinating logistics and introducing the consultant to key informants and other sources of information, as well as ensuring that adequate resources are in place to have swift evaluation flow. Mercy Corps global MEL team and Technical support units will provide input to the evaluation design and draft report. The consultant will report to the TRAIL Senior Program Manager and the Director of Programs, who will provide relevant program documentation (prepared or requested). At minimum, the evaluator should have experience in market facilitation evaluation and programming, financial services, agriculture development, and food security. Mercy Corps MEL Specialist will support the team to ensure access to existing program data, reports and documentation, setting up data collection with target beneficiaries, households, farmers and partners and support with arranging meetings, focus group discussions and key informant interviews.

Reporting and Dissemination Requirements

The final evaluation report will not exceed 40 pages, not including attachments. The report shall be structured in accordance with the following guidelines:

· Cover Page (with a photo), List of Acronyms

· Table of Contents that identifies page numbers for the major content areas of the report.

· Executive Summary (3 pages) should be a clear and concise stand-alone document that gives readers the essential contents of the evaluation report, previewing the main points in order to enable readers to build a mental framework for organizing and understanding the detailed information within the report. It should highlight the major findings and recommendations as per evaluation objectives, including lessons learned and good practices.

· Methodology: It should describe the sampling methods including strengths and weaknesses of methods with potential to alter conclusions reached, team composition, schedule of activities undertaken, description of any or special statistical analysis undertaken, including justifications and software package used. The discussion of any random sampling used should include details on how the respondents were identified and invited to participate. The methodology section should also include a detailed description of information collection techniques used throughout the evaluation.

· Results: The results section should be structured based on the evaluation questions and objectives. It may for instance be helpful to organize the report against Program objectives, while in some instances it may make more sense to organize the report and findings as per evaluation questions.

· Synthesis, Recommendations and Lessons Learned: This is space for the consultant to reflect on the data and results in a way that logically leads to concrete recommendations for current and future Program improvements, pulls out organization lessons learned, and generally comments on data and results. Everything presented in this section must be directly linked back to the information presented in the results section of the report. Ideally, items discussed here should not be completely new to the reader, but rather will refer to previous discussions. Recommendations that are not directly tied to Results can be included in an Evaluator Comments section for the report.

• Annexes: These include information collection instruments in English and translation (if applicable); list of interviewees with numbers and types of interactions; SOW, qualitative protocols developed and used, photos, participant profiles or other special documentation needed. Datasets can be provided in electronic format and as an Annex.

Required Expertise

The selected consultant is expected to have strong expertise in program evaluation, specifically, evaluations of market-based, M4P (market facilitation) and agricultural development, broad knowledge of youth, gender and development issues as well as financial inclusion and services. The consultant must have experience in a variety of settings and working with a number of different people that include members of staff, government officials, local government extension officers, associations, private business actors and community members in rural and urban environments. Successful applicants will have:

• Demonstrated experience conducting and managing all aspects of complex program evaluation
• Demonstrated understanding of market systems development/M4P approach and agricultural knowledge
• Experience in northern Uganda preferred
• Advanced academic qualification in finance, business administration, economics, or economic development
• Familiarity with the Uganda agricultural context and market actors
• Excellent analytical, research, writing and concise and compelling communication skills; Strong visual presentation skills preferred.
• Language skills: Professional capacity in English

Application Process

Technical Proposal: The applications will first be evaluated on technical merits. The technical proposal assesses the capacity of the applicant, based on its submitted technical documents, specifications, performance history, and references submitted. For this purpose, certificates and additional references may be requested and subsequently examined. The Technical Proposal should be no more than 10 pages, excluding attachments. It should provide analysis of the TOR but not copy and paste any part of the TOR. The Technical Proposal should include:

· Brief Analysis of the TOR

· Proposed qualitative and quantitative methodology, including any specifics on sampling methods

· Detailed workplan with a timeline

· Summary of previous relevant experience

· References (at least 3)

· Sample report (at least 1) of a similar nature (attachment)

· CV of key staff (attachment)

Financial/Cost Proposal: The financial/cost evaluation is based on budget presented in the application. This will be reviewed if the consultant passes the initial Technical Proposal Evaluation phase. The evaluation is intended to assess and confirm that applicants provide good value to Mercy Corps for the cost of all goods and/or services offered. The Financial Proposal should clearly state daily rates for any key staff. For fieldwork, Mercy Corps will provide field-related travel within the Acholi Sub-region only. Mercy Corps will hire enumerators in partnership with the final evaluation consultant and manage all fees related to enumerators and data cleaning. Consultant should include all other travel costs associated with field work, including per diem for consultant’s staff, travel to/from home location and hotel fees. These rates should be clearly defined within the financial proposal.

Other Terms & Conditions

1. Reports and Information

a. The consultant, at such times and in such forms as Mercy Corps may require, shall furnish Mercy Corps such periodic reports as it may request pertaining to the work or services undertaken pursuant to this contract, the costs and obligations incurred or to be incurred in connection therewith, and any other matters covered by this contract.

1. Records

a. The consultant shall maintain accounts and records, including personnel, property, and financial records, adequate to identify and account for all costs pertaining to the contract and such other records as may be deemed necessary by Mercy Corps to assure proper accounting for all project funds. These records will be made available for audit purposes to Mercy Corps or any authorized representative, and will be retained for three years after the expiration of this contract unless permission to destroy them is granted by Mercy Corps.

1. Findings Confidential

a. All of the reports, information, data, etc., prepared or assembled by the consultant under this contract are confidential and the consultant agrees that they shall not be made available to any individual or organization without the prior written approval of Mercy Corps.

1. Copyright

a. No reports, maps, or other documents produced in whole or in part under this contract shall be the subject of an application for copyright by or on behalf of the consultant.

1. Compliance with Local Laws

a. The consultant shall comply with all applicable laws, ordinances and codes of Ethics governing this nature of service, and shall save Mercy Corps harmless with respect to any damages arising from any offense done in performing any of the work under this contract.

1. Payment Terms

a. Advance payments of a minimal percentage (no more than 40%) are allowable.

1. Withholding Tax

a. Consultancy agreement value will be subject to withholding tax as per all applicable laws and ordinances regarding such a service agreement as per the laws of the Government of Uganda. Any proposal based on this TOR should include withholding tax.

Applications: Submit your expression of interest for the consultancy to the Senior HR & Legal Manager, Kampala Head Office ,E-mail toug-mcjobs@mercycorps.org

Deadline for Submission: Close of business by 5:00 pm January 2, 2018 Only** short-listed Consultants will be contacted by Mercy Corps. Any canversing will lead to disqualification.

Follow this link to access the entire final evaluation TORs