Turkey: Final Evaluation of GOAL Syria’s Emergency Food Support to Conflict Affected People in Syria

GOAL launched a humanitarian program in Northern Syria in October 2012, and established a coordinating office in Antakya, Turkey with sub-offices in Harem and Darkosh, Syria. The objective of the GOAL Syria response is to provide emergency support to vulnerable families displaced or affected within Syria by the conflict, via the distribution of cash, vouchers, food kits, and non-food items, and support to water delivery, solid waste removal, and bread production systems.

GOAL is addressing increasing food insecurity from insufficient access to food near the Turkish border and unavailability of food near the conflict line in Idleb Province by providing monthly food rations to 30,406 households and vouchers to 11,665 households.

GOAL Syria is seeking a rigorous external end-of-project evaluation for FFP-funded food aid response. The evaluation will be organized along OECD evaluation criteria and will assess the extent to which GOAL met its project objectives while providing lessons learned and best practices to inform future programming.

1.1 Background

Four years of conflict have incrementally impacted people in Syria in all facets of life; the United Nations estimates that over 7.6 million people have been internally displaced and a further 3.2 million have fled to neighboring countries as refugees.[1] Unabated insecurity and the continued degradation of households’ ability to cope have deepened the humanitarian impact of the crisis, with over 12.2 million people estimated to be in need of assistance.

Factors such as conflict-induced inflation, currency depreciation and continued conflict-driven displacement have critically served to reduce the purchasing power of affected populations; during displacement, the possibility of finding work or undertaking any kind of economic activity is significantly reduced, contributing to ever-higher levels of vulnerability.^[2] Within the seven sub-governorates surveyed in the MSNA, a total of 4.5 million people were reported to be in need of food assistance: 785,00 people^[3] were found to be in either acute or moderate needs in Idlib alone – a significant increase from findings in May 2014, where 532,030 people in Idlib were assessed to be in acute or moderate need.^[4] In Hama, 537,500 people^[5] were found to be in either moderate or acute need- representing an increase from May 2014 where an estimated 185,700 people were are in acute need of food assistance with a further 246,300 in moderate need.^[6]

• UNOCHA Humanitarian Bulletin – Syria Operations from Turkey Issue 12, January 19^th– 30^th 2015
• HNO FSL Sector Draft, October 2014.
• People In Need (PIN) figures, as rounded from the FSL Working Group for the Humanitarian Needs Overview (HNO).
• DYNAMO Dynamic Monitoring Report, Issue number 2, May 2014.
• People In Need (PIN) figures, as rounded from the FSL Working Group for the HNO.
• DYNAMO Dynamic Monitoring Report, Issue number 2, May 2014.

Food Support Project Objectives

The strategic objective of the project is “*Increased food security and diet diversity among conflicted affected communities in Idlib and Hama Governorates, northern Syria*.” This would be achieved if “*access to food amongst vulnerable IDP and host populations increased.*” Through this project GOAL sought to achieve this result through two modalities – distribution of regionally purchased family food rations, and

As part of the project strategy, these objectives are measured through the following indicators:

· % HHs with an adequate food consumption score (FCS)

· % beneficiaries reporting that they had sufficient food stocks to meet HH needs in the previous 7 days

· Decrease in % HH's who report utilizing negative coping strategies (such as selling assets for food, running into debt, etc.)

· # of beneficiaries targeted and reached, disaggregated by sex and age (6 to 24 months, 25 to 59 months, 5 to 18 years, and >18 years of age)

· % expenditure of targeted HHs reported as used for food purchase

· % food vouchers redeemed by targeted beneficiaries during the corresponding shopping period

2.2 Research Project Purpose

The purpose of this research project is assess GOAL’s Food for Peace funded project according to OECD evaluation criteria. This will allow GOAL to remain accountable to Food for Peace for delivering the results and impact intended with the project, and to improve its future food security programming through lessons learned and best practices generated through this project.

2.3 Research Project Scope

The research project should be organized around OECD evaluation criteria as follows, with suggested research questions provided.

Relevance:Under which conditions and constraints are each of GOAL’s modalities most appropriate to address food security among the most vulnerable populations? Does this program effectively reach the households most vulnerable to food insecurity? Are the contents of the food kits and the value of the vouchers appropriate to meet nutritional and food needs, and specific to the Syrian context?

Effectiveness: Was the program sufficiently adaptable to a fluid and insecure context to deliver food in a timely fashion and sufficiently achieve targets? Were the monitoring mechanisms effective in providing timely data to inform programming decisions? How effective was the project design and its modalities in addressing the unmet food needs of targeted communities?

Impact: To what extent does this project improve food security or safeguard against food insecurity? Are there any ill effects or unplanned impacts as a result of this project? Did pregnant and lactating women, children under 2, and other sub-groups vulnerable to undernutrition benefit proportionally from this project? Does this project have any quantifiable impact on nutrition? Are there any positive or negative spillover effects on non-beneficiaries?

Efficiency: Is the modality a cost-effective way of increasing food consumption score in the short-term? Are adequate human and financial resources applied to delivering project outcomes?

Sustainability:To what extent has this project affected households’ using negative coping strategies? To what extent do the two modalities support the recovery of markets and market systems?

2.4 Research Project Tasks

1. Refine the research objectives and primary research questions in consultation with GOAL Syria’s technical and management teams
2. Devise and test a methodology and evaluation tools to quantify and describe the extent of the project’s impact on various stakeholders, vulnerable households
3. Conduct secondary data collection and research, including using GOAL’s existing project monitoring data, to identify gaps in data coverage and knowledge
4. Collect primary data in Syria to establish and quantify the economic and food security impact on beneficiaries, and to the extent possible, non-beneficiaries
5. Provide a draft report to programme management that will be incorporated into ongoing programme planning and evaluation, as well as recommendations for maximizing social impact
6. Incorporate GOAL feedback into draft report and prepare a final report. The Final report should both describe the results of the evaluation, and provide actionable recommendations for improving the FSL program
7. Methodology

A recommended methodology is outlined below, but the final methodology and tools to be used is to be determined by the evaluation team and will be contingent on the above tasks. GOAL recommends a mixed methods approach that can quantify impact and achievement against targets and indicators, and can also assess the appropriateness of the composition of the food ration and the value of the voucher.

At the time of the evaluation, GOAL expects to have the results of an evaluation comparing the impact of food rations and vouchers on household food security. GOAL also expects to have preliminary findings from an assessment on vulnerability to food insecurity. Therefore, GOAL prefers methods that would build upon these findings to provide a more robust understanding of the targeting schema for voucher and food kit modalities, potentially including a decision tree schematic, for both beneficiaries and non-beneficiaries.

The evaluation team should consist of one to two Team Leaders. Access to Syria is likely to be impossible for an international consultant, so a Training-of-Trainers (ToT), or if possible, a Syrian counterpart is required for international applicants. Preference will be given to International Team Leaders who speak Arabic, and/or those with experience of the Syrian response.

3.1 Planning

Before arriving in country the evaluation team will do the following:

§ Review key internal and external documents

§ In partnership with the GOAL Syria MEAL Coordinator and FSL team, refine and finalize the specific evaluation questions to be explored from the scope described above.

§ Propose to the MEAL Coordinator and the FSL team the appropriate methodology to be developed for the Syrian context to evaluate the Food for Peace project and address the OECD evaluation criteria.

§ Prepare an outline of the data collection methods that are required and the relevant survey templates and participatory data collection guides to be used for data collection.

§ Develop data entry software with quality checks in place with a minimum 10% double entry.

§ Develop a work plan consisting of key milestones required for data collection in order for logistics to be arranged by the MEAL Coordinator.

§ In consultation with the MEAL Coordinator and FSL Coordinator, develop an analysis plan and report framework addressing key questions.

On arrival in country the evaluation team will:

§ Hold a short planning meeting with all members of the evaluation team including the MEAL Coordinator and FSL team, to review and amend the questions as needed for the data collection tool.

§ Liaise with the MEAL Coordinator and MEAL Field Manager on the training and recruitment of the data collection staff and the use of mobile data collection for the proposed survey tools and qualitative guides, as primary data collection will be required for the study.

§ Hold a brief workshop with the SMT to communicate evaluation methods, sampling frame and methodology, sample size, enumeration plan, objectives, and outcomes. This will include a short description of the evaluation questions and methods proposed, and the implications the findings of the evaluation may have on GOAL Syria cash-based response programming.

Post-site visit

§ Data analysis, report development, and dissemination

3.2 Primary Data Collection

Areas of primary data collection in Syria will span across the FFP project area in Idleb. The sampling frame should take into account continual FFP distributions. To the greatest extent possible, the evaluation should consider both beneficiaries and non-beneficiaries, examining any potential positive or negative spill over effects.

In the initial stages of data collection, the consultants should conduct random checks on the data and preliminary analyses to identify and problems and make swift corrections.

Consultants are requested to include a full timeframe (which GOAL will then input with regard to travel days) within their proposal document in the following format:

ActivityNumber of days Person responsible Deliverables e.g. Training of Trainers 4 days Assistant Consultant Training documentation, improved capacity of data collection staff to collect data

1. Ethical Considerations

The evaluation team will make clear to all participating stakeholders that they are under no obligation to participate in the evaluation study. All participants will be assured that there will be no negative consequences if they choose not to participate. The evaluation team will obtain informed consent from the participants. The research team will ensure prior permission is received for taking and use of visual still/ moving images for specific purposes, i.e., ‘for research report and presentations. The evaluation team will assure the participants’ anonymity and confidentiality and will ensure the visual data is protected and used for agreed purposes only. In particular, the evaluation team will employ robust data security measures to further ensure participants’ confidentiality and anonymity. The evaluation team is responsible for determining whether or not their proposed methodology would require Institutional Review Board (IRB) clearance, and will be responsible for clearing the process and training if such approval is required.

1. Presentation and Documentation of Findings and Recommendations

This consultancy will take place at the end of the Food for Peace grant period, starting no earlier than 1 October 2015, with the final approved report submitted by no later than 30 November, 2015.

The findings of the evaluation must be shared with GOAL in the following formats:

§ Closing workshop in Antakya, Turkey with GOAL staff to present findings and get feedback

o Agreed lessons learned and best practices that can be incorporated into FSL programming and other emergency programs in Syria

o Agreed recommendations that will inform and improve GOAL’s FSL strategy, with agreed action points and deadlines.

§ Draft Research Report submitted to MEAL Coordinator and FSL Coordinator for feedback and comments, two weeks after conclusion of field visit.

§ Final Research Report- The report must be clear and concise and the following sections must be included as a minimum: Executive Summary, Literature Review of Food and Voucher Responses in Syria, Methodology, Analysis of Findings, Recommendations, Annexes: TORs, a timeline of the response, a list of individuals interviewed, statistical outputs, templates of data collection tools used, a description of the methods employed, a summary of survey results (if appropriate) and any other relevant materials.

§ An evidence-based report on best practices and lessons learned identified during the evaluation, relating to the project’s technical, logistical, implementation, and monitoring aspects.

Deliverable 1: Presentation of findings

Deliverable 2: Action Plan with deadlines

Deliverable 3: Final Evaluation Report

Deliverable 4: Evidence-Based Lessons Learned and Best Practices Document

1. Dissemination of Findings

Results and recommendations will be made available externally to interested stakeholders at the discretion of GOAL Syria’s senior management. The final report will be the property of GOAL Syria.

1. Assumptions and Requirements

§ Evaluators will have access to all documentation and can take part in relevant meetings and field trips within Turkey.

§ Evaluators will have access to key staff in the responding GOAL offices in Syria and Turkey and partner offices to obtain adequate information provided.

§ The evaluation team will have access to members of the affected population for conducting interviews.

§ Evaluators will take confidentiality and objectivity into consideration during the process.

§ Security concerns could impact the timing and the scope of the evaluation. It is important for the team to remain flexible. They must be open to making changes to the schedule and itinerary such as visiting alternate sites, conducting remote reviews and interviews, etc.

§ GOAL will provide all transport within Turkey, and if security permits for a Syrian national, transportation to Syria.

1. Consultant Profile

For the purposes of this evaluation, GOAL welcomes international, Syrian and Turkish firms and evaluators to apply. Preference will be given to evaluation teams that can access the field in northern Syria.

The profile of the lead consultant is:

§ Individuals or firms in academia, social research, or humanitarian evaluation (Ph.D. students or professionals) with a background in humanitarian aid, food security, Middle East studies, or research methods.

§ Master’s or doctoral degree either in development economics, agricultural economics, development studies, agronomy, nutrition, or other related field

§ Extensive experience evaluations along DAC OECD evaluation criteria (experience evaluating USAID projects desirable), ideally leading an evaluation team and experience of designing evaluation methodology / tools, data analysis etc.

§ Experience of working in humanitarian contexts and good understanding of humanitarian response work – both in programmes and operations

§ In-depth knowledge of quantitative and qualitative research methods

§ Experience with mobile data collection

§ Competent in using statistical packages for quantitative and qualitative analyses

§ Excellent presentation and writing skills

§ Capacity to work collaboratively with multiple stakeholders

§ Excellent analytical and writing in English and Arabic (preferred)

It is strongly preferred that the consultants who will be visiting Turkey will additionally have strong experience organizing and conducting Training of Trainers.

1 Offer Checklist

BEFORE SUBMITTING THIS OFFER PLEASE ENSURE

1. A print out of this advert has been signed acknowledging acceptance of GOALs Terms and Conditions as outlined below
2. A detailed proposal is attached including:
3. Up to three relevant examples of past assessments or research completed
4. CV’s for relevant staff
5. Technical proposal including detailed tasks, recommended methodology summary and proposed schedule, your relevant experience, how you meet the profile required and details of time required (maximum 8 pages)
6. a proposed schedule and details of time required;
7. any other relevant requirements/support needs;
8. Detailed, itemized cost proposal, including daily fee and any other associated costs (GOAL will provide accommodation)

2. Timetable

Deadline for Reply: 25th August 2015

3 ABOUT GOAL:

For further information about GOAL please visit www.goalglobal.org

4 INSTRUCTION TO BIDDERS

By submitting your Offer, the Bidder accepts in full the conditions of this advertisement, waiving his/her own conditions of sale.

Please read all instructions, terms and conditions carefully, and ensure your information and documentation is provided on time as failure to do so may result in rejection of your bid.

If clarification is required on this tender please send your query to tenders-syria@sy.goal.ie with a copy to GOAL’s Logistics Coordinator, Will Holden: wholden@sy.goal.ie and GOAL M&E Coordinator Joseph Witiw jwitiw@sy.goal.ie Please include the reference number and words “clarification required” in the subject line. Direct contact with any other GOAL staff member, before opening date, will result in the Immediate Disqualification of The Submitted Tender.

5 SUBMISSION OF OFFERS

Offers must be delivered in one of the following ways:

1. In a sealed envelope to the following address:

GOAL Turkey, Antakya office, Ataturk Street, Kanatlı District No: 134 Floor: 5, Apt 8. Antakya Hatay,

Your proposal, in original, should be sealed in an envelope addressed as follows:

Request for Offer for GOAL SYRIA

GOAL Reference G-SY-ANT-BK-11272-2015

2. By email to the following address:

tenders-syria@sy.goal.ie

The subject line and email body should reference the following:

Request for Offer for GOAL SYRIA

GOAL Reference G-SY-ANT-BK-11272-2015

If submitting by e-mail, please include scanned signed copies of your bid along with scans of all the required documentation

Important: Offers transmitted in any other manner than those indicated above or offers received after the deadline date and time will not be considered.

6 SELECTION CRITERIA

When analyzing the Offers, the following are requirements for GOAL:

· Known reliability in delivery of timely and quality services

· Relevant field/country experience

· Relevant sector specific technical experience & qualifications

· Relevant evaluation experience

· Presentation and writing skills evident from the proposal

· Demonstrated understanding of the work proposed in the TOR (ANNEX 1)

· Detailed methodology proposed

· 2 Professional References,

· Cost/budget

7 INFORMATION REQUIRED

7.1 DOCUMENTATION REQUIRED

Please ensure you have included all documentation outlined in the checklist in section 1

7.2 SPECIFICATION OF SERVICES

Please give full details of the services being offered, including all information required in the Annexes.If your response deviates from GOAL’s required specifications in this RFO and associated documents please include full details of the deviations.

GOAL requires individuals / your company to provide accurate and true information in both your quote and any other information provided verbally or through email throughout the process of RFO submissions and clarifications. All information provided to GOAL as part of this RFO process should be accurate. Providing false information may lead to your exclusion from the process.

7.3 PRICING:

1. Prices must be expressed in Turkish Lira (TRY) or US Dollars (USD). Please, note that GOAL Standard Monthly Financial Rate will be used for analyzing offers submitted in any other currency.
2. Any discount offered to GOAL must be clearly indicated as a percentage of the overall cost.

7.4 PAYMENT TERMS

1. Payment will be made to the vendor by bank transfer within 30 days from receipt by GOAL of all reports mentioned in the contract according to the agreed schedule.

8 CONDITIONS OF TENDER/RFO

1. GOAL reserves the right to deal with any Offer of its choice or any or all parts of the Offer and to purchase services from various Offers. GOAL is not bound to accept the lowest Offer, or any Offer.
2. This document is not a contract or an Offer into a contract, but is a request for a quotation for the services indicated
3. GOAL does not undertake to pay by letter of credit or in advance of delivery.
4. Respondents are bound by their Offer for a period of 180 days as from the closing date of bids. If the validity of your offer is less than 180 days, or more than 180 days timeframe, please, clearly indicate same in your offer
5. GOAL is in no way responsible for any costs associated with preparing the RFO response.
6. GOAL reserves the right to alter the dates of the timetable.
7. GOAL will inform each respondent to the results of the decision on their Offer; this process is not open to the public. GOAL is not obliged to justify or explain selection to any respondent.
8. Any queries about this RFO should be addressed in writing to GOAL via email as detailed above
9. Any contract that results from this tender will be subject to GOALs standard Terms and Conditions (**Annex 2)**.

9 BIDDER’S SIGNATURE.

I have read and understood this document:

Signed:

Date:

Name:

Position:

Organisation: