*Position Title : Consultant (External Evaluator-IBM)
Duty Station : Home-based with travel to project locations (Ankara)
Type of Appointment : Consultant, July 12 to August 18, 2021
Estimated Start Date : As soon as possible
Closing Date : 07 July 2021
Requisition: CON2021/05
Context:
The EU-funded project "Regional Co-operation on Border Management with Greece and Bulgaria Phase 2" aims to achieve the EU strategic goal of open and secure borders by developing and strengthening Turkey's institutional capacity to align with the EU’s integrated border management (IBM) policy. Its specific objective is to support the development of functional, effective and integrated systems in border management between Greece, Bulgaria and Turkey, in line with EU standards, through the enhancement of inter-agency, bilateral and regional cooperation and coordination.
Due to its geographical location, Turkey acts as a link between the East and the West and is, therefore, an obvious 'passage' to the West, while at the same time being a final destination country for people coming from the Far East and Far South. As a country partway through the process of accession to the EU, Turkey is aware of how significant cross-border cooperation in the region is. In order to facilitate effective and efficient coordination of the shared borders, Turkey aims to expedite the effective usage of allocated national and international funds. Turkey took a leading role in organizing a cross-border meeting on IBM in Istanbul in October 2011, in coordination with Bulgaria and Greece, with the participation of representatives of the respective border management institutions from the headquarters, as well as the local level. The Ministry of Interior (MoI) started to develop the Action in close coordination with IOM to further strengthen the cooperation that was initiated at the cross-border meeting on IBM in Istanbul in October 2011. Phase 1 of the "Regional Cooperation on Border Management among Turkey, Greece and Bulgaria" project started in 2014 and was completed on 31 December 2016. The main objective of the project was to support Turkey's border management efforts in line with the EU Acquis and good practice by enhancing cross-border cooperation with Greece and Bulgaria at central and local levels. Phase 2 is the continuation of Phase 1 of the project, further striving to achieve closer cooperation among the three countries. Cooperation at both the national and international level is accepted as a crucial element of strengthened border management in the region. The project also reflects Turkey's new vision of and comprehensive approach to IBM, supported by the Border Management Roadmap for Implementation of IBM in Turkey. Phase 2 reflects the need for dialogue and consultations among the neighbouring countries to discuss common approaches to their migration and border management systems, and share ideas and information to enhance understanding and cooperation in border management. Such a process could lead to the development of a coherent policy framework for the management of shared borders in the region.
Under the overall supervision of the Senior Programme Development Officer and direct supervision of M&E Officer and in close coordination with the National Programme Officer, the incumbent will assess the relevance, efficiency, effectiveness, impact, coherence, and sustainability of the project activities and performance through evaluation report and activities. The evaluation should also capture achievements, challenges and best practices/lessons learned to inform the project team and stakeholders for future programming.
Core Functions / Responsibilities:
The results of the project:
Result 1: Trust level among the three countries' border management staff has increased
• Under result 1, the activities mainly included field visits to Kapıkule (TR), Kapitan Andreevo (BG) and Kipi (GR) Border Crossing Points, to removal & receptions centres in Sofia, Drama Paranesti and Kırklareli Pehlivanköy and findings of the expert regarding the observation visits.
Result 2: Structured daily contacts among the three countries' border management staff at local, regional and central levels have been put in place.
· Under result 2, the activities mainly included meetings among the heads of beneficiary agencies on the local level, language training for officials of Turkish beneficiary agencies, an assessment on Turkish Coast Guard Information System (CGIES) and a workshop to discuss findings of the assessment (CGIES)
Result 3: Joint operational capacities of border agencies of the three countries have been enhanced.
Under result 3, the activities mainly included joint operational training for the staff of border agencies with a focus on irregular migration and IBM, including various topics from examination of travel documents, document security and risk analysis, detection of stolen vehicles, risk analysis to the prevention and protection against communicable diseases with an emphasis on COVID-19.
Result 4: Legal and regulatory frameworks related to cross-border cooperation among the three countries have been strengthened.
· Under result 4, the activities mainly included study visits for Turkish officials to the EU Member States to learn on different aspects of border and migration management and assessment of legal and institutional frameworks in Turkey (including international cooperation aspects among Turkey, Bulgaria and Greece) in the field of tackling trafficking and smuggling of migrants, joint Training-of-Trainers workshop on profile analysis in the field of counter-trafficking and migrant smuggling, translation/printing of UNODC training manuals on countering trafficking and migrant smuggling, an international conference on countering trafficking and migrant smuggling.
Result 5: Mechanisms and necessary organizational structures for further cross-border cooperation among the three countries have been established and practically tested
Under result 5, the activities focused on testing joint operational activities of the three countries related to border and migration management. Particular attention was paid to further support operations of the Police and Customs Cooperation Centre (PCCC).
Evaluation purpose and objective
The final external evaluation aims to assess the relevance, efficiency, effectiveness, impact, coherence, and sustainability of the project activities and performance. The purpose of the exercise will be to provide the project management, EU, and key partners with an evaluation of the extent to which the project has achieved its expected results and to assess the quality of project implementation. The evaluation should also capture achievements, challenges and best practices/lessons learned to inform the project team and stakeholders for future programming. IOM will share the evaluation report with the donor and other stakeholders to demonstrate the impact of the project, and to provide these stakeholders with a means of assessing the relevance and value of the project for its intended beneficiaries.
Evaluation scope
The evaluation will cover the project period of 30 May 2017 to 29 May 2021 in all of the provinces in which the project has been implemented.
Evaluation criteria **
The final project evaluation will use the six main OECD-DAC evaluation criteria: relevance, efficiency, effectiveness, impact, coherence, and sustainability.
Evaluation questions
The following key questions will guide the end of project evaluation, to be discussed and confirmed with the selected evaluator concerning feasibility within the timeframe available for the evaluation:
Evaluation Criteria
Evaluation Question
1. Relevance: assessing to what extent the project's Objective and intended results remain valid and pertinent either as originally planned or as subsequently modified.**
To what extent did the project/ programme continue to make sense in the current context, and to what extent did project objective and tasks remain valid and pertinent?
Did the project's expected outcomes and outputs remain valid and pertinent either as originally planned or as subsequently modified?
Was the project aligned with and supportive of IOM national, regional, and/or global strategies and the Migration Governance Framework?
3. Effectiveness: assessing the extent to which the project achieves its intended results.
Was the project/programme effective in reaching planned results, in bringing planned changes? Are the target beneficiaries satisfied with the services provided?
What was the major factors influencing the achievement of the project's expected outcomes?
To what extent did the project adapt changing external conditions to ensure project outcomes?
4. Efficiency: assessing how well human, physical, and financial resources are used to undertake activities and how well these resources are converted into outputs.
Was the project being implemented in the most efficient way compared to alternative means of implementation?
Was a workplan and resource schedule available and used by the project management and other relevant parties?
5. Impacts: assessing the positive and negative, primary, and secondary long-term effects produced by a project, directly or indirectly, intentionally, or unintentionally.**
Which positive/negative and intended/unintended effects could be observed in the project?
Did the impact come from the project activities, from external factors or from both?
Did the project take timely measures for mitigating any unplanned negative impacts?
6. Coherence: the compatibility of the intervention with other interventions in country, sector or institution. **
- Were there other actors involved in the same type of activities, and were they complementary to IOM's activities?
7. Sustainability: assessing to what extent the project's results will be maintained for a certain period of time after the current project phased out.
Were structures, resources, and processes in place to ensure that benefits generated by the project continue once external support ceases?
How far was the project embedded in institutional structures that are likely to survive beyond the life of the project?
Were the results obtained sufficient to draw any conclusion on sustainability before the actual end of the project/programme? Were some activities already ongoing without any more support from the project/programme?
Though the Evaluator should collect findings and draw conclusions on the above questions, particular emphasis should be placed on questions of effectiveness, efficiency and impact of the project and selected approaches. Recommendations should focus on how to deal with identified challenges and gaps and improve further project programming.
Evaluation methodology
IOM will select an external evaluator to carry out this evaluation. The data collection will include the use of quantitative and qualitative approaches to gain a deeper understanding of the project's results (outputs, outcomes, objective) and to ensure the cross-validation of data. The evaluation report will compose analyses of various evidence-based sources of information, including desk analysis/review, evaluation survey data, and interviews with beneficiaries, counterparts, project team.
The evaluation will provide quantitative and qualitative data through the following methods:
- Desk analysis and review of all relevant project documentation, including project proposal, log frame, work plans, project quarterly donor/progress reports, project reports, monitoring reports,
- In-depth interviews will be used to gather primary data from key stakeholders using semi-structured questionnaires (remotely or in person, TBC pending travel restrictions), as well as an online survey.
Ethics, norms and standards for evaluation **
The evaluator must follow the IOM Data Protection Principles, UNEG norms and standards, and ethical guidelines while carrying out the evaluation.
Evaluation deliverables **
An inception report will be prepared by the Evaluator and shared with the IOM team. The report should include an evaluation matrix, evaluation methodology, work plan, interview guide, and other data collection instruments to be used for the evaluation. IOM can provide templates for an Inception Report and for an Evaluation Matrix for reference. The Evaluator may use their own format but should include all of the elements of the IOM templates.
Following the field visit, the Evaluator will prepare a short PowerPoint presentation of the initial findings, conclusions, and recommendations. This will be used to debrief the IOM team to identify and address any misinterpretations or gaps.
A draft report will be shared with the IOM team, building on the debrief and initial feedback. The IOM team will review and provide feedback on the report. The feedback will be provided on technical aspects and not on the findings, conclusions, or recommendations. The Evaluator will make factual corrections to the report.
A final report will be prepared and shared with the IOM team. IOM can provide a template for an evaluation report. The Evaluator may use their own format but should include all of the elements of the IOM template: an executive summary, list of acronyms, introduction, evaluation context and purpose, evaluation framework and methodology, findings, conclusions, and recommendations. Annexes should include the TOR, inception report, list of documents reviewed, list of persons interviewed or consulted, and data collection instruments.
A two-page evaluation brief will be prepared by the external Evaluator to share the key findings, conclusions, and recommendations. IOM template will be provided to prepare the brief.
Finally, the Evaluator will prepare a draft management follow up response matrix (template to be provided by IOM) by inserting the recommendations as well as an indicative timeframe or deadline for implementation. This will later be finalized by the IOM team.
All deliverables are to be written in English. The final report should meet the standards laid out in the UNEG Quality Checklist for Evaluation Reports.
Specifications of roles **
Role of each party are as follows:
· External Evaluator
o Duly implement the data collection, analysis, and reporting activities of the final evaluation
o Timely flag any challenges or emerging issues to the project team.
o Prepare and deliver the inception report, final report, two-page evaluation brief and the visual presentation of the evaluation the findings and recommendations.
· MEAL Unit
o Facilitate the communication between the external evaluator and the program team.
o Facilitate arranging associated meetings and logistics.
o Help address any challenges or emerging issues flagged by the evaluator.
o Provide feedback on the deliverables submitted by the external evaluator.
· Program Management
o Oversee the general process of the final evaluation.
Time schedule
The final evaluation is expected to take 23 working days for the consultant, including preparation, data collection, analysis, and reporting (28 days total, including IOM review). The Consultant should be able to undertake some of the tasks concurrently to fit within the planned timeframe without compromising the quality expected. The assignment is expected to be conducted between 12/07/2020- 18/08/2020.
Activity/ Working Days/ Responsible/Locations/ Timing by weeks
· Review project documents and relevant literature/ 3 days / Evaluator/ Home-based/ Week 1
· Prepare and finalize Inception report data collection instruments / 2 days / Evaluator/ Home-based/ Week 1 and 2
· Data collection process (interviews with respective actors) / 5 days / Evaluator/ Online or Face to face in project locations / Week 3 and 4
· Initial analysis of the data collected / 2 days / Evaluator/ Home-based/ Week 5
· De-brief IOM team on initial findings / 1 day / Evaluator/ Online or face to face meetings/ Week 5
· Draft Report and full analysis of data / 8 days / Evaluator/ Home-based/ Week 6
· Finalization of the evaluation report and submit two-page evaluation brief, and draft management response*/ 2 days / Evaluator/ Home-based/ Week 8
Evaluation budget
Deliverables / Amount to be paid
**
Inception Report - 15 %
Draft Final Report -35 %
Final Report - 50 %
Evaluation requirements
IOM Turkey is seeking an independent, multidisciplinary external evaluation consultant.
**
Required Qualifications and Experience:
Education
· Master’s degree in International Relations, Public Administration, Social Policy, Psychology, Sociology, or a related field from an accredited academic institution, with ten years of relevant professional experience; or
· Completed University degree from an accredited academic institution, with twelve years of relevant professional experience.
Experience
- Proven Experience in conducting at least 3 evaluations of large-scale projects comparable to the one to be evaluated
- Strong background and expertise in conducting quantitative and qualitative data analysis
- Demonstrated sound understanding of migrant's thematic topics, e.g. migration governance, labour migration, trafficking in persons, crisis management, border management, etc. **
- Experience working with IOM is an advantage
- Excellent analytical, oral, and written communication skills in English.
- Experience with collecting data in difficult circumstances
- Ability to create graphic visuals on key findings.
- Experience in technical and analytical report writing.
- Experience in leading an international evaluation project.
- Experience in working in complex institutional environments.
- Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability.
- Ability to work with minimal supervision and to meet deadlines.
Languages
Fluency in English is required (oral and written). Working knowledge of Turkish is an advantage.
Notes
1 Accredited Universities are the ones listed in the UNESCO World Higher Education Database
Required Competencies:
Values - all IOM staff members must abide by and demonstrate these three values:
• Inclusion and respect for diversity: respects and promotes individual and cultural differences; encourages diversity and inclusion wherever possible.
• Integrity and transparency: maintains high ethical standards and acts in a manner consistent with organizational principles/rules and standards of conduct.
• Professionalism: demonstrates ability to work in a composed, competent and committed manner and exercises careful judgment in meeting day-to-day challenges.
Core Competencies – behavioural indicators level 2
• Teamwork: develops and promotes effective collaboration within and across units to achieve shared goals and optimize results.
• Delivering results: produces and delivers quality results in a service-oriented and timely manner; is action oriented and committed to achieving agreed outcomes.
• Managing and sharing knowledge: continuously seeks to learn, share knowledge and innovate.
• Accountability: takes ownership for achieving the Organization’s priorities and assumes responsibility for own action and delegated work.
• Communication: encourages and contributes to clear and open communication; explains complex matters in an informative, inspiring and motivational way.
Other:
The consultant must adhere to the International Organization for Migration (IOM) Data Protection Principles (IN/138) and maintain confidentiality.
The consultant will be responsible to follow IOM writing guidelines and latest glossaries in all given assignments for accurate translation.
Any offer made to the candidate in relation to this vacancy notice is subject to funding confirmation.
Appointment will be subject to certification that the candidate is medically fit for appointment, accreditation, any residency or visa requirements, and security clearances.
No late applications will be accepted.
How to apply:
*Interested candidates are required to submit a letter of motivation, curriculum vitae, the proposed methodology for the evaluation, detailed budget (which includes all the budgetary items with their respective costs), and at least two (2) samples report of previous evaluations to IOMTRJOBS@iom.int with the subject line Application:* CON2021/05 Consultant (External Evaluator-IBM) *on or before July 07, 2021.*
Only shortlisted candidates will be contacted.
