- INTRODUCTION AND CONTEXT OF THE’ EVALUATION
The Society of Jesus-Haiti has obtained 1.5 M funding from Red Xavier and CPAL to carry out the following project: “Accompaniment of families victims of the earthquake of August 14 and construction of housing in the great Sud”. The Society of Jesus-Haiti is the’ entity responsible for the implementation of the project through the Commission of’ Intervention of the Jesuits in the South (CIJS). The terms and conditions of the financing are contained in a protocol of agreement signed between the partners of the project.
The construction project of 120 houses in the Great South, including 60 in the department of the South and 60 in the department of the Grande has been completed since July 2023. According to the’ agreement protocol with Red Xavier and CPAL a technical evaluation report must be produced at the end of the project to reflect the operations, the, project resources and expenditures. An amount in the budget has been allocated for this external evaluation. In order to meet this obligation, the CIJS and the Society of Jesus in Haiti must recruit an independent evaluator or firm according to a work program validated by both partners.
II- SCOPE AND OBJECTIVES OF L’EVALUATION
This evaluation should be both qualitative (by examining the changes observed in the lives of the target groups during the period they joined the project) and quantitative (by collecting results data based on defined indicators (according to the logical framework).
2.1. The Objectives of’evaluation
- Document the changes (effect, impact), intentional or unintentional, positive or negative that the project’s achievements (activities, results) have induced. In addition, lessons learned and recommendations for the future’ must be identified.
- Get an overview of the key elements of the implementation process that explain why the reported changes occurred and inform how these changes were achieved. This involves an analysis of the functioning of the project/’organisation.
- Capitalize (on ?) the achievements and guide the development of future initiatives in the field of housing construction and the strengthening of victim family organizations.
- Conduct a results-based analysis of the balance sheet of activities carried out according to those planned according to the initial directions of the project.
2.2. Specific expectations of the’evaluation
- Verify the level of satisfaction of beneficiaries ;
- Verify the soundness of buildings and their conformity with planning ;
- Verify the relevance and consistency of the project’s initial objectives and their adequacy to the targeted issues ;
- Measuring the degree of’ achievement of objectives and outcomes ;
- Evaluate the level of participation of stakeholders (project partners, staff involved) in the implementation of project activities ;
- Identify and inventory the difficulties and constraints encountered in the implementation of the projects ;
- Report challenges to reorient future actions at the Southern level ;
- Evaluate the’ impact of the project on the’ intervention areas ;
- Propose recommendations for the’ventuality of’another project.
2.3. The expected content of the’assessment.
- Overall assessment of the’ impactintervention of the project over the period from July 2021 – July 2023 ;
- Contextual analysis of the relevance of the project over the period from July 2021-July 2023 as a response to the identified problems ;
- Analysis of the’ effectiveness and’efficiency of the actions undertaken at the level of the’ project and housing construction ;
- Analysis of positive direct effects and project limitations ;
- Analysis of the viability and sustainability of the results achieved ;
- In-depth analysis of the constraints faced by the project ;
- Identification of key lessons learned and capitalisation of’ project experiences ;
- Recommendations and concrete proposals for the’improvement of the performance of the different actors involved ;
- An analysis of the sustainability of actions after the end of the project.
III-OBJECTIVES AND RESULTS OF THE PROJECT
General Objective
Accompany families affected by the earthquake of August 14, 2021 in their struggle for the enjoyment of their fundamental rights and their aspiration to a better life on the social, psychological and spiritual levels.
Specific objectives :
Guarantee the’acces of 120 families has decent housing conditions in 4 communities located in the departments of the Great South of the country.
Result 1 : 120 Families (from 5 to 8 people) are housed in dignity at the level of the departments of the South and the Grande Anse of’Haiti.
Result 2 : 120 families acquire skills in disaster prevention and practices that protect the « common house ».
Result 3 : The 120 families supported are equipped with various tools to increase their resilience in the aftermath of the earthquake.
IV- QUESTIONS TO WHICH THE’EVALUATION MUST ANSWER
- Relevance
- Is the’ approach adopted by the project likely to contribute to the organizational strengthening of victim families ?
- To what extent were the objectives originally defined appropriate ?
- Has the project strategy been consistent in achieving the intended objectives
- Are the project objectives precise and provided with operational’ indicators ?
- Efficacy
- To what extent have the project objectives been achieved ?
- Have we reached as many families originally planned in the project ?
- What were the main factors influencing the’ whether or not the objectives set in the project of’ accompaniment and housing construction were achieved ?
- Did the beneficiaries have any difficulties in participating in housing construction activities and training activities ?
- Have any unforeseen effects been achieved ?
- Have the resources been used in an efficient manner to achieve the’ results ?
- Efficiency
- What elements make it possible to deduce that the project of’ accompanying the families victims of the earthquake and housing construction was carried out in’ in an economically responsible way ?
- On which indices is based the’ assessment that the cost of housing construction per beneficiary is very effective ?
- How to estimate the relationship between the effects, observed impacts of the project and the resources used
- Whether the project had sound management in terms of governance in relation to the structure put in place in the implementation of the project.
- Have the resources been used in an effective manner in the pursuit of the results ?
- What the’ cost-benefit analysis of the delivery of services and the results of the housing construction project of the victim families results in.
- Impact (direct and indirect effects)
- What’ has this project changed in the lives of the beneficiaries and the families ?
- Are the observed changes relevant ? What are the factors that allow you to identify them ?
- In the absence of this project, would these changes be possible ? if not explain the reasons.
- Does the real chain of causality correspond to that defined in the logical framework of the project ? If not, where is the difference ?
- Were there any unintended positive effects on beneficiaries ?
- Have there been any unintended negative impacts on recipients and prioritized areas ?
- Have there been activities aimed at raising awareness and environmental education of beneficiaries and families ?
- Sustainability
- To what extent are the beneficiaries of the project likely to pursue community activities as a result of the accompanying’ and the training received ?
- What important factors have influenced to make the project a sustainable or unsustainable achievement ?
- Has the project had a positive influence on the organizational capacities of the beneficiary families ?
- Has’intervention ensured respect for environmental resources ?
V- ORGANISATION OF THE MISSION D’EVALUATION
- Startup Meeting
In order to ensure a correct conduct of the’assessment, it would be appropriate to conduct a start-up meeting with the participation of key members such as the Superior of the Territory, the’Ex-Project Director, and, the Departmental Coordinators and the Economic Manager of the Territory, the representative of CJI and the emergency manager of XN. At this meeting all the crucial points of the project will have to be discussed.
The territorial authorities will make the necessary documents available to the Consultant or the firm.
- Period d’execution
The duration of the’assessment is estimated as an indication at four weeks which we summarize in the’execution calendar in point X.
- Exploratory phase
At the beginning of the mission, the’evaluators team will conduct a preliminary analysis of the existing’information, among others :
technical file of the project;
key documentation on the contract signed with the partners) ;
document of the Society of Jesus;
intermediate and final narrative reports of the project;
financial reports of the project if necessary.
- Basic data collection phase
The period of data collection in the field is estimated to be one full week. It will be done with a participatory approach. Interviews can be structured or semi-structured to generate comparable data within and outside the study. The tools will provide space to gather input from the study population, which may address aspects not necessarily foreseen in the design of the methodology.
Interview with the Society of Jesus authorities;
Interview with the Directorate and departmental coordination of the’ project accompaniment and
construction of housing ;
Interview with beneficiary families;
Observation of constructions;
VI- Methodology
The evaluation will be consultative and participatory, and will include a combination of documentary reviews, interviews with different actors and’ field surveys. The effects and the’ impact of this project must then largely be measured and concretized through samples in the two departments of the South and the Grandes Anse. It is desirable that data collection tools be used taking into account standards such as the Sphere Shelter and Settlements Standards Handbook, the Sphere Shelter Cluster Guide for Haiti and’ other standards considered relevant to have the’ evaluation and comparison criteria.
- EVALUATOR’S RESPONSIBILITIES
The evaluator will be responsible for the following tasks:
- Work closely with the coordinators of the regions and the authorities of the Society of Jesus in Haiti ;
- Execute all the services mentioned in the TDRs
- Collecting relevant information.
- Issue a detailed report including observations, findings and recommendations.
- RESPONSIBILITIES OF THE COMPANY OF JESUS
The Society of Jesus and the Consultants are jointly responsible for the’execution of the’assessment. However, the consultant is the only one responsible for undertaking all activities related to the’assessment. It is understood that The Company will provide the Consultant with all the necessary support in terms of logistics and accommodation.
- PROFILE OF L’EVALUATEUR
Qualifications & training
Hold a university degree Bachelor (Master) in a field relevant to the mission: civil engineering, social sciences, financial and administrative management.
Experience
- Have at least 5 years of’ professional experience in monitoring and evaluating programmes and/or projects ;
- Have knowledge and proven experience of working in Haiti ;
- Have experience in the’evaluation of construction projects and international cooperation ;
- Have skills in accompaniment of’organisation ;
- Have a good knowledge of’statistical analysis ;
- Have practical experience in the field of training and transfer of knowledge ;
- Have the ability to triangulate information and have a critical and constructive analysis of the information received ;
- Have experience in database design and management ;
Required languages:
- Excellent command of the French language is required ;
- Good knowledge of’anglais ;
- A good knowledge of the Spanish’
- A good knowledge of Creole is an asset.
- REPORT
The consultant provides a’assessment report within 10 days after the end of the mission. The report will give a comprehensive and logical presentation of the data collected. The report will be submitted to the Superior of the territory of the Society of Jesus in Haiti and to each member of the coordination committee of the’evaluation. It will ensure the return of the results of the mission to the relevant partners.
How to apply
Interested firms or individuals must submit a technical and financial offer that includes:
- Methodology of work with proposed schedule;
- A financial proposal between 9,000.00 US and 10,000.00 US. In the financial proposal, the assessor is not expected to include travel, subsistence and transport costs. These costs will be covered by the contracting party.
- Legal documents (Patent etc.);
- Profile of consultants ;
- At least two (2) professional references
Proposals must be submitted to the’address: 95, route du Sofa-vert, Port-au-Prince, Haiti or by email a :
- Asuncion Taboada Lanza: a.taboada@entreculturas.org
- Juan Emilio Hernandez: jhernandez@jesuits.org