CONSULTANT TERMS OF REFERENCE:
‘Supportive Educational Engagement for Development (SEED)’ ENDLINE STUDY
- RIGHT TO PLAY
Established in 2000, Right To Play is an international non-governmental organization committed to improving the lives of children and youth affected by conflict, disease, and poverty. Headquartered in Toronto, Canada, Right To Play is active in 15 countries across Africa, Asia, and the Middle East, and has fundraising offices in six European and North American countries. Pioneering its innovative child-centered, play-based learning methodology, Right To Play works across the five key outcome areas of quality education, peaceful communities, health and well-being, gender equality, and child protection.
Right To Play has been active in the education and sports for development sectors in Jordan since 2006, training teachers in UNRWA and Ministry of Education schools as well as coaches in local communities to provide engaging interactive sessions that utilize games and sports to promote psychosocial wellbeing, education and gender equality. Vulnerable Jordanian, Palestinian, and Syrian children who take part play days and tournaments organized by Right To Play are more engaged in school and have vastly improved life skills. In turn, the youth with whom Right To Play works achieve higher grades, experience greater levels of cooperation and cohesion and are empowered to overcome trauma, adversity, and cultural stigmas to fulfill their dreams.
All RTP projects are gender-responsive, placing particular emphasis on female empowerment. They are also usually supported by a sustainable rehabilitation component whereby school classrooms and play spaces are renovated, football pitches are constructed within underserved communities, or students lead maintenance initiatives within their schools. In 2019, RTP reached a total of 102,848 Jordanian, Palestinian, and Syrian children and youth in schools across Amman, Irbid, Zarqa, Mafraq, and Aqaba. In addition, the organization currently has 2,904 active teachers and coaches, having trained 766 this year.
- ‘Supportive Educational Engagement for Development (SEED)’
School closures in response to the COVID-19 pandemic have placed a considerable burden on the Jordanian education system and caused learning losses among students. The impact of school closures is compounded by pre-existing challenges, including the 2019 teacher strikes and an already overburdened and under-funded education system. Although the Ministry of Education (MoE) launched an online strategy, limited access to basic ICT infrastructure, connectivity and electricity has hampered learning in the country’s most remote areas and among vulnerable communities.
The SEED project, funded by Walter Haefner Stiftung, aimed to Help vulnerable community youth overcome learning and developmental challenges resulting from COVID-19 through the provision of supportive educational services, positive learning environments, and play-based learning. The project selected 9 community centers on the basis of a needs assessment exercise as well as criteria set by, and recommendations from the Ministry of Youth and RTP. Through SEED, Right To Play will train a total of 31 teachers (of which 29 are active) who had conducted the remedial classes in CBOs, covering the subjects, English, mathematics, Arabic and science. Reaching about 2880 students in catch up class over the course of three years.
The project is composed of three main intervention arms:
Outcome 1: Teachers are better equipped to deliver PBL in a quality learning environment
The project will follow a three-pronged approach towards the development of community centers as an appropriate space for the provision of educational support.
- Firstly, community centers were equipped with classrooms and materials to host remedial classes.
- Secondly, teachers were trained as part of Right To Play’s Continuum of Teacher Training (COTT) in the use of play-based methodologies to deliver remedial classes in the subjects of English, Arabic, Maths and Science.
- Thirdly, parents and community members were engaged in PTA awareness sessions
Outcome 2: Children and youth have improved their academic performance through participation in play-based remedial classes
The children and youth participated in weekly remedial classes in English, Arabic, Maths and Science in the learning centers. Each child has participated in remedial classes over a period of three months. The classes were delivered by trained teachers using a play-based, interactive approach. Pedagogical studies prove that creative, interactive, and applied learning is more effective for information retention and the promotion of children’s engagement in education. The classes will therefore provide an opportunity for children who have fallen behind on academic learning to regain the same level of knowledge as their peers and build their self-confidence and other life skills for positive child development.
They also participated in Play days conducted at the learning centers that encouraged community children and youth to actively engage in their remedial classes and create positive associations with learning and education.
Family game days have also helped parents to learn how to create positive and supportive learning environments for children to thrive and regain the motivation to learn.
- PROJECT GOAL AND OUTCOMES
IMPACT
Help vulnerable community youth and children overcome learning and developmental challenges resulting from COVID-19 through the provision of educational services, and play-based learning.
OUTCOMES
- Teachers are better equipped to deliver PBL in a quality learning environment
- Children and youth have improved their academic performance through participation in play-based remedial classes
Target Geographies
Karak, Maan and Aqaba, Jordan
Target Beneficiaries
- Children and youth: 2.880 across 9 Community centers
- Teachers: 29 (in English, Arabic, Science and Mathematics)
Full Project Timeline
(Sep 2022 – Jun 2025)
Endline Study Timeline
Approximately eight weeks, beginning in Nov 2024
The project’s outcomes and indicators are as follows:
Ultimate Outcome:Help vulnerable community youth and children overcome learning and developmental challenges resulting from COVID-19 through the provision of educational services, and play-based learning.
- % of children and youth demonstrating improvements in their academic performance after participating in remedial classes. (disaggregated by gender, age group, center, and governorate)
Outcome One:Teachers are better equipped to deliver PBL in a quality learning environment
- % of trained subject teachers reporting increased knowledge in theory of CoTT & PBL methodologies
- % of trained subject teachers delivering quality CoTT & PBL methodologies in the classroom
Outcome Two: Children and youth have improved their academic performance through participation in play-based remedial classes
- % of children and youth that report an overall improvement in their academic achievements
4. ENDLINE CONSULTANCY OBJECTIVE AND SCOPE OF WORK
The objective of the endline consultancy is to establish a final project evaluation and indicator values. The SEED endline is expected to be conducted in person, especially during the data collection phase.
The endline consultant will be expected to:
- Perform a comprehensive review of existing project materials, monitoring and evaluation activities undergone, and measurement tools, including, in particular, the baseline study and performance management framework.
- Design and plan a final evaluation in collaboration with Right To Play staff. The consultant should maintain continuity with the baseline data collection tools, sampling, and methodology if possible; a review of these tools and methodology will nevertheless be necessary and alterations should be suggested if needed.
- An inception report must be submitted prior to the start of the study, providing a detailed evaluation plan that gives:
- An outline of the study approach/methodology, stressing continuity with the baseline study if possible (if not, thorough reasons for alterations must be discussed Right To Play prior to submission of the inception report)
- The timeline of activities
- Sampling requirements and framework, stressing continuity with the baseline study if possible (if not, thorough reasons for alterations must be discussed Right To Play prior to submission of the inception report)
- The methodology of collecting, triangulating, and summarizing qualitative and quantitative primary and secondary data, stressing continuity with the baseline study if possible (if needed, data quality protocols should be developed to guide data collection/entry for RTP field staff, including spot checking protocols). If continuity is not possible, thorough reasons for alterations must be discussed with Right To Play prior to submission of the inception report.
- Fieldwork logistics and schedule
- Fieldwork manual including data collectors’ training guide.
- Provide training for data collectors and submit the following:
- Data collectors’ training agenda
- Data collectors’ training report
- Provide a comprehensive final evaluation report (both a draft and final version) that:
- Establishes end-of-project values for all outcome and output indicators
- Evaluate the degree to which project outcomes were achieved by comparing end-of-project indicator values with baseline values, as well as analyzing any other relevant qualitative or quantitative data obtained during regular project monitoring
- Provides recommendations for future programming based on the findings of the final evaluation and, if necessary, identifies areas for improvements based on a thorough analysis of any reasons why outcomes may not have been achieved
- Provides a summary of the project and the findings of the baseline assessment to serve as an introduction to the final evaluation
5. ENDLINE METHODOLOGY
The endline study should be conducted in-country, with in person data collection. It should employ a variety of tools, including, for example, surveys, focus group discussions, and key informant interviews, to collect both qualitative and quantitative data, ensuring in-depth analysis of the project starting points and providing endline indicator values.
A review of project and organizational documents, as well as Right To Play’s current data collection tools must be undertaken, and all data collection practices must be in line with child safeguarding principles and both Right To Play and governmental COVID-19 safety regulations.
The endline will be conducted with the communities where the project is being implemented. Right To Play will support the consultant in making any logistical arrangements for data collection and meetings with key stakeholders.
Right To Play will review the consultant’s submitted inception report prior to data collection and will provide guidance for the endline report. All raw data must be submitted to Right To Play prior to submission of the final report.
6. ROLE DURATION
The endline study should be started by November 2024, with design, data collection, analysis and reporting lasting approximately eight weeks.
7. DELIVERABLES
Deliverables are illustrated in the table below; the specifics and timeframe should be negotiated with Right To Play upon confirmation of the consultancy.
DELIVERABLE DETAILS
- Right To Play consultations
- An initial online kick-off meeting will be held with RTP to finalize plans for the study.
2. Submission of Inception Report with evaluation and fieldwork plan
- Evaluation plan:
- An outline of the study approach/methodology and COVID-19 safety measures to be undertaken if any needed
- The timeline of activities
- Sampling requirements and framework
- The methodology of collecting, triangulating, and summarizing qualitative and quantitative primary and secondary data (if needed, data quality protocols should be developed to guide data collection/entry for Right To Play field staff, including spot checking protocols) and COVID-19 safety measures to be undertaken
- Fieldwork plan:
- Fieldwork logistics and schedule
- Fieldwork manual including data collectors’ training guide
3. Training of data collectors and submission of report
- Data collectors’ training agenda
- Data collectors’ training report
4. Data collection
- Ensure that both quantitative and qualitative data is collected in-person, or, if not possible, online.
5. Data submission
- Cleaned, raw data in two formats: Excel and a statistical analysis software format (e.g. SPSS or STATA) if possible.
6. Validation Workshop
- Online consultation with key stakeholders for revision and validation of findings.
7. First Draft Endline Evaluation Report
- Revised data analysis framework document
- Excel spreadsheets, or SPSS/Stata scripts with clear, easy to understand notes
- Ensure that all values for outcome and output indicators are provided (filled in on the PMF) and decide on final target values in collaboration with RTP.
- Draft endline report.
8. Final Endline Evaluation Report
- PowerPoint presentation with summary findings for formal presentation to key stakeholders.
- Copies of original and cleaned data sets including any field notes, as well as annexes of processed results tables (with all levels of disaggregation, including geographical areas breakdown).
- Final report
9. De-briefing meeting with RTP
Timelines for each deliverable will be discussed during the interview and the kick off meeting after selection
- QUALIFICATIONS
- A consultant/consultancy firm/group with at least 3-8 years of experience in the research and/or evaluation field, including experience in quantitative and qualitative data collection, analyzing quantitative and qualitative data, and reporting.
- Extensive experience managing and designing evaluation studies in diverse contexts (e.g. Middle East context, with children and young people, in urban settings, etc.).
- Extensive experience creating measurement frameworks, refining indicators, and creating measurement tools for education-focused programs.
- Experience in education, including non formal education, remedial education and the subjects of Mathematics, Arabic, English and Science. Any experience and understanding of Play Based Learning is a bonus.
- Experience in Positive Youth Development (PYD), life skills measurement and behavioral change measurement, and youth psycho-social wellbeing.
- Experience using participatory methodologies and following OECD-DAC principles for evaluation and measurement.
- A relevant degree in social sciences, international development, statistical sciences, or another related field.
- Excellent skills in, and experience with, data analysis using statistical computing tools (Excel, SPSS, STATA, NVIVO).
- Proficiency in Arabic and in English.
- Experience conducting online studies is desirable, though not required.
How to apply
9. PROPOSAL APPLICATION SUBMISSION
Interested organizations should submit proposals with the following documents:
- Cover letter including the consultant’s/firm’s suitability for the assignment and current contact information.
- Registration document for the consultancy company/group
- CV including contact details of two references. If the lead consultant is planning to recruit enumerators in Jordan to support the data collection, data entry, and dataset development, please state this in your application and if possible, provide details (cost, expertise, expected role of each consultant, etc.).
- Include one or two samples of relevant evaluation work.
- A detailed response to the ToRs, including: a technical proposal addressing the purpose and objectives of the assignment; plans for in-person data collection, and key sampling criteria.
- Financial proposal with a detailed budget breakdowns for each methodology based on expected daily rates and an initial work plan.
- Initial drafts of the proposed workplans for each methodology in the form of a Gantt chart.
Both the financial and technical proposals must be submitted to Heba Al Qaisi, Monitoring, Evaluation, and Learning Officer, at halqaisi@righttoplay.com by the 30 of September 2024, Please also copy Logistics Officer Fakhri Al Syouri fsyouri@righttoplay.com
All offers should be valid until at least until the 31st December 2024. If you are applying as an international organisation, please ensure that you include all travel costs in your financial offer. All enumerator and training costs must also be included.
The selected candidate must adhere to both Right To Play and governmental standards regarding health and safety.
Right To Play is a child-centered organization. Our recruitment and selection procedures reflect our commitment to the safety and protection of children in our programs.
Note: Final candidates will be contacted by RTP and only the ones who make it to the final phase (Interview phase) of the recruitment process will be notified whether they have been selected or not.
