External Evaluator for end of project Evaluation at Orbis International

  • Full Time
  • Zambia
  • Applications have closed

Orbis International

Orbis International

Changing the Way the World Sees

Orbis International is a nonprofit organisation that works in Africa, Asia, Latin America, and the Caribbean. Our vision is to transform lives through the prevention and treatment of blindness. With our network of partners, we mentor, train and inspire local communities so they can save sight in their communities.

In Zambia, Orbis is a partner of the Ministry of Health and provides technical support to eye care teams to provide quality eye care in Lusaka, Copperbelt and Northwestern provinces.

Orbis seeks the services of a legally registered and qualified external evaluator to conduct an end of project evaluation for the “Saving Sight, Changing Lives II” Adult Cataract project in North Western province.

[wbcr_html_snippet id=”920″ title=”display ads”]

The consultant must have a license and Taxpayer Registration Certificate to justify the 15% withholding tax deduction or willing to have 15% of the overall payment retained with Orbis International, Zambia as withholding tax and ultimately paid to the Zambia Revenue Authority.

If eligible, please submit your interest and technical and financial proposal in response to the TORs below by email to Tendai.Nhandu@orbis.org and info.zambia@orbis.org within 7 working days of this announcement. The closing date for receiving the applications is close of business, 26th November.

The successful consultant will be notified by 1st December 2021.

Orbis International, Zambia reserves the right to reject any or all bids and proposals.

Orbis International, Zambia
15 Kabulonga Road, Kabulonga, Lusaka.
Tel +260 211 265902/ Mobile +260 763590963 | Zambia.

TOR for End-term Evaluation

1. Introduction and Background

1.1 Introduction:

This Terms of Reference (TOR) outlines relevant details for Orbis International Zambia to hire an external evaluator to conduct an end-term evaluation for the Saving Sight Changing Lives II project.

1.2 Background:

The Saving Sight Changing Lives II (SSCL II) project in NWP was funded by Hainan Airlines (2018 to 2019) and later received funding from the Latter-Day Saint Charities (2019- date). The project has been implementing activities in line with Orbis International’s strategic approach to provide on the ground training for local eye health professionals, supporting and equipping eye health centers throughout the province and by advocating the importance of eye health at provincial level.

The project has also worked with communities to increase awareness, demand for, and access to adult cataract surgery through several community engagement approaches, including community sensitization meetings radio programmes and the use of film. Further, the project trained Community Health Workers as agents of change in their communities, developed and distributed IEC material, as well as improved co-ordination and referrals between primary and district levels.

The project has also worked to improve the surgical capacity and quality of cataract surgical services through procurement of equipment and consumables at main surgical facilities in the province.

[wbcr_html_snippet id=”920″ title=”display ads”]

2. Project Information

2.1 Project goal: Reduce avoidable blindness and visual impairment in North-Western province Zambia, through improved and sustainable awareness and cataract surgical services

1.1 Project objectives:

a) Increase awareness, demand for, and access to cataract surgery

b) Improve the surgical capacity and quality of cataract surgical services in North-Western province

c) Advocate for an enabling environment for eye health and facilitate south-south co-operation

2.3 Target population and project sites:

The target population is poor, rural-dwelling adults blind from cataract across all 11 districts of North-Western Province. This population has a rate of illiteracy of 75%, and the large majority live as subsistence farmers, meaning that they have little ability to bear the additional economic burden of cataract blindness, and are unlikely to seek services spontaneously without a robust programme of outreach.

Project Sites:

Solwezi General Hospital (SGH) in the provincial capital of Solwezi, NWP: Responsible for coordinating the outreach activities of District hospitals, and the performance of cataract surgeries at SGH and at the district facilities.

Mukinge Mission Hospital: Responsible for performance of cataract surgeries at Mukinge and the District facilities and carrying out community outreach screening

  • 6 District hospitals (Secondary level): Deliver primary eye care and carry out cataract outreach screenings in the community, and coordinates activities of the local Health Posts and Health Centers.
  • 44 Health Posts and 168 Health Centers (Primary level):  Community health assistants at the health posts examine and refer eye patients to the Health Centers for Primary Eye Care and potential referral on to the district level.

2.4 Project duration: 1st August 2019 to 31 December 2021.

2.5 Project partners: Provincial and District Ministry of Health.

2.6 Project strategy and approach:

I. To increase awareness and demand for, and access to cataract surgery targeting women

II. To improve the surgical capacity and quality of cataract surgical services at Solwezi General Hospital and Mukinge Mission Hospital:

III. To advocate for an enabling environment for eye health and facilitate south-south co-operation

3. Objectives and Outcomes of the Evaluation

3.1 Evaluation objectives:

  • Assess the performance and results of the project in relation to project goal.
  • Assess the effects of the program on target groups, partner institutions, and hospitals.
  • Generate evidence of organizational learning and accountability.
  • Make recommendations which can inform the design of the next project.

3.2 Evaluation outcome:

This evaluation will document how effective and efficient the project was in meeting the planned objectives and goal. The outcome of the evaluation will generate best practices, lessons learnt, conclusions and recommendations that Orbis can use to improve the design of future projects.

3.3 Evaluator deliverables:

1. An inception package, outlining:

a. Evaluation design and methodology. In the methodology section, detail:

  • data collection tools and organization
  • sampling procedures
  • quality assurance
  • data analysis
  • ethical considerations

[wbcr_html_snippet id=”920″ title=”display ads”]

b. Work-plan

2. A presentation to Orbis International Zambia highlighting significant findings and draft recommendations before the end of field work.

3. A draft report to be reviewed and commented on by Orbis International Zambia.

4. A final report of maximum 40 pages, excluding annexes, but including an executive summary of maximum two pages.

5. A power-point presentation of the main findings, conclusions, and recommendations, suitable for Orbis International Zambia to use in presentation to stakeholders.

3.3.1 Structure of the final report

The report should be written in English and include the following sections:

  • Acknowledgments
  • Table of contents
  • Executive summary
  • List of abbreviations
  • Introduction
  • Background: overview of project, strategy, and activities
  • Methodology: methods, limitations
  • Findings: overall, by objectives, and by partner hospital
  • Strengths, gaps/challenges, and lessons learned
  • Discussion
  • Recommendations
  • Annexes: TOR; data collection tools; lists of interviewees, documents reviewed, sites visited; and disclosure of any evaluation team member’s conflict of interest, etc.

4. Evaluation Scope, Questions, and Methodology

4.1 Scope of the evaluation:

This evaluation will cover the period August 2019 to December 31, 2021, and the evaluator is expected to:

  • Outline evaluation design and methodology including data collection instruments and detailed work plan.
  • Participate an inception meeting and prepare/share report.
  • Collect, compile, and analyze the data.
  • Produce draft and final review reports.
  • Present the main findings, conclusions, and recommendations to Orbis Zambia and partner institution.
  • Maintain regular communication with key contact person of Orbis International Zambia throughout the contract period

The evaluation will cover all the sampled districts which will be a representation of the 11 districts where the project is working and will seek to establish if all the three project objectives were met.

4.2 Evaluation questions:

1. How effective was the project in achieving their: (i) targets and (ii) objectives (allowing for external factors potentially contributing to these results and noting changes in objectives during the life of projects)?

2. To what extent the resources (including financial) were used economically and efficiently, and alternative programming approaches?

3. To what extent the project interventions and approached/strategies were suited to the context, priorities and policies of the host Ministry and Province?

4. How and to what degree have the services integrated into the local / partners health system? To what degree have the local stakeholders been involved in the project? Do they show the ownership of project design/ implementation?

5. How has the project strengthened local partner’s capacity in providing eye care services? Is it partner’s eye care capacity remained and or will be extended/expanded after Orbis support is withdrawn and how?

6. What were the strengths, gaps/challenges, and lessons learned with respect to results achieved (including distribution of results), implementation, and application of learning to project design and interventions?

7. Did the project have other notable effects on the facilities and beneficiary? These may be positive or negative, and planned or unplanned

8. What are the recommendations for a revised project with the same focus?

4.3 Evaluation methodology:

[wbcr_html_snippet id=”920″ title=”display ads”]

The evaluator is expected to design an appropriate methodology to answer the evaluation questions. The methodology and data collection tools will be finalized in consultation with Orbis. Typically, the evaluator is required to travel to project sites and have face-to-face discussions with various project stakeholders to gather required information. Currently the COVID-19 pandemic has reduced, and the evaluator will have contact meetings with respondents. The methodology should include:

A. Review of secondary data including but not limited to the project plan; M&E operational plan, data collection instruments, quarterly and annual progress reports; financial reports; medical/hospital data; and event reports, case studies, and special assessments/surveys.

B. Generate primary data via methods such as the following:

  • Analyse core indicators from the pull-out reports from Indicata/records and analyse to unearth trends in volume of patient services provided (e.g., # of patient visits, # of spectacles prescribed, # of surgeries performed etc.) from partner hospitals, as well as validate data that’s already been reported.
  • Collect and analyze data from eye health facilities (e.g., vision centres, etc.)
  • Interview health facility staff, management, and other key informants
  • Consult with relevant Orbis staff
  • Collect case stories to show the outcome or impact of the project. Case stories can be patients who received services from the partner hospitals, or hospital staff who received training
  • Conduct partner and direct beneficiaries’ satisfaction surveys using Orbis survey tools.

4.4 Selection of sites or partners for the evaluation:

The below table shows project implementation sites. The evaluator is required to sample some sites using appropriate method that will help select a representative sample of the total sites. The project is implemented in urban, peri-urban, and rural districts. This therefore means the health facilities are at different levels. Some districts have ophthalmic staff and others don’t have and this should be considered during sampling. The following factors should be considered while sampling.

  • Service delivery level (e.g., primary, secondary, or tertiary)
  • Geographical representations (e.g., rural vs. urban)
  • Facilities with Ophthalmic staff (Surgeons, Ophthalmic Clinical Officers and Ophthalmic Nurses)

DISTRICT
ROUTE
GEOGRAPHICAL REPRESENTATION
SERVICE DELIVERY LEVEL
OPHTHALMIC STAFF
Solwezi
Provincial HQ
Urban
Primary & secondary
Surgeon, OCO & ONs
Kasempa
M8
Peri-urban
Primary & Secondary
Surgeon, OCO & ONs
Mufumbwe
M8
Rural
Primary
OCO& ONs
Manyinga
M8
Rural
Primary
None
Kabompo
M8
Peri-urban
Primary
None
Zambezi
M8
Peri-urban
Primary
ONs
Chavuma
M8
Rural
Primary
OCO
Kalumbila
T5
Rural
Primary
OCO
Mwinilunga
T5
Peri-urban
Primary
ON
Ikelenge
T5
Rural
Primary
None
Mushindamo
Chingola rd.
Rural
Primary
None
Note: M8 is Main Road 8 and T5 means Trunk Road. The districts are positioned along these routes.

5. Timeline and Tasks

[wbcr_html_snippet id=”920″ title=”display ads”]

Time frame
Evaluation design and tools developed- 8th December, 2021
Orbis feedback on tools developed- 10th December 2021
Inception meeting- 13th December, 2021
Virtual consultation, key informant interviews, and secondary data analysis completed- 24th December, 2021
Primary data analysis completed, and draft report submitted- 31st December, 2021
Findings presented by evaluator- 4th January, 2022
Orbis feedback on draft report provided- 14th January, 2022
Final report submitted- 21st January, 2022

6. Expected Competencies of and Selection Criteria for the Evaluator

6.1 Expected Competencies of the Evaluator

The evaluator should have:

  • A master’s degree in the field of public health/medicine/development studies/social science or other relevant discipline.
  • Experience in research and evaluation in health systems, public health, community health, community development; eye health care services will be an added advantage
  • Professional familiarity with hospital settings
  • Strong methodological skills in the development and implementation of data collection tools, data management, and analysis
  • Excellent written English and report writing skills
  • Oral and written proficiency in the local language

7. Submission Checklist for Proposal

The evaluator will submit a detailed proposal. The proposal must describe the methodology, tools, and analysis plan in detail. The proposal should be divided into two parts: technical and financial. The financial proposal will include the evaluation’s estimated cost and list the evaluator’s daily rate. The technical part will contain the following sections:

Background of evaluation company or organization
Detailed evaluation methodology
Detailed work plan/timeframe
Evaluator’s CV listing relevant experience
References

Proposals will be subject to a price and quality comparison.

8. How to Apply

Interested applicants are requested to summit proposal (technical and financial) and required documents on or before 24th November 2021. Application should be submitted via email to tendai.nhandu@orbis.org, copying info.zambia@orbis.org   Please mention “SSCL II TOR” in the email subject line.

9. Considerations

10.1 Ethical Considerations:

The evaluation will respect human subjects’ considerations such as confidentiality of responses in interviews or discussions as well as any personal patient information (which will not include identifiers) and obtaining informed oral consent from patients participating in interviews or surveys.

10.2 Child Protection Policy:

The firm/individual shall comply with the Child Protection Policy of Orbis International. Any violation /deviation in complying with Orbis’ child protection policy will result in termination of the agreement

10.3 Ownership:

All documents, papers, and data produced during the assessment are to be treated as Orbis property and restricted for public use. The contracted agency/consultant will submit all original documents, materials, and data to Orbis International Zambia.

To apply for this job email your details to Tendai.Nhandu@orbis.org