FINAL EVALUATION OF TRANSPARENCY INTERNATIONAL’S SIEMENS INTEGRITY INITIATIVE PROJECT
Application Closing Date - 25 Jul 2018
Job Start Date - 13 Aug, 2018
Duration - 13 August – 20 September 2018
Location - home-based, with potential travel to some National Chapters and to Berlin.
Transparency International (TI) is the global civil society organisation leading the fight against corruption. Through more than 100 chapters worldwide and an international secretariat in Berlin, Germany, TI raises awareness of the damaging effects of corruption and works with partners in government, business and civil society to develop and implement effective measures to tackle it.
The Siemens Integrity Initiative Project (SII Project) ‘Collective Action for Clean Business’, funded by the Siemens Integrity Initiative (SII), is a three year project that started in January 2015 and was extended to September 2018. The total budget of the programme is over 3 million USD. A mid-term evaluation has been conducted in 2016.
The SII Project seeks to reduce corruption through improved transparency, integrity and accountability in business practices around the world. TI promotes business integrity at three levels, individual businesses, groups of businesses and the environment, all of which are underpinned by collective action. In order to achieve this objective of facilitating change at scale, the SII Project improves the capacity of TI to work as a catalyst for collective action at national levels in multiple countries and advocates for improved standards, norms and practices within international fora and initiatives.
The Transparency International Secretariat (TI-S) in Berlin is seeking a consultant to evaluate the extent to which the SII Project has achieved the set goals.
The overall objectives of the end-project evaluation are the following:
- Provide an objective assessment of the achievements and results, weaknesses and strengths of the project, as well as an analysis of its performance in terms of progress and process, relevance, sustainability, and the extent to which the project is contributing to enabling the desired impact.
- Provide an objective assessment of the extent to which the recommendations of the mid-term evaluation have been addressed during the course of the remaining project period.
- Generate lessons learned and good practices from each of the respective expected objectives of the project.
- Provide clear recommendations that can guide the TI Secretariat (TI-S) and National Chapters for the implementation of future projects.
Key issues to be addressed:
The following questions could be addressed during the end-project evaluation, but are subject to discussion and agreement with TI-S during the period of designing the evaluation approach.
Relevance: The extent to which the project is suited to the priorities and policies of the target group, the organisation responsible for the project and the donor organisation. It is useful to consider the following questions:
- In which ways has the programme supported TI National Chapters to carry out their anti-corruption objectives?
- Are the activities and outputs of the project consistent with the project goals and objectives?
Outcomes and impacts: The positive and negative changes produced by the project, directly or indirectly. This involves the main outcomes and impacts resulting from the project. The evaluation should be concerned with both intended and unintended outcomes and impacts. It is useful to consider the following questions:
- What has been achieved?
- Who were the direct and indirect beneficiaries of the programme?
- What real difference have the activities made so far to the beneficiaries?
- Which other factors contributed to the changes that were generated, and to what extent can the changes be attributed to the project activities (plausibility)?
- Has the real chain of causality been consistent with the chain of causality established at the planning stage? If not, what were the differences?
Effectiveness: The extent to which the project achieved its objectives, i.e. a comparison of the intended outcome with the observed outcome. It is useful to consider the following questions:
- To what extent were the objectives achieved?
- What were the major factors influencing the achievement or non-achievement of the objectives?
- Were the initial objectives realistic?
Efficiency: The qualitative and quantitative outputs in relation to the inputs. It is useful to consider the following questions:
- Is progress being achieved at reasonable costs?
- Is the actual timeline of development and implementation realistic? Were the objectives achieved on time?
- Was the project implemented in an economically justifiable way under the given circumstances? Are there any benchmarks to support the answers?
- Have effective management and administration systems been in place and was there a suitable Performance, Monitoring and Evaluation (PME) system?
- Have the recommendations from the mid-term evaluation been used to refocus interventions? Has the mid-term evaluation led to a better strategy to achieve the desired impact?
Sustainability: Sustainability is concerned with measuring whether the benefits of a project are likely to continue after funding has been withdrawn. It is useful to consider the following questions:
- To what extent are the benefits of the project likely to continue once donor funding has ceased?
- How sustainable is the approach post-current funding – financially and conceptually?
- What concrete steps were/are being taken to enhance the sustainability of the project?
Methodology, research process and resources:
The end-project evaluation will be planned and conducted in close consultation with the TI-S Monitoring Evaluation and Learning (MEL) Unit and the Business Integrity Programme (BIP) team. The evaluation approach and methods must be agreed with the TI-S MEL Unit and the BIP team. The BIP team will provide the necessary substantive support, including submission of all documents for desk review.
The evaluation expert is ultimately responsible for the overall methodological approach and design of the evaluation, which should be adapted to the requirements of these Terms of Reference (TOR). The evaluation should use a participatory and gender sensitive approach engaging relevant staff at TI-S and National Chapter levels, stakeholders and beneficiaries through structured methods. Both quantitative and qualitative data should be utilised in assessing the project. The exact evaluation methodology should be defined, discussed, and agreed with TI-S during the first days of the evaluation.
The end-project evaluation should include but not necessarily be limited to the following methods:
- Desk review of relevant documents
- Individual and/or group interviews with internal and external stakeholders
- Meetings with external stakeholders
- Survey questionnaires to internal and external stakeholders
- Potential travel to selected National Chapters
The overall approach should be as representative and as comprehensive as possible. The evaluation expert should present a detailed statement of the proposed review methods in the technical proposal.
EXPECTED DELIVERABLES AND TIMELINE
The consultant or team are expected to submit an evaluation report that documents the evaluation activities and results following a clear structure. The evaluation report will contain the findings, conclusions and recommendations as well as a recording of the lessons learned. The report will be written by the evaluation expert.
The consultant or team will initially prepare a draft report, which will be discussed with TI-S. While considering the comments provided on the draft, the evaluation expert shall use their independent and impartial judgment in preparing the final report.
The final report should not be longer than 20 pages, excluding the annexes and the executive summary, and should be accompanied by a summary power point presentation. Annexes to the final report should be kept to an absolute minimum. Only those annexes that serve to demonstrate or clarify an issue related to a major finding should be included. Existing documents should be referenced but not necessarily annexed. Maximum number of pages for annexes is 10.
In sum, the main expected deliverables are:
- Methodology and timeline note.
- Draft report for internal fact checking.
- Final report with a summary power point presentation.
Guidance and quality insurance
- The findings should be referenced.
- The consultant’s approach should be guided by the Transparency International Impact Matrix methodology (https://www.transparency.org/whoweare/accountability/impact_monitoring/4).
- The consultant should use the TI report template and style guide.
- The research should abide by ethical protocols including participant confidentiality and privacy if they require that.
All presentations and reports are to be submitted in English, in electronic form, in accordance with the deadlines stipulated above. The Consultant is responsible for editing and quality control of language. The TI Secretariat retains the sole rights with respect to all distribution, dissemination and publication of the deliverables.
TI-S is inviting expressions of interest from individual consultants or a team of consultants to carry out the end-project evaluation of the SII Project. The Consultant should have the following qualifications:
People’s skills: be able to mediate the different expectations of the different internal stakeholders in order to produce a strong evaluation report that will genuinely serve the learning purposes set out in these TOR.
Work style: is well planned and organised even within a fluid working environment and has a capacity for initiative with competent analytical and problem solving skills. Maintains a strong level and flow of communication with reporting stakeholders.
Language: excellent command of English to a native speaker’s level.
Applicants should have the following skills and experience:
- University degree in social sciences or related field from a reputed institution and postgraduate education in social sciences methods, strategic management, evaluation, or equivalent experience.
- Substantial experience of conducting evaluations.
- Demonstrable experience of NGO or social enterprise management, knowledge of and experience in business integrity work/environment an advantage.
- Demonstrable experience of working with value for money/cost-benefit approaches.
- Experience in working across cultures.
The consultant or team are expected to work up to 20 working days, and end by the 20th of September. A detailed timeline needs to be agreed at the beginning of the assignment.
REMUNERATION AND COSTS
The Consultant should provide a detailed breakdown, before any VAT or other charges, of all their estimated costs, including but not limited to; total fee as a lump sum or standard daily or hourly rates, (if applicable) international travel, local transport, accommodation, work materials.
Transparency International e.V. (Secretariat), (TI-S) is registered as a Business Entity in Germany with VAT identification number DE273612486. In order to determine the Value Added Tax (VAT) implications of this tender, we kindly request that the Consultants fill out the VAT Form for Tenders/Vendor Form (instructions inside the form) and submit the completed and duly signed form along with their email application.
The link to the VAT Form for Tenders/Vendor Form is available below.
The application should include the following documents in English:
- A detailed technical proposal of how the assignment will be approached.
- An indicative budget.
- A letter of motivation, specifically focusing on concrete examples relating to what is requested in these TOR regarding the necessary skills and experience.
- A detailed timeframe.
- Curriculum Vitae with full description of the applicant’s profile and experience.
- Contact details for at least two independent referees with in-depth and proven knowledge of the applicant’s expertise and relevant work experience for these TOR.
- Completed VAT Form for Tenders/Vendor Form (see below).
Please indicate “SII End-Project Evaluation” in the subject line of your email application. Applications should be sent in English by email to the BIP team at BIPfinalEVAL@transparency.org by 6pm (Berlin) 25 July 2018.
Please note that only shortlisted applicants will be contacted.
The international fight against corruption needs your expertise, your skills and experience, and your passion for social justice.
From our secretariat in Berlin and in more than 100 national chapters, Transparency International seeks professionals and volunteers with exceptional talent and commitment to join our efforts and make a contribution to a better world.
Important documents and information
- Gender and diversity policy
- Relocation allowance policy
- Grades and salary bands
- Purchase and procurement summary guidelines
- VAT form for tenders
- Code of Conduct: 4.3.2. Staff Recruitment / Non-preferential Treatment of Family and Friends
"Appointments to all positions will be made on merit, regardless of gender; region; religion; disability; family status; sexual orientation, etc. We are committed to open, fair, and transparent appointment, recruitment, hiring, and procurement procedures and practice. Family members, and friends and organisations with which we or our families or friends are associated, will not be accorded preferential treatment. […] To manage potential conflicts of interest, we will disclose such connections with potential applicants or candidates of whom we are aware. We will recuse ourselves from any recruitment or contracting process where we have a conflict of interest. We will ask shortlisted candidates to declare such relations at Transparency International Secretariat or with the Board of Directors. We will not allow situations in which close family relatives or partners are in a direct reporting relationship to one another."