1. Introduction
Pact is an international development nonprofit that works on the ground in nearly 40 countries to end poverty and marginalization. We partner with local organizations, businesses, and governments to build lasting solutions for thriving, resilient communities. Our vision is a world where everyone owns their future. Pact has worked in Ukraine since 2006 in the areas of governance, capacity development, and health. Building on a decade of experience, we address key challenges facing civil society organizations in Ukraine.
This Consultant request (CR) is a part of the Activity to Enhance Non-Governmental Actors and Grassroots Engagement (ENGAGE). The purpose of ENGAGE is to increase citizen awareness of and engagement in civic activities at the national, subnational, and local level.
ENGAGE institutional partners developed organizational capacity development plans (graduation roadmaps) as part of their ENGAGE awards. Pact aims to evaluate each institutional partner organization against their expected organizational sustainability plans and metrics, results on increased citizen outreach and awareness of and engagement in advancing reform themes, intentions to mainstreaming vulnerable, marginalized, and hard-to-reach constituencies, anti-corruption, and government accountability and transparency. This activity feeds into ENGAGE’s FY23 learning agenda.
The goal of this CR is to hire a Ukrainian consultant to review ENGAGE institutional partners’ organizational capacity development plans, evaluate the plan’s completion, prepare a comprehensive evaluation report, and make a presentation of key research take-aways.
2. Scope of Work
At the onset of the ENGAGE project, Pact aimed to use a tailored capacity development approach to strengthen diverse types of networks and coalitions, from loose horizontal networks organized around local or regional issues to formal national coalitions. Through a multi-staged competitive process, ENGAGE selected convening organizations as institutional partners which are also leaders of policy reform advocacy. Pact was to use Organizational Network Analysis (ONA), network meetings that result in action plans, including strategic communication plans. Pact was to directly assist convening CSOs to curate network dialogue and exchange. ENGAGE’s approach included linking partners to training and coaching from technical experts for skill and knowledge areas. Pact was to directly build partner capacity by enabling them to co-create products and solutions with experts, such as by allowing members of a coalition to develop a communications strategy with a public relations firm. To improve CSO communication on reform processes, Pact was also to help partners define target audiences, identify communications channels, develop, and deliver messages, and assess message impact.
Direct capacity development included strengthening CSOs’ capacity to improve civic engagement and constituency-building that supports reform initiatives. ENGAGE planned to motivate CSOs to build and mobilize broader constituency bases and provide local and national CSOs with practical methodologies, including the use of social media platforms, mobile data collection for crowdsourcing and citizen polling, and models for volunteer/membership recruitment and management. Capacity development also included strengthening technical skills and knowledge for the effective implementation of civic initiatives. Pact planned to provide training, coaching, and TA in ICT use, including mobile data collection, data mining, and geospatial mapping. Trainings also will focus on discrete knowledge areas relevant to specific campaigns. Specific capacity development also included strengthening strategic leadership of civic initiatives in the form of providing leadership coaching for senior civil society leaders.
At the project’s original midpoint, internal and external evaluation lessons and the extended scope of ENGAGE prompted programming adaptation. Since then, ENGAGE is focused on linking national, regional, and local civic initiatives, provide incentives to CSOs working on similar issues to network and build coalitions with one another and strengthening their constituent base. ENGAGE maintained its support for institutional partners with an increased emphasis on enhancing the scope of subnational and local outreach to engage a wider range of constituents. ENGAGE activities increased support to information sharing and the development of joint initiatives among local CSOs and new grassroots civic initiatives. Adaptation also included an accent on developing and institutionalizing mechanisms that strengthen civic engagement.
A key program adaptation was to focus capacity development on sustainability, strategic communications, and leadership support of CSOs to conduct effective civic initiatives. Pact was to help partners define target audiences, identify communications channels, develop, and deliver messages, and assess message impact. Grantees were expected to reach diverse audiences more effectively: men and women, youth and pensioners, and other key constituencies, such as IDPs.
To assist institutional partners towards graduation, ENGAGE assessed the performance of institutional partners using a tailored Organizational Journey to Self-Reliance Assessment, developed earlier by ENGAGE Performance was assessed towards financial and programming outcomes. Based on performance assessment results, the readiness of institutional partners to implement their capacity development plans (graduation roadmaps). Pact then was to assist institutional partners’ own organizational capacity development journeys to stoke their passion and develop their competency as conveners, advisors, and donors to local CSOs and civic coalitions. As part of these efforts, Pact also conducted full-fledged USAID-certified financial audits. All capacity development, whether conducted directly by Pact or through the engagement of consultants, was to be directly linked to support policy advocacy, policy impact and sustainability.
ENGAGE was expected to achieve the following programmatic results:
- Effective civic advocacy and oversight campaigns implemented.
- Issues advocated for by civil society included in government policies and legislation.
- Horizontal and vertical linkages between national, regional, and local CSOs increased.
- CSO and citizen feedback mechanisms institutionalized at national and local levels.
- Civic engagement in national, regional, and local civic coalitions and initiatives increased.
- Civic engagement in anti-corruption efforts increased.
- Information sharing and networking among local level CSOs/ grass roots initiatives/ civic activists increased.
- Constituent outreach of CSOs improved.
- CSOs’ use of ICT to share information and engage constituents increased.
- CSO’s ability to constructively engage with traditional media improved.
- Citizen awareness and understanding of government reforms increased.
- Citizen awareness of role and importance of civil society organizations increased.
- CSO leadership capacities improved.
- Organizational (including technical) capacity of anti-corruption CSOs improved.
- Public trust in CSOs improved.
- Organizational capacity of anti-corruption CSOs improved.
- Financial readiness of advocacy and watchdog CSOs increased.
Purpose: To provide an evidence-based third-party evaluation of the project’s so-far outcomes, and wherever possible impact, on organizational sustainability and resiliency of ENGAGE’s partner CSOs.
Objectives:
- To evaluate ENGAGE institutional partners’ organizational performance, results achieved vis-à-vis organizational development plans (graduation roadmaps implementation).
- To assess ENGAGE’s capacity development level of contribution to organizational sustainability and resiliency ENGAGE’s partner CSOs.
Duties and Responsibilities:
Task 1: Review the institutional partners’ organizational capacity development plans (graduation roadmaps).
Task 2: Evaluate using qualitative and quantitative methods the results of institutional partners’ organizational capacity development plans (graduation roadmaps) implementation.
Task 3: Develop a comprehensive evaluation report, including identifying areas of future organizational development (in the English language).
Task 4: Present the key research findings to ENGAGE (in English).
Research questions:
- What is the current level of progress on organizational development/sustainability plans? (Source: compare org plans to present status)
- What have been some facilitators and inhibitors to making progress on these?
- To what extent, if any, are capacity development interventions leading to improved organizational performance and ultimate impact in target communities/constituencies (usually the goal or impact-level desired results)?
- Sub question 1.1: What organizations are realizing (i) improved organizational performance and (ii) improved impact?
- Sub question 1.2: What type of/to what degree did organizations receive CD support?
- Sub question 1.3: Is there a correlation between type/degree of CD support and (i) improved performance and (ii) improved impact?
- Sub question 1.4: (if yes to correlation) Qualitative: How/why did CD support result in the performance/impact?
Pact anticipates eleven ENGAGE partners’ performance to be assessed under this evaluation.
Available additional background and data sources:
- ENGAGE’ organizational evaluation methodologies.
- Partners’ capacity development plans (graduation roadmaps).
- Analytical report of institutional partners’ capacity development.
- Organizational Performance Index scores.
- Partners’ programmatic reports.
Deliverables:
- Develop a final research plan, prepare Key Informant Interviews guide templates, and create institutional partners’ organizational survey questionnaire.
- Collect and provide survey data tables in XLS, CVS, SPSS/Stata/R/similar.
- Provide survey data charts and data interpretation summary in PPT.
- Develop a research report and PPT with the key findings (both in English).
Timeline of the Services Performance: September 1, 2023 – November 30, 2023.
Expected Level of Effort: Estimated Level of Effort is 35 consulting days. Deadlines and due dates could be negotiated if strong arguments are laid in the proposal.
3. Qualifications:
- Technical knowledge, skills and expertise in monitoring and evaluation (M&E) concepts.
- Technical knowledge of organizational sociology, change management, concepts and approaches measuring organizational outcomes and impact.
- Knowledge of political-economic challenges of country’s in political transition from authoritarian to democratic political culture.
- Demonstrated experience in developing research tools (online surveys, focus groups, key informant interviews) and conducting this research.
- Strong analytical skills to support both qualitative and quantitative research.
- Excellent writing and presentation skills.
- Fluency in English is a must.
All proposals which fail to comply with the basic minimum requirements outlined in the solicitation shall be eliminated. Only proposals displaying excellent knowledge of organizational sociology, expertise in M&E concepts, and submitted a full package of documentation required for application will be evaluated. See Sections C and E.
4. Application Instructions
Proposals must be submitted to kbondar@pactworld.org no later than 17:00 on August 16, 2023 (Kyiv time). The subject line should contain: “Proposal under Consultant Request P4767-2023-08”.
Documentation required for application:
- Resume/CV. Description of qualifications to conduct this study and a brief description of similar past projects.
- Technical Proposal:
- Methodology or design (and rationale for explanation)
- Data collection methods and rationale
- Sample and sampling, if proposed
- Data analysis method
- Financial proposal (budget) in Excel file (in UAH currency). Clearly stating the LOE with a requested rate per unit (per deliverable and/or per day/hour) for consultants. The proposals are expected to be submitted from an individual consultant (or a leader of a group of consultants) as an individual/private entrepreneur.
Questions
All questions or clarifications regarding this Consultant Request must be in writing and submitted to kbondar@pactworld.org no later than 17:00 on August 7, 2023 (Kyiv time). The subject line should contain: “Questions to Consultant Request P4767-2023-08.” Questions and requests for clarification, and the responses thereto, will be circulated to all Consultant Request recipients who indicate interest.
All proposals which fail to comply with the basic minimum requirements outlined in the solicitation shall be eliminated. Only proposals submitted with a full package of documentation required for the application will be evaluated.
