| Project Detail |
Project Name Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1
Project Number 53343-002
Country Regional
Bangladesh
Fiji
Pakistan
Philippines
China, Peoples Republic of
Project Status Active
Project Type / Modality of Assistance Technical Assistance
Source of Funding / Amount
TA 9940-REG: Mainstreaming Impact Evaluation Methodologies, Approaches, and Capacities in Selected Developing Member Countries - Subproject 1
Technical Assistance Special Fund US$ 1.50 million
Strategic Agendas Environmentally sustainable growth
Inclusive economic growth
Drivers of Change Gender Equity and Mainstreaming
Knowledge solutions
Sector / Subsector
Agriculture, natural resources and rural development / Agricultural policy, institutional and capacity development
Education / Education sector development
Energy / Energy sector development and institutional reform
Finance / Inclusive finance
Public sector management / Social protection initiatives
Transport / Transport policies and institutional development
Gender Equity and Mainstreaming Some gender elements
Description The Subproject 1 TA aims to mainstream impact evaluation (IE) to improve the development effectiveness of project and policy interventions in Asian Development Bank developing member countries (DMCs). The TA will support (i) the conduct of atleast five IE study phases/surveys applying various methodologies and survey instruments, and (ii) the development of IE awareness and capacity among the DMCs.
Project Rationale and Linkage to Country/Regional Strategy Impact evaluation is essential to strengthen ADBs Strategy 2030 ambition to be a knowledge provider. The development profession has increasingly recognized the need for rigorous IE methodologies (including randomized experiments and appropriate econometric approaches) to isolate the effects of interventions from those of confounding factors. Recognizing the value of IE, ERCD under its first IE TA cluster (CTA 0012) initiated many studies. However, few have been brought to completion so far because IEs often require multiple surveys spanning prior and post project implementation. Initiated studies have also not all had consistent technical oversight from regional departments (RDs), which do not all have staff with background in IE. Under this new TA, more effective mainstreaming and continued support will be provided to ensure that promising initiated studies from CTA 0012 are completed, while new IE studies are initiated. TA support to conduct IE studies will be further improved by focusing support more strategically to add value to operations. This includes (i) adopting nimble approaches for IEs to be completed in shorter periods, (ii) targeting under-studied themes, and (iii) supporting IE of pilot interventions under consideration for future investments. Thus, additional resources will be required to (i) support ongoing IE studies for completion; (ii) support new IE studies; (iii) disseminate study findings and lessons; and (iv) contribute to capacity building of DMC stakeholders. The TA will ensure that financial resources are accompanied by appropriate technical expertise and oversight via more of a _One ADB_ approach, in which research economists from ERCD can be fully engaged in studies, along with global experts.
Impact Enhanced knowledge has improved the development effectiveness of ADB finance and partnerships.
Project Outcome
Description of Outcome
Consideration of evidence on the effectiveness of interventions in ADB operations and discussions informing DMC policies expanded.*
*Impact evaluation has three main outcome pathways: 1) direct pathway of study findings informing the design of similar subsequent projects; 2) process pathway of interaction between the impact evaluation and project teams leading to improvements prior to any findings; and 3) broader conceptual pathway in which findings inform other research and discussions to influence policies in a range of contexts and countries. The third pathway is often the most important over the long term, but is also difficult to track or predict in the short term, so it has no direct target.
Progress Toward Outcome
Implementation Progress
Description of Project Outputs
Impact evaluation studies conducted
IE awareness and capacity enhanced
Status of Implementation Progress (Outputs, Activities, and Issues)
Geographical Location Bangladesh - Nation-wide; China - Nation-wide; Fiji - Nation-wide; Pakistan - Nation-wide; Philippines - Nation-wide
Summary of Environmental and Social Aspects
Environmental Aspects
Involuntary Resettlement
Indigenous Peoples
Stakeholder Communication, Participation, and Consultation
During Project Design
During Project Implementation
Business Opportunities
Consulting Services
Each of the IE studies will require a team of consultants, both international and national, to be engaged separately. The consultants will (i) provide technical guidance and feedback on the initial IE concept, (ii) develop the design of the IE studies together with the ADB team, (iii) assist in guiding and overseeing the implementation of IE studies, (iv) assist in survey and sampling design, (v) implement the surveys, and (vi) assist in data analysis and report preparation. In addition, other consultants will need to backstop activities beyond the individual studies (including Output 2, as well as overall support to Output 1), by supporting outreach, helping to monitor and improve IE efforts by the study teams, ensuring that ADB knowledge products are generated from studies, preparing synthesis reports, and contributing to capacity building.
Consequently, the TA will require the services of a mix of individual consultants and firms. Requisite fields of expertise and cost estimates of consulting services will be finalized upon selection and approval of IE proposals by the IEC. Support beyond individual IE studies by international IE experts and editors and national research associates, project coordinators, and layout artists will be through individual consulting services. The precise composition of firms and individual consultants for IE studies funded under Output 1 will depend on the proposals approved by the IEC. Some studies may contract specific roles through individual consultant selection or framework agreements, supplemented by nonconsulting services for data. Others may be contracted to firms via selection methods defined based on the resource needs of the IE studies. Purchase of goods, data and IT equipment within consulting contracts will be allowed if justified to be cost-effective and approved by ADB. Subject to approval of the Procurement, Portfolio, and Financial Management Department, single source selection will be utilized when the proposed engagement is a continuation of previously initiated work and/or there is only one firm with capacity to deliver the proposed IE tasks. The consultants will be engaged in accordance with the ADB Procurement Policy 2017, as amended from time to time and the associated project administration instructions and/or staff instructions.
Procurement Procurement will follow the ADB Procurement Policy (2017, as amended from time to time), the Procurement Regulations for ADB Borrowers (2017, as amended from time to time) and Staff Instructions for TA Procurement of Goods, Works and Nonconsulting Services. Nonconsulting services for separately contracted data collection will be procured using open advertisement or request for quotation. Procurement of equipment will take place in coordination with ADBs Office of Information Systems and Technology and Office of Administrative Services. When the TA is completed, any procured equipment will remain ADB property and/or will be disposed of in accordance with relevant ADB guidelines. Disbursements under the TA will be made in accordance with ADBs Technical Assistance Disbursement Handbook (2010, as amended from time to time).
Responsible ADB Officer Takashi Yamano
Responsible ADB Department Economic Research and Regional Cooperation Department
Responsible ADB Division Economic Analysis and Operations Support Division
Executing Agencies
Asian Development Bank
6 ADB Avenue,
Mandaluyong City 1550, Philippines |
