效果效率影响可持续性课件

1、IFADs Approach to Project EvaluationPresentation at SHIPDET, 5 May 2015国际农业发展基金的项目评价方法上海国际发展评价培训春季班,2015年5月5日Contents 纲要Background on IFADs Independent Office of Evaluation (IOE)Some thoughts on why independent evaluation is usefulExperiences in planning and conducting evaluationsUse of project eval

2、uationsIOEs evaluation products国际农发基金独立评价办公室（IOE）背景介绍对独立评价作用的认识评价的计划与实施经验项目评价的用途IOE的评价产品2INDEPENDENT OFFICE OF EVALUATION OF IFAD (IOE) 国际农发基金的独立评价办公室Introduction 背景介绍3Background on IFAD 国际农发基金概况IFAD = International Fund for Agricultural DevelopmentSpecialised UN Agency, operating as an internationa

3、l financial institutionloans to governments for agricultural investment projectsSmaller grant programme to a wider variety of actors for research, innovation and capacity buildingIFAD started operations in 1978. Since then, approved operations for US$ 16 billion (November 2014)IFAD = 国际农业发展基金专门化的联合国

4、机构，按照国际金融机构的方式运作贷款各国政府的农业投资项目小额赠款-致力于研究、创新和能力建设的各类机构IFAD从1978年开始运营。截至2014年11月，批准的项目金额达160亿美元。4Independent Office of Evaluation of IFAD国际农发基金独立评价办公室Responsibility of the Independent Office of Evaluation (IOE)Special division of IFAD; does not report to IFADs ManagementReports to the Executive Board o

5、f IFAD (representative of Member States)Evaluation Policy 2003 and 2011Two main principles: accountability and learning独立评价办公室（IOE）的职责IFAD的特设部门，不向IFAD的管理层汇报向IFAD的执行董事会报告（执董会由推选的成员国代表组成）评价政策2003与2011版两条主要原则：问责与学习5Types of Evaluations 评价类别Corporate-level EvaluationsCountry Programme EvaluationsProject

6、 EvaluationsEvaluation Synthesis ReportsImpact Evaluations Annual Report on Results and Impact of IFAD Operations (ARRI)机构层面的评价国别项目评价项目评价评价综合报告影响评价年度结果与影响报告6WHY INDEPENDENT EVALUATION?为什么要做独立评价？Some general considerations 一般性问题7Independent Evaluation独立评价Self-evaluation自评价Monitoring监测Accountability a

7、nd Learning in IFADIFAD的问责与学习8Independent Evaluation 独立评价独立评价对绩效进行客观透明的评判有助于营运知识的创造与传播能尽早获得关于营运情况的评价结论与经验教训，有助于改进决策重点关注与发展效果有实质性关联的话题和问题与各种利益相关者密切合作的同时，保持IOE的独立公正性遵循职业标准使用来自于利益相关者的反馈为创新和学习提供外部视角将管理的重心从关注投入转移到关注结果Independent EvaluationJudges performance in an objective and transparent wayContributes

8、to operational knowledge creation or disseminationDelivers operations evaluation findings and lessons early enough to inform decision makingFocuses on topics and issues that have substantial relevance to development effectiveness.Engages with diverse stakeholders while maintaining its integrity Adhe

9、res to professional standardsUses feedback from stakeholdersProvides an external perspectives for innovation and learningShifts management focus from inputs to results(Based on Bob Picciotto, 2013. Evaluation Independence in Organizations; Journal of Multi Disciplinary Evaluation Volume 9, Issue 20)

10、 9Exercise 练习What are the differences between “independent evaluation” and “self evaluation”?What are the advantages and disadvantages for each of the two types of evaluations?“独立评价”与“自评价”的区别是什么？两种评价各自的优缺点是什么？10Independent & Self-Evaluation 独立评价与自评价Self-evaluationIndependent evaluationCloser to the

11、action Lacks distance, less objectiveExposed to vested interests Often lacks evaluation skills Interests and concerns may differ from beneficiaries. Likely to support risky management decisionsLikely to select evidence that supports assumptionsChallenges assumptions on the design of policies & progr

12、amsMakes self-evaluators think about organizational achievements, systematic stakeholder consultation, reaching consensus about program goals and focusing resources program goalsEnhances effectiveness of self-evaluationValidates information自评价独立评价与评价的活动关系更近 因缺乏距离，不够客观易受既得利益的影响通常缺乏评价技能可能有着与受益人不尽相同的利益

13、与关注点很可能会支持风险较大的管理决定很可能会选择那些支持假设的证据挑战政策与项目设计时的假设促使自评价人员对组织取得的成绩、对利益相关者的系统性咨询、对项目目标达成共识、围绕项目目标实现来进行资源配置等进行思考提高自评价的有效性验证信息11PLANNING AND CONDUCTING EVALUATIONS评价的设计与实施Some experiences and tips 经验与技巧12IOEs Evaluation Process独立评价办公室的评价流程Selection of cases & themesApproach paper Desk reviewData collection

14、 in the fieldDebriefing Draft report & peer reviewComments by Government & IFAD Management Feedback to StakeholdersManagement responseAgreement at completion pointFinal reportCommunication products选择案例和主题方法文件案头审查实地数据采集任务报告起草报告和同行评议政府和IFAD管理层进行评论反馈给利益相关者管理层的反馈评价完成时达成协定评价报告终稿宣传材料13Planning an Evaluati

15、on 评价的计划Clarify purpose, users & useDefine evaluation subject Evaluation questionsAnalytical frameworkDefine methodologyDevelop tools明确评价的目的、使用者和用途定义评价主题评价问题分析框架确定评价方法开发评价工具14Evaluation Criteria 评价标准RelevanceEffectivenessEfficiencyImpactSustainabilityGender equality and womens empowermentNatural res

16、ources and climate changeInnovation and Scaling-upBorrower performance (Government)Lender performance (IFAD)相关性效果效率影响可持续性性别平等和妇女赋权自然资源和气候变化创新与规模扩大借款人的绩效（政府）贷款人的绩效（IFAD）15Exercise 练习Which evaluation criteria are you familiar with?Please identify a few evaluation questions to assess those criteria.你对哪

17、种评价标准比较熟悉？请列出几个评价问题来对那些评价标准进行评估？16Evaluation Framework 评价框架体系Evaluation questionsDetailed questions/ indicatorsData sourcesMethods usedRelevanceQ1Q2Q3EffectivenessEfficiencyImpactSustainability评价问题详细问题/指标数据来源使用的方法相关性Q1Q2Q3效果效率影响可持续性17Data Collection Methods 数据收集方法Qualitative and semi-structuredDirec

18、t field observationsKey informant interviewsFocus group discussionsCase studies Participatory techniques (e.g. wealth ranking, community mapping, historical transects, most significant changes)QuantitativeWeb-based surveys Large sample household surveys18定性数据与半结构化的数据直接的实地观察关键知情人访谈焦点小组讨论案例研究参与式技术（如财富

19、排名、社区地图绘制、历史横切面、最显著变化）定量数据基于网络的调查大样本的入户调查Exercise 练习Which data collection methods are you familiar with? List as many as you can!Which methods are best suited for the following evaluations:Evaluating the impact of drinking water systems in 50 villagesEvaluating the efficiency of small scale wind pow

20、er projects in two provincesEvaluating the effectiveness of training for accountants你对哪种数据收集方法比较熟悉？请尽可能多地列举。下列评价最适用哪种数据收集方法：对50个村庄的饮用水供水系统的影响进行评价对两个省的小型风电项目的效能进行评价对会计从业人员培训的效果进行评价19Rating System 评级体系RatingAssessment Category6Highly satisfactory SATISFACTORY5Satisfactory4Moderately satisfactory3Moder

21、ately unsatisfactory UNSATISFACTORY2Unsatisfactory1Highly unsatisfactory评级评价类别6非常满意满意5满意4比较满意3比较不满意不满意2不满意1非常不满意20Report Outline 评价报告的提纲Executive summaryManagement responseEvaluation objectives, methodology and process The projectProject contextProject implementationMain evaluation findingsRural pov

22、erty impactCore criteriaOther performance criteria Overall project achievementPerformance of partners ConclusionsRecommendations摘要管理层的反馈意见评价的目的、方法与流程项目项目背景项目实施评价的主要发现对农村贫困率的影响核心标准其它绩效标准项目的总体成绩合作伙伴的绩效结论建议21COMMUNICATION AND USE OF EVALUATIONS IN IFAD评价在IFAD的交流与使用After the evaluation 评价完成之后22Use of Project Evaluations 项目评价的用途Project evaluation