版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
2011年11月2011年11月1MonitoringandEvaluatingODAThispresentationwillcoverWhymonitor?Whyevaluate?MonitoringintheWorldBank,othermulti-lateraldevelopmentbanks,bilateraldonorsEvaluationintheWorldBank,othermulti-laterals,bilateraldonorsMonitoringandEvaluatingODAT2Whatismonitoring?Definitionofmonitoring:acontinuousprocessthatusessystematiccollectionofdataaboutprogressinanon-goingdevelopmentproject,forusebymanagersandother
stake-holdersWhatismonitoring?Definitio3Whymonitor?Toimproveimplementationofon-goingprojects;mustprovidepracticalinformationToassesswhetherdevelopmentobjectiveslikelytobemetToidentifysystematicissuesandrisksacrossprojects,bycountry,bysector,andoverallToprovideinputforexpostevaluationWhymonitor?Toimproveimpleme4WhatisEvaluation?Definitionof(expost)evaluation:assessmentofacompletedproject,program,orpolicy,itsdesign,implementation,andresults.WhatisEvaluation?Definition5Whyevaluateandwhocares?Why?Tworeasons:TolearnfromexperienceToprovideaccountabilityWhouses(orshoulduse)evaluations:BoardsofDirectors(MDBs)andMinistersandDirectorsGeneralforoversight;ODAmanagersforpoliciesandstrategies;ODAstaffforprogramandprojectdesigns,waysofdoingbusiness;Clientcountries,externalpartners,andthepublicforpolicies,aligningprograms,researchWhyevaluateandwhocares?Why6M&EincontextWorldBankcommits/disburses$20-23billion/year;Approves~280loansandcredits/year;activeloanportfolio:~1,400in>120countriesBankalsoprovidesgrantsandothernon-lendingservices(diagnosticwork)Bankhastotaladministrativebudgetof$2billionMostotherMDBscommit$1–6billion/yearBilateralODA:$200million(Greece,Luxembourg,NewZealand,Portugal)-$25billion/year(USA)Bilateralagencieshaveadministrativebudgetsof$11million(Luxembourg)to>$700million(Japan)M&EincontextWorldBankcom7MonitoringintheWorldBankEveryon-goinglendingoperationismonitoredbyvisitsfromBankstaffabouttwiceayear;Implementationstatusandresults(ISR)reportissuedtwiceeachyear:ProgressonimplementationProgressinmeetingdevelopmentobjectivesProblemprojectsidentifiedPortfolioatriskreports–separatemethodology–updatedmonthlyOtherqualitycontrolactivitiesincludequalityatentryreviews;qualityofsupervisionMonitoringintheWorldBankEv8Evaluation:thetopicsSelfevaluationIndependentevaluation:whyitmattersTools:projects;sectors;countries;etc.Coverage:howmanyevaluationsResources/budgetMainchallengeforevaluationDisclosureOtherEvaluationIssuesEvaluation:thetopicsSelfev9Self-EvaluationintheBankSelfevaluationintheBank:Everyprojecthasanimplementationcompletionreport,donebystaffofresponsibleunit(about280/year)Everynewcountryassistancestrategynowhascompletionreportcoveringpreviouscountryassistancestrategy,donebystaffofresponsibleunit(about20/year)Self-EvaluationintheBankSel10Self-evaluationinotherdonorsMulti-lateralinstitutions:almostallMDBshaverequirementforself-evaluation,althoughinsomeMDBs(AsianDB,EBRD,EIB),theevaluationdepartmentisinvolvedBilateraldonors:somerequireforprojectsovergivenvalue,othersdon’t;SDC(Swiss):externalevaluatorsdoself-evaluation;GTZ(German)hasinnovativeeVAL(electronic)system.Self-evaluationinotherdonor11IndependentevaluationWhatisindependence?Theextenttowhichtheevaluationunit:ReportsdirectlytoaBoardorothergoverningunit;Hasstaff,budget,andfunctionsindependentfrommanagement;notinvolvedwithmanagementofODABehavesindependentlybyissuingobjective,impartial,andbalancedreportsIndependentevaluationWhatis12IndependentevaluationIntheWorldBank,independentevaluation,since1973,haslookedlikethis:BoardofDirectorsInstitutionalIntegrityPresidentPaulWolfowitzIndependentEvaluationGroupInternalAuditingSVP&ChiefEconMDOperationsCFOSVP&GenCounselInspectionPanelMDOperationsIndependentevaluationIntheW13IndependentevaluationInbilateraldonors,independentevaluationhasevolvedtolooklikethis:MinistryofForeignAffairs
EvaluationUnitDirectorGeneralAidagencyOperationalunitOperationalunitOperationalunitIndependentevaluationInbilat14IndependentevaluationWhyindependencematters:Allowsforobjective,unbiasedevaluationsEvaluationfindingsarenottailoredtomanagement’swishesIndependencelendscredibilitytofindingsIndependencedifficulttoachieveandmaintainIndependentevaluationWhyinde15EvaluationTools:WorldBankProjectevaluationsImplementationCompletionReport(ICR)reviewsProjectperformanceassessmentreviews(PPARs)CountryevaluationsCASCompletionReport(CASCR)ReviewsCountryassistanceevaluations(CAEs)Sector,thematic,globalevaluationsProcessevaluationsCorporateevaluations(ARDE,AROE)EvaluationTools:WorldBankP16EvaluationTools:interactionsSynergiesamongdifferentevaluationtoolscanprovidevaluableinputGlobal(Globalprograms)EvaluationtoolsintheWorldBankCorporate(ARDE)Sector(finance,education)Thematic(gender,decentralization)Process(PRSP)CountryAssistanceEvaluation
CASCRReview
CASCRReviewICRReview(validationofself-evaluation)ProjectPerformanceAssessmentReviewCountryAssistanceEvaluationICRReview(validationofself-evaluation)ProjectPerformanceAssessmentReviewProjectlevelCountrylevelSector,thematic,policylevelGlobalandcorporatelevelEvaluationTools:interactions17EvaluationCoverage:WorldBankEvaluationCoverage:WorldBa18EvaluationcoverageInmostMDBs,fullrangeofevaluations:project,country,sector,thematicevaluationsInmostbilaterals,fewprojectevaluations;somecountrylevel;mostfocusonthemesorprogramsMostbilateralsproduces3-10evaluations/yearDFIDproduces20-25reports/yr;PotentialweaknessofcountryandthematicevaluationswithoutunderpinningsofprojectevaluationstouseasinputEvaluationcoverageInmostMDB19Resourcesforevaluation:MDBsResourcesvary,butaspercentoftotaladministrativebudget,fairlysimilar:
Resourcesforevaluation:MDB20Resourcesforevaluation:bilateralsBilateraldonoragenciesaremorelikelytohireexternalconsultantsforvirtuallyallevaluations(UK,Norway,Denmark,Switzerland,Australia)Basedonnumbersfromafewbilaterals(DFID,NORAD,SDC),evaluationbudgetis~2%oftotaladministrativebudget;figuresof0.5–2%havebeencitedbyothers.Smallerdonors(Greece,NewZealand)arestillsettinguptheirevaluationunitsResourcesforevaluation:bila21MainchallengeforevaluationHowtomakeevaluationsusefulMostmanagers,stafffocusedonfuture,notonpastEvaluationmust/shouldbe:TimelyOperationallyrelevant:avoidgeneralizations,platitudesEasilyaccessible:avoidlongreportsConstructive:goodpracticeshouldberewardedWidelydisseminatedanddisclosedMainchallengeforevaluationH22DisclosureofevaluationreportsWorldBank:publicdisclosureofall:PPARsCAEsSector,thematic,globalevaluationsProcessevaluationsCorporateevaluationsEBRD,ADB:selectivepublicdisclosure:evaluationsinvolveprivatesectorBilaterals:majoritydisclose,butvaries:UK,Norway–fulldisclosure;Germany–selectivedisclosureDisclosureofevaluationrepor23DisclosureForWorldBank:reportsandinformationonevaluationtools,approaches,onwebsite:andscrolldowntoright-hadsideofhomepage,or:/iegForotherdonors:checktheirwebsitesDisclosureForWorldBank:rep24OtherissuesinevaluationEvaluationapproachUseofperformanceindicatorsSourcesofinformationRatingsProcessesPartnershipsOtherchallengesOtherissuesinevaluationEval25EvaluationApproachWithincontextofresults-basedmanagement,Bankusesobjectives-basedapproach,focusonoutcomesandimpactBankloans;grants;diagnosticwork;dialoguePhysicaloutputs;privatization;newlaws;agencycreated;trainingcompleted;sub-loansdisbursed.Moreefficientoperations;betterfiscalmanagement;employment
creation;betteraccesstoservices;InputsOutputsExogenousfactorsExogenousfactorsOutcomeImpactLonger-termobjective,likepovertyreduction,bettereducational,healthoutcomesEvaluationApproachWithincont26EvaluationApproachBankassesses:Outcome(relevance,efficacy,efficiency)Useofperformanceindicatorsforoutputs,outcomes,impactRisktoDevelopmentBankandBorrowerPerformanceEvaluationApproachBankassess27SourcesofinformationforevaluationBaselinedatainprojectappraisaldocuments(sometimes)MonitoringreportsshouldhaveinformationonperformanceindicatorsDatabasesforprojectarea;sector;countryatbeginningofproject,endofprojectOthercountry-levelindeces(IMFfinancialstatistics,DoingBusinesssurveys;WorldBankIndicatorsofcorruptionsurveys;UNDPhumandevelopmentindicators)SurveysInterviews,focusgroups Sourcesofinformationforeva28UseofRatingsWorldBankusesratingsonprojectoutcomesandoutcomesofcountryassistance.Noratingsonsector,thematic,otherevaluationsOtherMDBsuseratingsforprojectoutcomes;notforcountryassistanceBilaterals:someuseratings,onlyforprojects;somedonotuseanyratingsUseofRatingsWorldBankuses29EvaluationApproach:ratingsProjectRatingsinWorldBank:Outcomes:6pointscale(HS-HU)RiskstoDevelopment:4pointscale(H-N)BankandBorrowerperformance:4pointscale(HStoHU)ProsandconsofratingPro:providesdataandaccountabilityCon:takesfocusawayfromlessonlearningandrichnessofevaluationEvaluationApproach:ratingsP30ProcessesIndependencedoesnotmeanisolationMDBsandbilateraldonorsincorporatecommentsfromoperationalmanagersandstaffandfromstakeholdersinclientcountriesintoevaluationreports:Bank’sinitiatingpapersforcountry,thematic,globalevaluationssenttomanagementforcommentandtoBoardofDirectorsforinformation;IMF’sinitiatingpaperforallevaluationspostedonIMFwebsiteandpubliccommentinvited;wideconsultationsthroughoutprocess.ProcessesIndependencedoesnot31PartnershipsinevaluationCountryandsectorevaluationssometimesinvolvepartnershipswithotherMDBsand/orbilateraldonors(jointorparallelevaluations)Opportunistic,notsystematic,partnershipsProsandconsofevaluationpartnershipsPros:widercoverage,otherviewpointsCons:morecostlyandmoretimerequired;maynotagreeonoutcomes;mayaffecttimelinessoffinalreportPartnershipsinevaluationCoun32OtherchallengesDatadifficulttoobtain,ordifferentsourceshaveconflictingdataOftendifficultorimpossibletohaveacontrolgroup(especiallyinsectorandcountryevaluations)Beneficiarysurveyscanbecostly,lowresponserateProblemofattribution(cause-effect)difficultorimpossibletoestablishOtherchallengesDatadifficult332011年11月2011年11月34MonitoringandEvaluatingODAThispresentationwillcoverWhymonitor?Whyevaluate?MonitoringintheWorldBank,othermulti-lateraldevelopmentbanks,bilateraldonorsEvaluationintheWorldBank,othermulti-laterals,bilateraldonorsMonitoringandEvaluatingODAT35Whatismonitoring?Definitionofmonitoring:acontinuousprocessthatusessystematiccollectionofdataaboutprogressinanon-goingdevelopmentproject,forusebymanagersandother
stake-holdersWhatismonitoring?Definitio36Whymonitor?Toimproveimplementationofon-goingprojects;mustprovidepracticalinformationToassesswhetherdevelopmentobjectiveslikelytobemetToidentifysystematicissuesandrisksacrossprojects,bycountry,bysector,andoverallToprovideinputforexpostevaluationWhymonitor?Toimproveimpleme37WhatisEvaluation?Definitionof(expost)evaluation:assessmentofacompletedproject,program,orpolicy,itsdesign,implementation,andresults.WhatisEvaluation?Definition38Whyevaluateandwhocares?Why?Tworeasons:TolearnfromexperienceToprovideaccountabilityWhouses(orshoulduse)evaluations:BoardsofDirectors(MDBs)andMinistersandDirectorsGeneralforoversight;ODAmanagersforpoliciesandstrategies;ODAstaffforprogramandprojectdesigns,waysofdoingbusiness;Clientcountries,externalpartners,andthepublicforpolicies,aligningprograms,researchWhyevaluateandwhocares?Why39M&EincontextWorldBankcommits/disburses$20-23billion/year;Approves~280loansandcredits/year;activeloanportfolio:~1,400in>120countriesBankalsoprovidesgrantsandothernon-lendingservices(diagnosticwork)Bankhastotaladministrativebudgetof$2billionMostotherMDBscommit$1–6billion/yearBilateralODA:$200million(Greece,Luxembourg,NewZealand,Portugal)-$25billion/year(USA)Bilateralagencieshaveadministrativebudgetsof$11million(Luxembourg)to>$700million(Japan)M&EincontextWorldBankcom40MonitoringintheWorldBankEveryon-goinglendingoperationismonitoredbyvisitsfromBankstaffabouttwiceayear;Implementationstatusandresults(ISR)reportissuedtwiceeachyear:ProgressonimplementationProgressinmeetingdevelopmentobjectivesProblemprojectsidentifiedPortfolioatriskreports–separatemethodology–updatedmonthlyOtherqualitycontrolactivitiesincludequalityatentryreviews;qualityofsupervisionMonitoringintheWorldBankEv41Evaluation:thetopicsSelfevaluationIndependentevaluation:whyitmattersTools:projects;sectors;countries;etc.Coverage:howmanyevaluationsResources/budgetMainchallengeforevaluationDisclosureOtherEvaluationIssuesEvaluation:thetopicsSelfev42Self-EvaluationintheBankSelfevaluationintheBank:Everyprojecthasanimplementationcompletionreport,donebystaffofresponsibleunit(about280/year)Everynewcountryassistancestrategynowhascompletionreportcoveringpreviouscountryassistancestrategy,donebystaffofresponsibleunit(about20/year)Self-EvaluationintheBankSel43Self-evaluationinotherdonorsMulti-lateralinstitutions:almostallMDBshaverequirementforself-evaluation,althoughinsomeMDBs(AsianDB,EBRD,EIB),theevaluationdepartmentisinvolvedBilateraldonors:somerequireforprojectsovergivenvalue,othersdon’t;SDC(Swiss):externalevaluatorsdoself-evaluation;GTZ(German)hasinnovativeeVAL(electronic)system.Self-evaluationinotherdonor44IndependentevaluationWhatisindependence?Theextenttowhichtheevaluationunit:ReportsdirectlytoaBoardorothergoverningunit;Hasstaff,budget,andfunctionsindependentfrommanagement;notinvolvedwithmanagementofODABehavesindependentlybyissuingobjective,impartial,andbalancedreportsIndependentevaluationWhatis45IndependentevaluationIntheWorldBank,independentevaluation,since1973,haslookedlikethis:BoardofDirectorsInstitutionalIntegrityPresidentPaulWolfowitzIndependentEvaluationGroupInternalAuditingSVP&ChiefEconMDOperationsCFOSVP&GenCounselInspectionPanelMDOperationsIndependentevaluationIntheW46IndependentevaluationInbilateraldonors,independentevaluationhasevolvedtolooklikethis:MinistryofForeignAffairs
EvaluationUnitDirectorGeneralAidagencyOperationalunitOperationalunitOperationalunitIndependentevaluationInbilat47IndependentevaluationWhyindependencematters:Allowsforobjective,unbiasedevaluationsEvaluationfindingsarenottailoredtomanagement’swishesIndependencelendscredibilitytofindingsIndependencedifficulttoachieveandmaintainIndependentevaluationWhyinde48EvaluationTools:WorldBankProjectevaluationsImplementationCompletionReport(ICR)reviewsProjectperformanceassessmentreviews(PPARs)CountryevaluationsCASCompletionReport(CASCR)ReviewsCountryassistanceevaluations(CAEs)Sector,thematic,globalevaluationsProcessevaluationsCorporateevaluations(ARDE,AROE)EvaluationTools:WorldBankP49EvaluationTools:interactionsSynergiesamongdifferentevaluationtoolscanprovidevaluableinputGlobal(Globalprograms)EvaluationtoolsintheWorldBankCorporate(ARDE)Sector(finance,education)Thematic(gender,decentralization)Process(PRSP)CountryAssistanceEvaluation
CASCRReview
CASCRReviewICRReview(validationofself-evaluation)ProjectPerformanceAssessmentReviewCountryAssistanceEvaluationICRReview(validationofself-evaluation)ProjectPerformanceAssessmentReviewProjectlevelCountrylevelSector,thematic,policylevelGlobalandcorporatelevelEvaluationTools:interactions50EvaluationCoverage:WorldBankEvaluationCoverage:WorldBa51EvaluationcoverageInmostMDBs,fullrangeofevaluations:project,country,sector,thematicevaluationsInmostbilaterals,fewprojectevaluations;somecountrylevel;mostfocusonthemesorprogramsMostbilateralsproduces3-10evaluations/yearDFIDproduces20-25reports/yr;PotentialweaknessofcountryandthematicevaluationswithoutunderpinningsofprojectevaluationstouseasinputEvaluationcoverageInmostMDB52Resourcesforevaluation:MDBsResourcesvary,butaspercentoftotaladministrativebudget,fairlysimilar:
Resourcesforevaluation:MDB53Resourcesforevaluation:bilateralsBilateraldonoragenciesaremorelikelytohireexternalconsultantsforvirtuallyallevaluations(UK,Norway,Denmark,Switzerland,Australia)Basedonnumbersfromafewbilaterals(DFID,NORAD,SDC),evaluationbudgetis~2%oftotaladministrativebudget;figuresof0.5–2%havebeencitedbyothers.Smallerdonors(Greece,NewZealand)arestillsettinguptheirevaluationunitsResourcesforevaluation:bila54MainchallengeforevaluationHowtomakeevaluationsusefulMostmanagers,stafffocusedonfuture,notonpastEvaluationmust/shouldbe:TimelyOperationallyrelevant:avoidgeneralizations,platitudesEasilyaccessible:avoidlongreportsConstructive:goodpracticeshouldberewardedWidelydisseminatedanddisclosedMainchallengeforevaluationH55DisclosureofevaluationreportsWorldBank:publicdisclosureofall:PPARsCAEsSector,thematic,globalevaluationsProcessevaluationsCorporateevaluationsEBRD,ADB:selectivepublicdisclosure:evaluationsinvolveprivatesectorBilaterals:majoritydisclose,butvaries:UK,Norway–fulldisclosure;Germany–selectivedisclosureDisclosureofevaluationrepor56DisclosureForWorldBank:reportsandinformationonevaluationtools,approaches,onwebsite:andscrolldowntoright-hadsideofhomepage,or:/iegForotherdonors:checktheirwebsitesDisclosureForWorldBank:rep57OtherissuesinevaluationEvaluationapproachUseofperformanceindicatorsSourcesofinformationRatingsProcessesPartnershipsOtherchallengesOtherissuesinevaluationEval58EvaluationApproachWithincontextofresults-basedmanagement,Bankusesobjectives-basedapproach,focusonoutcomesandimpactBankloans;grants;diagnosticwork;dialoguePhysicaloutputs;privatization;newlaws;agencycreated;trainingcompleted;sub-loansdisbursed.Moreefficientoperations;betterfiscalmanagement;employment
creation;betteraccesstoservices;InputsOutputsExogenousfactorsExogenousfactorsOutcomeImpactLonger-termobjective,likepovertyreduction,bettereducational,healthoutcomesEvaluationApproachWithincont59EvaluationApproachBankassesses:Outcome(relevance,efficacy,efficiency)Useofperformanceindicatorsforoutputs,outcomes,impactRisktoDevelopmentBankandBorrowerPerformanceEvaluationApproachBankassess60SourcesofinformationforevaluationBaselinedatainprojectappraisaldocuments(sometimes)MonitoringreportsshouldhaveinformationonperformanceindicatorsDatabasesforproject
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 2024年湖南益阳市资阳区事业单位(紧缺)人才引进30人历年高频500题难、易错点模拟试题附带答案详解
- 2024年湖南湘西自治州事业单位招聘历年高频500题难、易错点模拟试题附带答案详解
- 2024年湖南湘潭市发改委所属事业单位招聘合同制人员5人历年高频500题难、易错点模拟试题附带答案详解
- 2024年湖南永州市零陵区园区企业及基层急需紧缺人才招聘80人高频500题难、易错点模拟试题附带答案详解
- 2024年湖南桃源县部分事业单位招聘59人历年高频500题难、易错点模拟试题附带答案详解
- 2024年湖南怀化市新晃侗族自治县招聘事业单位工作人员78人高频500题难、易错点模拟试题附带答案详解
- 2024年湖南常德西洞庭管理区事业单位招考高频500题难、易错点模拟试题附带答案详解
- 2024年湖南常德安乡县部分事业单位招聘110人历年高频500题难、易错点模拟试题附带答案详解
- 2024年湖南岳阳市发展和改革委员会委属事业单位选调11人历年高频500题难、易错点模拟试题附带答案详解
- 2024年湖南宁乡市教育局事业单位选调7人历年高频500题难、易错点模拟试题附带答案详解
- 《生活中的算法》教学设计
- 幼儿情绪情感观察记录表
- 就业信息的收集与处理课件
- 企业档案管理培训ppt课件
- U8-条码方案与实施应用(库存条码)
- 完整版ANSYS命令流教学手册
- 海天注塑机型号汇总
- 变形铝与铝合金热处理规范方案
- 无定向导线计算
- 文言“之”字的用法(课堂PPT)
- RV减速器和谐波减速器
评论
0/150
提交评论