Raymond-MHP版雇员培训与开发(英文版·第6版)课件IChap006_第1页
Raymond-MHP版雇员培训与开发(英文版·第6版)课件IChap006_第2页
Raymond-MHP版雇员培训与开发(英文版·第6版)课件IChap006_第3页
Raymond-MHP版雇员培训与开发(英文版·第6版)课件IChap006_第4页
Raymond-MHP版雇员培训与开发(英文版·第6版)课件IChap006_第5页
已阅读5页,还剩79页未读 继续免费阅读

下载本文档

版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领

文档简介

TrainingEvaluationChapter6

TrainingEvaluation

1ObjectivesExplainwhyevaluationisimportantIdentifyandchooseoutcomestoevaluateatrainingprogramDiscusstheprocessusedtoplanandimplementagoodtrainingevaluationDiscussthestrengthsandweaknessesofdifferentevaluationdesignsObjectivesExplainwhyevaluati2ObjectivesChoosetheappropriateevaluationdesignbasedonthecharacteristicsofthecompanyandtheimportanceandpurposeofthetrainingConductacost-benefitanalysisforatrainingprogramExplaintheroleofworkforceanalyticsanddashboardsindeterminingthevalueoftrainingpracticesObjectivesChoosetheappropria3IntroductionTrainingeffectiveness:BenefitsthatthecompanyandthetraineesreceivefromtrainingTrainingoutcomesorcriteria:MeasuresthatthetrainerandthecompanyusetoevaluatetrainingprogramsIntroductionTrainingeffective4IntroductionTrainingevaluation:TheprocessofcollectingtheoutcomesneededtodetermineiftrainingiseffectiveEvaluationdesign:Collectionofinformation,includingwhom,what,when,andhow,fordeterminingtheeffectivenessofthetrainingprogramIntroductionTrainingevaluatio5ReasonsforEvaluatingTrainingCompaniesmakelargeinvestmentsintrainingandeducationandviewthemasastrategytobesuccessful;theyexpecttheoutcomesoftrainingtobemeasurableTrainingevaluationprovidesthedataneededtodemonstratethattrainingdoesprovidebenefitstothecompanyItinvolvesformativeandsummativeevaluationReasonsforEvaluatingTrainin6FormativeEvaluationTakesplaceduringprogramdesignanddevelopmentIthelpsensurethatthetrainingprogramiswellorganizedandrunssmoothlyTraineeslearnandaresatisfiedwiththeprogramItprovidesinformationabouthowtomaketheprogrambetter;itinvolvescollectingqualitativedataabouttheprogramPilottesting:ProcessofpreviewingthetrainingprogramwithpotentialtraineesandmanagersorwithothercustomersFormativeEvaluationTakesplac7SummativeEvaluationDeterminestheextenttowhichtraineeshavechangedasaresultofparticipatinginthetrainingprogramItmayincludemeasuringthemonetarybenefitsthatthecompanyreceivesfromtheprogram(ROI)ItinvolvescollectingquantitativedataSummativeEvaluationDetermines8SummativeEvaluationAtrainingprogramshouldbeevaluated:Toidentifytheprogram’sstrengthsandweaknessesToassesswhethercontent,organization,andadministrationoftheprogramcontributetolearningandtheuseoftrainingcontentonthejobToidentifywhichtraineesbenefitedmostorleastfromtheprogramSummativeEvaluationAtraining9SummativeEvaluationTogatherdatatoassistinmarketingtrainingprogramsTodeterminethefinancialbenefitsandcostsoftheprogramTocomparethecostsandbenefitsof:Trainingversusnon-traininginvestmentsDifferenttrainingprogramstochoosethebestprogramSummativeEvaluationTogather10Figure6.1-TheEvaluation

ProcessFigure6.1-TheEvaluation

Pr11Table6.1-EvaluationOutcomesTable6.1-EvaluationOutcome12Table6.1-EvaluationOutcomesTable6.1-EvaluationOutcome13OutcomesUsedintheEvaluationofTrainingProgramsReactionoutcomesItiscollectedattheprogram’sconclusionCognitiveoutcomesDeterminethedegreetowhichtraineesarefamiliarwiththeprinciples,techniques,andprocessesemphasizedinthetrainingprogramSkill-basedoutcomesTheextenttowhichtraineeshavelearnedskillscanbeevaluatedbyobservingtheirperformanceinworksamplessuchassimulatorsOutcomesUsedintheEvaluatio14OutcomesUsedintheEvaluationofTrainingProgramsAffectiveoutcomesIftraineeswereaskedabouttheirattitudesonasurvey,thatwouldbeconsideredalearningmeasureResults:Usedtodeterminethetrainingprogram’spayoffforthecompanyOutcomesUsedintheEvaluatio15OutcomesUsedintheEvaluationofTrainingProgramsReturnoninvestmentDirectcosts:Salariesandbenefitsforallemployeesinvolvedintraining;programmaterialandsupplies;equipmentorclassroomrentalsorpurchases;andtravelcostsIndirectcosts:Notrelateddirectlytothedesign,development,ordeliveryofthetrainingprogramBenefits:ValuethatthecompanygainsfromthetrainingprogramOutcomesUsedintheEvaluatio16OutcomesUsedintheEvaluationofTrainingProgramsTrainingQualityIndex(TQI):Computerapplicationthatcollectsdataabouttrainingdepartmentperformance,productivity,budget,andcourses,andallowsdetailedanalysisofthisdataQualityoftrainingisincludedintheeffectivenesscategoryOutcomesUsedintheEvaluatio17DeterminingWhetherOutcomesareAppropriateCriteriaRelevanceTheextenttowhichtrainingoutcomesarerelatedtothelearnedcapabilitiesemphasizedinthetrainingprogram.Criterioncontamination-theextentthattrainingoutcomesmeasureinappropriatecapabilitiesorareaffectedbyextraneousconditions.Criteriondeficiency-thefailuretomeasuretrainingoutcomesthatwereemphasizedinthetrainingobjectives.ReliabilityThedegreetowhichoutcomescanbemeasuredconsistentlyovertime.DiscriminationThedegreetowhichtrainees’performanceontheoutcomeactuallyreflectstruedifferencesinperformance.PracticalityTheeasewithwhichtheoutcomemeasurescanbecollected.DeterminingWhetherOutcomesa18Figure6.2-CriterionDeficiency,Relevance,andContaminationOutcomesMeasuredinEvaluationOutcomesIdentifiedbyNeedsAssessmentandIncludedinTrainingObjectivesOutcomesRelatedtoTrainingObjectivesContaminationRelevanceDeficiencyFigure6.2-CriterionDeficie19EvaluationPracticesItisimportanttorecognizethelimitationsofchoosingtomeasureonlyreactionandcognitiveoutcomesToensureanadequatetrainingevaluation,companiesmustcollectoutcomemeasuresrelatedtobothlearningandtransferEvaluationPracticesItisimpo20Figure6.3-TrainingEvaluationPracticesOutcomesPercentageofCompaniesUsingOutcomeFigure6.3-TrainingEvaluati21Figure6.4-TrainingProgramObjectivesandTheirImplicationsforEvaluationFigure6.4-TrainingProgram22EvaluationDesignsThreatstovalidity:Factorsthatwillleadanevaluatortoquestioneitherthe:Internalvalidity:ThebelievabilityofthestudyresultsExternalvalidity:TheextenttowhichtheevaluationresultsaregeneralizabletoothergroupsoftraineesandsituationsEvaluationDesignsThreatstov23Table6.6-ThreatstoValidityTable6.6-ThreatstoValidit24MethodstoControlforThreatstoValidityPretestsandpost-tests:Comparisonofthepost-trainingandpretrainingmeasurescanindicatethedegreetowhichtraineeshavechangedasaresultoftrainingUseofcomparisongroups:GroupofemployeeswhoparticipateintheevaluationstudybutdonotattendthetrainingprogramHawthorneeffectMethodstoControlforThreats25MethodstoControlforThreatstoValidityRandomassignment:AssigningemployeestothetrainingorcomparisongrouponthebasisofchancealoneItisoftenimpracticalAnalysisofcovarianceMethodstoControlforThreats26TypesofEvaluationDesignsPost-testonly:Onlypost-trainingoutcomesarecollectedAppropriatewhentraineescanbeexpectedtohavesimilarlevelsofknowledge,behavior,orresultsoutcomespriortotrainingPretest/post-test:Pretrainingandpost-trainingoutcomemeasuresarecollectedUsedbycompaniesthatwanttoevaluateatrainingprogrambutareuncomfortablewithexcludingcertainemployeesTypesofEvaluationDesignsPos27Table6.7ComparisonofEvaluationDesignsTable6.7ComparisonofEvalua28TypesofEvaluationDesignsPretest/post-testwithcomparisongroup:IncludestraineesandacomparisongroupDifferencesbetweeneachofthetrainingconditionsandthecomparisongroupareanalyzeddeterminingwhetherdifferencesbetweenthegroupswerecausedbytrainingTypesofEvaluationDesignsPre29TypesofEvaluationDesignsTimeseries:TrainingoutcomesarecollectedatperiodicintervalsbothbeforeandaftertrainingItallowsananalysisofthestabilityoftrainingoutcomesovertimeReversal:TimeperiodinwhichparticipantsnolongerreceivethetraininginterventionSolomonfour-group:Combinesthepretest/post-testcomparisongroupandthepost-test-onlycontrolgroupdesignThisdesigncontrolsformostthreatstointernalandexternalvalidityTypesofEvaluationDesignsTim30Table6.10-FactorsthatInfluencetheTypeofEvaluationDesignTable6.10-FactorsthatInfl31DeterminingReturnonInvestmentCost-benefitanalysis:ProcessofdeterminingtheeconomicbenefitsofatrainingprogramusingaccountingmethodsthatlookattrainingcostsandbenefitsROIshouldbelimitedonlytocertaintrainingprograms,becauseitcanbecostlyDeterminingcostsMethodsforcomparingcostsofalternativetrainingprogramsincludetheresourcerequirementsmodelandaccountingDeterminingReturnonInvestme32DeterminingReturnonInvestmentDeterminingbenefits–Methodsinclude:Technical,academic,andpractitionerliteraturePilottrainingprogramsandobservanceofsuccessfuljobperformersObservanceofsuccessfuljobperformersEstimatesbytraineesandtheirmanagersTocalculateROIIdentifyoutcomesPlaceavalueontheoutcomesDeterminethechangeinperformanceaftereliminatingotherpotentialinfluencesontrainingresultsObtainanannualamountofbenefitsDeterminethetrainingcostsCalculatethetotalbenefitsbysubtractingthetrainingcostsfrombenefits(operationalresults)CalculatetheROIbydividingoperationalresultsbycostsTheROIgivesanestimateofthedollarreturnexpectedfromeachdollarinvestedintrainingDeterminingReturnonInvestme33Table6.11-DeterminingCostsforaCostBenefitAnalysisTable6.11-DeterminingCostsf34DeterminingReturnonInvestmentUtilityanalysis:Cost-benefitanalysismethodthatinvolvesassessingthedollarvalueoftrainingbasedon:EstimatesofthedifferenceinjobperformancebetweentrainedanduntrainedemployeesThenumberofindividualstrainedThelengthoftimeatrainingprogramisexpectedtoinfluenceperformanceThevariabilityinjobperformanceintheuntrainedgroupofemployeesDeterminingReturnonInvestme35PracticalConsiderationsinDeterminingROITrainingprogramsbestsuitedforROIanalysis:HaveclearlyidentifiedoutcomesArenotone-timeeventsArehighlyvisibleinthecompanyArestrategicallyfocusedHaveeffectsthatcanbeisolatedPracticalConsiderationsinDe36PracticalConsiderationsinDeterminingROIShowingthelinkbetweentrainingandmarketsharegainorotherhigher-levelstrategicbusinessoutcomescanbeveryproblematicOutcomescanbeinfluencedbytoomanyotherfactorsnotdirectlyrelatedtotrainingBusinessunitsmaynotbecollectingthedataneededtoidentifytheROIoftrainingprogramsMeasurementoftrainingcanbeexpensivePracticalConsiderationsinDe37Table6.13-ExamplesofROI’sTable6.13-ExamplesofROI’s38SuccessCasesandReturnonExpectationsReturnonexpectations(ROE):

ProcessthroughwhichevaluationdemonstratestokeybusinessstakeholdersthattheirexpectationsabouttraininghavebeensatisfiedSuccesscases:ConcreteexamplesoftheimpactoftrainingthatshowhowlearninghasledtoresultsthatthecompanyfindsworthwhileSuccessCasesandReturnonEx39MeasuringHumanCapitalandTrainingActivityAmericanSocietyofTrainingandDevelopment(ASTD):ProvidesinformationabouttraininghoursanddeliverymethodsthatcompaniescanusetobenchmarkWorkforceanalytics:PracticeofusingquantitativemethodsandscientificmethodstoanalyzedatafromhumanresourcedatabasesandotherdatabasestoinfluenceimportantcompanymetricsMeasuringHumanCapitalandTr40MeasuringHumanCapitalandTrainingActivityDashboards:ComputerinterfacedesignedtoreceiveandanalyzethedatafromdepartmentswithinthecompanytoprovideinformationtomanagersandotherdecisionmakersUsefulbecausetheycanprovideavisualdisplayusingchartsoftherelationshipbetweenlearningactivitiesandbusinessperformancedataMeasuringHumanCapitalandTr41Table6.14-TrainingMetricsTable6.14-TrainingMetrics42TrainingEvaluationChapter6

TrainingEvaluation

43ObjectivesExplainwhyevaluationisimportantIdentifyandchooseoutcomestoevaluateatrainingprogramDiscusstheprocessusedtoplanandimplementagoodtrainingevaluationDiscussthestrengthsandweaknessesofdifferentevaluationdesignsObjectivesExplainwhyevaluati44ObjectivesChoosetheappropriateevaluationdesignbasedonthecharacteristicsofthecompanyandtheimportanceandpurposeofthetrainingConductacost-benefitanalysisforatrainingprogramExplaintheroleofworkforceanalyticsanddashboardsindeterminingthevalueoftrainingpracticesObjectivesChoosetheappropria45IntroductionTrainingeffectiveness:BenefitsthatthecompanyandthetraineesreceivefromtrainingTrainingoutcomesorcriteria:MeasuresthatthetrainerandthecompanyusetoevaluatetrainingprogramsIntroductionTrainingeffective46IntroductionTrainingevaluation:TheprocessofcollectingtheoutcomesneededtodetermineiftrainingiseffectiveEvaluationdesign:Collectionofinformation,includingwhom,what,when,andhow,fordeterminingtheeffectivenessofthetrainingprogramIntroductionTrainingevaluatio47ReasonsforEvaluatingTrainingCompaniesmakelargeinvestmentsintrainingandeducationandviewthemasastrategytobesuccessful;theyexpecttheoutcomesoftrainingtobemeasurableTrainingevaluationprovidesthedataneededtodemonstratethattrainingdoesprovidebenefitstothecompanyItinvolvesformativeandsummativeevaluationReasonsforEvaluatingTrainin48FormativeEvaluationTakesplaceduringprogramdesignanddevelopmentIthelpsensurethatthetrainingprogramiswellorganizedandrunssmoothlyTraineeslearnandaresatisfiedwiththeprogramItprovidesinformationabouthowtomaketheprogrambetter;itinvolvescollectingqualitativedataabouttheprogramPilottesting:ProcessofpreviewingthetrainingprogramwithpotentialtraineesandmanagersorwithothercustomersFormativeEvaluationTakesplac49SummativeEvaluationDeterminestheextenttowhichtraineeshavechangedasaresultofparticipatinginthetrainingprogramItmayincludemeasuringthemonetarybenefitsthatthecompanyreceivesfromtheprogram(ROI)ItinvolvescollectingquantitativedataSummativeEvaluationDetermines50SummativeEvaluationAtrainingprogramshouldbeevaluated:Toidentifytheprogram’sstrengthsandweaknessesToassesswhethercontent,organization,andadministrationoftheprogramcontributetolearningandtheuseoftrainingcontentonthejobToidentifywhichtraineesbenefitedmostorleastfromtheprogramSummativeEvaluationAtraining51SummativeEvaluationTogatherdatatoassistinmarketingtrainingprogramsTodeterminethefinancialbenefitsandcostsoftheprogramTocomparethecostsandbenefitsof:Trainingversusnon-traininginvestmentsDifferenttrainingprogramstochoosethebestprogramSummativeEvaluationTogather52Figure6.1-TheEvaluation

ProcessFigure6.1-TheEvaluation

Pr53Table6.1-EvaluationOutcomesTable6.1-EvaluationOutcome54Table6.1-EvaluationOutcomesTable6.1-EvaluationOutcome55OutcomesUsedintheEvaluationofTrainingProgramsReactionoutcomesItiscollectedattheprogram’sconclusionCognitiveoutcomesDeterminethedegreetowhichtraineesarefamiliarwiththeprinciples,techniques,andprocessesemphasizedinthetrainingprogramSkill-basedoutcomesTheextenttowhichtraineeshavelearnedskillscanbeevaluatedbyobservingtheirperformanceinworksamplessuchassimulatorsOutcomesUsedintheEvaluatio56OutcomesUsedintheEvaluationofTrainingProgramsAffectiveoutcomesIftraineeswereaskedabouttheirattitudesonasurvey,thatwouldbeconsideredalearningmeasureResults:Usedtodeterminethetrainingprogram’spayoffforthecompanyOutcomesUsedintheEvaluatio57OutcomesUsedintheEvaluationofTrainingProgramsReturnoninvestmentDirectcosts:Salariesandbenefitsforallemployeesinvolvedintraining;programmaterialandsupplies;equipmentorclassroomrentalsorpurchases;andtravelcostsIndirectcosts:Notrelateddirectlytothedesign,development,ordeliveryofthetrainingprogramBenefits:ValuethatthecompanygainsfromthetrainingprogramOutcomesUsedintheEvaluatio58OutcomesUsedintheEvaluationofTrainingProgramsTrainingQualityIndex(TQI):Computerapplicationthatcollectsdataabouttrainingdepartmentperformance,productivity,budget,andcourses,andallowsdetailedanalysisofthisdataQualityoftrainingisincludedintheeffectivenesscategoryOutcomesUsedintheEvaluatio59DeterminingWhetherOutcomesareAppropriateCriteriaRelevanceTheextenttowhichtrainingoutcomesarerelatedtothelearnedcapabilitiesemphasizedinthetrainingprogram.Criterioncontamination-theextentthattrainingoutcomesmeasureinappropriatecapabilitiesorareaffectedbyextraneousconditions.Criteriondeficiency-thefailuretomeasuretrainingoutcomesthatwereemphasizedinthetrainingobjectives.ReliabilityThedegreetowhichoutcomescanbemeasuredconsistentlyovertime.DiscriminationThedegreetowhichtrainees’performanceontheoutcomeactuallyreflectstruedifferencesinperformance.PracticalityTheeasewithwhichtheoutcomemeasurescanbecollected.DeterminingWhetherOutcomesa60Figure6.2-CriterionDeficiency,Relevance,andContaminationOutcomesMeasuredinEvaluationOutcomesIdentifiedbyNeedsAssessmentandIncludedinTrainingObjectivesOutcomesRelatedtoTrainingObjectivesContaminationRelevanceDeficiencyFigure6.2-CriterionDeficie61EvaluationPracticesItisimportanttorecognizethelimitationsofchoosingtomeasureonlyreactionandcognitiveoutcomesToensureanadequatetrainingevaluation,companiesmustcollectoutcomemeasuresrelatedtobothlearningandtransferEvaluationPracticesItisimpo62Figure6.3-TrainingEvaluationPracticesOutcomesPercentageofCompaniesUsingOutcomeFigure6.3-TrainingEvaluati63Figure6.4-TrainingProgramObjectivesandTheirImplicationsforEvaluationFigure6.4-TrainingProgram64EvaluationDesignsThreatstovalidity:Factorsthatwillleadanevaluatortoquestioneitherthe:Internalvalidity:ThebelievabilityofthestudyresultsExternalvalidity:TheextenttowhichtheevaluationresultsaregeneralizabletoothergroupsoftraineesandsituationsEvaluationDesignsThreatstov65Table6.6-ThreatstoValidityTable6.6-ThreatstoValidit66MethodstoControlforThreatstoValidityPretestsandpost-tests:Comparisonofthepost-trainingandpretrainingmeasurescanindicatethedegreetowhichtraineeshavechangedasaresultoftrainingUseofcomparisongroups:GroupofemployeeswhoparticipateintheevaluationstudybutdonotattendthetrainingprogramHawthorneeffectMethodstoControlforThreats67MethodstoControlforThreatstoValidityRandomassignment:AssigningemployeestothetrainingorcomparisongrouponthebasisofchancealoneItisoftenimpracticalAnalysisofcovarianceMethodstoControlforThreats68TypesofEvaluationDesignsPost-testonly:Onlypost-trainingoutcomesarecollectedAppropriatewhentraineescanbeexpectedtohavesimilarlevelsofknowledge,behavior,orresultsoutcomespriortotrainingPretest/post-test:Pretrainingandpost-trainingoutcomemeasuresarecollectedUsedbycompaniesthatwanttoevaluateatrainingprogrambutareuncomfortablewithexcludingcertainemployeesTypesofEvaluationDesignsPos69Table6.7ComparisonofEvaluationDesignsTable6.7ComparisonofEvalua70TypesofEvaluationDesignsPretest/post-testwithcomparisongroup:IncludestraineesandacomparisongroupDifferencesbetweeneachofthetrainingconditionsandthecomparisongroupareanalyzeddeterminingwhetherdifferencesbetweenthegroupswerecausedbytrainingTypesofEvaluationDesignsPre71TypesofEvaluationDesignsTimeseries:TrainingoutcomesarecollectedatperiodicintervalsbothbeforeandaftertrainingItallowsananalysisofthestabilityoftrainingoutcomesovertimeReversal:TimeperiodinwhichparticipantsnolongerreceivethetraininginterventionSolomonfour-group:Combinesthepretest/post-testcomparisongroupandthepost-test-onlycontrolgroupdesignThisdesigncontrolsformostthreatstointernalandexternalvalidityTypesofEvaluationDesignsTim72Table6.10-FactorsthatInfluencetheTypeofEvaluationDesignTable6.10-FactorsthatInfl73DeterminingReturnonInvestmentCost-benefitanalysis:ProcessofdeterminingtheeconomicbenefitsofatrainingprogramusingaccountingmethodsthatlookattrainingcostsandbenefitsROIshouldbelimitedonlytocertaintrainingprograms,becauseitcanbecostlyDeterminingcostsMethodsforcomparingcostsofalternativetrainingprogramsincludetheresourcerequirementsmodelandaccountingDeterminingReturnonInvestme74DeterminingReturnonInvestmentDeterminingbenefits–Methodsinclude:Technical,academic,andpractitionerliteraturePilottrainingprogramsandobservanceofsuccessfuljobperformersObservanceofsuccessfuljobperformersEstimatesbytraineesandtheirmanagersTocalculateROIIdentifyoutcomesPlaceavalueontheoutcomesDeterminethechangeinperformanceaftereliminatingotherpotentialinfluencesontrainingresultsObtainanannualamountofbenefitsDeterminethetrainingcostsCalculatethetotalbenefitsbysubtractingthetrainingcostsfrombenefits(operationalresults)CalculatetheROIbydividingoperationalresultsbycostsTheROIgivesanestimateofthedollarreturnexpectedfromeachdollarinvestedintrainingDeterminingReturnonInvestme75Table6.11-DeterminingCostsforaCostBenefitAnalys

温馨提示

  • 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
  • 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
  • 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
  • 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
  • 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
  • 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
  • 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。

评论

0/150

提交评论