![大数据数据挖掘培训讲义机器学习,发现模式_第1页](http://file4.renrendoc.com/view/9676ac2452396edce96e08fae5faa24d/9676ac2452396edce96e08fae5faa24d1.gif)
![大数据数据挖掘培训讲义机器学习,发现模式_第2页](http://file4.renrendoc.com/view/9676ac2452396edce96e08fae5faa24d/9676ac2452396edce96e08fae5faa24d2.gif)
![大数据数据挖掘培训讲义机器学习,发现模式_第3页](http://file4.renrendoc.com/view/9676ac2452396edce96e08fae5faa24d/9676ac2452396edce96e08fae5faa24d3.gif)
![大数据数据挖掘培训讲义机器学习,发现模式_第4页](http://file4.renrendoc.com/view/9676ac2452396edce96e08fae5faa24d/9676ac2452396edce96e08fae5faa24d4.gif)
![大数据数据挖掘培训讲义机器学习,发现模式_第5页](http://file4.renrendoc.com/view/9676ac2452396edce96e08fae5faa24d/9676ac2452396edce96e08fae5faa24d5.gif)
版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
MachineLearning:
findingpatternsOutlineMachinelearningandClassificationExamples*LearningasSearchBiasWeka2FindingpatternsGoal:programsthatdetectpatternsandregularitiesinthedataStrongpatternsgoodpredictionsProblem1:mostpatternsarenotinterestingProblem2:patternsmaybeinexact(or spurious)Problem3:datamaybegarbledormissing3MachinelearningtechniquesAlgorithmsforacquiringstructuraldescriptionsfromexamplesStructuraldescriptionsrepresentpatternsexplicitlyCanbeusedtopredictoutcomeinnewsituationCanbeusedtounderstandandexplainhowpredictionisderived
(maybeevenmoreimportant)Methodsoriginatefromartificialintelligence,statistics,andresearchondatabaseswitten&eibe4Canmachinesreallylearn?Definitionsof“learning”fromdictionary:Togetknowledgeofbystudy,
experience,orbeingtaughtTobecomeawarebyinformationor
fromobservationTocommittomemoryTobeinformedof,ascertain;toreceiveinstructionDifficulttomeasureTrivialforcomputersThingslearnwhentheychangetheirbehaviorinawaythatmakesthemperformbetterinthefuture.Operationaldefinition:Doesaslipperlearn?Doeslearningimplyintention?witten&eibe5ClassificationLearnamethodforpredictingtheinstanceclassfrompre-labeled(classified)instancesManyapproaches:Regression,DecisionTrees,Bayesian,NeuralNetworks,...Givenasetofpointsfromclasseswhatistheclassofnewpoint?6Classification:LinearRegressionLinearRegressionw0+w1x+w2y>=0Regressioncomputeswifromdatatominimizesquarederrorto‘fit’thedataNotflexibleenough7Classification:DecisionTreesXYifX>5thenblueelseifY>3thenblueelseifX>2thengreenelseblue5238Classification:NeuralNetsCanselectmorecomplexregionsCanbemoreaccurateAlsocanoverfitthedata–findpatternsinrandomnoise9OutlineMachinelearningandClassificationExamples*LearningasSearchBiasWeka10TheweatherproblemOutlookTemperatureHumidityWindyPlaysunnyhothighfalsenosunnyhothightruenoovercasthothighfalseyesrainymildhighfalseyesrainymildnormalfalseyesrainymildnormaltruenoovercastmildnormaltrueyessunnymildhighfalsenosunnymildnormalfalseyesrainymildnormalfalseyessunnymildnormaltrueyesovercastmildhightrueyesovercasthotnormalfalseyesrainymildhightruenoGivenpastdata,CanyoucomeupwiththerulesforPlay/NotPlay?Whatisthegame?11The
weatherproblemGiventhisdata,whataretherulesforplay/notplay?OutlookTemperatureHumidityWindyPlaySunnyHotHighFalseNoSunnyHotHighTrueNoOvercastHotHighFalseYesRainyMildNormalFalseYes……………12The
weatherproblemConditionsforplayingOutlookTemperatureHumidityWindyPlaySunnyHotHighFalseNoSunnyHotHighTrueNoOvercastHotHighFalseYesRainyMildNormalFalseYes……………Ifoutlook=sunnyandhumidity=highthenplay=noIfoutlook=rainyandwindy=truethenplay=noIfoutlook=overcastthenplay=yesIfhumidity=normalthenplay=yesIfnoneoftheabovethenplay=yeswitten&eibe13WeatherdatawithmixedattributesOutlookTemperatureHumidityWindyPlaysunny8585falsenosunny8090truenoovercast8386falseyesrainy7096falseyesrainy6880falseyesrainy6570truenoovercast6465trueyessunny7295falsenosunny6970falseyesrainy7580falseyessunny7570trueyesovercast7290trueyesovercast8175falseyesrainy7191trueno14WeatherdatawithmixedattributesHowwilltheruleschangewhensomeattributeshavenumericvalues?OutlookTemperatureHumidityWindyPlaySunny8585FalseNoSunny8090TrueNoOvercast8386FalseYesRainy7580FalseYes……………15WeatherdatawithmixedattributesRuleswithmixedattributesOutlookTemperatureHumidityWindyPlaySunny8585FalseNoSunny8090TrueNoOvercast8386FalseYesRainy7580FalseYes……………Ifoutlook=sunnyandhumidity>83thenplay=noIfoutlook=rainyandwindy=truethenplay=noIfoutlook=overcastthenplay=yesIfhumidity<85thenplay=yesIfnoneoftheabovethenplay=yeswitten&eibe16ThecontactlensesdataAgeSpectacleprescriptionAstigmatismTearproductionrateRecommendedlensesYoungMyopeNoReducedNoneYoungMyopeNoNormalSoftYoungMyopeYesReducedNoneYoungMyopeYesNormalHardYoungHypermetropeNoReducedNoneYoungHypermetropeNoNormalSoftYoungHypermetropeYesReducedNoneYoungHypermetropeYesNormalhardPre-presbyopicMyopeNoReducedNonePre-presbyopicMyopeNoNormalSoftPre-presbyopicMyopeYesReducedNonePre-presbyopicMyopeYesNormalHardPre-presbyopicHypermetropeNoReducedNonePre-presbyopicHypermetropeNoNormalSoftPre-presbyopicHypermetropeYesReducedNonePre-presbyopicHypermetropeYesNormalNonePresbyopicMyopeNoReducedNonePresbyopicMyopeNoNormalNonePresbyopicMyopeYesReducedNonePresbyopicMyopeYesNormalHardPresbyopicHypermetropeNoReducedNonePresbyopicHypermetropeNoNormalSoftPresbyopicHypermetropeYesReducedNonePresbyopicHypermetropeYesNormalNonewitten&eibe17AcompleteandcorrectrulesetIftearproductionrate=reducedthenrecommendation=noneIfage=youngandastigmatic=no
andtearproductionrate=normalthenrecommendation=softIfage=pre-presbyopicandastigmatic=no
andtearproductionrate=normalthenrecommendation=softIfage=presbyopicandspectacleprescription=myope
andastigmatic=nothenrecommendation=noneIfspectacleprescription=hypermetropeandastigmatic=no
andtearproductionrate=normalthenrecommendation=softIfspectacleprescription=myopeandastigmatic=yes
andtearproductionrate=normalthenrecommendation=hardIfageyoungandastigmatic=yes
andtearproductionrate=normalthenrecommendation=hardIfage=pre-presbyopic
andspectacleprescription=hypermetrope
andastigmatic=yesthenrecommendation=noneIfage=presbyopicandspectacleprescription=hypermetrope
andastigmatic=yesthenrecommendation=nonewitten&eibe18Adecisiontreeforthisproblemwitten&eibe19ClassifyingirisflowersSepallengthSepalwidthPetallengthPetalwidthType0.2Irissetosa24.93.01.40.2Irissetosa…517.0Irisversicolor51.5Irisversicolor…102.5Irisvirginica101.9Irisvirginica…Ifpetallength<2.45thenIrissetosaIfsepalwidth<2.10thenIrisversicolor...witten&eibe20Example:209differentcomputerconfigurationsLinearregressionfunctionPredictingCPUperformanceCycletime(ns)Mainmemory(Kb)Cache(Kb)ChannelsPerformanceMYCTMMINMMAXCACHCHMINCHMAXPRP112525660002561612819822980003200032832269…20848051280003200672094801000400000045PRP= -55.9+0.0489MYCT+0.0153MMIN+0.0056MMAX
+0.6410CACH-0.2700CHMIN+1.480CHMAXwitten&eibe21SoybeanclassificationAttributeNumberofvaluesSamplevalueEnvironmentTimeofoccurrence7JulyPrecipitation3Abovenormal…SeedCondition2NormalMoldgrowth2Absent…FruitConditionoffruitpods4NormalFruitspots5?LeavesCondition2AbnormalLeafspotsize3?…StemCondition2AbnormalStemlodging2Yes…RootsCondition3NormalDiagnosis19Diaporthestemcankerwitten&eibe22TheroleofdomainknowledgeIfleafconditionisnormal
andstemconditionisabnormal
andstemcankersisbelowsoilline
andcankerlesioncolorisbrownthen
diagnosisisrhizoctoniarootrotIfleafmalformationisabsent
andstemconditionisabnormal
andstemcankersisbelowsoilline
andcankerlesioncolorisbrownthen
diagnosisisrhizoctoniarootrotButinthisdomain,“leafconditionisnormal”implies
“leafmalformationisabsent”!witten&eibe23OutlineMachinelearningandClassificationExamples*LearningasSearch
BiasWeka24LearningassearchInductivelearning:findaconceptdescriptionthatfitsthedataExample:rulesetsasdescriptionlanguageEnormous,butfinite,searchspaceSimplesolution:enumeratetheconceptspaceeliminatedescriptionsthatdonotfitexamplessurvivingdescriptionscontaintargetconceptwitten&eibe25EnumeratingtheconceptspaceSearchspaceforweatherproblem4x4x3x3x2=288possiblecombinationsWith14rules2.7x1034possiblerulesetsSolution:candidate-eliminationalgorithmOtherpracticalproblems:MorethanonedescriptionmaysurviveNodescriptionmaysurviveLanguageisunabletodescribetargetconceptordatacontainsnoisewitten&eibe26TheversionspaceSpaceofconsistentconceptdescriptionsCompletelydeterminedbytwosetsL:mostspecificdescriptionsthatcoverallpositiveexamplesandnonegativeonesG:mostgeneraldescriptionsthatdonotcoveranynegativeexamplesandallpositiveonesOnlyLandGneedbemaintainedandupdatedBut:stillcomputationallyveryexpensiveAnd:doesnotsolveotherpracticalproblemswitten&eibe27*Versionspaceexample,1Given:redorgreencowsorchicken
Startwith: L={} G={<*,*>}Firstexample:<green,cow>:positive
HowdoesthischangeLandG?witten&eibe28*Versionspaceexample,2Given:redorgreencowsorchicken
Result: L={<green,cow>} G={<*,*>}Secondexample:<red,chicken>:negativewitten&eibe29*Versionspaceexample,3Given:redorgreencowsorchicken
Result: L={<green,cow>} G={<green,*>,<*,cow>}Finalexample:<green,chicken>:positive
witten&eibe30*Versionspaceexample,4Given:redorgreencowsorchicken
Resultantversionspace: L={<green,*>} G={<green,*>}witten&eibe31*Versionspaceexample,5Given:redorgreencowsorchicken
L={} G={<*,*>}<green,cow>:positive L={<green,cow>} G={<*,*>}<red,chicken>:negative L={<green,cow>} G={<green,*>,<*,cow>}<green,chicken>:positive L={<green,*>} G={<green,*>}witten&eibe32*Candidate-eliminationalgorithmInitializeLandGForeachexamplee: Ifeispositive: DeleteallelementsfromGthatdonotcovere
ForeachelementrinLthatdoesnotcovere: Replacerbyallofitsmostspecificgeneralizations
that 1.covereand 2.aremorespecificthansomeelementinG RemoveelementsfromLthat
aremoregeneralthansomeotherelementinL Ifeis
negative: DeleteallelementsfromLthatcovere
ForeachelementrinGthatcoverse:
Replacerbyallofitsmostgeneralspecializations
that 1.donotcovereand
2.aremoregeneralthansomeelementinL
RemoveelementsfromGthat
aremorespecificthansomeotherelementinGwitten&eibe33OutlineMachinelearningandClassificationExamples*LearningasSearchBiasWeka34BiasImportantdecisionsinlearningsystems:ConceptdescriptionlanguageOrderinwhicht
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 2025至2031年中国太阳能交通灯行业投资前景及策略咨询研究报告
- 2025年吸尘器滚轮地刷项目可行性研究报告
- 2025年包装热收缩膜项目可行性研究报告
- 2025年五色石子项目可行性研究报告
- 2025至2030年鳕鱼保鲜剂项目投资价值分析报告
- 2025至2030年中国送布轮数据监测研究报告
- 2025至2030年草艺品手把项目投资价值分析报告
- 2025至2030年电动伺服阀项目投资价值分析报告
- 2025至2030年中国臂挂式高速球摄像机数据监测研究报告
- 2025至2030年无油高速涡轮牙钻机项目投资价值分析报告
- 2022年菏泽医学专科学校单招综合素质考试笔试试题及答案解析
- 市政工程设施养护维修估算指标
- 中国古代文学史 建安文学与正始文学
- 课堂嵌入式评价及其应用
- 《管理学基础》完整版课件全套ppt教程(最新)
- 短视频:策划+拍摄+制作+运营课件(完整版)
- 基金会财务报表审计指引
- 蓝色卡通风好书推荐教育PPT模板
- 2022年江苏省泰州市中考数学试题及答案解析
- 石家庄铁道大学四方学院毕业设计46
- 智能化系统培训
评论
0/150
提交评论