机器学习简介-课件

机器学习简介OutlineWhatismachinelearning(ML)TypesofmachinelearningWorkflowPopularmodelsApplicationsFuturesWhatismachinelearningTrainingset(labelsknown)Testset(labelsunknown)f()=“apple”f()=“tomato”f()=“cow”WhatismachinelearningDefinitionMachinelearningreferstoasystemcapableoftheautonomousacquisitionandintegrationofknowledgeMachinelearningisprogrammingcomputerstooptimizeaperformancecriterionusingexampledataorpastexperienceComputerDataAlgorithmProgramKnowledgeKnowledge(new)WhatismachinelearningEverymachinelearningalgorithmhasthreecomponentsRepresentationModel(rules,statistics,instance;logic,KNN,SVM,DNN,…)EvaluationPerformance(accuracy,mse,energy,entropy,…)OptimizationParametersCombinatorialoptimizationConvexoptimizationConstrainedoptimizationTypesofmachinelearningSupervisedlearningTrainingdataincludesdesiredoutputsUnsupervisedlearningTrainingdatadoesnotincludedesiredoutputsSemi-supervisedlearningTrainingdataincludesafewdesiredoutputsReinforcementlearningRewardsfromsequenceofactionsTypesofmachinelearningSupervisedlearningClassification:discreteoutputRegression:continuousoutputBias-variance大家应该也有点累了，稍作休息大家有疑问的，可以询问和交流8TrainingandValidationDataFullDataSetTrainingDataValidationDataIdea:traineachmodelonthe“trainingdata”andthentesteachmodel’saccuracyonthevalidationdataUnderfitting&OverfittingPredictiveErrorModelComplexityErroronTrainingDataErroronTestDataIdealRangeforModelComplexityOverfittingUnderfittingTypesofmachinelearningUnsupervisedlearningClusteringDimensionalityreductionFactoranalysisTypesofmachinelearningSemi-supervisedlearningClusteringorclassificationTypesofmachinelearningReinforcementlearningRobot&controlWorkflowPredictionTrainingLabelsTrainingTrainingImageFeaturesImageFeaturesTestingTestImageLearnedmodelLearnedmodelSlidecredit:D.HoiemandL.LazebnikWorkflowFeaturesWorkflowModelsLogic,RulesStatistical,BlackboxmodelStatic,dynamicmodelOnlinelearningEnsemblelearningWorkflowArchitectureModelFeatureHardwarePopularmodelsLinearmodel:logisticregression,lineardiscriminantanalysis,linearregression(withbasisfunction)PopularmodelsNearestneighborFeature&distancePopularmodelsSupportvectormachinePopularmodelsArtificialneuralnetworkPopularmodelsDecisiontreePopularmodelsCollaborativefilteringPopularmodelsHierarchicalclusteringK-meansSpectralclusteringManifoldlearningPopularmodelsHiddenmarkovmodelConditionalrandomfieldsApplicationsApplicationsApplicationsApplicationsApplicationsApplicationsApplicationsApplicationsApplicationsAttentionApplicationsImageclassificationApplicationsApplicationsBrainmachineinterfaceApplicationsApplicationsApplicationsApplicationsApplication