人工智能进阶复旦计算机学院

人工智能进阶维数约稀疏学概率图模大数生物认互联网/移动视觉搜多生物信息精准医维数内在维可视计算效

Ci Mi(Copiedfrom1主主成分分析---最大化方奇异值分析ICA[Hyvarneneta,2LDA（线性判别分析X -vaaSw( LDA（线性判别分析X -vaaSw( µi)(x µi)i=1x2!Bewee-vaaSB Ni( i=1ObecJ(W)DmesoeducSBwSw3[H.S.Seung&D.D.Lee.[Teebaumea,[RowesadSau,可解释计算有效示例：平移人等度规映射等度规映射[Tenenbaumeta.,S Gveaegbooodsze$k$,compuepawsedsaceeacpoadsegbogpos（设定邻域Sep2CompueGeodescdsacebeweefa-awayposbyuzggapdsace（计算图上的测地线距离）Sep3EmpoyMudmesoascagocacuaesow-dmesoasubspace（利用多元尺度来计算 4LocayLnearEmbeddng[RowesandSau,实际效果LocayLnearEmbeddng[RowesandSau,实际效果维数约维数约稀疏学概率图模深度学优化技Occam‘srazor压缩传感压缩传感(CompressveSens6特征组合---Lasso/LARSL1Normˆ=argmin|yXX|特征组合---Lasso/LARSL1Normˆ=argmin|yXX|2 2||2 1|| 3B (x x稀疏 稀疏 特征表达(部件)非负矩阵分解[SeugadLee,深度学习简介HebbDBN(DeepBeliefMultimodal维数深度学习简介HebbDBN(DeepBeliefMultimodal维数约稀疏学概率图模深度学HoraceBasilHoraceBasilBarlowBalow体。donthavemuchtmetoreadpapersanymore,evenwhenmdonthavemuchtmetoreadpapersanymore,evenwhenmstedasacoauthorGeoffHintonisalivinglegend.Healmostsingle-handedlyinventedbackpropagationfortrainingfeed-forwardneuralnetworks.ProfessorHintonrespondedbycreatingdeepnetworksanddeeplearning,anultimateformofmachinelearningRestrctedRestrctedBotzmannMachne(RBM)-浅SVMSupportVectorMachines/最大熵方法（如LR,Logistic•Hinton,Science,卷积神经网络（卷积神经网络（LeNet-5,LeCunYan,Y.LeCun,L.Bottou,Y.Bengio,andP.Haffner.Gradient-basedlearningappliedtoRecognition.ProceedingsoftheIEEE,Nov.1998.2012-A非线性激活函数：防过拟合：Dopou2012-A非线性激活函数：防过拟合：Dopou数据增引入max-poog技大数据训练202mageNe比赛第一双GUNVDAGTX580显著减少训练Knzhevsky,Alx,IlyaSutskever,andGeoffreyE.Hinton,Imagenetclassificationwithdeepconvolutionalneuralnetworks,NIPS,2012InfectInfectonLSTM(Long-ShortTermLSTM(Long-ShortTerm成功的原因之一(ICLR2017最 过拟合但却能让测试误差继续降模型复杂度的定义需要重新思(GeoffreyHnton,⽣物神经元不可能进⾏数值