知识图谱 概念与技术 第8章:知识图谱管理系统_第1页
知识图谱 概念与技术 第8章:知识图谱管理系统_第2页
知识图谱 概念与技术 第8章:知识图谱管理系统_第3页
知识图谱 概念与技术 第8章:知识图谱管理系统_第4页
知识图谱 概念与技术 第8章:知识图谱管理系统_第5页
已阅读5页,还剩114页未读 继续免费阅读

下载本文档

版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领

文档简介

《知识图谱:概念与技术》软亚洲研究院KnowledgeGraphServingSystems123...TomCruiseAdmitsKatieHolmesDivorcedHim123...TomCruiseAdmitsKatieHolmesDivorcedHimToProtectSuriFromScientologyAANewsHeadlineTomCruise–people.person.marriage–(marriage)–time.event.person–KatieHolmesTomCruise–people.person.children–(SuriCruise)–people.person.parent–KatieHolmesmCruisefilmactorfilmBambiVerleihungfilmfilmactorKatieHolmes44ityBoverthehiddenrelationsbetweenentitiesEnablemorethanwhatentityindexescansupport•inthescaleofterabytes•Complexdataschema•Richrelations•Inthescaleof•Inthescaleofterabytes“Pal”•Complexdataschema•Richrelations•Multi-typedentities123mso/“Pal”123mso/type.object.typemso/organism.dog123mso/organism.dog.breeds“CollieRough”123mso/type.object.typemso/film.actor123mso/film.actor.film789789mso/type.object.typemso/film.film789mso/“LassieComeHome”Disk-basedKey-valueStoreColumnStoreDocumentStoreTypicalRDBMSGraphSystemSQLComfortZoneTypicalRDBMSDisk-basedKey-valueStoreColumnStoreDocumentStoreTypicalRDBMSDisk-basedKey-valueStoreColumnStoreDocumentStoreSQLComfortZoneGraphSystem•Randomaccess(PoorLocality)•Foranode,itsadjacentnodescannotbeaccessedwithout“jumping”nomatter•Notcache-friendly,datareuseishard•Itishardtopartitiondata•Difficulttoextractparallelismbypartitioningdata•Hardtogetanefficient“DivideandConquer”solution•Datadriven•thestructureofcomputationsisnotknownapriori•Highdataaccesstocomputationratioeanalyticsorbothtime•Onlinequeriesaresensitivetolatencyesspatternsofagraphquery nesidedeoutorscaleupnesidedeoutorscaleupRDBMS,MapReduce1…2…3…4…5…6…………132421431516……WHEREEsrc1;… …… ……nesidedeoutorscaleupIndex-basedsubgraphmatching[SunVLDB2012]Index-basedsubgraphmatching[SunVLDB2012]dvsonesidedeoutorscaleup““telephone”……“email”nesidedScaleoutorscaleup•Programmingmodelsimpleandefficient•sharedmemoryaddressspace•Expensive•Hardwareisyourultimatelimit•Programmingmodeliscomplex•Relativelycheaperandcanmakeuseofcommoditypc•FlexibletomeetvariousneedsPnesidedeoutorscaleupconsistencyguarantee•Thehellofreferentialintegrity•Thedisasterofcascadingrollbackrcommitfordistributedtransactions … …… … … …ionesanyoftheselocks,abort.Rollback… =38,729=38,729,054SourceThedatacenterasacomputerbook)eachdiskseekeachdiskseekread10ms38387,290,540msRAMlatencynsdond338,729,054nodestoaccess,ittakesatleast38seconds.edsynchronousasynchronousedsynchronousasynchronousthmsSourceThedatacenterasacomputerbook)ssmartoneswritebetterprograms……ssmartoneswritebetterprogramsHopMsg#Node#permachinedndn2n2d2n3n3nnnistheservercountedegreefilmactorfilmactorExternalStorageitntomultiplebasicunitqueriesandjointhelelontheflybcG1a1a2a1d1b1b1bcG1a1a2a1d1b1b1abedfdabedfdabcedfbbfacdsicunitwhichoneisthebestabedfdabedfdabcedfbbfacdsicunitwhichoneisthebestabcedfabedfItatmostneedstocrossthesicunitwhichoneisthebesta2cqdbbq4dfea2cqdbbq4dfe1qa1cbc3qb3fefa2cqdbb1efq'abdfeq'2acq4dfea2cqdbb1efq'abdfeq'2acq4dfe1qa1cbcqf3beqfcomposition•RDBMS•MapReduceSystems•PageRank,FlockDBayleylGiraphGraphLabGraphChiGraphXPropertygraphsOnlinequeryshardingIn-memorystorageAtomicity&Transactionan•AndrewLumsdaine,DouglasGregor,BruceHendrickson,JonathanBerry.Challengesinparallelgraphprocessing.ParallelProcessingLetters2007.2013.•LuizAndréBarroso,UrsHoelzle.Thedatacenterasacomputer:Anintroductiontothedesignofwarehouse-scalemachines.2009.•GrzegorzMalewicz,MatthewH.Austern,AartJ.C.Bik,JamesC.Dehnert,IlanHorn,NatyLeiser,GrzegorzCzajkowski.Pregel:asystemforlarge-scalegraphprocessing.SIGMOD2010.•AapoKyrola,GuyBlelloch,CarlosGuestrin.GraphChi:Large-scalegraphcomputationonjustaPC.OSDI2012.•ZhaoSun,HongzhiWang,HaixunWang,BinShao,andJianzhongLi.Efficientsubgraphmatchingonbilli

温馨提示

  • 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
  • 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
  • 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
  • 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
  • 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
  • 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
  • 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。

评论

0/150

提交评论