大数据系统核心技术

ACMFellow、IEEEETInternationalSymbiotictrendbetweenbigdataandbigGartnerHypeCycleandBigThisHypeCyclesitsmainlyonthePeakofInflatedExpectations.Andbig-datahasjustpassedtheWeencouragedepartment-levelexperimentationwithoutenterprisecommitmentoverthenextthreetofiveyears.ChallengesandSymbioticofBigdataandBigSymbioticHPCcomputinganddata-IntensiveHeterogeneity:includingsensors,controllers,mobiledevices,etc.MassiveopportunityofVastdynamicanddistributed[Supercomputing2014SymbiotictrendbetweenbigdataandbigSymbiotictrendbetweenbigdataandbig模型和结构模型和结构模型和优化ParallelModelofParallelModelsforAlgorithmParallelModelsforSystemExecutionExecutionModelProgrammingEnvironment ExecutionAbstractMachineExecution SoftwarepackagesProgramlibrariesUtilityapplicationsHigh-LevelProgrammingSoftwarepackagesProgramlibrariesUtilityapplicationsHigh-LevelProgrammingAPI(MPI,OpenMP,CnC,Xio,Chapel,etc.)LanguageExecutionModelLanguageExecutionModelExecutionMachineRuntime SoftwarepackagesProgramlibrariesUtilityapplicationsHigh-LevelProgrammingSoftwarepackagesProgramlibrariesUtilityapplicationsHigh-LevelProgrammingAPI(MPI,OpenMP,CnC,Xio,Chapel,etc.)LanguageLanguageExecution

理、故障AMD12AMD12Intel8Intel8

BSP

题:

软件总体设计和工程实现-成三、研发超并行执行模型数据流为背景的引擎执行模型（odeles)重大研发课题（-SymbiotictrendbetweenbigdataandbigInspiredalltheInspiredallthemajorplayersindataflowduringseventiesandeighties,includingKimGostelowandI@UCIrvine[ByArvind:ISCA2006GeneralpurposeparallelmachinesbasedonadataflowgraphmodelofcomputationEvolutionofMultithreadedExecutionandArchitectureModels CDC

B.Cosmic

B.J-

Others:Multiscalar(1994),SMT(1995),Dennis1972

MITmodelmodel

&Culler

Nikhil&

Gaoet.

APoolCoarse-Grainthread-Thefamilyhomemodel

Fine-Grainnon-preemptiveThe“hotel”Coarse-Grainvs.Fine-Grain[Gao:invitedtalkatFranAllen’sRetirementWorkshop, 管道不断