物联网大数据的高效处理

1、$ $+$ ; fi fifi fl (fl % fi )yfl $ fifi TAOS Data, Inc. All rights reserved.fl flfi73fi;/).:,flfi/fifl,fifi)fl, fi4OSIsoft PIfifiP, $S=).O,7fi I:flscale upfifid.,$=cfi,4EDfl windowsS fl(Aa,/7(Paa fl fl $;$,yflC %, fl(fifl3D$,yfl*# TAOS Data, Inc. All rights reserved.egdKafka, Redis, Hbase, Mon,oD ,

2、Cassandra, ES, Hadoop, Spark,Zookeeper3$nfiflfl,fi$=fanfl ;ecZfifi,_fifirx g5:b,g5mKzflfifi,JnifiEfi _ fifirxR6,dWfiB,HRfi,fififl;i$f $ofiMnkfi=fofiMn, oDiwflA,fifidbfl$;fi Zflfifi,n flfifi$C,flfiB $ fl,Nfl s,i EpSZfi,Ky,fi rfl $ : . TAOS Data, Inc. All rights reserved. . fl#%$;P+%+%Afifl ;PA+9%0+$0

3、,$O*fl+D%224O.244.6 fifi:03 ;P+M$,$ 1;fi:+fifi*flfi,F*flfiI+3M:, fifi=fi+$fifiC 3 fi*fl+;%;N; %fi+M$,$+M 1003 TAOS Data, Inc. All rights reserved.12345678916TDengine TAOS Data, Inc. All rights reserved. flfi( flfi&fl $, fifi fi fl fl,fl fl, fl / 3fifi%fi :3 fi% $ fi0 . ,$ TDenginefl TAOS Data, Inc.

4、All rights reserved. Dengine fi;$ 3fifi ; yflflSQLfl fifi fl y $ TDengine TAOS Data, Inc. All rights reserved. Dengine Shell: Command Line InterfaceVisualization ToolGrafanaTDengine Python/Matlab/R Analytics, ML Applications IoT ApplicationJava/C/C+/RestfulTelegrafKafkaOPCData HubMQTT ServerWeb Base

5、d Management ToolTime-series Data Processing EngineClustered TAOS Data, Inc. All rights reserved.;$0 A flfi/fi/ %fi/# $/%$/./fl 34$ -&$Aflfl fl7 -&$#/#fl flfi -& TAOS Data, Inc. All rights reserved.CNCfi fl $MQTT(erver18 $: fiMySQL,1fi 220 fiCNCCNCCNCCNCfi 9 % TDengine= QApp (*E-)L)Mobie AppApp ( y.

6、flA$) Nfl,$8 #M.fi AS #fiTETL TAOS Data, Inc. All rights reserved.$ $%:CDH LZO fi :44.3%TDengine fi :3.34%TDengine fl fl yflfifiCDH TAOS Data, Inc. All rights reserved. IDC GrafanaTelegrafCPURAMNETNGXDB TelegrafCPURAMNET NGX DB Telegraf+T engine+Grafana :!fi %+ IT TDengine TAOS Data, Inc. All rights

7、 reserved. $TgCIMfiflTDengine! $ yfl $fifi3 fifi fi fififi fifi fifi flfifi TAOS Data, Inc. All rights reserved.TDengine $ TAOS Data, Inc. All rights reserved.C C+JavaIPython Client A#RES+ APIClient A#SPARKHadoopA#MeterC;HDDBA +ool flBEMeterC;HD+Den/ine Cluster Dengine fi$# TAOS Data, Inc. All right

8、s reserved.EDBAI,$dTDengine TDenginenc,;ARA$PfiY$ HMCARA P;oJ)e;$ HTTPS L$ TAOSE SDKvB|oTDengine$xzrflt, E nR o ;fl)%u;fim 3$hLqTDengineRflSPA,KH/doop3$oK flyfipfiP,TKflI$ Dengine fi$#TDengineE O h C/C+,MyS+Lfi,gkTvsdPPQ, J/v/,Python 3 , API fl%$TDengineE,EST API, fi,a SdP TAOS Data, Inc. All rights

9、 reserved. Dengine fifl$ TAOS Data, Inc. All rights reserved.$; &8-e/fl, flCPUfifl fl =, flA;A fiWa: e/;Aa ; fl fl2fl,fle/MM,.$tfiMfl) %O;ALa flflA;Ae/;A fifl e/M;A,e/;A$e/;AMP&, fififi $; Q.$flA;ATL;S#M, .$Meta ata AafifizIfifl $ flA;AfiC e/A; A,fiDfl e/A;A, fififi Dengine fifl$ TAOS Data, Inc. All

10、 rights reserved. Dengine $ flfi $fi3fifi, fi 6$fl ;A) fl ;Afl fl#,flz fifi0);A4 ,fifizfi)fi! fl. * TAOS Data, Inc. All rights reserved. Dengine 3appvnodemnode1: insert2: get meta-data3: response4: insert5: ack6: acktaosc TAOS Data, Inc. All rights reserved.= ;A /flfi/fl$ fi E $8fl ,Oflfifl 4%DC,fi$

11、 / Afl%Hfl,Tfi$ !fl Q ,fl,/Z Q %P.A/,)DC%fi &fiM,= /,$_/C; fl fl ;3,fl.Afi !fl /, );Afi($fl/%fl fl /fl$,Jfl%fi$ /fl Dengine fl$ TAOS Data, Inc. All rights reserved.$KV-$T#DB,fl: 2;EAflfl, Dfi fi ;EA2flfifl-9R;fiTDengine, ;EA2fl $%;flK,$fi AV; Bl,ck Range Index, DB =%I2.$012345012345 fl TAOS Data, In

12、c. All rights reserved.FILEFILEWriteAppmemorydiskCommit logVnodePeer VnodeFlush Dengine fl3 TAOS Data, Inc. All rights reserved. Dengine flH;n?flfifl$,flG,)i$fi,fi fifiUhflfifl$q$TDengine, o$nTRedis;%flWflfiflqSfiflg;s$l,fifl?zfiflfl .qTDengineZ-i3?,Z-iflD?,dflfi6$%fDq 8fifiy1+ fTDenginefl)$rinter,a

13、l, fivnatm(9flfatm(fiflfi$fio,fiflfiN(iIflovnf%sH6t1fifiHFy1+ select avg(degree) from thermometer where loc=beijing interval(5m);%sfl 7$H6fifiHFy1+ TAOS Data, Inc. All rights reserved.TDengine treamfi m.AAv, Max, Min, Percen5ile, Sum, C1un5, Dev, Firs5, Las5, Diff, Scale, WAv, SpreadpCflhxWcflfieg,L

14、flfifi$o4Pdflr$ut4hSxWvELfiSfiCF$,aAPse_CflhvE4LfiflD flEDflvEuMt4xW,flFEhselect avg(degree) from thermometer where loc=beijing interval(5m) sliding(1m);NfFxWfl-$Fi;7(create table d1 asselect avg(degree) from thermometer where loc=beijing interval(5m) sliding(1m);NFxWffl-$5Fi;7(,fiCF$d1 TAOS Data, I

15、nc. All rights reserved. Dengine fl fl fi$:fi fl) fl;A $fi % fl;A $fi TAOS Data, Inc. All rights reserved. fi 4335Kafka1%K 2fiD317Dfi1%K7;DflP fl;$-+1%KA9M APP 1APP 2APP 3MeterDT=AMeterDT=ATDengine Cluster TAOS Data, Inc. All rights reserved.flC?+flCfiE6DBfi%N,fififlQL$,Ffifi%flCOgLaAedSpar, Had/p C

16、/nnect/r,Bfifl Oracle,MySQL, Cassandra, M/ng/DBH,$Oyfl,cflfl$fl4fi$ TAOS Data, Inc. All rights reserved. Dengine $:$g flflflflyfly$flflfl flflfl$yflflfl.&$,B:A$ :fl fl fl, );A,+%;fifi/!,6fi 8,Bflfi$&;$ ,&6fi TAOS Data, Inc. All rights reserved. Dengine $flCOC:oFbSQL$flC,FbOSshell$btwks$dCSVfl:$Dtaos

17、du,p: EpOfl!OflD$ Ofl$fi$,EpODwO,q%$V$WEBDoSshell$Lfl3Swebs,o.:u(eCtwO,WQ_3)ofifid$8$3vflouLflmC3twflyd4lWdod6mCflhSDB$,3$uESQLrL, BWdQyd4 TAOS Data, Inc. All rights reserved. Dengine . CtD!=,fifiD ;AIDCfiflIDfl M;A,$H, sflfl,flIDC;Afl;A;A$6%(% ,aCIrU,fiflO1 ;AtMasterfl,;A(BE,e8sMaster$ IDC ,fifi,Master+zfl4IDC_fi$%flQ6% TAOS Data, Inc. All rights reserved.T engine