微软Azure云加速技术架构

1、微软Azure云加速技术架构Cloud Acceleration at MicrosoftEFFICIENCYFLEXIBILITYFPGAsRegistersControl UnitArithmeti(CU)c Logic Unit (ALU)CPUsGPUsASICsNPUs3Project BrainwaveBrainwaveA Scalable DNN Serving PlatformFast: Flexible Friendly:FFFL0L1FFFL0Pretrained DNN Model in ONNX, etc.Brainwave Soft NPUInstr Decoder

2、& ControlBW NPUNetwork switchesFPGAsScalable DNN Hardware Microservice14void LSTM(int steps) for (int t = 0; t steps; t+) 16.17.mv_mul(Uc); vv_add(xWc);3.v_rd(NetQ);18.v_tanh();4.v_wr(InitialVrf, xt);19.vv_mul(it);5.v_rd(InitialVrf, xt);20.vv_add(ft_mod);6.mv_mul(Wf);21.v_wr(MultiplyVrf, c_prev);7.v

3、v_add(bf);22.v_wr(InitialVrf, ct);8.v_wr(AddSubVrf, xWf);23.v_rd(InitialVrf, ct);9.v_rd(InitialVrf, h_prev);24.v_tanh();10.mv_mul(Uf);25.vv_mul(ot);11.vv_add(xWf);26.v_wr(InitialVrf, h_prev);12.v_sigm();27.v_wr(NetQ);13.vv_mul(c_prev);28.14.v_wr(AddSubVrf, ft_mod);29. 15.v_rd(InitialVrf, h_prev);20h

4、ttps:/en-us/research/uploads/prod/2018/06/ISCA18-Brainwave-CameraReady.pdfStratix V D587%59%66%2002.4Arria 10 115051%80%100%3009.8Stratix 10 28091%69%91%25048GRUh=2816, t=750BW1.98735.9274.8GRUh=2816, t=750Titan Xph=2560, t=375 h=2560, t=375 h=2048,t=375 h=2048,t=375 h=1536, t=375 h=1536,

5、 t=375BWTitan Xp BWTitan Xp BWTitan Xph=1024, t=1500 BWh=1024, t=1500 Titan XpGRU GRU GRU GRU GRU GRU GRUGRU GRU GRUh=512, t=1 h=512, t=1BWTitan Xp0.99374.620.95451.590.95131.733.79259.510.0130.0629.690.419.790.3711.170.334.980.320.250.0561.83.341.2323.32.80.4Titan XpBW_S10Numerical TypeFl

6、oat32MSFP8Peak TFLOPs12.148TDP (W)250125Process (nm)TSMC 16Intel 1423Stratix V RNN-optimized NPUs in Scale Productionhttps:/en-us/research/uploads/prod/2018/03/mi0218_Chung- 2 018Mar25.pdfh ttps:/search/2017-12/search-2017-12-december-ai-update 24Corsica/ZiplineSys MgmtPCIeIface SR- IOVDMA EngineCom

7、pletions & NotificationsKey Management andKey DerivationCfgKey VaultSecurity and Management ProcessorApplication InterfaceSR-IOV, Security,Scheduling/QoS Cmd ProcessingCorsican &sion4 Compressio4 DecompresPipelinesCompress / DecompressEncrypt / DecryptAuthenticationCloud SocketFast PathZipline Fast PathSlow Path28Compress Data:XP10, Gzip, ZlibEncrypt Data:AES-GSM, XTS, XEXAuthenticate Data:CRC, SHA2, HMAC-SHA2Decrypt Data Decompress Data Authenticate Data Key GenerationKey VaultCRC-64(Data)CRC-64(D