ArchSummit全球架构师峰会-《京东容器平台与数据中心基础设施协同发展实践》-鲍永成

技术总监 据中心研发。•容器技术在京东商城历史与未来•容器技术是什么•传统数据中心•京东敏捷数据中心建设•开源•容器集群管理&应用编排VS数据中心基础软件止于分容器让编排成为自然的事情JDOS图谱•分物理机=>分容器•业务系统100%全面容器运行•上线周期由1天降低到10分钟JDDataCenterOperatingSystem(JDOS)inuxKernel•60%业务•SRE初步形成•首次支撑618大促•全面基于镜像发布上线•RS副本数从容扩容应对高峰流量••••••••erviceAttachedResourcesServiceAppOrchestrationJenkinsDockerfile SourceCodeJenkinsSlavePodDockerJenkinsDockerfile SourceCodeJenkinsSlavePodDocker JDOS-apiSkyLBSkyNetcontrollerSkyDNS SkyLBSkyNetcontrollerSkyDNSsschedulerSSkyFSElasticSearchElasticSearchPPrometheus•容器技术在京东的历史和未来•容器技术【泛指Container&CM】是什么•传统数据中心•京东敏捷数据中心•开源ce•容器技术在京东的历史和未来•容器技术是什么•传统数据中心•京东敏捷数据中心建设•开源计划NS负载均衡层VLAN网络MDBx24监控中心•容器技术在京东的历史和未来•容器技术是什么•传统数据中心•京东敏捷数据中心建设•开源rviceLoadBalancerdockerIPportscanIPportscanAPIReadDNSfromReadDNSfrom/WriteDNSto/Del/UpdateRedIPfrom/UpdateIPstatusDNSreq/rviceLoadBalancerdockerIPportscanIPportscanAPIReadDNSfromReadDNSfrom/WriteDNSto/Del/UpdateRedIPfrom/UpdateIPstatusDNSreq/respWriteto/DeleteServicetoDNSCheckServicetoDNSCheckIPstatuseetcdJDOSCreate/Del/GetRSforServiceceancerBasedonDPDKLoadBalancerDockerLoadBalancerDockerLoadBalancerLoadBalancerDockerDockerDockerDockerDockerDockerDockerockerockerDockerDockerLBBasedonContainer(Haproxy)LoadBalancerntDockerLoadBalancerDockerJDOSCreate/Del/GetRSforServiceceancerBasedonDPDKLoadBalancerDockerLoadBalancerDockerLoadBalancerLoadBalancerDockerDockerDockerDockerDockerDockerDockerockerockerDockerDockerLBBasedonContainer(Haproxy)LoadBalancerntDockerLoadBalancerDockerClientpkthashtableSessiontablers-pkt-hashtableClientpkthashtableSessiontablers-pkt-hashtableRouterTable:quaggaLoadbalancerylbquaggaLoadbalancerylbServiceServiceylbLoadbalancerquaggaRouterRouterSeService10.20.3.2via192.20.5.210.20.4.2via192.20.5.210.20.5.2via192.20.7.210.20.6.2via192.20.7.2………10.20.3.2via192.20.6.21010.20.3.2via192.20.5.210.20.4.2via192.20.5.210.20.5.2via192.20.7.210.20.6.2via192.20.7.2………10.20.3.2via192.20.6.210.20.4.2via192.20.6.210.20.5.2via192.20.8.210.20.6.2via192.20.8.2………010.20.5.2via192.20.9.210.20.6.2via192.20.10.2192.20.7.2/30192.20.8.2/30192.20.6.2/30ASARouter………defaultvia192.20.8.1TORSwitch………………defaultvia192.20.3.1ComputeServer192.20.3.2/24ASBRouter192.20.4.2/24ComputeServerASBRouter192.20.10.2/24ComputeServerASBRouterASASY192.20.1Router192.20.7SpineSwitch192.ASYRouter192.20.8.1/SpineSwitch19192.10.20.3.2via192.20.3.210.20.4.2via192.20.4.2………defaultvia192.20.5.1TORSwitch192.20.4.TORSwitch192.20.4.1/24ASARouter192.20.3.1/24192.20.5.2/30192.20.9.2/24Compute192.20.9.2/24ComputeServerASASBRouter20.4.2.20.3.220.4.2.20.3.2.20.6.2•容器技术在京东的历史和未来•容器技术是什么•传统数据中心•京东敏捷数据中心建设•开源分布式共享存储codecontainerfs布式DNSAPITomcatKubernetesTomcat...NginxSSL/TLSNginxSSL/TLSAPI/JDOS2.0ContainerFSNginxSSL/TLS...TomcatNginxSSL/TLSTomcatAPITomcatKubernetesTomcat...NginxSSL/TLSNginxSSL/TLS