IDC系统网络实施文档

1、 Page * MERGEFORMAT 1CIDC系统网络实施文档 DOCPROPERTY Project ID * MERGEFORMAT 腾云天下IDC实施文档上海华讯网络系统有限公司II上海华讯网络系统有限公司I目录 TOC o 3-5 h z t 标题 1,1,标题 2,2 HYPERLINK l _Toc418087411 第1章设备信息 PAGEREF _Toc418087411 h 3 HYPERLINK l _Toc418087412 第2章拓扑介绍 PAGEREF _Toc418087412 h 3 HYPERLINK l _Toc418087413 2.1L3-Pod VX

2、LAN BGP EVPN拓扑 PAGEREF _Toc418087413 h 3 HYPERLINK l _Toc418087414 第3章VXLAN BGP EVPN配置方法 PAGEREF _Toc418087414 h 4 HYPERLINK l _Toc418087415 3.1N95-1配置及说明 PAGEREF _Toc418087415 h 4 HYPERLINK l _Toc418087416 3.2N95-2配置及说明 PAGEREF _Toc418087416 h 9 HYPERLINK l _Toc418087417 3.3N93-1配置及说明 PAGEREF _Toc4

3、18087417 h 14 HYPERLINK l _Toc418087418 3.4N93-2配置及说明 PAGEREF _Toc418087418 h 21版本控制信息文档属性属性内容项目名称文档标题腾云天下IDC实施文档文档版本号1.0版本日期2015-04-23作者常骁审核人文档变更过程版本更新日期更新人主要更新内容1.02015-04-23常骁文档生成 设备信息表1.设备信息设备型号设备名称NX-OS版本管理地址用户名/密码Nexus 9504N95-17.0(3)I1(1a)1.1.1.1admin/ciscoNexus 9504N95-27.0(3)I1(1a)1.1.1.2ad

4、min/ciscoNexus 9372N93-17.0(3)I1(1a)2.1.1.1admin/ciscoNexus 9372N93-27.0(3)I1(1a)2.1.1.2admin/cisco拓扑介绍L3-Pod VXLAN BGP EVPN拓扑2台N93与2台N95采用L3互联（10.200.1.0/24）并使用OSPF协议作为underlay层用于互通；2台N93与2台N95运行BGP协议作为overlay层用于传递VTEP下挂的终端到VTEP网关的流量；2台N93上运行VXLAN协议保证下联终端可以跨上面L3网络实现L2通信；（172.16.16.0/20）N93-1上使用1个端口

5、配置为L3口用于与用户外部网络连接；VXLAN BGP EVPN配置方法将VXLAN gateway 建立在Nexus 9372上，在N93-1上通过写静态路由的方式与客户原有网络进行联通；保证VXLAN下挂用户间L2通信走VXLAN网络，去10.10.0.0/18网络走到N93上再通过BGP联通； 注释只有NX-OS版本为7.0以上才支持VXLAN BGP EVPNN95-1配置及说明设备配置配置内容!Command: show running-config!Time: Fri Apr 24 13:57:13 2015version 7.0(3)I1(1a)hostname N95-1vdc

6、 N95-1 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 768 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 maximum 96 limit-resource m4route-mem minimum 58 maximum 58 lim

7、it-resource m6route-mem minimum 8 maximum 8feature telnet 开启telnetnv overlay evpn 开启evpnfeature ospf 开启OSPFfeature bgp 开启BGPfeature pim 开启pimfeature interface-vlan 开启SVIfeature lacp 开启lacpfeature lldp 开启lldpusername admin password 5 $1$bZjikP9F$yR89Z2u3LRgdaqFe1i16l. role network-adminno password st

8、rength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x3a367acf836e9daa858eaea628047f1b priv 0 x3a367acf836e9daa858eaea628047f1b localizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL(2)

9、owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMONWARNINGrmon event 5 log trap public description INFORMATION(5) owner PMONINFOip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim rp-candidate l

10、oopback1 group-list 225.0.0.0/8 指定RP地址 ip pim ssm range 232.0.0.0/8ip pim anycast-rp 100.1.1.1 1.1.1.1 指定RP冗余ip pim anycast-rp 100.1.1.1 1.1.1.2 指定RP冗余vlan 1vrf context managementinterface Vlan1interface Ethernet1/1 description N93-1:E1/49 speed 40000 duplex full mtu 9216 ip address 10.200.1.2/30 ip

11、 router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能 no shutdowninterface Ethernet1/2 description N93-2:E1/49 speed 40000 duplex full mtu 9216 ip address 10.200.1.10/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能 no shutdowninterface Ethernet1/3 no shutdowninterface Ethernet1/4 no s

12、hutdowninterface Ethernet1/5 no shutdowninterface Ethernet1/6 no shutdowninterface Ethernet1/7 no shutdowninterface Ethernet1/8 no shutdowninterface Ethernet1/9 no shutdowninterface Ethernet1/10 no shutdowninterface Ethernet1/11 no shutdowninterface Ethernet1/12 no shutdowninterface Ethernet1/13 no

13、shutdowninterface Ethernet1/14 no shutdowninterface Ethernet1/15 no shutdowninterface Ethernet1/16 no shutdowninterface Ethernet1/17 no shutdowninterface Ethernet1/18 no shutdowninterface Ethernet1/19 no shutdowninterface Ethernet1/20 no shutdowninterface Ethernet1/21 no shutdowninterface Ethernet1/

14、22 no shutdowninterface Ethernet1/23 no shutdowninterface Ethernet1/24 no shutdowninterface Ethernet1/25 no shutdowninterface Ethernet1/26 no shutdowninterface Ethernet1/27 no shutdowninterface Ethernet1/28 no shutdowninterface Ethernet1/29 no shutdowninterface Ethernet1/30 no shutdowninterface Ethe

15、rnet1/31 no shutdowninterface Ethernet1/32 no shutdowninterface mgmt0 vrf member management ip address 192.168.1.1/30interface loopback0 ip address 1.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能interface loopback1 ip address 100.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim s

16、parse-mode 开启组播功能line consoleline vtyboot nxos bootflash:/n9000-dk9.7.0.3.I1.1a.bin sup-1router ospf 100 router-id 1.1.1.1router bgp 65535 启用BGP作为overlay层协议 router-id 1.1.1.1 log-neighbor-changes address-family ipv4 unicast 开启iPv4功能 address-family l2vpn evpn 开启L2vpn功能 retain route-target all 保留路由标记

17、neighbor 2.1.1.1 remote-as 65535 与N93-1建立IBGP邻居 log-neighbor-changes update-source loopback0 源端口选择loopback0 address-family ipv4 unicast 开启iPv4功能 address-family l2vpn evpn 开启L2vpn功能 send-community both 传递所有community route-reflector-client 作为N93-1的RR neighbor 2.1.1.2 remote-as 65535 与N93-2建立IBGP邻居 log

18、-neighbor-changes update-source loopback0 源端口选择loopback0 address-family ipv4 unicast 开启iPv4功能 address-family l2vpn evpn 开启L2vpn功能 send-community both 传递所有community route-reflector-client 作为N93-2的RRN95-2配置及说明!Command: show running-config!Time: Fri Apr 24 13:57:08 2015version 7.0(3)I1(1a)hostname N95-

19、2vdc N95-2 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 768 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 maximum 96 limit-resource m4route-mem minimum 58 maximum 58

20、 limit-resource m6route-mem minimum 8 maximum 8feature telnet 开启telnetnv overlay evpn 开启evpnfeature ospf 开启OSPFfeature bgp 开启BGPfeature pim 开启PIMfeature interface-vlan 开启SVIfeature lacp 开启lacpfeature lldp 开启lldpusername admin password 5 $1$EsgoPddD$xlhuSuUJEWF3UtUes2wHE1 role network-adminno passwor

21、d strength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x90d4dc45822ab254147c4f7dd900b547 priv 0 x90d4dc45822ab254147c4f7dd900b547 localizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL

22、(2) owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMONWARNINGrmon event 5 log trap public description INFORMATION(5) owner PMONINFOip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim rp-candida

23、te loopback1 group-list 225.0.0.0/8 指定RP地址ip pim ssm range 232.0.0.0/8ip pim anycast-rp 100.1.1.1 1.1.1.1 指定RP冗余ip pim anycast-rp 100.1.1.1 1.1.1.2 指定RP冗余vlan 1vrf context managementinterface Vlan1interface Ethernet1/1 description N93-1:E1/2 speed 40000 duplex full mtu 9216 ip address 10.200.1.6/30

24、ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能 no shutdowninterface Ethernet1/2 description N93-2:E1/2 speed 40000 duplex full mtu 9216 ip address 10.200.1.14/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能 no shutdowninterface Ethernet1/3 no shutdowninterface Ethernet1/4 no

25、shutdowninterface Ethernet1/5 no shutdowninterface Ethernet1/6 no shutdowninterface Ethernet1/7 no shutdowninterface Ethernet1/8 no shutdowninterface Ethernet1/9 no shutdowninterface Ethernet1/10 no shutdowninterface Ethernet1/11 no shutdowninterface Ethernet1/12 no shutdowninterface Ethernet1/13 no

26、 shutdowninterface Ethernet1/14 no shutdowninterface Ethernet1/15 no shutdowninterface Ethernet1/16 no shutdowninterface Ethernet1/17 no shutdowninterface Ethernet1/18 no shutdowninterface Ethernet1/19 no shutdowninterface Ethernet1/20 no shutdowninterface Ethernet1/21 no shutdowninterface Ethernet1

27、/22 no shutdowninterface Ethernet1/23 no shutdowninterface Ethernet1/24 no shutdowninterface Ethernet1/25 no shutdowninterface Ethernet1/26 no shutdowninterface Ethernet1/27 no shutdowninterface Ethernet1/28 no shutdowninterface Ethernet1/29 no shutdowninterface Ethernet1/30 no shutdowninterface Eth

28、ernet1/31 no shutdowninterface Ethernet1/32 no shutdowninterface mgmt0 vrf member management ip address 192.168.1.1/30interface loopback0 ip address 1.1.1.2/32 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能interface loopback1 ip address 100.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim

29、sparse-mode 开启组播功能line consoleline vtyboot nxos bootflash:/n9000-dk9.7.0.3.I1.1a.bin sup-1router ospf 100 启用OSPF作为underlay层协议 router-id 1.1.1.2router bgp 65535 启用BGP作为overlay层协议 router-id 1.1.1.2 log-neighbor-changes address-family ipv4 unicast 开启iPv4功能 address-family l2vpn evpn 开启L2vpn功能 retain rou

30、te-target all 保留路由标记 neighbor 2.1.1.1 remote-as 65535 与N93-1建立IBGP邻居 log-neighbor-changes update-source loopback0 源端口选择loopback0 address-family ipv4 unicast 开启iPv4功能 address-family l2vpn evpn 开启L2vpn功能 send-community both 传递所有community route-reflector-client 作为N93-1的RR neighbor 2.1.1.2 remote-as 655

31、35 与N93-2建立IBGP邻居 log-neighbor-changes update-source loopback0 源端口选择loopback0 address-family ipv4 unicast 开启iPv4功能 address-family l2vpn evpn 开启L2vpn功能 send-community both 传递所有community route-reflector-client 作为N93-2的RRN93-1配置及说明设备配置配置内容!Command: show running-config!Time: Fri Apr 24 05:56:03 2015vers

32、ion 7.0(3)I1(1a)hostname N93-1vdc N93-1 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 512 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 maximum 96 limit-resource m4ro

33、ute-mem minimum 58 maximum 58 limit-resource m6route-mem minimum 8 maximum 8feature telnet 开启telnetnv overlay evpn 开启evpnfeature ospf 开启OSPFfeature bgp 开启BGPfeature pim 开启PIMfeature interface-vlan 开启SVIfeature vn-segment-vlan-based 开启VN-segmentfeature lacp 开启lacpfeature dhcp 开启DHCPfeature lldp 开启lld

34、pfeature nv overlay 开启nv overlay username admin password 5 $1$8WQwoQlf$GH3S/c4PEFtuPvvW1qzCy/ role network-adminno password strength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x319af30c28464fb01da525458c81f50f priv 0 x319af30c28464fb01da525458c81f50f loca

35、lizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL(2) owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMONWARNINGrmon event 5 log trap

36、public description INFORMATION(5) owner PMONINFOfabric forwarding anycast-gateway-mac 0000.1111.2222 设置forwarding mac地址（网关的mac地址）ip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim ssm range 232.0.0.0/8vlan 1,101,1001vlan 101 定义vlan 101作为L3层NVE端口 vn-segment 900001 设定VLAN与VXLAN的关系vlan 100

37、1 定义vlan 1001作为L2层NVE透传VLAN vn-segment 2001001 设定VLAN与VXLAN的关系route-map static2BGP permit 10 新建route-map匹配所有静态路由service dhcp 开启DHCP服务ip dhcp relay 开启DHCP中继服务ipv6 dhcp relayvrf context managementvrf context vxlan-900001 定义一个vxlan的vrf vni 900001 与VLAN 10001使用vn-segment匹配 ip route 0.0.0.0/0 10.10.0.1 与

38、外部网络互连的静态路由 rd auto 定义RD address-family ipv4 unicast 开启ipv4功能 route-target both auto 定义RT route-target both auto evpn 定义evpn RTinterface Vlan1interface Vlan101 定义L3层NVE SVI no shutdown vrf member vxlan-900001 划入vxlan的vrf中interface Vlan1001 定义L2层NVE透传SVI no shutdown vrf member vxlan-900001 划入vxlan的vr

39、f中 ip address 172.16.16.1/20 定义网关 ip proxy-arp 开启arp代理功能 fabric forwarding mode anycast-gateway 调用网关mac ip dhcp relay address 10.10.32.54 开启dhcp中继interface nve1 定义NVE端口 mtu 9216 修改MTU值 no shutdown source-interface loopback0 定义源端口 host-reachability protocol bgp使用BGP作为overlay协议 member vni 900001 assoc

40、iate-vrf 指定vni 900001为L3 nve端口 member vni 2001001 指定vni 2001001用组播225.4.0.1地址透传 mcast-group 225.4.0.1interface Ethernet1/1 switchport access vlan 1001 将端口划入vlan 1001中interface Ethernet1/2 switchport access vlan 1001interface Ethernet1/3 switchport access vlan 1001interface Ethernet1/4 switchport acc

41、ess vlan 1001interface Ethernet1/5 switchport access vlan 1001interface Ethernet1/6 switchport access vlan 1001interface Ethernet1/7 switchport access vlan 1001interface Ethernet1/8 switchport access vlan 1001interface Ethernet1/9 switchport access vlan 1001interface Ethernet1/10 switchport access v

42、lan 1001interface Ethernet1/11 switchport access vlan 1001interface Ethernet1/12 switchport access vlan 1001interface Ethernet1/13 switchport access vlan 1001interface Ethernet1/14 switchport access vlan 1001interface Ethernet1/15 switchport access vlan 1001interface Ethernet1/16 switchport access v

43、lan 1001interface Ethernet1/17 switchport access vlan 1001interface Ethernet1/18 switchport access vlan 1001interface Ethernet1/19 switchport access vlan 1001interface Ethernet1/20 switchport access vlan 1001interface Ethernet1/21 switchport access vlan 1001interface Ethernet1/22 switchport access v

44、lan 1001interface Ethernet1/23 switchport access vlan 1001interface Ethernet1/24 switchport access vlan 1001interface Ethernet1/25 switchport access vlan 1001interface Ethernet1/26 switchport access vlan 1001interface Ethernet1/27 switchport access vlan 1001interface Ethernet1/28 switchport access v

45、lan 1001interface Ethernet1/29 switchport access vlan 1001interface Ethernet1/30 switchport access vlan 1001interface Ethernet1/31 switchport access vlan 1001interface Ethernet1/32 switchport access vlan 1001interface Ethernet1/33 switchport access vlan 1001interface Ethernet1/34 switchport access v

46、lan 1001interface Ethernet1/35 switchport access vlan 1001interface Ethernet1/36 switchport access vlan 1001interface Ethernet1/37 switchport access vlan 1001interface Ethernet1/38 switchport access vlan 1001interface Ethernet1/39 switchport access vlan 1001interface Ethernet1/40 switchport access v

47、lan 1001interface Ethernet1/41 switchport access vlan 1001interface Ethernet1/42 switchport access vlan 1001interface Ethernet1/43 switchport access vlan 1001interface Ethernet1/44 switchport access vlan 1001interface Ethernet1/45 switchport access vlan 1001interface Ethernet1/46 switchport access v

48、lan 1001interface Ethernet1/47 switchport access vlan 1001interface Ethernet1/48 switchport access vlan 1001interface Ethernet1/49 description N95-1:E1/1 no switchport speed 40000 duplex full mtu 9216 ip address 10.200.1.1/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能 no shutdowninter

49、face Ethernet1/50 description N95-2:E1/1 no switchport speed 40000 duplex full mtu 9216 ip address 10.200.1.5/30 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能 no shutdowninterface Ethernet1/51 连接客户10.0网络端口 description link to N3K no switchport vrf member vxlan-900001 ip address 10.10.3.1

50、0/18 ip proxy-arp no shutdowninterface Ethernet1/52interface Ethernet1/53interface Ethernet1/54interface mgmt0 vrf member managementinterface loopback0 ip address 2.1.1.1/32 ip router ospf 100 area 0.0.0.0 ip pim sparse-mode 开启组播功能line consoleline vtyboot nxos bootflash:/n9000-dk9.7.0.3.I1.1a.bin ro

51、uter ospf 100 启用OSPF作为underlay层协议 router-id 2.1.1.1router bgp 65535 启用BGP作为overlay层协议 router-id 2.1.1.1 address-family ipv4 unicast 开启ipv4功能 address-family l2vpn evpn 开启evpn功能 retain route-target all 保留所有RT标记 neighbor 1.1.1.1 remote-as 65535 与N95-1建立IBGP邻居 update-source loopback0 指定源端口 address-famil

52、y ipv4 unicast 开启ipv4功能 address-family l2vpn evpn 开启evpn功能 send-community both 传递所有community neighbor 1.1.1.2 remote-as 65535 与N95-2建立IBGP邻居 update-source loopback0 指定源端口 address-family ipv4 unicast 开启ipv4功能 address-family l2vpn evpn 开启evpn功能 send-community both 传递所有community vrf vxlan-900001 addres

53、s-family ipv4 unicast advertise l2vpn evpn 定义vrf vxlan-900001传递evpn redistribute static route-map static2BGP 10.0网络路由重分布进BGP中进行传递evpn vni 2001001 l2 定义vni 2001001 为L2类型 rd auto 定义RD route-target import auto 定义进流量RT route-target export auto 定义出流量RTN93-2配置及说明设备配置配置内容!Command: show running-config!Time:

54、 Fri Apr 24 05:57:05 2015version 7.0(3)I1(1a)hostname N93-2vdc N93-2 id 1 limit-resource vlan minimum 16 maximum 4094 limit-resource vrf minimum 2 maximum 4096 limit-resource port-channel minimum 0 maximum 512 limit-resource u4route-mem minimum 248 maximum 248 limit-resource u6route-mem minimum 96 m

55、aximum 96 limit-resource m4route-mem minimum 58 maximum 58 limit-resource m6route-mem minimum 8 maximum 8feature telnet 开启telnetnv overlay evpn 开启evpnfeature ospf 开启OSPFfeature bgp 开启BGPfeature pim 开启PIMfeature interface-vlan 开启SVIfeature vn-segment-vlan-based 开启VN-segmentfeature lacp 开启lacpfeature

56、dhcp 开启DHCPfeature lldp 开启lldpfeature nv overlay 开启nv overlay username admin password 5 $1$FMoBigOA$QqUqFV/9AFSJGSSMJ1yH8. role network-adminno password strength-checkip domain-lookupcopp profile strictsnmp-server user admin network-admin auth md5 0 x6e2e1f589c198fd709c83b695c507659 priv 0 x6e2e1f58

57、9c198fd709c83b695c507659 localizedkeyrmon event 1 log trap public description FATAL(1) owner PMONFATALrmon event 2 log trap public description CRITICAL(2) owner PMONCRITICALrmon event 3 log trap public description ERROR(3) owner PMONERRORrmon event 4 log trap public description WARNING(4) owner PMON

58、WARNINGrmon event 5 log trap public description INFORMATION(5) owner PMONINFOfabric forwarding anycast-gateway-mac 0000.1111.2222 设置forwarding mac地址（网关的mac地址）ip pim rp-address 100.1.1.1 group-list 225.0.0.0/8 指定RP地址ip pim ssm range 232.0.0.0/8vlan 1,101,1001vlan 101 定义vlan 101作为L3层NVE端口 vn-segment 9

59、00001 设定VLAN与VXLAN的关系vlan 1001 定义vlan 1001作为L2层NVE透传VLAN vn-segment 2001001 设定VLAN与VXLAN的关系vrf context managementvrf context vxlan-900001 定义一个vxlan的vrf vni 900001 与VLAN 10001使用vn-segment匹配 rd auto address-family ipv4 unicast 开启ipv4功能 route-target both auto 定义RTroute-target both auto evpn 定义evpn RT i

60、nterface Vlan1interface Vlan101 定义L3层NVE SVI no shutdown vrf member vxlan-900001 划入vxlan的vrf中interface Vlan1001 no shutdown vrf member vxlan-900001 划入vxlan的vrf中ip address 172.16.16.1/20 定义网关 ip proxy-arp fabric forwarding mode anycast-gateway 调用网关mac interface nve1 定义NVE端口 mtu 9216 修改MTU值 no shutdow