Nexus9000系列

1、Cisco Nexus 9000系列交换机 Cisco NX-OS 模型March 2014AgendaCisco Nexus 9000 系列交换机的介绍Nexus 9500Nexus 9300 FEX 对Nexus 9000支持Network Design and Scaling with Nexus 9000Enhanced NX-OS Automation and ProgrammabilityCisco Nexus 9000 Series SwitchesHigh-Performance 10 Gbps/40 Gbps/100 Gbps Switch FamilyFLEXIBLE FO

2、RM FACTORS CAN ENABLE VARIABLE DATA CENTER DESIGN AND SCALINGNexus 9300Nexus 950048 1/10G SFP+ & 12 QSFP+SCALABLE 1 GE/10 Gbps/40 Gbps/100 GE PERFORMANCE PERFORMANCEPORTSPRICEPROGRAMMABILITYPOWER96 1/10G-T & 8 QSFP+12-port QSFP+ GEMACI Ready Leaf Line Card48 1/10G-T & 4 QSFP+ACI-ready Leaf line card

3、48 1/10G SFP+ & 4 QSFP+Aggregation line card36 40G QSFP+C9500 8-SlotAgendaCisco Nexus 9000 Series Switches IntroductionNexus 9500Nexus 9300 FEX Support on Nexus 9000Network Design and Scaling with Nexus 9000Enhanced NX-OS Automation and ProgrammabilityNexus 9500 架构平台概述High port density 高密度的端口 288 x

4、40 Gbps/Nexus 9508 1152 x 10 Gbps/Nexus 9508Layer 2 and Layer 3 line-rate performance on all ports and all packet sizesLow latency低延迟Up to 3.5 usec on the 36 x 40GE QSFP line card (N9K-X9636PQ)Power efficiency电源功率Platinum-rated power supplies; 90-94% power efficiency across all workloads3.5 W/10 Gbp

5、s port14 W/40 Gbps portFirst modular chassis without a mid-planeUnobstructed front-to-back airflowVXLAN bridging, gateway, routingHighly integrated switch and buffer functionalityOnly 2 to 4 ASICs per line cardNo buffer bloatMix of 28 nm Cisco and 40 nm Broadcom ASICsNexus 9500 Platform Architecture

6、8-Slot Modular Chassis Nexus 9508 前视图Nexus 9508 后视图8 行卡插槽每个接口最大3.84TB 全双工冗余的管理引擎支持3000W AC电源2+0, 2+1, 2+2 redundancySupports up to 8 power suppliesRedundant system controller cards3 or 6 fabric modules (behind fan trays)3 fan trays, front-to-back airflowNo mid-plane for LC-to-FM connectivityDesigned

7、 for Power and Cooling EfficiencyDesigned for Reliability Designed for Future ScaleChassis Dimensions: 13 RU x 30 in. x 17.5 in (HxWxD) Nexus 9500 Platform Architecture电源模块和风扇3000 W AC PSUSingle 20 A input 220 VSupport for a range of international cabling optionsRange of PSU configurations最少1个电源模块2

8、PSU for a fully-loaded chassisN+1 redundancyN+N grid redundancy2 times the head room for future port densities,bandwidth, and opticsUp to 8 PS total3 fan trays3 dual fans per trayDynamic speed control driven by temperature sensorsStraight airflow across line cards and fabric modulesN+1 redundancy pe

9、r trayNexus 9500 Platform ArchitectureSupervisor ModuleRedundant half-width supervisor enginePerformance- and scale-focusedRange of management interfaces External clock input (PPS)Supervisor ModuleProcessor Romley, 1.8 GHz, 4 coreSystem Memory16 GB, upgradable to 48 GBRS-232 Serial PortsOne (RJ-45)1

10、0/100/1000 Management PortsOne (RJ-45)USB 2.0 InterfaceTwoSSD Storage64 GB64 GB SSD16 GB DRAM(Upgradable to 48 GB)10/100/1000 mgmt portDual USB portsConsole portPPS clock inputLatest quad-core Intel Sandy Bridge ProcessorRedundant paths to system controllers架构平台系统控制模型冗余设计的半宽系统控制器Off loads supervisor

11、 from device management tasksIncreased system resiliencyIncreased scalePerformance- and scale-focusedDual core ARM processor, 1.3 GHzCentral point-of-chassis controlEthernet Out of Band Channel (EOBC) switch:1 Gbps switch for intra-node control plane communication (device management)Ethernet Protoco

12、l Channel (EPC) switch: 1 Gbps switch for intra-node data plane communication (protocol packets)Power supplies through system management bus (SMB) Fan traysNexus 9500 Fabric ModuleFabrics ModulesInterconnect I/O module slotsInstalled at the rear of the chassisUses Broadcom Trident II ASICs as the ne

13、twork forwarding engine (NFE)3.84 Tbps duplex per line card slot (6 fabric cards)1.92 Tbps duplex per line card slot (3 fabric cards)All fabric cards are active and carry trafficNexus 9500 Fabric ModuleData Plane Scaling For 8-Slot ChassisEach fabric module for the 8-slot chassis can provide up to 3

14、20 Gbps to each I/O module slotWith 6 fabric modules, each I/O module slot can have up to 1.92 Tbps forwarding bandwidth in each directionNFEFabric 1NFE320 Gbps(8 x 40 Gbps)NFEFabric 2NFE320 Gbps(8 x 40 Gbps)NFEFabric 3NFE320 Gbps(8 x 40 Gbps)NFEFabric 4NFE320 Gbps(8 x 40 Gbps)NFEFabric 5NFE320 Gbps

15、(8 x 40 Gbps)NFEFabric 6NFE320 Gbps(8 x 40 Gbps)Line Card Slot320 Gbps640 Gbps960 Gbps1.28 Tbps1.60 Tbps1.92 TbpsCisco Nexus 9500 Line CardsN9K-X9636PQ A 36-port, 40 Gbps QSFP+ line card needs 6 fabric modules to operate at line rate on all 36 ports and for all packet sizes.36x 40 Gbps QSFP ports2.8

16、8 Tbps full-duplex fabric connectivityLayer 2 and 3 line-rate performance on all ports for all packet sizesSupports 4x 10 Gbps break-out modeCisco NX-OS mode onlyNexus 9500 Line CardN9K-X9636PQThree network forwarding engines (NFE)Each NFE has 12 x 40 Gbps links to the front panel and 12 x 40 Gbps i

17、nternal links to the fabric modulesNFE 112 x 40 Gbps 12 x 40 Gbps EthernetNFE 212 x 40 Gbps12 x 40 Gbps EthernetNFE 312 x 40 Gbps12 x 40 Gbps EthernetEach 36-port, 40 Gbps QSFP+ line card needs 6 fabric modules to operate at line rate on all 36 ports.Connect to Fabric ModulesFront-Panel PortsNexus 9

18、500 Line CardsN9K-X9636PQ Fabric Connectivity All ports on the line card can operate at line rate for any packet sizes with 6 fabric modulesEach of the 3 NFEs on the line card has 12 x 40 Gbps links to fabric modules - one to each Fabric Trident II ASICNFENFE12 x 40 Gbps12 x 40 GbpsNFE12 x 40 GbpsNF

19、EFabric 1NFENFEFabric 2NFENFEFabric 3NFENFEFabric 4NFENFEFabric 5NFENFEFabric 6NFE1 x 40 Gbps 1 x 40 Gbps 36-port 40 Gbps QSFP+Nexus 9500 Line CardsN9K-X9564PX And N9K-X9564TX N9K-X9564PX48 1/10G SFP+ ports + 4 40G QSFP+ portsN9K-X9564TX48 1/10GBase-T ports + 4 40G QSFP+ ports1.92 Tbps duplex fabric

20、 connectivityLayer 2 and 3 line-rate performance on all ports for all packet sizesCisco NX-OS and Application Centric Infrastructure (ACI) mode48-port 1/10G SFP + 4-port 40G4 x 40G or 16 x 10G48-port 1/10G-T + 4-port 40G4 x 40G or 16 x 10GNexus 9500 Line CardsN9K-X9564PX And N9K-X9564TX NFE 1ALE 112

21、 x 40 Gbps48 x 1/10G SFP/SFP+ALE 212 x 40 Gbps4 x 40G QSFP+Network InterfacesNFE 2Network Interfaces12 x 40 Gbps12 x 40 Gbps12 x 40 GbpsEthernet6 x 40 GbpsEthernet48 x 1/10G Base-TConnect to Fabric ModulesConnect to Hosts or Network 2 network forwarding engines (NFEs)2 application leaf engines (ALEs

22、) for additional buffering and packet handlingNexus 9500 Line CardsN9K-X9564PX And N9K-X9564TX Fabric ConnectivityMinimum of 3 fabric modules to get all line-rate portsNFEASIC 1Fabric 1NFEASIC 2NFEASIC 1Fabric 2NFEASIC 2NFEASICNSNSNFEASIC 1Fabric 3NFEASIC 2NFEASIC2 x 40 Gbps 2 x 40 Gbps 48-port 1/10

23、 G SFP+ and 4-port 40G QSFP+48-port 1/10G-T and 4-port 40G QSFP+Optical Innovation: Removing 40 Gb BarriersProblem40 Gb optics are a significant portion of capital expenditures (CAPEX)40 Gb optics require new cablingRe-use existing 10 Gb MMF cabling infrastructureRe-use patch cables (same LC connect

24、or)SolutionQSFP, MSA-compliantDual LC connectorSupport for 100 m on OM3 and upto 150m on OM4TX/RX on two wavelengths at 20 Gb eachCisco 40 Gb SR-BiDi QSFP Available end of CY13 and supported across all Cisco QSFP portsQSFP-BIDI vs. QSFP-40G-SR412-Fiber vs. Duplex Multimode FiberTXRXTX/RXTX/RX4 x 10G

25、4 x 10G2 x 20G2 x 20G12-Fiber ribbon cable with MPO connectors at both endsDuplex multimode fiber with Duplex LC connectors at both ends12-Fiber infrastructureDuplex Multimode Fiber Higher cost to upgrade from 10G to 40G due to 12-Fiber infrastructureUse of duplex multimode fiber lowers cost of upgr

26、ading from 10G to 40G by leveraging existing 10G multimode infrastructureQSFP-BIDIQSFP SR12-Fiber infrastructureDuplex Multimode Fiber QSFP-BIDIQSFP SRNexus 9500 SeriesLine Cards Nexus 9500 System ScalabilitiesIn Standalone Mode (NX-OS) * Shared with IP hostsNexus 9000 SeriesFull Line-Rate Throughpu

27、t PerformanceUnprecedented, Full Line-Rate Performance:Proven with RFC 2544, RFC 2889, RFC 3918 throughput tests Results were taken using a fully loaded Nexus 9508 switch with 288 40 GE ports:All ports are line rate at 100% unicast traffic loadAll ports are line rate at 100% multicast traffic loadFu

28、ll line rate for all packet sizes (64 to approx. 9216 Bytes)1.2E+0121.0E+0120.0E+0122.0E+0124.0E+0126.0E+0128.0E+012(frames)Nexus 9000 SeriesLow-Latency PerformanceLow Latency (Same for Both Unicast and Multicast)Proven with RFC 2544, RFC 2889, RFC 3918 throughput tests Results were taken using a fu

29、lly-loaded Nexus 9508 switch with 288 40 GE ports:Unicast latency at 100% traffic load: 1.6 usec (64-Byte packets)3.5 usec (9216-Byte packets)Multicast latency at 100% traffic load:1.6 usec (64-Byte packets)3.5 usec (9216-Byte packets)AgendaCisco Nexus 9000 Series Switches IntroductionNexus 9500Nexu

30、s 9300 FEX Support on Nexus 9000Network Design and Scaling with Nexus 9000Enhanced NX-OS Automation and ProgrammabilityNexus 9300 Platform Architecture Nexus 9396PQ960G 48-port 1/10 Gb SFP+ and 12-port 40 Gb QSFP+ 2 RUNexus 9396TX (future)960G48-port 1/10 GBaseT & 12-port 40 Gb QSFP+ 2 RUNexus 93128

31、TX1,280G96-port 1/10 G-T and 8-port 40 Gb QSFP+ 3 RUNexus 9300 - CommonRedundant fan and power supplyFront-to-back and back-to-front airflowDual- core CPU with default 64 GB SDDUplink Module12-port 40 Gb QSFP+Additional 40 MB bufferFull VXLAN gateway, bridging and routing capabilityNexus 9300 Platfo

32、rm Architecture 2 RU height48 1 Gb SFP/10 Gbps SFP+ ports12 40 Gbps QSFP ports (on GEM module)1 100/1000baseT management port1 RS232 console port2 USB 2.0 portsFront-to-back and back-to-front airflow options1+1 redundant power supply options2+1 redundant fansNo-blocking architecture with line-rate p

33、erformance on all ports for all packet sizesCisco Nexus 9396PXConsoleManagement PortUSB Ports48 1Gbps SFP/10Gbps SFP+ portsGEM module with 12 40 Gbps QSFP+ portsPower supplyPower supply(2+1) fan traysNexus 9300 Platform Architecture3 RU height96 1/10 Gbps BaseT ports8 40 Gbps QSFP ports (on GEM modu

34、le)1 100/1000baseT management port1 RS232 console port2 USB 2.0 portsFront-to-back and back-to-front airflow options1+1 redundant power supply options2+1 redundant fansCisco Nexus 93128TXConsole management port USB ports96 1 GBaseT/10 GBaseT portsGEM module with 12 40 Gbps QSFP+ ports (8 active upli

35、nks)Power supplyPower supply(2+1) fan traysNexus 9300 System Block DiagramNFEALENetwork Interfaces12 x 40 Gb Hi-Gig212 x 40 GbEthernetFront Panel 48 x 1 GE/10 GE PortsGEM 12 x 40 GE QSFP+ UplinksNexus 9396PQ/Nexus 9396TXNexus 93128TXNFEALENetwork Interfaces8 x 40 Gb24 x 40 GbEthernetFront Panel 96 x

36、 1 GE/10 GE PortsGEM 12 x 40 GE QSFP+ Uplinks (only 8 ports are active)Nexus 9300 System ScalabilitiesIn Standalone Mode* Shared with IP hostsAgendaCisco Nexus 9000 Series Switches IntroductionNexus 9500Nexus 9300 FEX Support on Nexus 9000Network Design and Scaling with Nexus 9000Enhanced NX-OS Auto

37、mation and ProgrammabilityNexus 9500/9300 Investment ProtectionNexus 2200 FEX SupportInvestment protectionCost-effective 100 Mbps/1 Gbps server accessFEX support scalabilityUp to 32 FEXs per Nexus 9500Up to 16 FEXs per Nexus 9300Nexus 2248TPNexus 2248TP-ENexus 2232PP-10GbpsNexus 2232TMNexus 2232TM-E

38、Nexus 2248PQNexus B22-HPNexus B22-DellNexus 9500/9300 Investment ProtectionNexus 2000 FEX SupportSupported FEX Topology:Single-homed FEXvPC port channel to hostsact/stdyAgendaCisco Nexus 9000 Series Switches IntroductionNexus 9500Nexus 9300 FEX Support on Nexus 9000Network Design and Scaling with Ne

39、xus 9000Enhanced NX-OS Automation and ProgrammabilityCollapsed Aggregation And Access Option 1: Layer 2 and 3 boundary is on the corevPC between aggregation and coreNexus 9500 can be EoR with FEX in the racksNexus 9300 can be MoR and EoR with FEX in the racksOption 2: Layer 3 all the way to accessEC

40、MP between access and aggregationNexus 9500 can be EoR with FEX in the racksNexus 9300 can be MoR and EoR with FEX in the racksConfiguration OptionsNexus 7000DC EdgeDC CoreDC Aggr./AccessCollapsed Aggregation and AccessDC AccessRacks/RowsFabric ExtendersFabric ExtendersN9300 N9300 N9300 N9300 N9500

41、N9500 N9500 N9500 N9500 N9500 Traditional 3-Tier Network DesignOption 1: Layer 2 or 3 boundary is on aggregationvPC between access and aggregationNexus 9500 can be EoRNexus 9300 can be ToR or MoROption 2: Layer 2 or 3 boundary is on aggregationvPC between access and aggregationNexus 9500 can be EoRN

42、exus 9300 can be ToR or MoRConfiguration OptionsNexus 7000DC EdgeDC CorePoD NDC AccessDC Aggr.Traditional 3-Tier NetworkPoD 1DC AccessDC Aggr.Racks/ RowsFabric ExtendersFabric ExtendersN9300 N9300 N9300 N9300 N9500 N9500 N9500 N9500 N9500 N9500 N9500 N9500 N9500 N9500 Configuration Options:Layer 3 IP fabricLayer 3 all the way to accessLayer 2 extensibility can be provided by VXLANNexus 9500 can be EoRNexus 9300 can be ToR and MoR