思科UCS技术深度介绍

1、思科UCS技术深度介绍Unified Computing SystemDay 1 AgendaUnified Computing Architecture and Building BlockUCS Connectivity UCS ManagementDay 2 AgendaUCS GPU for VDIUCS Open StackUCS Big DataLABsUCS Architecture & Building BlocksCisco UCS B-Series Compute PlatformChassis I/O ModuleLANLogical View of UCSSANSwit

2、ch Fabric | Svr. MgmtFCoE | UCS ManagerRack Mount ServersC-SeriesBlade Chassis | Svr. BladesB-SeriesFront View of UCS2 x power supplies2 x fan modules4 x Single Slot blades2 x double slot blades4 x power supplieschassisredundantfabric interconnectRear View of UCS4 x power entry2x IO Modulesmanagemen

3、t portFI Cluster portsconsole port6100 Series 20/406200 Series 48/96 x fabric/border ports2 x power entry8 x fan modulesexpansion module bayBlade Building BlocksExample - B22 M3Half Width, 2 Socket Blade Server, Sandy Bridge-EN (95W Capable), 12 DIMM, 2 SFF HDD, 1 PCIe Gen3 mezzanine slot, 2 x 20 Gb

4、 capable mLOM, Modular TPM, 2 x Flexible Flash 16GB SD Cards, internal USB port Full Width, 4 Socket Blade Server, Sandy Bridge-4S EP (130W Capable), 48 DIMM, 4 SFF HDD, 2 PCIe Gen3 mezzanine slot, 2 port x 40 Gb capable mLOM, Modular TPM, 2 x Flexible Flash 16GB SD Cards, internal USB port Example

5、- B420 M3MezzanineLOMMezzanineLOMMezzanineLOMLcl StorageLcl StorageLcl StorageMemoryCPUMemoryCPUUCS B-Series Adapter Offerings - VICsVM I/O Virtualization and ConsolidationPCIe x1610GbE/FCoEvNICsEth0FC12FC3Eth127EthVIC 1240B200 M3, B420 M3, B22 M32 x 10 fab A2 x 10 fab BExpander Card 2 x fab A and 2

6、 X fab B VIC 1280B200 M2, B250 M2, B440 M2, B230 M24 x 10 fab A4 x 10 fab B48 | 96 - Port Fabric Interconnects 6200 UP2RUCisco UCS 6200 Series FI ComparisonProduct Features and SpecsUCS 6248UPUCS 6296UPSwitch Fabric Throughput960 Gbps1920 GbpsSwitch Footprint1RU2RU1 Gigabit Ethernet Port Density4896

7、10 Gigabit Ethernet Port Density48961/2/4/8G Native FC Port Density4896Port-to-Port Latency2.0us2.0us# of VLANs40964096Layer 3 Ready (future)40 Gigabit Ethernet Ready (future)Virtual Interface Support63 per Downlink63 per DownlinkUnified Ports (Ethernet or FC)Expansion Modules For 6200 SeriesUCS 620

8、0 Series Expansion Module-UPUnified PortPort can be :FCoEEthFCSlide Bare SelectionCan be defined as :ApplianceStorageServerUplinkI/O Module (Fabric Extenders)IOM-2204IOM-2208BackplaneRedundant data and management pathsI/O ModulesBlade ConnectorsPSU ConnectorsUCS M-Series Modular ServersCloud-Scale I

9、nverts Computing Architecture Core Enterprise WorkloadsCloud ScaleMany ApplicationsServerSingle ServerMany ServersSingle ApplicationSCMERP/FinancialLegacyCRMEmailOnline ContentGamingMobileIoTE-CommerceHypervisorCisco System Link TechnologyExtending the UCS Fabric inside the serverComputeShared Infra

10、structureShared Local ResourcesPCIeCompute CartridgesUCS M SeriesShared Local Resources Improved utilization of resourcesResource amortization over smaller nodesBased on Cisco System Link Technology Third Gen VIC extends UCS fabric to within the serverModular Design Improved subsystem lifecycle mana

11、gementAbility to scale individual subsystems independently Lean Componentry Improved compute densityCost and power optimizationUCS M-Series Composable Server19M-Series Design ConsiderationsUCS M-Series was designed to complement the compute currently shipping B-Series and C-Series serversThe goal of

12、 the M-Series is to offer smaller compute nodes to meet the needs of scale- out applications, while taking advantage of the management infrastructure and converged innovation of UCS By disaggregating the server components, UCS M-Series helps provide a component life cycle management strategy as oppo

13、sed to a server-by-server strategyUCS M-Series provides a platform that will provide flexible and rapid deployment of compute, storage, and networking resources202 x 40 GbUplinksMidplane4 x SSD Drives w/ControllerPower& CoolingApplication seesUCSManagementPolicy-based profiles applied to resourcesNe

14、tworkResourcesComputeResourcesStorageResourcesPower & CoolingResourcesCisco System Link Technology2U Rack Mount ChassisUCS M-Series ArchitectureNetworkResources21UCS M-Series OverviewFront View2 RUBrand new modular compute platform portfolioUCS M4308 Modular ChassisProduct Line Extension to the curr

15、ently shipping B-Series and C-SeriesPowered by Cisco System Link -Next generation UCS ASIC technology used in the VICFocus AreasDensity, Power Efficiency, Modularity, Ease of ManagementRear View4 x SSD Scale from 480 GB SATA to 6.4 TB SAS2 x 40 Gb UplinksPower Supplies 2 x 1400 WattsUCS M-Series Car

16、tridges Portfolio12Aggregate Capacity 16 Servers 64 Xeon Cores512 GB MemoryMax ClockSpeed 2.7 GHzMax TDP 45 W /procAggregate Capacity 8 Servers 32 Xeon Cores256 GB MemoryMax ClockSpeed 3.7 GHzMax TDP 82 W /procAggregate Capacity 4 Servers 80 Xeon Cores1024 GB MemoryMax ClockSpeed 2.6 GHzMax TDP 105

17、W / procUCS M142UCS M1414UCS M2814Role of the Fabric Interconnect and UCS ManagerUCS M-Series operates only in UCS managed mode Unique version of UCS Manager for the first few quartersUCS Manager is required to provide configuration of network and storage resourcesAll switching is local to the fabri

18、c interconnectsEach vNIC has a unique virtual Ethernet interface on the fabric interconnectStatistics and counters are centralized by UCS Manager for each interfaceCisco UCS 3x60 ProductC3160 Rack Storage ServerSingle Server Node40Gbps Connectivity with 4x10GbpsStandalone CIMC and CIMC SupervisorC32

19、60 Rack Storage ServerDual Server NodeDrives available to both Server Nodes, asymmetric split of drives between nodes available160Gbps with 4x 40Gbps(QSFP)Standalone CIMC, CIMC Supervisor, and UCSM Single/Dual ServerDual CPU Socket per serverUp to 1TB Memory512GB per ServerDual Modular LOM (mLOM)Mul

20、tiple Connectivity OptionsUp to 4GB RAID CacheEnterprise Storage FeaturesUp to 62 Drive Bays60 LFF with support for up tp 14 SSDs, plus up to 4 SFF Boot SSDUCS C3000 Capacity Optimized Server FamilyCommon Chassis, Drives, PSU, 12Gbps SAS-3 InfrastructureUp to 12Gbps SAS-3 4K Native Drives SupportedF

21、ully Modular ChassisLower TCO and $/GBShorter Depth with innovative airflowLess than 32 inches no need for extended rackInvestment ProtectionDesigned for future upgradeability with Server Refresh, HDD, SDDBest Sequential I/O and System ThroughputDesigned for 12Gbps Performance with support for SAS-3

22、 and 4K Native DrivesCapable of up to 160Gbps ThroughputUCS C3000 AdvantagesModular Architecture of the UCS C3000Note: Only difference between C3160 and C3260 is SIOCHDD4 Rows of hot-swappable HDD4TB/6TB with up to 1 row of 400GB/1.6TB SSDTotal top load: 56 drivesFAN8 hot-pluggable fansServer Node2x

23、 E5-2600 V2 CPUs128/256GB RAM1GB/4GB RAID CacheSAS HBA NodeOptional Disk Expansion4x hot-swappable, rear-load LFF 4TB/6TB HDDTwo 120GB/480GB SSDsHot-Plug OS/BootSystem I/O Controller (SIOC)Cisco mLOM Slot or VIC 1300 on ChipPower Supply4 hot-pluggable PSUsThere are up to 2 System IO Controllers (SIO

24、C) per C3260 systemResponsible for system services, CIMC, network managementEach SIOC has a Dedicated management portConsole Port for PPCUSB PortUCSC C3260 SIOC also contains a embedded VIC 1300 SeriesWith 2 x 40G QSFP, capable of 4x10G/10GBaseT via Breakout Cable or 2x10G via QSAUCS C3260 System I/

25、O ControllerPID: UCSC-C3260-SIOCAug 2015FCoE NFSiSCSISMB, SMB Direct (for C3260 Only)Supported Storage Connectivity on UCS C3000C3260: Drives / Storage ManagementTop Load Drives (56x)2x2x2x2xC3260 system allocates storage from a pool to each node via chassis manager serviceChassis Manager controls d

26、rive allocation to nodes and handles mapping of drives via expander zoningDrive management is dynamic and can be performed as part of service profile or on-the-fly2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2x2xLSI 310812G SAS RoCC3260 Server Node 2E5-2620v2 / 256GBC3260 - Server Node 4E5-2695v2 / 2

27、56GBIntel PatsburgSATA2x2x2x 120GB or 480GB SATA SSDLSI 310812G SAS RoCIntel PatsbergSATA2x2x2x 120GB or 480GB SATA SSDAll drives zoned at expander levelSSDHDDe.g. 40 HDD (160TB) allocated to C3260Server Node Be.g. 12 SSD (4.8TB) + 4 HDD (16TB) allocated to C3260Server Node ASimilar to other rack se

28、rvers, C3260 has two different networking modes that use can select from: Dedicated and Cisco Card ModeManagement traffic is transported via SIOC that has the Active CMCManagement network OverviewDedicated ModeCisco Card ModeUse Cases for the UCS C3000 Server FamilyService ProvidersPublic SectorServ

29、ice Providers, EnterpriseSoftware Defined StorageObject StoreMedia Streaming and Content DistributionVideo SurveillanceExchangeBackup and Archive (as Service)Service Providers, Enterprise, CloudCisco UCS C3x60Service Providers, EnterpriseBig Data and Analytics100+ Customers Testing/Deploying UCS C31

30、60Storage SpacesCisco UCS Mini* Dual purpose chassis5108 Chassis OverviewUpdated ChassisNew PIDPhysically the sameAdded backplane traces to support 6324 Fabric InterconnectHW Backward CompatibleSupport current and new Fabric Interconnect and IOMsClassical deployment requires UCS 2.2(1b)Mini UCS requ

31、ires UCS 3.0(1)Support current and new Power SuppliesSupport existing and new serversFrontRear* Swap out chassis I/OChassis and PSU Changes+=N20-C6508N20-C6508-UPGUCSB-5108-DCUCSB-5108-DC-UPGUCSB-5108-AC2UCSB-5108-AC2-UPGUCSB-5108-AC2=UCSB-5108-DC2UCSB-5108-DC2-UPGUCSB-5108-DC2=New backplane1Gbit su

32、pport for Cluster Interconnect10Gbit data x-link (Post-FCS feature)Does not affect 2208/2204 FEX Change to new PSU that supports 100-120V & 200-240V available in UCS at 200-240VUCSB-PSU-2500ACPLUCSB-PSU-2500ACDVGo forward Chassis for all UCSGo forward PSU for all UCS ChassisUCS or UCS MiniWhat combi

33、nation of components are chosenUCS 5108 Chassis with new backplane (UCSB-5108-AC2 etc)Supports existing and future blades+=UCS2204XP2208XP6248 Fabric Interconnect6296 Fabric Interconnect+New PSU at 200-240V (UCSB-PSU-2500ACDV)+=UCSMiniUCS 5108 Chassiswith new backplane (UCSB-5108-AC2 etc)+Mini FI632

34、4UCS-FI-M-6324Dual Voltage PSU (UCSB-PSU-2500ACDV)UCS Mini Chassis SupportPower Supplies and ServersUCS Server SupportUCSM 3.0(1)B200M3C220M3 & C240M3UCSM 3.0(2)B200 M4B22 M3C220M4 & C240M4Future ReleaseB420 M4B260 M4/B460 M4Dual Voltage Power Supplies2,500W Output 200 240V1,300W Output 100 120V100

35、120V Mode Limitations2+2 = 2,600W 4-6 Blades max3+1 = 3,900W 6-8 Blades6324 Fabric InterconnectUCS-FI-M-6324 4 x10G SFP+Unified PortsUplink (Eth/FC/FCOE)Server Direct-attached only, no FEXAppliance portFC/FCoE Storage Port Supports 1G or 10G1x40G QSFP+Not supported as an uplinkEth/FCoE only4x10G bre

36、ak outLicensed Port2nd Chassis Q4 CY15 Direct-attached C-series, no FEXAppliance PortFCoE Storage PortManagement Port10/100/1000 MbpsUSB PortFirmware upgradesConsole Port6324 Fabric InterconnectExpansionFCS release8 blades in single chassisUp to 7 rack mount serversC220M3 and C240M3Post FCS ReleaseC

37、onnect up 2 Chassis2nd chassis is child (with 2204XP or 2208XP IOM)Licensed 40G scalability portTotal 20 Servers 16 Blades4 Rack ServersPost FCSFCSUCS MiniB200 M3/M4 Blade ServerB420 M3 Blade ServerC240 M3/M4 Rack ServerUCS Manager 3.0C220 M3/M4 Rack Server6324 Fabric InterconnectsEnterprise Capabil

38、ity at Edge ScaleConnect up to 7 C-Series rack servers for expanded capacityNew architectural entry point for Unified Computing UCS in an All-in-One package: ComputeNetworkingUCS ManagementUnified Computing in 6UChassis-Integrated Fabric InterconnectsStandard UCS Blades / Fans / Power SuppliesUCS Mi

39、niStorage Architectural Support, 3.0.2Network Attached File/BlockNo certification requiredUCS InvictaNetwork Attached StorageETH 1ETH 2iSCSI/NASiSCSI/NASETH 1ETH 2iSCSI/NAS/FC/FCoELANSANCisco MDS/Nexus 5000/ BrocadeFC/FCoESwitch Mode or NPV modeDirect Attached StorageSAN Attached StorageiSCSI/NAS/FC

40、/FCoEUCS ConnectivityDescribe UCS ConnectivityDescribe Port Functions on the UCS 6100 and 6200 SeriesConsole PortMgmt 0Mgmt 1UnusedL1 ClusteringL2 Clustering Note: 6100 series are older modelNote: 6200 series are current modelNetworking Component Summary2104 | 2204 XP I/O Module40 Gigper fabric2104X

41、P2208XP I/O Module2208XP80 GigPer fabric2104XP IOM vs. 2208XP IOM2x Chassis ThroughputBlade 1Blade 2Blade 3Blade 4Blade 5Blade 6Blade7Blade 8Server PortsFabric PortsFabric Interconnect 6200IOMPort ChannelIOM 2208XPOnly possible between 6200-2208XPHost IFs pinned to port-channelPort-Channel HashIP L2

42、 DA/SA, VLAN, L3 DA/SA, L4 DP/SPFCoEL2 SA/DA, L2 VLAN, FC SID/DID, FC-OXIDPort-Channel (IOM-FI)Fabric Ports: Discrete vs. Port Channel ModeServers can utilize all 8x 10GE IOM uplinksBandwidth range per blade 0 to 160 GbA blade is pinned to a logical interface of 80 Gbps FabricFailover if all uplinks

43、 on same side go downPer flow traffic distribution with-in a port-channelRecommended with VIC 1280 Suitable for most environments MOST FLEXIBLEServers can only use a single 10GE IOM uplinkBandwidth range per blade - 0 to 20 GbA blade is pinned to a discrete 10 Gb uplinkFabricFailover if a single upl

44、ink goes downPer blade traffic distribution , same as BalboaSuitable for traffic engineering use caseSuitable in a multitenancy environment160 Gb (Discrete Mode)Slot 1Slot 2Slot 3Slot 4Slot 5Slot 6Slot 7Slot 8160 Gb (Port Channel Mode)Slot 1Slot 2Slot 3Slot 4Slot 5Slot 6Slot 7Slot 8Topology Designs

45、For Maximum BandwidthUCS 1280 VICUCS 2208 IOMSide AUCS 6248UPShared IOM Port Channel bandwidth of 20-80GbpsvNIC Burst up to 40GbpsShared IOM Port-Channel with 8 serversHost port-channel pinned to the IOM port-channelSide B1280 VIC UCS 2104 IOMSide AShared IOM uplink bandwidth of 10GbpsvNIC Burst up

46、to 10GbpsShared IOM Uplink with 1 other serverHost port pinned to a discrete IOM uplink UCS 6248UPSide BUCS 1280 VICUCS 2208 IOMSide AUCS 6248UPDedicated IOM uplink bandwidth of 10GbpsvNIC Burst up to 10Gbps*(IOM uplink limitation)Dedicated IOM UplinkHost port-channel pinned to discrete IOM uplinkSi

47、de BConnection Examples with UCS “All-in-One” Solution (UCS Mini)Architecture supported at FCSMax Scale Architecture supported post-FCSConnect up to 20 servers 16 blades + 4 rack mount serversUses existing UCS serversUse the same compute and storage bladesNew low-power optionCan use 110v or 208v PSU

48、sUCS 1200 series VICNext Generation VIC (Palo Alto) based on Sereno ASICDual 4x10 Gbps connectivity into fabric1280 4X10 / fabric1240 2X10 / fabricW / Extender add 2X10 /fabricPCIe x16 GEN2 host interfaceCapable of 256 PCIe devices (OS dependent) Same host side drivers as VIC Retains VIC features wi

49、th enhancements(iSCSI boot, Fabric Failover)SRIOV “capable” deviceVIC 1280VIC 1240VIC 1225(C-Series)PCIe Gen2 x16 Gen2 x16 Gen2 x16 Embedded CPUs 3 675 Mhz 3 675 Mhz 3 675 Mhz Connectivity 10g, 4x10g, 40g 10g, 2 x10g, 4 X 10g, 20g, 40g 2 X 10GvNICs (VNTag) 256 256 256 Port channelYesYesYesForm Facto

50、rMezzanineMezzanine + ExpanderPCIExpress(half height)VIC 1200 Series3rd Gen Cisco VICDoubles host PCIe performance, BW and Root complex resourcesDoubles embedded processing, for datapath (fNIC, sNIC) and future services Support for RDMA for SMB Direct, ROCEOver 256 Virtual DevicesFour Form FactorsBl

51、ade mLOM, Mezz, PCIe Half Height, PCIe MLOMSupport for Overlay NetworksStateless offloads for NVGRE and VXLANThe ultimate engine for true stateless computing unleashes maximum network bandwidth, features and performancePCIe Gen 3Enables Greater Bandwidth CQ314Blade VICs3rd GenerationVIC 1340 mLOMopt

52、ional port expander cardVIC 1380 Mezz2nd GenerationVIC 1240optional port expander cardVIC 1280Rack VICs3rd GenVIC 1385 Dual Port 40Gb QSFP PCIe (Mar. 2015)2nd GenVIC 1285 Dual Port 40Gb QSFP PCIeVIC 1225 Dual Port SFP+ PCIeVIC 1225T Dual Port 10GBaseT PCIeVIC 1227 Dual Port SFP+ mLOMVIC 1227T Dual P

53、ort 10GBaseT mLOM (Jan. 2015)VIC 128540Gb QSFPVIC 122510Gb SFP+VIC 1225T10Gb RJ-45VIC 122710Gb SFP+ mLOMSummarize Internal Networking Connectivity for the UCSManagement NetworkEth0Eth0Eth5Eth5NXOSUCSMNXOSL1 and L2Chassis 1Chassis 2UCSMMEZZCARDBlade 1CIMCBlade 8Chassis Management SwitchCMCCMCMEZZCARD

54、Chassis Management SwitchCIMCI/O MuxI/O MuxMEZZCARDBlade 1CIMCBlade 8Chassis Management SwitchCMCCMCMEZZCARDChassis Management SwitchCIMCI/O MuxI/O MuxFabric Interconnect 2Fabric Interconnect 110Gb10Gb10Gb10GbUCS Networking - Fabric Port TypesmonitorLANIP StorageFCoE StorageDescribe UCSM Port TypesU

55、CS 6100UCS 6100Nexus 2248Nexus 2248uplinksFC StorageapplianceServerstorage portUCS Manager View of New Port TypesPort Types vs. FI Operating Mode UCS Fabric ModesSwitching Modes: End Host EthernetServer 1VNIC 0Server 2VNIC 0uplinkuplinkFabric AL2Switching6100 AMAC LearningMAC LearningVLAN 10Spanning

56、TreeLANvEth 3vEth 1Server vNIC pinned to an Uplink portNo Spanning Tree ProtocolReduces CPU load on upstream switchesReduces Control Plane load on 6100Simplified upstream connectivityUCS connects to the LAN like a Server, not like a SwitchMaintains MAC table for Servers onlyEases MAC Table sizing in

57、 the Access LayerAllows Multiple Active Uplinks per VLANDoubles effective bandwidth vs STPPrevents Loops by preventing Uplink-to-Uplink switching Completely transparent to upstream LANTraffic on same VLAN switched locallySwitching Modes: Switch EthernetFabric Interconnect behaves like a normal Layer

58、 2 switchServer vNIC traffic follows VLAN forwardingSpanning tree protocol is run on the uplink ports per VLANRapid PVST+Configuration of STP parameters (bridge priority, Hello Timers etc) not supported VTP is not supported currently MAC learning/aging happens on both the server and uplink ports lik

59、e in a typical Layer 2 switch Upstream links are blocked per VLAN via Spanning Tree logic Server 1VNIC 0Server 2VNIC 0uplinkFabric AL2Switching6100 AMAC LearningVLAN 10LANvEth 3vEth 1RootFabric FailoverFabric Failover is only applicable in EHM.NIC teaming software required to provide failover in Swi

60、tch mode.vNIC110GE10GEvEth1OS / Hypervisor / VMvEth1IOMIOMPHY AdapterVIC 1280Cisco VIC M81KRMenlo M71KRVirtual Interface Card (VIC)6100-A6100-BL1L2L1L2Physical CableVirtual CableFI-ALANFI-BServer PortsPrimary RootSecondary RootActive/ActiveBorder PortsServer PortsPrimary RootSecondary RootBorder Por