VMware Virtual SAN超融合方案-深入介绍

1、VMware Virtual SAN超融合方案深入介绍Technical WalkthroughVirtual SAN Technical Walkthrough 1SDS and Virtual SAN Overview 2Use Cases3Hardware Requirements4Technical Characteristics and Architecture5Configuration Walkthrough6Virtual Machine Provisioning Operations7Resiliency and Failed Scenarios8Interoperabili

2、ty9Design Considerations10Troubleshooting2The Software-Defined Data CenterTransform storage by aligning it with app demands3Expand virtual compute to all applicationsVirtualize the network for speed and efficiencyManagementtools give wayto automationCustomers Face Several Challenges with Storage Tod

3、ay4Device-centric SilosStatic classes of serviceRigid provisioningLack of granular controlFrequent data migrationsTime consuming processesLack of automationSlow reaction to requestComplex ProcessesVIAdminStorage AdminApp AdminNot commodityLow utilizationOverprovisioningSpecialized Expensive HWA New

4、Approach is Needed: Software-Defined Storage5New Control PlaneFrom Hardware-centric to App-centricNew Data PlaneFrom Specialized to Industry Standard HardwareSoftware-Defined StorageStorage Today Policy-driven automationCommon across arraysDynamic controlServer SANFlash acceleratedDistributed6VMware

5、 vSphere Storage Policy-Based MgmtApp-centric storage automationCommon mgmt across heterogeneous arraysVMware Virtual SANHyper-converged architectureData persistence delivered from the hypervisorThe VMware Software-Defined Storage VisionTransforming Storage the Way Server Virtualization Transformed

6、ComputevSpherevSphere Virtual Volumes Extends the Control Plane of Software-Defined Storage to the Ecosystem7VMware Software-Defined StoragevSphereStorage Policy-Based MgmtvSpherevSphereVirtual SANStorage Policy-Based MgmtVVOL-enabled arraysVMware Software-Defined StoragevSphere Virtual VolumesThe S

7、torage Partner Ecosystem has Rallied behind Virtual SAN and Virtual Volumes8vSphereVirtual SANStorage Policy-Based MgmtVVOL-enabled arraysVMware Software-Defined StoragevSphere Virtual VolumesStorage Policy-Based Management:9vSphereStorage Policy-Based MgmtVirtual SANCapacityPerformanceAvailability2

8、 Failures to tolerateObject Space Reservation 10 GBFlash Read Cache10 %Intelligent storage placement at scaleDynamic adjustments in real timeAutomated policy enforcement App-centric Control Plane That Across Storage TiersVMware Virtual SAN 6.0Radically Simple Hypervisor-Converged Storage for VMsVMwa

9、re Virtual SAN : Hybrid Architecture11vSphere + Virtual SANSoftware-defined storage built into vSphereRuns on any standard x86 serverPools HDD/SSD into a shared datastoreManaged through per-VM storage policiesHigh performance through flash accelerationHighly resilient - zero data loss in the event o

10、f hardware failuresDeeply integrated with the VMware stackVirtual SANHard disksSSDHard disksSSDHard disksSSDVirtual SAN DatastoreRadically Simple Hypervisor-Converged Storage SoftwareVirtual SAN Can Be Deployed With A Tiered Hybrid Or All-Flash Architecture12HybridAll-Flash40K IOPS per Host90K IOPS

11、per Host+sub-millisecond latencyNew!CachingRead and Write CacheWrites cached first, Reads go direct to capacity tierCapacity TierSAS/NL SAS/SATA/Direct-attached JBODCapacity TierFlash DevicesReads go directly to capacity tierDataPersistenceVirtual SANSSDPCIeUltra DIMMSSDPCIeUltra DIMMVMware Virtual

12、SAN: All-Flash Architecture13vSphere + Virtual SANFlash devices used for caching as well as data persistenceCost-effective all-flash 2-tier model:Cache is 100% write: using write-intensive, higher grade flash devices (SSDs, PCIe, Ultra DIMM)Persistence tier: can leverage lower cost read-intensive SS

13、DsUp to 90K IOPS/HostConsistent performance with sub-millisecond latenciesVirtual SAN All-FlashVirtual SAN All-Flash DatastoreSSDsSSDsSSDsPerformance with Predictable LatencyVirtual SAN 6.0 Performance and Scale Improvements144x Performance 2x Scale90K IOPS/host (4.5x more)Scale to 64 nodes (2x more

14、)200 VMs/host (2x more)62 TB max. virtual disk sizeEnterprise Data ServicesNew high performance snapshots & clonesRack awareness to tolerate rack failuresHW-based checksum & encryptionBroader Hardware SupportExpand scalability for blades with direct-attached JBODs Expanded HCL and more ready nodesAl

15、l FlashArchitectureData persistence on SSDIntelligent caching and two-tier architectureDisk FormatVSAN 5.5 to 6.0Disk Serviceability FunctionsIn-Place modular rolling upgrade Seamless In-place UpgradeSeamless Upgrade Rollback Supported Upgrade performed from RVC CLIPowerCLI integration for automatio

16、n and managementAbility to manage flash-based and magnetic devices.Storage consumption models for policy definitionDefault Storage PoliciesResync Status dashboard in UIVM capacity consumption per VMDKDisk/Disk group evacuationNew On-Disk FormatNew delta-disk type vsanSparsePerformance Based snapshot

17、s and clonesVirtual SAN 6.0 New FeaturesVSAN PlatformNew Caching Architecture for all-flash VSANVirtual SAN Health ServicesProactive Rebalance Fault domains supportHigh Density Storage Systems with Direct Attached StorageFile Services via 3rd partyLimited support hardware encryption and checksum15VM

18、FS-LVSAN FS2x16x 31x2x2x 4.5xVirtual SAN 6.0 Ready for Enterprise-Class Applications16Virtual SAN 5.5Virtual SAN 6.0HybridVirtual SAN 6.0All-FlashHosts per Cluster326464VMs per Host100200200IOPS per Host20K40K90KSnapshot depth per VM23232Virtual Disk size2TB62TB62TBVirtual Machine per Cluster3200640

19、06400Virtual SAN is Deeply Integrated with VMware StackIdeal for VMware environments bringing the benefit of VMwares products to make storage easyvMotionvSphere HADRSStorage vMotionvSphereSnapshotsLinked ClonesVDP AdvancedvSphere ReplicationData ProtectionVMware ViewVirtual DesktopvRealize Operation

20、svRealize AutomationIaaSCloud Ops and AutomationSite Recovery ManagerDisaster RecoverySite ASite BStorage Policy-Based Management17Virtual SAN Is Built Into vSphereDrivers embedded in the VM kernel contain the Virtual SAN smartsNo need to install virtual appliancesCPU utilization 15 min and 2/3 dail

21、y snapshotsIntegrated with vSphere Replication and VMware SRMReduces cost of storageMinimizes data center footprintHandle peak performance requirements (boot, login, read/write storms) Granularly scale from POC to production without huge upfront investmentsSupports high VDI densityCustomers are Depl

22、oying VSAN in Several Use CasesSite ASite BStaging & Test/DevRapid storage provisioning and complete automationReduces cost of storage for non-mission critical workloadsEnables Cloud Architect to easily provision storage20Virtual SAN 6.0 Now Ready For Business-Critical Apps21VDIDRTest/DevVirtual Inf

23、rastructureBest storage for VMsOptimized for Virtual InfrastructureEnterprise-classReady for business critical appsBusinessCritical AppsVMware Virtual SANHardware RequirementsHardware Requirements23Any Server on the VMware Compatibility GuideAll flash-based devices, and storage controllers MUST be l

24、isted on the VMware Compatibility Guide for VSAN 1Gb/10Gb NICSAS/SATA Controllers (RAID Controllers must work in “pass-through” or RAID0” mode)SAS/SATA/PCIe SSDSAS/NL-SAS/SATA HDDAt least 1 of each(Except All-Flash)4GB to 8GB USB, SD CardsBoot DevicesWhat installation device to use:Depends on amount

25、 of host memoryUp to 512 GBUse SD/USB devices as the installation media. 512 GB or greaterUse a separate magnetic disk or solid stated disk as the installation device24Flash Based DevicesIn Virtual SAN hybrid ALL read and write operations always go directly to the Flash tier.Flash based devices serv

26、e two purposes in Virtual SAN hybrid architectureNon-volatile Write Buffer (30%)Writes are acknowledged when they enter prepare stage on the flash-based devices.Reduces latency for writesRead Cache (70%)Cache hits reduces read latencyCache miss retrieve data from the magnetic devicesChoice of hardwa

27、re is the #1 performance differentiator between Virtual SAN configurations.25Flash Based DevicesIn Virtual SAN all-flash read and write operations always go directly to the Flash devices.Flash based devices serve two purposes in Virtual SAN All Flash:Cache Tier (write buffer)High endurance flash dev

28、ices.Listed on VCGCapacity TierLow endurance flash devicesListed on VCGChoice of hardware is the #1 performance differentiator between Virtual SAN configurations.26Flash Based DevicesVMware SSD Performance Classes Class A: 2,500-5,000 writes per secondClass B: 5,000-10,000 writes per secondClass C:

29、10,000-20,000 writes per secondClass D: 20,000-30,000 writes per secondClass E: 30,000+ writes per secondExamplesIntel DC S3700 SSD 36000 writes per second - Class EToshiba SAS SSD MK2001GRZB 16000 writes per second - Class CWorkload Definition Queue Depth: 16 or lessTransfer Length: 4KBOperations:

30、writePattern: 100% randomLatency: less than 5 msEnduranceTerabytes Writes per lifetime of the deviceRandom write endurance up to 3.5 PB on 8KB transfer size per NAND module, or 2.5 PB on 4KB transfer size per NAND module27Magnetic Disks (HDD)SAS/NL-SAS/SATA HDDs supported7200 RPM for capacity10000 R

31、PM balance between capacity and performance15000 RPM for additional performance NL SAS will provide higher HDD controller queue depth at same drive rotational speed and similar price pointNL SAS recommended if choosing between SATA and NL SAS 28Storage ControllersSAS/SATA Storage Controllers Pass-th

32、rough or “RAID0” mode supportedPerformance using Pass-through mode is controller dependentCheck with your vendor for PCI-e device performance behind a RAID-controllerReplacing devices for upgrade of failure purposes may required host downtime Support hot plug devicesStorage Controller Queue Depth ma

33、tters Higher storage controller queue depth will increase performanceMinimum queue support 256Validate number of drives supported for each controller29Storage Controllers RAID0 ModeConfigure all disks in RAID0 modePCI-e based devices (SSD)Magnetic disks (HDD)Disable the storage controller cacheAllow

34、s better performance as cache is controlled by Virtual SAN Disks Device cache supportFlash based devices leverage write through cachingESXi may not be able to differentiate flash based devices from magnetic devices.Use the vSphere Web Client under the Cluster Virtual SAN Settings Disk management Use

35、 ESXCLI to manually flag the devices as PCI-e device (SSD)30Network1Gb / 10Gb supported for hybrid architecture10Gb shared with NetIOC for QoS is recommended for most environmentsIf 1GB then recommend dedicated links for Virtual SAN10Gb only supported for all-flash architecture10Gb shared with NIOC

36、for QoS will support most environmentJumbo Frames will provide nominal performance increaseEnable for greenfield deploymentsEnable in large deployments to reduce CPU overheadVirtual SAN supports both VSS & VDSNetIOC requires VDSNetwork bandwidth performance has more impact on host evacuation, rebuil

37、d times than on workload performance31Firewall PortsVirtual SAN Vendor Provider (VSANVP)Inbound and outbound TCP 8080Virtual SAN Clustering Service (CMMDS) Inbound and outbound UDP 12345 23451Virtual SAN Transport (RDT)Inbound and outbound TCP 2233 32Virtual SAN Support for Blade-only Direct Attache

38、d JBODs2015 & 2016Storage BladesBlade ServersSAS ConnectionManage disks in enclosures Enables Virtual SAN to scale on blade servers by adding more storage to blade servers with few or no local disks Flash acceleration provided on the server or in the subsystemSupported on both VSAN 5.5 and 6.0Exampl

39、es: IBM Flex SEN with x240 Blade SeriesDell FX2 with 12G ControllersDirect Attach Compute:Storage 1:1High Density Direct Attached Storage VMware Virtual SAN VCG and Ready Nodes341212/go/virtualsan-hclVirtual SAN Hardware Quick Reference Guide5 Ready Node profile guidelinesSizing assumptionsDesign co

40、nsiderationsVirtual SAN Ready NodesList components and quantity that make up each Ready NodeInfo on how to quote/order the Ready Node33Always use certified components!Drivers and firmwareSupportability Increase customer satisfactionReduce rework and time-to-marketVMware Virtual SAN: One Destination

41、SDDC & SDS, Three Paths35Component Basedusing the VMware Virtual SAN Compatibility Guide (VCG) (1)Choose individual components SSD or PCIeSAS/NL-SAS/ SATA HDDsAny Server on vSphere Hardware Compatibility ListHBA/RAID ControllerVirtual SAN Ready Node40+ OEM validated server configurations ready for V

42、irtual SAN deployment (2)Note: 1) Components must be chosen from Virtual SAN HCL, using any other components is unsupported see Virtual SAN VMware Compatibility Guide Page2) VMware continues to update/add list of the available Ready Nodes, please refer to Virtual SAN VMware Compatibility Guide Page

43、for latest list3) Product availability varies by countries. Please contact your local VMware partners for details, pricing and availability click here Maximum FlexibilityMaximum Ease of UseVMware EVO:RAILA Hyper-Converged Infrastructure Appliance (HCIA) for the SDDCEach EVO:RAIL HCIA is pre-built on

44、 a qualified and optimized 2U/4 Node server platform. Sold via a single SKU by VMware Qualified EVO:RAIL Partners (QEPs) (3) Software + Hardware Hyper-Converged InfrastructureThere are 5 VSAN Ready Node Profiles Server WorkloadVirtual SAN All Flash - ServerServer Low ProfileServer Medium ProfileServ

45、er High ProfileUp to 30VMsUp to 4K IOPs5TB raw capacityUp to 60VMsUp to 24K IOPs8TB raw capacityUp to 120VMsUp to 40K IOPs14.4TB raw capacityVirtual SAN Hybrid - ServerServer Medium ProfileServer High ProfileUp to 60VMsUp to 60K IOPs8TB raw capacityCapacity 8x1TB SSDCaching 2x200GB SSDUp to 120VMsUp

46、 to 80K IOPs12TB raw capacityCapacity 12x1TB SSDCaching 2x400GB SSDFor complete details on the sizing assumptions and design considerations of the Ready Node profiles, please refer to the “Virtual SAN Hardware Quick Reference Guide” on the Virtual SAN VMware Compatibility Guide PageThere are 4 VSAN

47、Ready Node Profiles VDI WorkloadVirtual SAN All Flash - VDIVDI Linked Clones ProfileVDI Full Clones ProfileUp to 100 desktopsUp to 10K IOPs1.2TB raw capacityUp to 100 desktopsUp to 10K IOPs10.8TB raw capacityFor complete details on the sizing assumptions and design considerations of the Ready Node p

48、rofiles, please refer to the “Virtual SAN Hardware Quick Reference Guide” on the Virtual SAN VMware Compatibility Guide PageVirtual SAN Hybrid - VDIVDI Linked Clones ProfileVDI Full Clones ProfileUp to 200 desktops1.6TB raw capacityCapacity 4x400GB SSDCaching 1x400GB SSDUp to 200 desktops9.6TB raw c

49、apacityCapacity 12x800GB SSDCaching 2x400GB SSDVMWARE FIELD & PARTNER USE ONLY - CONFIDENTIALVMware Virtual SAN 6.0 Data ServicesPlatform Data Services38VSAN 6.0 currently offers the following data services and capabilitiesPerformance based snapshots and clonesHigh AvailabilityReplication ServicesDa

50、ta ProtectionRead / Write CachingHardware Checksum (via VSAN Ready Node)Hardware Encryption (via VSAN Ready Node)File Services (via 3rd party)NexentaConnect delivers the following file shares on top of VSAN:SMBNFSData services are unique to VSAN or made available through vSphere integrationVMware Vi

51、rtual SANTechnical Characteristics and ArchitectureTechnical CharacteristicsVirtual SAN is a cluster level feature similar to: vSphere DRSvSphere HAVirtual SANDeployed, configured and manage from vCenter through the vSphere Web Client (ONLY!).Radically simpleConfigure VMkernel interface for Virtual

52、SANEnable Virtual SAN by clicking Turn On40Virtual SAN Implementation RequirementsVirtual SAN requires:Minimum of 3 hosts in a cluster configurationAll 3 host MUST! contribute storageMaximum of 64 hostsLocally and HDDAS attached devicesMagnetic devicesFlash-based devices Network connectivity1GB Ethe

53、rnet10GB Ethernet (preferred for hybrid, required for all-flash)41esxi-01local storagelocal storagelocal storagevSphere Clusteresxi-02esxi-03HDDHDDHDDdisk groupdisk groupdisk groupStorage Policy-based Management FrameworkVirtual SAN leverages a storage policy framework in conjunction with VASA APIs

54、to expose storage characteristics to vCenter.SPBM is a storage policy framework built into vSphere that enables VM-centric policy driven provisioning.Storage CapabilitiesUnderlying storage and its capabilities are surfaces to vCenter.Virtual Machine Storage RequirementsRequirements can only be used

55、against available capabilities.VM Storage PoliciesConstruct that stores virtual machines storage provisioning requirements based on storage capabilities. 42Storage Policy WizardSPBMobjectVSAN object managervirtual diskVSAN objects may be (1) mirrored across hosts & (2) striped across disks/hosts to

56、meet VM storage profile policiesDatastore ProfileVirtual SAN SPBM Object Provisioning MechanismVMware Virtual SANConstructs, Artifacts and TerminologiesVirtual SAN Disk GroupsVirtual SAN uses the concept of disk groups to pool together cache devices and capacity devices as single management construc

57、ts.Virtual SAN Hybrid disk groups configurations are composed of at least 1 cache device (PCI-e) and 1 capacity device (HDD)Cache devices are use for performance (Read cache + Write buffer).Capacity devices are used for storage capacity.Disk groups cannot be created without a cache device.45disk gro

58、updisk groupdisk groupdisk groupEach host: 5 disk groups max. Each disk group: 1 cache device + 1 to 7 capacity devicesdisk groupcache devicecapacity devicescapacity devicescapacity devicescapacity devicescapacity devicescache devicecache devicecache devicecache deviceVirtual SAN Disk GroupsVirtual

59、SAN All-Flash disk group configurations are composed of at least 1 performance flash device and 1 capacity flash device.Flash devices are use in a two tier format for caching and capacity.Capacity flash devices are used for storage capacity similar to magnetic disks.All-Flash disk groups cannot be c

60、reated without a capacity flash device.46disk groupdisk groupdisk groupdisk groupEach host: 5 disk groups max. Each disk group: 1 Performance + 1 to 7 Capacity Devicesdisk groupcapacity devicescaching devicescaching devicescaching devicescaching devicescaching devicescapacity devicescapacity devices