vSAN6 5技术深入探讨

1vSAN6.5TechDeckPoweredbyVMwarevSANandvSphereRunsonanystandardx86serverPoolsHDD/SSDintoashareddatastoreDeliversenterprise-gradescaleandperformanceManagedthroughper-VMstoragepoliciesDeeplyintegratedwiththeVMwarestackvSpherevSANvSANDatastore

SupportingabroadvarietyofusecasesvSANBusinessCriticalAppsVirtualDesktops(VDI)DR/DATest/DevDMZROBOManagementStagingvSANLeveragesNext-GenerationHardwarePersistenceTiervSANNVMeSSDNVDIMMvSANNVMeNVDIMMvSANleveragesnext-genhardwareRe-Platformtodeliverthelowest$/Gigand$/IOPSCachingTierNVMeAllFlashupto150KIOPSPerHostvSAN,deeperdive5vSANobjectsandcomponentsstripe-2bstripe-2aRAID-0MirrorCopystripe-1bstripe-1aRAID-0witnessMirrorCopyRAID-1ThevSANdatastoreisanObjectStoreEachObjecthasmultipleComponentsThistoallowyoutomeetAvailabilityandPerformancerequirementsDataisdistributedbasedonVMStoragePolicyFlashDevicesAll

writesandthevastmajorityofreadsareservedbyflashstorageWrite-backBuffer(30%)(or100%inall-flash)Writesacknowledgedassoonastheyarepersistedonflash(onallreplicas)ReadCache(70%)Activedatasetalwaysinflash,hotdatareplacecolddataCachemiss–readdatafromHDDandputincacheAperformancetiertunedforvirtualizedworkloadsHighIOPS,low$/IOPSLow,predictablelatency7Achievedwithmodestcapacity:~10%ofHDDdiskgroupvSANDiskGroupsvSANusestheconceptofdiskgroupstopooltogetherflashdevicesandmagneticdisksassinglemanagementconstructsDiskgroupsarecomposedofatleast1flashdeviceand1-7capacitydevicesFlashdevicesareuseforreadcache/writebufferStoragecapacitycanbeprovidedbyeithermagneticdisksorflashbaseddevicesDiskgroupscannotbecreatedwithoutaflashdeviceCanhave5diskgroupsperhost=35capacitydevicesperhost8diskgroupdiskgroupdiskgroupdiskgroupEachhost:5diskgroupsmax.Eachdiskgroup:1flashdevice+1-7capacitydevicesDefineapolicyfirst…vSANcurrentlysurfacesfiveuniquestoragecapabilitiestovCenterServer9What

If

APIsAssignittoaneworexistingVMWhenthepolicyisselected,vSANusesittoplace/distributetheVMtoguaranteeavailabilityandPerformance10NumberofFailurestoTolerateDefinesthenumberofhosts,diskornetworkfailuresastorageobjectcantolerate.For“n”failurestolerated,“n+1”copiesoftheobjectarecreatedand“2n+1”hostcontributingstoragearerequired!11esxi-01esxi-02esxi-03esxi-04vSANPolicy:“Numberoffailurestotolerate=1”~50%ofI/Ovmdkwitness~50%ofI/ORAID-1vmdkNumberofDiskStripesPerObjectThenumberofHDDsacrosswhicheachreplicaofastorageobjectisdistributed.Highervaluesmayresultinbetterperformance.12esxi-01esxi-02esxi-03esxi-04vSANPolicy:“Numberoffailurestotolerate=1”+“StripeWidth=2”stripe-1astripe-2awitnessstripe-1bstripe-2bRAID-1RAID-0RAID-0FaultDomains,increasingavailabilitythroughawarenessCreatefaultdomainstoincreaseavailabilityFourdefinedfaultdomainsFD1=esxi-01,esxi-02FD3=esxi-05,esxi-06FD2=esxi-03,esxi-04FD4=esxi-7,esxi-08Toprotectagainstonerackfailureonly2replicasarerequiredandawitnessacross3failuredomains!13FD2FD3FD4vmdkvmdkwitnessFD1RAID-1esxi-01esxi-02esxi-03esxi-04esxi-05esxi-06esxi-07esxi-08vSpherevSANAnatomyofaHybrid/FlashWriteVMrunningonhostesxi-01esxi-01isownerofvirtualdiskobjectNumberOfFailuresToTolerate=1Objecthas2replicasonesxi-01andesxi-03GuestOSissueswriteoptovirtualdiskOwnercloneswriteoperationInparallel:sends“prepare”optoesxi-01(locally)andesxi-03esxi-01,esxi-03persistoperationtoflash(log)esxi-01,esxi-03ACKprepareoperationtoownerOwnerwaitsforACKfromboth‘prepares’andcompletesI/O!Later,ownercommitsbatchofwritesesxi-01esxi-02esxi-03vmdkvmdkRAID-1vSpherevSANDe-stagingWritesfromFlashtoHDD(hybrid)DatafromcommittedwritesaccumulateonFlash(WriteBuffer)FromdifferentVMs/virtualdisksElevatoralgorithmflusheswrittendatatoHDDasynchronouslyPhysicallyproximalbatchesofdataperHDDforimprovedperformanceConservative:overwritesaregood;conserveHDDI/OHDDwritebuffersareflushed,beforediscardingwritesfromSSDvmdkvmdkvmdkesxi-01esxi-02esxi-03vSpherevSANDe-stagingWritesfromflashtoflash(all-flash)DatafromcommittedwritesaccumulateonFlashCache(WriteBuffer)FromdifferentVMs/virtualdisksInall-flash,blocksthatarewrittenmostoften(hot)stayinwritecache.Inall-flash,blocksthatareinfrequentlyaccessed(cold)arede-stagedtoflashcapacitylayer.vmdkvmdkvmdkesxi-01esxi-02esxi-03vSpherevSANAnatomyofaHybridReadGuestOSissuesareadonvirtualdiskOwnerchoosesreplicatoreadfromLoadbalanceacrossreplicasNotnecessarilylocalreplica(ifone)AblockalwaysreadsfromsamereplicaAtchosenreplica(esxi-03):readdatafromflashReadCache,ifpresentOtherwise,readfromHDDandplacedatainflashReadCacheReplace‘cold’dataReturndatatoownerCompletereadandreturndatatoVMvmdkvmdk123456esxi-01esxi-02esxi-03vSpherevSANAnatomyofaAll-FlashReadGuestOSissuesareadonvirtualdiskOwnerchoosesreplicatoreadfromLoadbalanceacrossreplicasNotnecessarilylocalreplica(ifone)AblockalwaysreadfromsamereplicaAtchosenreplica(esxi-03):readdatafrom(write)FlashCache,ifpresentOtherwise,readfromcapacityflashdeviceReturndatatoownerCompletereadandreturndatatoVMvmdkvmdk123456esxi-01esxi-02esxi-03vSANCachingAlgorithmvSANexploitstemporalandspatiallocalityforcachingPersistentcachebythereplica(flash)Nodatalocality?(vSANclientside)ImprovedflashutilizationinclusterAvoiddatamigrationwithVMmigrationDRS:10sofmigrationsperdayNolatencypenaltyNetworklatencies:5–50microseconds(10GbE)Flashlatencieswithrealload:~1millisecondsvSANsupportsin-memorylocalcacheMemory:verylowlatencyViewAccelerator(CBRC)Ordersperminute5-minutemovingaveragevMotionvMotionTime(seconds)OrdersperminuteConsistentperformancethroughoutButwhatisvSANreallyabout?Simplicity20ReallySimpleSetup21DeduplicationandCompressionEnable?FaultDomains,2nodeorstretchedcluster?ManualorAutomaticDiskClaiming…EaseofDay0,1and2operationsvSpherevSANvSpherevSANHealthChecksPerformanceMonitoringCapacityReportsvSphereAPIsvSphereUIConfigurationvSANHealth–ReactiveHealthChecksIntroducedwithvSAN6.0IncorporateinthevSphereWebClientvSANHealthChecktoolinclude:LimitschecksvSANHCLhealthPhysicaldiskhealthNetworkhealthStretchedclusterhealth23vSANHealth–ProactiveHealthChecksProactivetoolsrunningonvSANclusterandpre-productiontestsVMCreationtestStoragePerformanceMulticastperformancetestNicefeatureforProofofConcepts(POCs)24PerformanceServiceEnableitonceIntegratedwithvSphereSimplifiedmetricsBackend(vSAN)Frontend(VM)DistributedArchitectureNoSPOFHistoricaldataStatusmonitoredbyhealthchecks25CapacityReportsDedupeandCompressionSavingsGroupbyObjectTypeFilesystemoverheadDedupeoverheadChecksumoverheadVirtualdisksSwapHomenamespace26vSphereAlerting 70+vSANHealthAlarmsManymorevSpherealarmsAlertviaSNMP/SMTPCreatecustomalarmsUseVMwareESXiVOBsor

ObservationIDsforvSANvSANManagementAPI6.2

interfaceforbespokesolution27vRealizeOperations+LogInsightvROpshasvSANawarenessStorageManagementPackvSANDashboards

andHeatMapsHostandDeviceStatisticsHealthAlertsCanalsomakecustomdashboardsLogInsightalsohasvSANawarenessvSANcontentpackLogaggregationfromvSANnodesIntegrationwithVROPSalerting28March2015

AllFlash

64NodeCluster

2xHybridSpeedSeptember2015

StretchedCluster

Replication:5minRPO

2-nodeforROBOMarch2016

Deduplication

Compression

QualityofServicevSAN6.0vSAN6.1vSAN6.2AcceleratingInnovationvSAN5.5vSAN–StretchedCluster30Active-ActivedatacentersvSANclustersplitacross2sites!EachsiteisaFaultDomain(FD)Site-levelprotectionwithzerodatalossandnear-instantaneousrecoveryAutomatedfailoverTodayTechnicalDetailsSupportforupto5msRTTlatencybetweendatasites10GbpsbandwidthexpectationWitnessVMcanresideanywhere200msRTTlatency100MbpsbandwidthrequirementvSphereVSANvSAN–DisasterRecoveryTodayReplication

betweenvSANdatastoresenablesRPOaslowas5

minutesLeverageSiteRecoveryManagerfordisasterrecoveryorchestrationStretchedacrossmetrodistance,replicatedacrossgeo!vSpherevSANSiteRecoveryManagervSphereReplicationvSpherevSANSiteRecoveryManagervSphereReplicationasyncreplicationAnydistanceallowing>=5minRPO<=5msRTT,10GbERemoteOfficeBranchOfficeDeploymentsvSAN6.1supports2-nodeforROBOdeploymentsBothhostsonlyusedtostore“data”ExtensionofvSANStretchedClustersolutionEachhostisaFaultDomain(FD)AllsitesmanagedcentrallybyonevCenterinstance32TechnicalDetailsOnewitnesshostneededpervSANclusterWitnessnodecanbeanESXiVM500msRTTlatency1.5MbpsbandwidthrequirementvSpherevSANvSpherevSANvSpherevSANvSpherevSANvSpherevSANesxi-01esxi-02esxi-03NearlinededuplicationandcompressionperdiskgrouplevelEnabledonaclusterlevelDeduplicatedwhende-stagingfromcachetiertocapacitytierFixedblocklengthdeduplication(4KBBlocks)CompressionafterdeduplicationIfblockiscompressed<=2KBOtherwisefull4KBblockisstoredBetaDeduplicationandCompressionforSpaceEfficiencyvmdkvmdkvmdkAllFlashOnlyNewin6.2Significantspacesavingsachievable,makingtheeconomicsofanall-flashvSANveryattractive33RAID-5InlineErasureCodingWhenNumberofFailurestoTolerate=1andFailureToleranceMethod=Capacity

RAID-53+1(4hostminimum)1.33xinsteadof2xoverhead20GBdiskconsumes40GBwithRAID-1,nowconsumes~27GBwithRAID-5RAID-5ESXiHostparitydatadatadataAllFlashOnlyESXiHostdataparitydatadataESXiHostdatadataparitydataESXiHostdatadatadataparityNewin6.234RAID-6InlineErasureCodingWhenNumberofFailurestoTolerate=2andFailureToleranceMethod=Capacity

RAID-64+2(6hostminimum)1.5xinsteadof3xoverhead20GBdiskconsumes60GBwithRAID-1,nowconsumes~30GBwithRAID-6AllFlashOnlyESXiHostparitydatadataRAID-6ESXiHostparitydatadataESXiHostdataparitydataESXiHostdataparitydataESXiHostdatadataparityESXiHostdatadataparityNewin6.235IntroducingvSAN6.5Q42016iSCSIAccess

2NodeDirectConnect

ManagementvSAN6.52-nodeDirectConnectvSAN6.5vSANDatastorewitnessvsanmanagementwitnessAbilitytoconnectthetwonodesdirectlyusingcrossovercablesSeparatevSANdatatrafficfromwitnesstraffic(2nodeonly)TwocablesbetweenhostsforhigheravailabilityofnetworkAllowsforLayer-2andLayer-3topologiesandstrictseparationoftrafficstreams2-nodeDirectConnect–ConfigurationDisablevSphereHAvMotionVMkernelinterfacesettingExplicitFail-overorder=uplink1

active/uplink2standbyvSANVMkernelinterfacesettingExplicitFail-overorder=uplink2active/uplink1standbySetthedesignatedwitnessVMkernelinterfacetowitnesstraffictype:esxclivsannetworkipadd-ivmkx-T=witnessValidatethetraffictypeiswitness:“TrafficType:witness”esxclivsannetworklistContinuewith2-nodesetupThenenableHAfortheclusterNote:FromthevSphereWebClient,thevmknicinterfacewillnolongerbeselectedforvSANtraffic.

Thisshouldnotbere-enabledinthevSphereWebClient!vSAN6.5vSANDatastorewitnessvsanmanagementwitnessProvideblockstoragethroughvSANiSCSIvSANiSCSITargetServiceenablesBlockStorage!SupportforPhysicalOracleRACClustersStorageforphysicalworkloads

ConfigurationdetailsMaxLUNsizeof62TBSupportsCHAPUniformconfigurationofVMkernelsProvidesallcorevSANfunctionalityfortheiSCSItargetDedupeandCompression,RAID-1,RAID-5,RAID-6iSCSITargetiSCSIInitiatoriSCSIInitiatoriSCSINetworkiSCSIObjectiSCSIObjectvSAN6.5vSAN

DatastoreEasyiSCSIconfigurationthroughWebClientEnableCreateMonitorvSAN6.5HighAvailability(HA)KeytechnologiesforHAiSCSIredirectMulti-pathIO(MPIO)EverytargethasanownerInitiatorcanconnecttoanyhostsActive/PassiveHATargetownerXIwanttoaccesstarget1.Target1isonesxi-02Target1isonesxi-03iSCSIXiSCSIesxi-01esxi-02esxi-03vSAN6.5vSAN6.5iSCSI:InitialSetup42vSAN6.5iSCSI:TargetsandLUNsViewvSAN6.5iSCSI:Creating/ManagingTargetsandLUNs44vSAN6.5iSCSI:InitiatorGroupViewandEdit45vSAN6.5CaveatsiSCSII/OoperationmightbeinterruptedduringiSCSItargetfailover(TransparentFailoverandclustervirtualIPisnotsupportedcurrently)AnyiSCSIinitiatorcandiscoveriSCSItargetsMCS(Multi-ConnectionperSession)isnotsupportedALUAisnotsupportediSNSisnotsupportedOnlineresizingofLUNisnotsupportedcurrentlyIntegrationwithVSANperformanceserviceisnotavailableMonitoringofactiveiSCSIclientsessionstoaLUNisnotavailable.HardwareHBA’snotsupportedvSAN6.5SupportlatesthardwareinnovationsvSpherevSANvSANDatastore

512evSAN6.5SupportforNVMeforworkloadsrequiringhighperformance512edrivesupporttoenablelargercapacitydrivesLatestnetworkingtechnologieslike25/40/100GbpsSupportforworkloadsthatarehighlytransactionalwithlowlatencyusingin-memorytechnologiesNewPowerCLISupportvSAN6.5HealthCheckandremediationCapacityandResyncMonitoring

Proactivetesting2nodeandstretchedclustersupportExtendVSANtoContainersandCNAPhotonControllerClusterManagersvSphereWorksoff-the-shelfwithDocker,Swarm,Kubernetes,…PersistentDockerVolumeDrivervSphereIntegratedContainersDockerAPICompatibilityPersistentVolumeDriverVM-likecontainerisolationPhotonPlatformVSANprovenstorageservicesavailablewithPhoton100%APImanagedVSANDesignedforDevOps

VMvCenterServerPrimaryClusterPhotonVSANforPhotonPrimaryClustervSphereVSAN6.5VIC

cnewvSAN6.5vSANBeta:AdvancedHCIsecurityandprotectionSECURESoftwareEncryptionforDataatRestPROTECTNestedFaultDomainsForStretchedClustersMANAGEEnhancedStorageandNetworkMonitoringThispresentationcontainsproductfeaturesthatarecurrentlyunderdevelopment.Featuresaresubjecttochange,andmustnotbeincludedincontracts,purchaseorders,orsalesagreementsofanykind.

Technicalfeasibilityandmarketdemandwillaffectfinaldelivery.Pricingandpackagingforanynewtechnologiesorfeaturesdiscussedorpresentedhavenotbeendetermined.

BETA3waystofindoutforyourselfhow

VMware-poweredHCIcanhelpyourorganizationSTRESSRELIEFHCIPOWEREDBYVIRTUALSAN53@vmwarevsanvSAN6.1and6.2Features54vSAN–StretchedCluster55Active-ActivedatacentersvSANclustersplitacross2sites!EachsiteisaFaultDomain(FD)Site-levelprotectionwithzerodatalossandnear-instantaneousrecoveryAutomatedfailover5msRTT,10GbETodayVMwarevSphere&vSANvSphere

witnessTechnicalDetailsSupportforupto5msRTTlatencybetweendatasites10GbpsbandwidthexpectationWitnessVMcanresideanywhere200msRTTlatency100MbpsbandwidthrequirementvSAN–DisasterRecovery56Today5msRTT,10GbEVMwarevSphere&vSANAnydistance>5minRPOSiteRecoveryManagervSphere&vSANSiteRecoveryManagerReplication

betweenvSANdatastoresenablesRPOaslowas5

minutesExclusivelyavailabletovSAN6.x,leveragesvSphereReplicationLeverageSiteRecoveryManagerfordisasterrecoveryorchestrationStretchedacrossmetrodistance,replicatedacrossgeo!vSphere

witnessROBODeploymentsvSAN6.1supports2-node(ROBO)deploymentsBothhostsonlyusedtostore“data”ExtensionofvSANStretchedClustersolutionEachhostisaFaultDomain(FD)AllsitesmanagedcentrallybyonevCenterinstance57witnesswitnesswitnessvSphere&vSANvSphere&vSANvSphere&vSANvSphere&vSANTechnicalDetailsOnewitnesshostneededpervSANclusterWitnessnodecanbeanESXiVM500msRTTlatency1.5MbpsbandwidthrequirementDeduplicationandCompressionforSpaceEfficiencyNearlinededuplicationandcompressionperdiskgrouplevelEnabledonaclusterlevelDeduplicatedwhende-stagingfromcachetiertocapacitytierFixedblocklengthdeduplication(4KBBlocks)CompressionafterdeduplicationIfblockiscompressed<=2KBOtherwisefull4KBblockisstoredBetaesxi-01esxi-02esxi-03vmdkvmdkvSphere&vSANvmdkAllFlashOnlyNewin6.2Significantspacesavingsachievable,makingtheeconomicsofanall-flashvSANveryattractive58RAID-5InlineErasureCodingWhenNumberofFailurestoTolerate=1andFailureToleranceMethod=Capacity

RAID-53+1(