IBM双活数据中心探讨

IBM双活数据中心方案介绍及探讨姜玉明Jiangyum@Tel程业务连续性的发展趋势IBM对双活数据中心的理解IBM的双活数据中心方案介绍220120721北京暴雨您想到的32012年存储趋势

存储虚拟化成为领跑者；容灾、业务连续性高高在上；重复数据删除在2012年赶上；4是什么驱使提高容灾的能力？宕机成本；提高关键业务系统的可用性；需要7x24小时的业务；5日程业务连续性的发展趋势IBM对双活数据中心的理解IBM的双活数据中心方案介绍6业务连续性－－需要前瞻的规划和策略数据中心大集中主备中心生产-查询中心（主辅中心）双活中心数据同步能力建设数据服务能力建设负载均衡能力建设数据复制技术切换/回切能力实现后备数据抽取与生产中心数据存在一定差异全局负载均衡技术中心间数据保持同步交易复制能力自动化管理削减数据中心数量，实现数据、业务处理集中化降低基础架构复杂度加强数据中心统一管理降低数据中心管理人员数量要求降低维护成本灾难备份系统建设专用后备系统用于紧急状态下的恢复降低灾难风险对业务的影响加强安全生产等级利用后备数据及系统用于部分生产用途分担生产系统压力提高生产系统响应能力后备中心有限生产能力无缝业务切换能力消除应用停机时间数据中心间实现负载均衡任何一个中心具备100%生产支持能力72/5/20237FootergoeshereAPPMWDBCD1CD1LoadBalancerTransactionsReplicationControllerAPPMWCD1CD13.跨中心的数据同步机制交易关联能力-Transactionstickiness,数据同步差异–Datareplicationgap数据恢复方法-RecoveryApproach,数据延迟-DataLatency1.网络接入-全局服务负载均衡4build“identical”systemenvironment服务器虚拟化技术Provisioning5.SeamlessProcessingtorolloutchangewithoutplannedoutage运营一体化配置流程-configurationmanagement变更管理-changemanagement人员部署-Role&Responsibility6.应用改造和支持DB2.Session同步机制双活方案的关键技术8开放系统业务连续性趋势应用相互关联度2000’s策略同城数据及容灾流程组织结构1990’s灾难恢复设备科技1970’s备份需求1980’s高可靠性同机房容灾2010’s应用级容灾2012双活数据中心远程异地三站点9灵活、高效的业务系统数据中心运营模式数据迁移业务逻辑运维人员组织架构公司战略10日程业务连续性的发展趋势IBM对双活数据中心的理解IBM的双活数据中心方案介绍11IBM的双活数据中心方案介绍概览Openhyperswap双活解决方案概览GPFS＋Vmware双活解决方案IBMSVC+vmware双活解决方案IBMSVC解决方案分析12IBMOpenActive-ActiveSolutionOfferingsActive-QueryorAsymmetricWorkloadActive-ActiveforSymmetricWorkloadPrimarySite(Production)SecondarySite(WarmStandby)PrimarySite(Production)SecondarySite(QueryWorkload)ProductionSite1ProductionSite2Active-QueryorAsymmetricWorkloadInfrastructureBaseSolutionAIXHyperSwapVirtualizedStorageSolutionSVCStretchClusterSoftwareBaseSolutionDB2HA-DR/ReplicationInfrastructureBaseSolutionAIXHyperSwap+FlashcopyVirtualizedStorageSolutionSVCStretchClusterSoftwareBaseSolutionDB2HA-DR/ReplicationInfrastructureBaseSolutionAIXHyperSwap+ParallelDB*VirtualizedStorageSolutionSVCStretchCluster+ParallelDB*SVCVDM+StretchCluster+VmwareSoftwareBaseSolutionDB2GeographicallyDispersedPureScaleClusters(GDPC)GeographicallyDispersedGPFSCluster+ParallelDB2012New2012Enhanced2012DB2Version102012New2012Enhanced2012DB2Version10LocallyTested*NeedfurthervalidationprocessActive-StandbyforFastTakeover1314AIXHyperSwapReferenceArchitecture

Pre-GATestcouldbeofferedtoclientnominatedinJun,2012IBMTargetGADate:Nov,2012MetroMirrorDS8K(PrimaryStorage)DS8K(SecondaryStorage)PowerAIXPowerHADBPowerAIXPowerHALANNetworkPrimarySiteSecondarySite15AIXHyperSwapTakeoverScenarioMetroMirrorDS8K(PrimaryStorage)DS8K(SecondaryStorage)PowerAIXPowerHADBPowerAIXPowerHALANNetworkDS8K(PrimaryStorage)DS8K(SecondaryStorage)Power780AIXPowerHADBPower780AIXPowerHADBDS8K(PrimaryStorage)DS8K(SecondaryStorage)Power780AIXPowerHADBPower780AIXPowerHADS8K(PrimaryStorage)DS8K(SecondaryStorage)Power780AIXPowerHADBPower780AIXPowerHADBScenario1:DiskFailureDS8KFailedHyperswapRTO=secondsNoApplicationinterruptionNoDatabaseRollbackScenario2:ServerFailureServerFailedPowerHAServerTakeoverDB/ApplicationRestartRTO=minutesApplicationdisrruptionDatabaseRollbackScenario3:SiteFailureSiteFailedPowerHAServerTakeover

(DiskQuorumMaintained)DB/ApplicationRestartRTO=minutesApplicationdisrruptionDatabaseRollbackPrimarySiteSecondarySiteNOTE:QuorumControl,Routers,DWDMdevice&Heartbeatnotshowninthediagramforsimplicityillustration16Why?TietogethermultiplesetsofdataintoasinglenamespaceAllowmultipleapplicationgroupstoshareportionsoralldataSecure,availableandhighperformancedatasharingGPFS双活解决方案

LANSANSANGPFSLANSANSANGPFSNSDProtocolCreateanenterprise-wide

Globalnamespace17操作系统及应用支持情况OperatingsystemsAIXLinuxRedHatSLESVMwareESXServerWindows2008ServerIndependentsoftwarevendor

supportincludes:DB2Oracle,OracleRacSAP/BusinessObjectsSASAbInitioInformaticaSAFVmwareAndothersIBM与VMware的合作全球联盟合作伙伴VMware与IBM提供全面的虚拟化、业务连续性和云计算解决方案，允许客户简化IT基础架构并且改进可管理性。

部署在IBM平台上的VMware虚拟化技术能够降低成本，节省数据中心的能源和空间，并且提高IT部门满足业务需求的能力。

通过高弹性平台，公司可虚拟化他们的关键任务工作负载。基于VMwarevSphere的解决方案包括IBMSystemx和BladeCenter服务器、IBMSystemStorage、服务和软件。长期承诺VMware与IBM将继续通过合作来设计、开发和测试能够重新定义业界标准的、值得客户信赖的虚拟化解决方案。IBM是VMware授权的全球培训中心/solutions/partners/alliances/ibm-home.html1819SVC支持VMwarevStorageAPIsforArrayIntegration(VAAI)功能集成vStorageAPI，在一个虚拟机的环境下使得VMware控制存储操作：OptimizedVMprovisioning(WriteSame)

AvoidszeroregionsforoptimizeddatatransferBlocklocking(AtomicTest&Set)

ImprovedperformancewithlessreservationconflictsFastcopy(optimizedcloning,XCOPY)

Storage-sidevolumetovolumecloningVMwareStorageStackVMFSNFSVMwareLVMDataMoverNFS

ClientNetworkStackvStorageAPI

forMulti-

PathingNFSHBADriversNICvStorageAPIsProvisioning/Cloning价值在管理和部署虚拟卷时改进了性能和有效性降低生产虚拟机上I/O负载，改进应用的性能SANVolumeControllerZero-administrationHAforVMwareusingSVCsinglelogicalinstancemobilizedVMsnoStorage-VMotionAppliancefunctionality,notsoftware-based,nolicense1…100km

Protectsnon-IBMsystemsbasedonSVC'stretchedcluster'

Xen+HyperVSVCSVCPrereqs:SVC,directfibreconnection,tie-breaker'quorum'LUNinbunkerlocation20Details:Symmetricdiskmirroring,stretchedSVCVMHostVMHostSVC1nodeASVC1nodeBHighavailability+protection

forvirtualmachinesVMVMLUN1LUN1'max.100kmrecommendedmax.300kmsupportedOnestoragesystem.Twolocations.VMVMVMVM21VMware虚机的存储高可用解决方案SVCClusterVMFSSVC

VDISK消除存储单点故障风险，业务持续运行SVC用于企业级复杂环境的存储高可用解决方案SVCVDisk卷镜像，任一存储故障不影响业务运行；存储无切换中断时间，应用无需重启；零数据丢失；不占用服务器资源，不影响服务器性能；优化中低端存储性能；ODM管理对象和镜像前一样（1X）轻松实在跨存储盘阵的快照。成本：中，SVC/V7000成本，但VDM免费/support/techdocs/atsmastr.nsf/WebIndex/WP101923SiteRecoveryManagerisnotneeded)SVCCluster存储跨域双活三中心解决方案SAN

VolumeControllerSVCCluster城市A－1生产中心城市A－2生产中心城市B灾备中心23***HowtoopentheDoor***AIXArchitectureOverviewIBMPowerHA

ClusterPowerVMLPARLPARLPARVIOPowerVMVIOLPARLPARTSMforERPTSMforERPTSMServerFCMFCMFlashCopyFlashCopyIBMSystemStorage24SVCstretchedcluster24***HowtoopentheDoor***VMwareArchitectureOverviewVMwareSRM

ClusterTSMforVETSMforVETSMServerFCMVEFCMVEFlashCopyFlashCopyESXserverVMVMVMESXserverVMVMVMDKIBMSystemStorageIBMSVCSVCstretchedcluster2525***HowtoopentheDoor***MSHyperVArchitectureOverviewMSCluster

ServiceTSMforMSSQLTSMforMSSQLTSMServerFCMFCMFlashCopyFlashCopyIBMSystemStorageIBMSVCMSHyperVVMVMVMIOVMMSHyperVVMVMIOVMSVCstretchedcluster2626NAS/NFSFibreChannelFibreChanneliSCSIFCoEiSCSIDS3300DS5000V7000DS8000NSeriesSONASDS3400TS3100TS3310TS3200TS3500TS7650ATS7560GBackupSVC/V7000VMware虚拟机存储架构IBM具有简单易用的存储解决方案用于整合并扩展VMWare的高级软件功能

(VMotion,VMHA,DRS,StorageVMotion,&SRM).IBM在VMWare虚拟环境下的存储解决方案包括

iSCSI,FC,FCoE,andNFS等所有VMWare支持的存储接口.经过验证的包括并行扩展、高可用、容灾复制等多种存储解决方案.VMWare虚拟环境下独特的IBM存储解决方案27存储共享，您关心的I/O共享问题WhatYouSeeNowWhatYouShouldSeedatastoreonlinestoredataminingMicrosoft

ExchangedatastoreonlinestoredataminingMicrosoft

Exchange28IBMSVC解决方案分析用户界面在线压缩（收费）任意的快照（收费）FC/FCoE/iSCSI存储分层在线迁移(NVM)本地高可用支持同步、异步容灾（收费）设备的使用效率（thinandeasytier）简化管理性能可靠性安全性扩展性在线维护能力故障监控及预警广泛的兼容性产品成熟、拥有大量的案例29StoragePoolSVC协助建立了一个十分灵活的存储架构SANHDSDS8000Virtual

DiskVirtual

DiskVirtual

DiskVirtual

DiskSANVolumeControllerDS4000HPEMC把不同存储阵列的存储容量组成一个统一的存储池AdvancedCopyServices在存储池上应用统一的拷贝服务功能通过中心控制点进行集中管理存储设备发生改变时，主机应用不会被迫中断30第31页友好的界面－－操作流程标准化实时收集系统级性能参数(CPU利用率;port利用率和I/O速率;卷和MDiskI/O速率，带宽，延迟），采集时间间隔为5秒先进的存储软件，拥有苹果界面存储供应流程的标准化31在线压缩功能GUIDisplaysCompressionSavingsonaVolume,PoolandSystembasis:32SVC完备的快照FlashCopy®功能33一个源卷多达256份快照Vol3

FlashCopy

targetofVol1Vol0

SourceMap1Map2Map3Map4Vol1

FlashCopy

targetofVol0Vol2

FlashCopy

targetofVol1Vol4

FlashCopy

targetofVol3灵活的快照组合模式建立增量快照Datacopied

asnormal应用改变了部分数据Later…新时间点快照仅拷贝变化了的数据支持永久增量快照模式Vol0

Source快照卷ThinProvisioning卷ThinProvisioning快照CreatediskbackupcopiesSourceLater…2.ReverseFlashCopyoperationOR1.PreservedamageddataBackuptotapecancontinueunaffectedTargetSourceSourceTargetTarget支持快照瞬间恢复跨阵列任意快照Upto256应用系统快照保护FlashCopyAVAILABILITYCreateinstantapplicationcopiesforbackuporapplicationtesting.Makebetteruseofspacewithincremental(onlychangedblocks)orspace-efficient(thinprovisioned)snapshots.Integrated,instantcopyforcritical

applicationsVirtuallyeliminatebackupwindowsRapidlycreateclonesforapplicationtestingViewinventoryofapplicationcopiesandinstantlyrestoreFlashCopyManagerUpto25634SVCGUI快照的管理FlashCopyGUIpanelnowdisplaystimestampshowingwhenmappingwasstarted3536SVC支持iSCSI和FCoESANStorageZonesLANHostserverswithFCoEHBAsFibre-attachedhostsExternalFibre-attachedstorage(optional)StorwizeV7000Hostserverswith10GigabitiSCSIHBAsSANZonesNew存储分层自动存储分层根据工作负载特性自动将活动数据在不同存储层次间重新分布降低IO响应时间用户可以选择自动或者半自动的数据块放置和迁移管理方式Whyitmatters?SSD提供比磁介质更好的吞吐量和IO响应时间.将整个vdisk卷全部迁移到SSD通常情况下并不是最佳方案。将热点数据块自动迁移到高性能存储上，少量的SSD就可以极大的提高整个系统的性能。SVCClusterExternalSSDRAIDArray(s)FC/SASRAIDArray(s)SATARAIDArray(s)ApplicationVirtualDisk37在线迁移数据Efficientlymanagetechnologyupgradesandleaseterminationsbytransparentlymovingapplicationdatafromlegacydiskarraystothenewsystem.MIGRATIONTransparentdatamovementVDSLegacyNetworkApplication

server38在线跨I/OGroup迁移I/Ogroup12.Volume

MoveHostI/O

SVCnodeSVCnodeSVCnodeSVCnodeI/Ogroup01.Multi-pathI/OtoVolumes3.ActivepathstorelocatedVolumes39本地高可用LocalMirrorAVAILABILITYForultra-highavailabilityapplications,synchronouslymirrorapplicationdatabetweentwoseparatediskenclosuresattachedtothesamesystem.40容灾复制:业务连续性Mirrordataoff-siteSynchronouslyoverMetrodistances.AsynchronouslyoverGlobaldistances.Application-levelconsistencygroups.PracticerecoveryproceduresForcriticalapplicationconsistencygroups,freezetheMirrorandtakeaconsistentFlashCopy.PracticeapplicationrecoveryproceduresfromtheFlashCopy.AutomaticallyrespondtodisastersDetectmirroringfailureandautomatefailovertoRecoveryvolume.Executepracticedapplicationrecovery

procedures.Automatefail-backafterrepair.BUSINESSCONTINUANCENetworkRecoverypracticevolumeNetworkNetworkRecoveryvolume41提升存储使用效率ThinprovisioningMoreproductiveuseofavailablestorage.Acrossallsupportedhostplatforms.PerformanceoptimizationEFFICIENCYWithoutthinprovisioning,pre-allocatedspaceisreservedwhethertheapplicationusesitornot.Withthinprovisioning,applicationscangrowdynamically,butonlyconsumespacetheyareactuallyusing.Dynamic

growthAnalyzesystemperformanceandthroughput.Transparentlyrearrangethedatatoeliminatehot-spotsandbalanceutilizationofallcomponents.Hot-spotsduetopoordatalayout.Optimizedperformanceandthroughput.Transparent

reorganization42精简配置和热点迁移IBMSVC解决方案分析用户界面在线压缩（收费）任意的快照（收费）FCoE/iSCSI存储分层在线迁移(NVM)本地高可用支持同步、异步容灾（收费）设备的使用效率（thinandeasytier）简化管理性能可靠性安全性扩展性在线维护能力故障监控及预警广泛的兼容性产品成熟、拥有大量的案例43第44页简化管理－－改善存储资源的部署计划传统磁盘阵列部署考虑：容量，磁盘容量/数量，RAID模式性能磁盘数量，磁盘转速，缓存，IOPs，系统吞吐能力，RAID模式可靠性，冗余控制器，RAID模式，数据备份功能性，分区，快照，远程数据复制兼容性，硬件平台，操作系统平台虚拟化后存储供应考虑：容量，多少容量能满足？功能性，根据需求，灵活选择存储池，快照，远程数据复制ControllersBlock-levelaccessApplicationServerApplicationServerApplicationServerSwitch项目上线前会议讨论！虚拟化后，变的很轻松44第45页简化管理－－简化存储的部署流程虚拟化前DiskRaidLUNHostgroupLUNmappingZoningMulti-PathPVVGPPLPLV虚拟化后一次性的划分存储池虚拟磁盘一次性的划分通用的多通路软件标准过程好处后续磁盘进行基本的硬件更换即可，比方说磁盘故障！友好的界面标准的流程实时的性能在线的迁移标准化的划分办法主机多通路管理软件统一化统一类型的磁盘，操作过程标准化45SVC性能最新SPC测试结果显示SVC性能领跑所有存储6节点的SVCSPC-1值达380,000

4节点的SVCSPC-1值达300,0008节点的SVCSPC-1达到520,000*相对应的HPXP24000最高性能值为200,000左右/results/benchmark_results_spc1/#spc1SVCSPC-2值高达7,080GBPS（8节点）TheintelligenceofthecachingalgorithmsTheamountofcacheTheuseofdifferentstoragetierswithSolidStateDiskTheabilitytohandletaggedcommandqueuingoperationsThepatternofaccessasitrelatestolocalityofreferencewhichaffectsthecachehitratiosThesizeofthedatablocktransferredDiskMagicSizingtools46可靠性－SVC虚拟化平台的高可靠性设计StorageNetworkManagedDisksVirtualDisksVirtualDisksVirtualDisksVirtualDisksNodeNodeNodeNodeNodeDesignedtobearedundant,modular,scalable,solutionVirtualdisksaresharedbetweenapairofnodesNodeNodeNodeEachnodeisanxSeries®eServer™with24GBofRead/WritecachethatismirroredacrossthepairThepoolofmanageddisksiscontrolledbyaclusterofmanagednodes(upto4pairs,scalinghigherinthefuture)SVC提供99.999%的高可靠性可以通过SVC实现不停机的数据迁移可以通过SVC实现不停机的微码（firmware）升级，及磁盘阵列的硬件维护StorageNetworkManagedDisksVirtualDisksVirtualDisksVirtualDisksVirtualDisksNodeNodeNodeNodeNodeDesignedtobearedundant,modular,scalable,solutionVirtualdisksaresharedbetweenapairofnodesNodeNodeNodeEachnodeisanxSeries®eServer™with24GBofRead/WritecachethatismirroredacrossthepairThepoolofmanageddisksiscontrolledbyaclusterofmanagednodes(upto4pairs,scalinghigherinthefuture)Redundant,hot-swappablecontrolnodesMirroredWritecachewithbatterybackupClusterconfigurationbackupandrestorecapabilityRedundancyofactivecomponentsincludingfansandpowersuppliesNon-disruptivesoftwareupgradestonodesDualaccesstoallfront-endandback-endportsRedundantpathsfromcontrolnodestointernaldisksoverSAS.RemotecallhomeErrornotificationandlogging47安全性－－访问和用户管理SSHprotocolcommunication;Differentusergroup;48…performanceForperformancesensitiveapplications,dynamicallyaddmoreperformancetoyourexistingcapacitybyaddingcontrollerpairs.…ormixwithadditionalcapacity……capacityForhighcapacityapplicationssuchasarchive,dynamicallyaddcapacitybyaddingdiskenclosures.…ormixwithadditionalperformance……featuresManyfeaturesareincluded.Softwareispreinstalledinthesystemandmanagementconsoleforeasysetup.Premiumfeaturesarealreadyinstalled.Enabledwithonlyalicensefile.PracticeDRrecoveryAutomatedfailover/fail-backThinProvisioningPerformanceoptimizationVirtualizationFlashCopySANVisualizationPerformancemanagementMetroMirrorGlobalMirrorSCALABILITY扩展性－－动态可扩展…49在线维护能力－－SVC节点在线替换SVC集群中任何一个节点失效，可以在不中断生产的条件下在线更换不需要改变SAN环境的配置不影响主机生产应用不影响SVC集群生产替换操作时间短—整个过程约30分钟50故障监控及预警－－系统管理SNMPSysLogEmail5152SVC兼容环境8GbpsSANfabricHP

MA,EMAMSA,EVA,XP,P9500,

3ParHitachi

LightningThunderTagmaStoreAMS,WMS,USP,USP-VVSPEMCCLARiiONCX4,Symmetrix,DMX,VMAX,VNX,VNXeMicrosoft

WindowsHyper-VIBMPower7IBMAIXIBMi6.1(VIOS)Sun

Solaris8/9/10HP-UX11iTru64OpenVMSCitrixXenServerIBM

BladeCenterSANContinuousCopyMetro/GlobalMirrorMultipleClusterMirrorVMwareESX3.5,vSphere4,5Point-in-timeCopyFullvolume,Copyonwrite

256targets,

Incremental,