HA常用心跳网络特点和配置

1、POWERHA常用心跳网络特点和配置最近系统的复习了一下PowerHA，做了一些相关的试验，今天时间充裕，在博 客里把有关于心跳方面的知识总结一下。谈到PowerHA,不得不谈心跳。记得拜 读IBM官方网站上浅谈 HACMP心跳一文中，作者王荣说了一句颇幽默 的话：“我们可以看出使用HACMP集群，可谓玩的就是心跳。”的确如此，在个人的学习和实施的过程中，发现心跳的确是要玩的，而且要玩好。一、心跳作用及分类PowerHA通过以下三种手段，来监控节点是否运行正常：1、RSCT监控网络接口和设备。.2、AIX LVM 监控硬盘、逻辑卷、卷组状态。3、PowerHA应用监控应用状态。PowerHA

2、使用心跳keep alive (KA)包来监控网络接口、通信设备、和 ip地址 标签有效性。在PowerHA中用基于IP网络和non-IP网络来交换心跳包。其中 基于 IP 网络包括：Ethernet (ether) 、Token-ring (token) 、Fiber Distributed Data In terface - FDDI (fddi)、Asyn chro nous Tran sfer Mode- ATM and ATM LAN Emulatio n) (atm) 、EtherCha nnel (ether) 、IP Versio n 6 (IPV6)、InfiniBand，其

3、中enther网络心跳比较常用。基于设备的主要包括：目标模式SCSI (tmscsi)、目标模式 SSA (tmssa)、磁盘心跳信号(diskhb)、串行RS232。磁盘心跳信号(diskhb)和串行RS232在实际环境中用到比较多(个 人根据实施经验判断，不一定准确)。、常用心跳网络配置1、RS232串口心跳配置硬件配置建议配置专门用作心跳网络的异步卡。异步卡及串口线的选择配置可以参考：PowerHA中异步卡和串口线的选择。配置方法：添加tty设备：smitty device 中找到tty.测试tty通信是否正常：在连接串口线后，在一台设备上输入：cat/etc/hosts>/dev

4、/ttyO另外一台输入：cat</dev/ttyO 。在PowerHA中添加：a、 添加网络 smitty hacmp - Exte nded Con figurati on - Exte nded Topology Con figurati on- Exte nded Topology Con figurati on - Exte nded Topology Con figuratio n # Pre-defi ned Serial Device Types 中 rs232b、 添加设备smitty hacmp- Exte nded Con figurati on- Exte nded

5、TopologyCon figurati on- Exte nded Topology Con figurati on-Con figureHACMPCommuni catio nIn terfaces/Devices-AddCommuni catio n In terfaces/Devices - Add Pre-defi ned Communi cati onIn terfaces andDevices - Communi cati onDevices -选择添加的网络-选择相应的端口2、磁盘心跳配置方法磁盘心跳简单说就是用共享磁盘来跑心跳。磁盘心跳从HACMP5.1中开始支持。优点：不占

6、用插槽，磁盘总线上的心跳网络能够在TCP/IP网络资源有限的情况下提供额外的HACMP节点间的通信手段，并且能够防止HACMP节点之间由于TCP/IP软件出现问题而无法相互通信。缺点：需要操作系统和存储支持，如使用增强型卷组，此外对于I/O读写负荷高的应用，也需要慎用。使用磁盘心跳需要安装操作系统 bos.clvm.e nh包以支持增强性并发卷组。配置方法：摘自：文中描述的是HACMP 5.4中操作，经验证和PowerHA 配置方法完全一样。Step1:配置并行卷组dbsvr1#smitty hacmpInitialization and Standard ConfigurationExten

7、ded ConfigurationSystem Man ageme nt (C-SPOC)Problem Determ in ati on ToolsMan age HACMP ServicesHACMP Communi cati on In terface Man ageme ntHACMP Resource Group and Applicati on Man ageme ntHACMP Log Viewi ng and Ma nageme ntHACMP File Collection Man ageme ntHACMP Security and Users Man ageme ntHA

8、CMP Logical Volume Man ageme ntHACMP Con curre nt Logical Volume Man ageme ntHACMP Physical Volume Man ageme ntCon figure GPFSCon curre nt Volume GroupsCon curre nt Logical VolumesSynchronize Con curre nt LVM MirrorsList All Con curre nt Volume GroupsCreate a Con curre nt Volume GroupCreate a Con cu

9、rre nt Volume Group with Data Path DevicesSet Characteristics of a Con curre nt Volume GroupImport a Con curre nt Volume GroupMirror a Con curre nt Volume GroupNode NamesMove cursor to desired item and press Esc+7.ONE OR MORE items can be selected.Press En ter AFTER maki ng all selecti ons.>dbsvr

10、1>dbsvr2Create a Con curre nt Volume GroupType or select values in entry fields.Press En ter AFTER mak ing all desired cha nges.TOPNode NamesPVIDVOLUME GROUP n amePhysicalpartitio nSIZE inmegabytes4Volume group MAJOR NUMBEREnhan ced Con curre nt ModeEn able Cross-Site LVM Mirrori ngVerificatio nf

11、alseEntry Fieldsdbsvr1,dbsvr20003714b1331a3edheartvg+56+#true+6#Warni ng:#Changing the volume group major nu mber may result in the comma nd being un able to execute successfully on a node that does not have the major nu mber curre ntly available. Please checkMORE.3F仁HelpEsc+5=ResetmageF2=RefreshEsc

12、+6=Comma ndF3=Ca ncelEsc+7=EditF4=ListEsc+8=Idbsvr1#lspvhdiskO0003714ba5048a99rootvgactivehdisk10003714bd3cf768arootvgactivehdisk20003714b7d935335datavgactivehdisk30003714b27d6164fdatavg_1activehdisk4noneNonehdisk50003714b1331a3edheartvgdbsvr2#lspvhdisk1000531c9c977a892rootvgactivehdisk20003714b7d93

13、5335datavghdisk3noneNonehdisk4noneNonehdiskO000531c9a501da2arootvgactivehdisk50003714b1331a3edheartvgStep2:编辑环境变量dbsvr1#vi /etc/e nviro nmentPATH=/usr/bi n: /etc:/usr/sb in:/usr/ucb:/usr/bi n/X11:/sbi n: /usr/java14/jre/bin:/usr/java14/b in:/usr/sb in/rsct/bi nTZ=BEIST-8LANG=en_USLOCPATH=/usr/lib/nl

14、s/locNLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.catLC_FASTMSG=truedbsvr2#vi /etc/e nvir onmentPATH=/usr/bi n: /etc:/usr/sb in:/usr/ucb:/usr/bi n/X11:/sbi n: /usr/java14/jre/bin:/usr/java14/b in:/usr/sb in/rsct/bi nTZ=BEIST-8LANG=en_USLOCPATH=/usr/lib/nls/locNLSPATH=/usr/lib/nls/msg/%L/%N:

15、/usr/lib/nls/msg/%L/%N.catLC_FASTMSG=trueStep3:测试并行卷组通讯dbsvrl# /usr/sbi n/rsct/bi n/dhb_read -p hdiskx -rDHB CLASSIC MODEFirst n ode byte offset: 61440Second node byte offset: 62976Han dshaki ng byte offset: 65024Test byte offset: 64512Receive Mode:Waiti ng for resp onse .Magic number = 0x87654321Ma

16、gic number = 0x87654321Magic number = 0x87654321Magic number = 0x87654321Link operati ng no rmally-（这两个命令需要同时执dbsvr2# /usr/sbin/rsct/bin/dhb_read -p hdiskxDHB CLASSIC MODEFirst n ode byte offset: 61440Second node byte offset: 62976Han dshak ing byte offset: 65024Test byte offset: 64512Tran smit Mode

17、:Magic number = 0x87654321Detected remote utility in receive mode. Waiting for response .Magic number = 0x87654321Magic number = 0x87654321Link operati ng no rmallyStep4:配置磁盘心跳网络dbsvr1#smitty hacmpInitialization and Standard ConfigurationExtended ConfigurationSystem Ma nageme nt (C-SPOC)Problem Dete

18、rm in ati on ToolsDiscover HACMP-related In formatio n from Con figured NodesExte nded Topology Con figurati onExte nded Resource Con figurati onExte nded Cluster Service Sett ingsExte nded Eve nt Con figurati onExte nded Performa nee Tuning Parameters Con figuratio n11Security and Users Con figurat

19、i onSn apshot Con figurati onExport Defin iti on File for Online Pla nning WorksheetsCon figure an HACMP ClusterCon figure HACMP NodesCon figure HACMP SitesCon figure HACMP NetworksCon figure HACMP Communi cati on In terfaces/DevicesCon figure HACMP Persiste nt Node IP Label/AddressesCon figure HACM

20、P Global NetworksCon figure HACMP Network ModulesCon figure Topology Services and Group ServicesShow HACMP TopologyAdd a Network to the HACMP ClusterCha nge/Show a Network in the HACMP ClusterRemove a Network from the HACMP ClusterMove cursor to desired item and press Enter.TOP# Discovery last perfo

21、rmed: (Apr 03 15:13)# Discovered IP-based Network Typesether# Discovered Serial Device Typesrs232# Pre-defi ned IP-based Network TypesXD_dataXD_ipatmetherfddihpsibtoke n# Pre-defi ned Serial Device TypesXD_rs23213diskhbAdd a Serial Network to the HACMP ClusterType or select values in entry fields.Pr

22、ess En ter AFTER mak ing all desired cha nges.Entry FieldsNetwork NameNetwork Typen et_diskhb_01 diskhbCon figure an HACMP ClusterCon figure HACMP NodesCon figure HACMP SitesCon figure HACMP NetworksCon figure HACMP Communi cati on In terfaces/DevicesCon figure HACMP Persiste nt Node IP Label/Addres

23、sesCon figure HACMP Global NetworksCon figure HACMP Network ModulesCon figure Topology Services and Group ServicesSelect a categoryMove cursor to desired item and press Enter.Add Discovered Communi cati on In terface and DevicesAdd Pre-defi ned Communi catio n In terface and DevicesCommuni catio n I

24、n terfacesCommuni catio n devicesSelect a Device NetworkMove cursor to desired item and press E diskhb 01Device Nameheartdbsvr1 (hostname )net diskhb 01Network NameNetwork Typediskhb15Device Path/dev/hdisk5 （路径手动填写）*Noden amedbsvrl 16#* Device Name* Network Type* Network Name* Device Path*No

25、den ameheartdbsvr2 diskhbn et_diskhb_O1/dev/hdisk5 dbsvr2 Step5:检查集群网络结构Show Cluster TopologyShow Cluster DefinitionShow Topology Information by NodeShow Topology In formatio n by NetworkShow Topology In formatio n by Communi cati on In terfaceCluster Name: gyjtCluster Conn ecti on Authe nticati on

26、Mode:Sta ndardCluster Message Authe nticati on Mode:NoneCluster Message En crypti on:NoneUse Persiste nt Labels for Commu ni cati on:NoNODE dbsvr1:heartdbsvr1/dev/hdisk5dbsvr1_svc26dbsvr1_boot 27dbsvr1_stbNetwork net_diskhb_01Networkdbsvr1_stbheartdbsvr1 /dev/hdisk5net_e

27、ther_01Network net_rs232_01dbsvr1_ttyO /dev/tty0NODE dbsvr2:Step6:同步集群配置Exte ndedCon figurati onMove cursor to desired item and pressEn ter.Discover HACMP-related In formatio n from Con figuredNodesExte nded TopologyCon figurati onExte nded ResourceCon figurati onExte nded Cluster Service

28、 Sett ingsExte nded Eve nt Con figurati onExte nded Performa nee Tuning ParametersCon figurati onSecurity and UsersCon figurati onSn apshot Con figurati onExport Definition File for Online PlanningWorksheetsExtended Verification andSynchroni zati onHACMP Cluster Test Tool3、IP网络心跳IP网络心跳 可以使用IP别名心跳即在b

29、oot网卡上添加别名IP，来跑心跳。也 可以用专门的网卡用作心跳通信。a、IP别名心跳配置注意：心跳地址没有子网限制，但是要注意和bootip在不同的子网中。配置方法：在 hacmp配置完成后smitty hacmp Exte ndedCon figurati on-Exte ndedTopologyCon figurati on-Con figureHACMP Networks-cha ngea Network to the HACMP Cluster下的IP Address Offset forHeartbeating over IP Aliase填入需要用作心跳传输的别名IP地址。当你输入任意IP地址后再同步完HA，只需要添加一个IP地址，启动HA后会自动在四 个boot，下面有例子。ip上生成四个private的ip地址，做心跳用。生成的规则如下：引用cookbook原文：When PowerHA starts, it buildsup an alias heartbeat n etwork start ing from this address, by calculat ingan IP address for each node based on the node nu mber.举例说明：当你输入,机器会在