Isilon集群安装和维护手册

...wd......wd......wd...XXXXIsilon集群安装和维护手册目录TOC\o"1-3"\u1.XXXX安装设定总览表32.Isilon的硬件安装52.1.前面板和铰链的安装52.2.滑轨的安装73.构建Isilon集群93.1.配置集群初始节点93.2.将新节点参加构建好的集群154.Isilon后期设置174.1.增加所需用户和组174.2.设置NFS导出〔共享〕184.3.设置CIFS导出〔共享〕194.4.DNS服务器设定修改214.5.客户端设置225.Isilon日常维护手册245.1.关闭节点/集群245.2.替换硬盘255.3.替换电源285.4.替换电池285.5.长期断电电池电量缺乏的处理方法296.Isilon后续添加节点说明29XXXX安装设定总览表集群局部Isilon集群概括安装节点5个保护级别全局N+2：1每节点裸容量〔1000为单位〕12TB每节点裸容量〔1024为单位〕10.8TB集群裸容量〔1000为单位〕60TB集群裸容量〔1024为单位〕54TB对外千兆以太网接口20网络设定局部内部网络Infiniband内网地址A~100/Infiniband内网地址B~100/内网Failover地址~100/外部网络使用网络接口5个节点的共个20千兆接口对外子网61-179其他对外子网无DNS服务器地址网关地址54非飘移管理地址SmartConnectVIP10.1103.180客户端连接Zone名称nas.hbdaily文件共享局部CIFS〔Windows文件共享〕设定导出/ifs/data/jsb/ifs/data/test其他设定值domainusersNFS设定共享无FTP设定FTP服务开启设定文件共享开启Isilon的硬件安装前面板和铰链的安装安装左，右铰链支架到机器上将前面板和左右铰链支架用螺丝固定连接显示线缆和前面板的PC板滑轨的安装抽出滑轨最内侧的轨道将内侧滑轨安装到Isilon节点上将导轨固定在机柜上安装Isilon节点到滑轨上给Isilon节点加电构建Isilon集群配置集群初始节点用串口线连接一台电脑和Isilon节点的管理端口在电脑上翻开“超级终端〞程序配置串口连接的设置Transferrate:9600bps—IQ1440/2250models115,200bps—IQ1920/3000/6000/9000andIQAcceleratormodels115,200bps—IQ1920x/3000x/6000x/9000xDatabits:8Parity:NoneStopbits:1Flowcontrol:Hardware提示符下创立root和admin账户和密码接下来，将被询问是否收集报警信息“WouldyouliketoallowIsilonSystems,Inc.toreceivecriticalalertsfromthiscluster?[no]〞Isilon的配置向导自动翻开Doyouwishto[1]createanewcluster.[2]joinanexistingcluster.[3]exitwizardandconfiguremanually.Wizard>>>创立集群Doyouwishto[1]createanewcluster.[2]joinanexistingcluster.[3]exitwizardandconfiguremanually.Wizard>>>1>>>1createanewcluster.按提示配置集群1〕Typeanewnameforthecluster.SetName>>>isilonClusternamesetto'isilon'2〕ClusterEncoding:[1]Windows-SJIS[2]Windows-949[3]Windows-1252[4]EUC-KR[5]EUC-JP[6]EUC-JP-MS[7]UTF-8-MAC[8]UTF-8[9]ISO-8859-1(Latin-1)[10]ISO-8859-2(Latin-2)[11]ISO-8859-3(Latin-3)[12]ISO-8859-4(Latin-4)[13]ISO-8859-5(Cyrillic)[14]ISO-8859-6(Arabic)[15]ISO-8859-7(Greek)[16]ISO-8859-8(Hebrew)[17]ISO-8859-9(Latin-5)[18]ISO-8859-10(Latin-6)[19]ISO-8859-13(Latin-7)[20]ISO-8859-14(Latin-8)[21]ISO-8859-15(Latin-9)[22]ISO-8859-16(Latin-10)[Enter]Usedefaultencoding:UTF-8SetEncoding>>><Enter>3〕Configureinterfaceint-a:[1]ConfigureNetmask[2]ModifyIPRanges[Enter]Keepthecurrentconfiguration:Netmask:unsetIPRanges:Norangesset.ConfigureInterfaceint-a>>>14〕Typeanewnetmask.Setint-aNetmask>>>int-aNetmasksetto''5〕Configureinterfaceint-a:[1]ConfigureNetmask[2]ModifyIPRanges[Enter]Keepthecurrentconfiguration:Netmask:IPRanges:Norangesset.ConfigureInterfaceint-a>>>26〕ManageclusterIPranges[1]AddanIPrange.[2]DeleteanIPrange.[Enter]KeepcurrentIPranges:Norangesset.Modifyint-aIPRanges>>>17〕EnterthelowIPaddressoftherangetoadd.LowIPAddress(Add)>>>EnterthehighIPaddressoftherange.HighIPAddress(Add)>>>IPrangeadded.8〕ManageclusterIPranges[1]AddanIPrange.[2]DeleteanIPrange.[Enter]KeepcurrentIPranges:'–'Modifyint-aIPRanges>>><Enter>int-aIPrangesconfigured.9〕Configureinterfaceint-a:[1]ConfigureNetmask[2]ModifyIPRanges[Enter]Keepthecurrentconfiguration:Netmask:IPRanges:'–'ConfigureInterfaceint-a>>><Enter>10〕Selecttheinternalinterfacetoconfigure.[1]int-a-PrimaryInternalInterface[2]int-b-SecondaryInternalInterface(Failover)[Enter]FinishedwithinternalinterfacesConfigureInternalInterfaces>>><Enter>11〕ConfigureExternalSubnet[1]Configureext-1[Enter]FinishedconfiguringExternalSubnetConfigureExternalSubnet>>>112〕Configureext-1Configureext-1settings[1]SetNetmask[2]SetMTU[3]SetIPRanges[Enter]Keepthecurrentsettings:Netmask:unsetMTU:1500IPRanges:NorangessetConfigureext-1settings>>>113)SetNetmaskforext-1Typethenetmask:ext-1netmask>>>14)Configureext-1settings[1]SetNetmask[2]SetMTU[3]SetIPRanges[Enter]Keepthecurrentsettings:Netmask:MTU:1500IPRanges:NorangessetConfigureext-1settings>>>315)SetIPRanges[1]AddanIPrange[2]DeleteanIPrange[Enter]KeepcurrentIPranges:NorangessetSetIPRangesforext-1>>>116)AddanIPrangeTypethelowIPaddressoftherangetoadd:>>>01TypethehighIPaddressoftherangetoadd:>>>0517)SetIPRanges[1]AddanIPrange[2]DeleteanIPrange[Enter]KeepcurrentIPranges:01-05SetIPRangesforext-1>>><Enter>18〕Configureext-1settings[1]SetNetmask[2]SetMTU[3]SetIPRanges[Enter]Keepthecurrentsettings:Netmask:MTU:1500IPRanges:01-05Configureext-1settings>>><Enter>19〕onfiguredefaultgateway[1]SetDefaultGateway[Enter]Keepcurrentdefaultgateway:'54'Configuredefaultgateway>>><Enter>20〕ConfigureSmartConnectsettings[1]SmartConnectZoneName[2]SmartConnectServiceIP[Enter]KeepcurrentSmartConnectsettings:SmartConnectZoneName:'isilon.znyy'SmartConnectServiceIP:'08'ConfigureSmartConnectsettings>>><Enter>21)ConfigureDNSsettings[1]DomainNameServers[2]DNSSearchList[Enter]KeepcurrentDNSsettings:DomainNameServers:notsetDNSSearchList:notsetConfigureDNSsettings>>><Enter>22)ConfigureExternalSubnet[1]Configureext-1[Enter]FinishedconfiguringExternalSubnetConfigureExternalSubnet>>><Enter>23)Manageclusterdateandtime[1]Settimezone[2]Setdayandtime[Enter]Keepcurrentdateandtime:“notset〞ModifyDate>>>24)Managetheclusteraddnodesetting[1]Manualjoin[2]Securejoin[Enter]Keepcurrentaddnodesetting:'Manual'ModifyAddNodeSetting>>><Enter>Joinmodekeptas'Manual'.25)Youhavemadethefollowingconfigurationchanges:-Clusternamechangedfromunsetto'isilon'.-Interfaceint-anetmaskchangedfromunsetto.-Interfaceint-aIPrangeshavechangedfromNonedefined.to01-05-EncodinginformationchangedfromunsettoUTF-8-Externalnetworkchanged.Doyouwishtocommitthesechanges?[yes]CommitChanges?>>><Enter>系统启动，进入图形界面s:\\01:8080将新节点参加构建好的集群选择参加集群Cluster->HardwareConfiguration->addnode选择参加集群Isilon后期设置增加所需用户和组Cluster->AccessManagement->Users/GroupsCreateauser用户没有NIS或者LDAP，增加用户wxx〔uid=361，groupproc,gid=592〕和wzz〔uid=1000，groupproc,gid=592〕使用Isilon集群存储上的空间使用ssh登陆到Isilon集群上，执行如下命令#pwgroupaddproc–g592#pwuseraddwxx–u361–gproc#pwuseraddwzz–u1000–gproc设置NFS导出〔共享〕在WebUI管理界面菜单栏“PROTOCALS〞下的“NFS〞项中配置export目录/ifs/data，将“Maprootusersto〞设定为wxx，“AssignGroups〞设定为proc删除系统默认的/ifs的NFS导出，增加安全性NFS共享设置设置CIFS导出〔共享〕在WebUI管理界面菜单栏“PROTOCALS〞下的“WindowsSharing〞项中配置addashare目录/ifs/data，将“Maprootusersto〞设定为wxx，“AssignGroups〞设定为proc删除系统默认的/ifs的CIFS共享，增加安全性新建Share文件系统管理在原有的/ifs/data目录下新建目录data1、data2、data3点击FileSystemExplorer在data目录下新建data1、data2、data3DNS服务器设定修改要充分发挥SmartConnect功能，需要节点通过DNS连接Isilon集群的zone名称，以到达不同的节点连接不同的IP地址的目的。启用Isilon的SmartConnectAdvanced功能然后将VIP设定为指定的16，并为需要做NFSFailover的地址池〔pool〕增加Zone名称，为Isilonnfs.isilon，具体设定如图修改DNS服务器设定修改/etc/named.conf，增加一个名为“isilon〞的zone，并设定使用设置文件db.isilonzone"isilon"in{typemaster;file"db.isilon";};在/var/named下创立db.isilon文件，设定内容如下$TTL86400@INSOAwnsoft4.nwbcnis.root.wnsoft4.nwbcnis.(20xx07290010800360060480086400)INNSwnsoft4.nwbcnis.isilonnfsINNSisilonvipisilonvipINA70在/etc/named.conf中添加forwards指向VIP options{directory"/var/named/";forwarders{00;8;};};运行rndcreload命令重新加载named服务的设置客户端设置为客户端设置DNS服务器修改/etc/resolv.conf内容，增加如下条目〔客户环境的DNS服务器地址为50〕nameserver 50注：如果已经设定了DNS服务器，此步可以省略挂载Isilon集群假设客户端需要挂载文件系统到/isidata1上，执行如下命令#mountisilonnfs.isilon:/ifs/data/isidata1客户端会自动向DNS服务器请求isilonnfs.isilon的IP地址，此时DNS会根据Zone的设定向isilonvip.isilon〔即之前设定的70〕请求isilonnfs.isilon这个主机的IP地址，SmartConnectAdvanced功能就会根据策略将不同的节点浮动IP地址返回给DNS服务器，再由DNS服务器返回给客户端，到达负载均衡的目的Isilon日常维护手册关闭节点/集群通过命令行关闭节点/集群翻开一个安全的外壳程序〔SSH〕，连接到想要shuttingdown的节点上在提示符下输入shutdown-pnow如果想要对集群进展操作，那么执行isi_for_array“shutdown-pnow〞等待节点保存日志，完成shutdown进程。在节点完成shutdown时，LED灯熄灭。通过WebAdmin方式ShuttingDown集群在“ClusterManagement〞菜单下点击“HardwareConfiguration〞，然后点击“Shutdown/RebootCluster〞“Shutdownorrebootcluster〞将会出现点击“Reboot〞关闭集群并重启，点击“Shutdown〞停顿集群不重启。替换硬盘通过命令行的方式替换硬盘在命令提示符下输入isidevices–astatus–d<NodeID#>，系统将显示这个节点所有硬盘的状态。例如：Node1,[OK]Bay1Lnum0[HEALTHY]SN:GTF402P6GHURDF/dev/da12Bay2Lnum3[HEALTHY]SN:GTF402P6GHWANF/dev/da9Bay3Lnum6[HEALTHY]SN:GTF402P6GHSJHF/dev/da6Bay4Lnum9[HEALTHY]SN:GTF402P6GHUTYF/dev/da3Bay5Lnum1[HEALTHY]SN:GTF402P6GHW71F/dev/da11Bay6Lnum4[HEALTHY]SN:GTF402P6GHX8DF/dev/da8Bay7Lnum7[HEALTHY]SN:GTF402P6GHWAZF/dev/da5Bay8Lnum10[HEALTHY]SN:GTF402P6GHX4TF/dev/da2Bay9Lnum2[REPLACE]SN:GTF402P6GHSZBF/dev/da10Bay10Lnum5[HEALTHY]SN:GTF402P6GHWGAF/dev/da7Bay11Lnum8[HEALTHY]SN:GTF402P6GHWAKF/dev/da4Bay12Lnum11[HEALTHY]