Isilon的安装和维护手册70

1、XXXXIsilonIQ 集群安装和维护手册上二XXXXIsilon集群安装和维护手册目录1.XXX 笈装设定总览表 32.Isilon 的硬件安装 42.1.前面板和钱链的安装 42.2.滑轨的安装 63.构建 Isilon 集群 83.1.配置集群初始节点 83.2.将新节点加入构建好的集群 144.Isilon 后期设置 164.1.增加所需用户和组 164.2.设置 NFS 导出（共享）174.3.设置 CIFS出（共享）184.4.DNS 服务器设定修改 204.5.客户端设置 225.Isilon 日常维护手册 245.1.关闭节点/集群 245.2.替换硬盘 255.3.替换电源

2、 285.4.替换电池 285.5.长期断电电池电量不足的处理方法 296.Isilon 后续添加节点说明 301XXXX安装设定总览表集群部分Isilon集群概括安装节点5个保护级别全局N+2:1每节点裸容量（1000为单位）12TB每节点裸容量（1024为单位）10.8TB集群裸容量（1000为单位）60TB集群裸容量（1024为单位）54TB对外千兆以太网接口20网络设定部分内部网络Infiniband内网地址A100/Infiniband内网地址B100/内网Failover地址1

3、00/外部网络使用网络接口5个节点的共个20千兆接口对外子网61-179其他对外子网无DNS服务器地址网关地址54非飘移管理地址SmartConnectVIP10.1103.180客户端连接Zone名称文件共享部分CIFS（Windows文件共享）设定导出/ifs/data/jsb/ifs/data/test其他设定值domainusersNFS设定/、J无FTP设定FTP服务开启HTTP设定HTTP文件共享开启2Isilon的硬件安装2前面板和钱链的安装安装左，右较链支架到机器上连接显示线缆和前面板的PC

4、板2.2.滑轨的安装抽出滑轨最内侧的轨道INTERMEDIATERAILREARSLIDEBRACKETINNERRAILRELEASELEVERFRONTMOUNTINGBFtACKET将内侧滑轨安装到Isilon 节点上将导轨固定在机柜上SLIDERAILMOUNTINGSCREW安装 Isilon 节点到滑轨上给 Isilon 节点加电PowerPowerUSBManagementSupply1Supply2PortaPortBLACKPLASTICGUDEBALLBEARINGRETAIrNERINTERMEDIATERAILBatteiyBatteryTray2ChassisIDSA

5、SLEDLighlP。ePow&rSwitch口feuw-r-PT-IE脂slbK良GigEEthernetExternalPortsInfiniBandfnternatPorts3.构建Isilon集群1配置集群初始节点用串口线连接一台电脑和 Isilon 节点的管理端口在电脑上打开“超级终端”程序配置串口连接的设置Transferrate:9600bpsIQ1440/2250models115,200bpsIQ1920/3000/6000/9000andIQAcceleratormodels115,200bpsIQ1920 x/3000 x/6000 x/9000 xDatabit

6、s:8Parity:NoneStopbits:1Flowcontrol:Hardware提示符下创建 root 和 admin 账户和密码接下来，将被询问是否收集报警信息“WouldyouliketoallowIsilonSystems,Inc.toreceivecriticalalertsfromthiscluster?no”Isilon 的配置向导自动打开Doyouwishto1 createanewcluster.2 joinanexistingcluster.3 exitwizardandconfiguremanually.Wizard创建集群Doyouwishto4.createan

7、ewcluster.5.joinanexistingcluster.6.exitwizardandconfiguremanually.Wizard11createanewcluster.按提示配置集群1.%2.Typeanewnameforthecluster.SetNameisilonClusternamesettoisilon2.%2.ClusterEncoding:#Windows-SJIS#Windows-949#Windows-1252#EUC-KR#EUC-JP#EUC-JP-MS#UTF-8-MAC#UTF-8#ISO-8859-1(Latin-1)#ISO-8859-2(Lat

8、in-2)#ISO-8859-3(Latin-3)#ISO-8859-4(Latin-4)#ISO-8859-5(Cyrillic)#ISO-8859-6(Arabic)#ISO-8859-7(Greek)#ISO-8859-8(Hebrew)#ISO-8859-9(Latin-5)#ISO-8859-10(Latin-6)#ISO-8859-13(Latin-7)#ISO-8859-14(Latin-8)#ISO-8859-15(Latin-9)#ISO-8859-16(Latin-10)#erUsedefaultencoding:UTF-8SetEncoding3.%2.)Configur

9、einterfaceint-a:1.ConfigureNetmask2.ModifyIPRangesEnterKeepthecurrentconfiguration:Netmask:unsetIPRanges:Norangesset.ConfigureInterfaceint-a14.%2.Typeanewnetmask.Setint-aNetmask255,255.255.0int-aNetmasksetto255,255.255.0,5.%2.Configureinterfaceint-a:6.%2.ConfigureNetmask7.%2.ModifyIPRangesEnterKeept

10、hecurrentconfiguration:Netmask:IPRanges:Norangesset.ConfigureInterfaceint-a26.%2.ManageclusterIPranges1.AddanIPrange.2.DeleteanIPrange.EnterKeepcurrentIPranges:Norangesset.Modifyint-aIPRanges17.%2.EnterthelowIPaddressoftherangetoadd.LowIPAddress(Add)10,10.10.1EnterthehighIPaddressofther

11、ange.HighIPAddress(Add)10,10.10.3IPrangeadded.8.%2.ManageclusterIPranges1.AddanIPrange.2.DeleteanIPrange.EnterKeepcurrentIPranges:10,10.10.1-Modifyint-aIPRangesint-aIPrangesconfigured.9.%2.Configureinterfaceint-a:1.ConfigureNetmask2.ModifyIPRangesEnterKeepthecurrentconfiguration:Netmask:25

12、IPRanges:10,10.10.1-,ConfigureInterfaceint-a10.%2.Selecttheinternalinterfacetoconfigure.3int-a-PrimaryInternalInterface4int-b-SecondaryInternalInterface(Failover)EnterFinishedwithinternalinterfacesConfigureInternalInterfaces11.%2.ConfigureExternalSubnet1.Configureext-1EnterFinis

13、hedconfiguringExternalSubnetConfigureExternalSubnet112.%2.)Configureext-1Configureext-1settings3.%2.1SetNetmask4.%2.SetMTU5.%2.SetIPRangesEnterKeepthecurrentsettings:Netmask:unsetMTU:1500IPRanges:NorangessetConfigureext-1settings113.%2.SetNetmaskforext-1Typethenetmask:ext-1netmask14.%2.

14、Configureext-1settings1SetNetmask2SetMTU3SetIPRangesEnterKeepthecurrentsettings:Netmask:MTU:1500IPRanges:NorangessetConfigureext-1settings315.%2.SetIPRanges1AddanIPrange2DeleteanIPrangeEnterKeepcurrentIPranges:NorangessetSetIPRangesforext-1116.%2.AddanIPrangeTypethelowIPaddressoftherang

15、etoadd:01TypethehighIPaddressoftherangetoadd:0517.%2.SetIPRanges4AddanIPrange5DeleteanIPrangeEnterKeepcurrentIPranges:01-05SetIPRangesforext-118.%2.Configureext-1settings1SetNetmask2SetMTU3SetIPRangesEnterKeepthecurrentsettings:Netmask:MTU:1500IPRan

16、ges:01-05Configureext-1settings19.%2.onfiguredefaultgateway6.SetDefaultGatewayEnterKeepcurrentdefaultgateway:54Configuredefaultgateway20.%2.ConfigureSmartConnectsettings1.%2.1SmartConnectZoneName2.%2.SmartConnectServiceIPEnterKeepcurrentSmartConnectsettings:SmartConnect

17、ZoneName:SmartConnectServiceIP:192,168.0.208,ConfigureSmartConnectsettings1ConfigureDNSsettingsDomainNameServersDNSSearchListEnterKeepcurrentDNSsettings:DomainNameServers:notsetDNSSearchList:notsetConfigureDNSsettings22)ConfigureExternalSubnet1Configureext-1EnterFinishedconfiguringExternalSubnetConf

18、igureExternalSubnet23)ManageclusterdateandtimeSettimezoneSetdayandtimeEnterKeepcurrentdateandtime:notsetModifyDate24)ManagetheclusteraddnodesettingManualjoinSecurejoinEnterKeepcurrentaddnodesetting:ManualModifyAddNodeSettingJoinmodekeptasManual.25)Youhavemadethefollowingconfigurationchanges:-Cluster

19、namechangedfromunsettoisilon.-Interfaceint-anetmaskchangedfromunsetto.-Interfaceint-aIPrangeshavechangedfromNonedefined.to01-05-EncodinginformationchangedfromunsettoUTF-8-Externalnetworkchanged.Doyouwishtocommitthesechanges?yesCommitChanges?3.2.将新节点加入构建好的集群选择加入集群Clust

20、er-HardwareConfiguration-addnodeHardwareCcnflgurationAddNodeClusteroeullsVffSKH&fdiEtEf：B_?_0_l_lASRIrrixfAJFrodes-:3OiBtKfsae:32月Tfi帆ia4曲ieIF3ddrat5：L?AvaMdbleNodes盛NwjpjnjnnngDverwnofOneFSorwflhaHprefilpnlihnthanItic曲BlurwibeartlcrwnflrjdeijIDEchdusterbelorebefigadded选择加入集群系统启动，进入图形界面https:10.

21、1.0.201:8080ClusterOverviewLlmtcrfizrMonitcicirigajremrHDDUMd1S.4GBNochenumberCientconnectionsummaryH0CAviilKJqInbouM口岫csdCPUusaae1m.iCQiYfl9uruikMnSerialHnjmbcirOme-FSPvtchEASutuiAc1ionAddNknJeCluricrDel-alhItaMMjBlilftfar3w:Jh4TE但HIMQdaarwrf.5hr止a?或kwrtiIMIEED*EMIifdvP”ibewM( (kZ内io#，*KdMCdnArMdiT

22、iWHMnainf1M由hWf4；13A蝮1保7m小心目UM电声_诩UMQM-3t-9r|4liMB-iAccessManagement-Users/GroupsAccessManagementCreateauserUaera岳网tm“LOCALSyitprjV串幡q1。曲Bctron巴UerotmFulFKimePrimary国心岬Afcounl5Wu出CjueslIskinUsersCtsatMViewderail|eu丁虹IskhUirsEnabtedSwifeMii1DafeW!kfB4nMnlatonu时值EnfibW逢旧期值lEfiiCfiEDEftHFIIskinUsersEnB

23、b4eriViewdraix|DeleteCreateauserAccessZoneaAclmDfreGLaiyLDAPN,sLocalProviderFileProviderlitersGroupsSettingsManageUsersCreateauser=RequrredfieldUSBmtmt：uiernameFflSBW&rd：“, ,IAddilbnolGraupaHO惟DirediKV.AeeaufMDate.CancelIMAlkwpaeswcKd0expire用户没有 NIS 或者 LDAP,增力口用户wxx(uid=361,groupproc,gid=592)和 w

24、zz(uid=1000,groupproc,gid=592)使用 Isilon 集群存储上的空间使用 ssh 登陆到 Isilon 集群上，执行如下命令pwgroupaddprocg592pwuseraddwxx-u361-gprocpwuseraddwzz 七 1000gproc设置 NFS 导出(共享)在 WebUI 管理界面菜单栏“PROTOCALS 下的“NFS项中配置 export 目录/ifs/data,将“Maprootusersto”设定为 wxx,“AssignGroups”设定为 proc删除系统默认的/ifs 的 NFS 导出，增加安全性口usleMd匚xOO-inila

25、n(DneFSWcrsion.701.5)UNIXSharing(NFS)ManageejistovgiNFSexpertserroreatenewexportsas悝un&e-uaieTiboallowdlenlstoaccesscontentstoredonIsilondusters-.JDASHBOARDCLUSTERMANAGEMENTFILESYSTEMMANAGEMENTOA7APROTECTIONPROTOCOLSUE.fulName.EmaJAddrcs-1RnmaryGroup.+限Id0础口TiiAhgn甲曲帆niHKUA息闻口叫口WindersShmringSMB

26、UMAXSharing-I1533AJTiAHYJWYnnciiliCvlMlglTB1NViMriRjnmQPWUSfHMai-MtMW5?NdIUITJWY在 data 目录下新建 data1、data2、data3”：CohiwrfttpUrH华小3-WviitriiHun*fttrarKwybnPdPdKyCunrwifKUteodMiTafSDSinjf2DI3-H-Mra911STBWfYmivji0BANYCMIIUIAlBtkNY(MwriOB*hYi4*xiRH3713-n-n134-9AHDdwHDBI4MANYCVIVJH邦l%ErHdl453DANYC-fllnil表1

27、%埠揩 2*2*BtUfVPtipyriOB的附Ei川1丫l*rH37IJ-n-ZIl-LMW1YDdai4.4.文件系统管理在原有的/ifs/data 目录下新建目录 datal、data2、data3点击 FileSystemExplorerDASKSOARDCLUSTERMANAGMEJNTFILESYSTEMMAHAGENENTDATAPROTECmONPROTOCOLS4.5.DNS 服务器设定修改要充分发挥 SmartConnect 功能，需要节点通过 DNS 连接 Isilon 集群的 zone 名称,同的节点连接不同的 IP 地址的目的。以达到不启用 Isilon 的 Smar

28、tConnectAdvanced能然后将 VIP 设定为指定的 16,并为需要做 NFSFailover 的地址池（pool）名称，为 Isilonnfs.isilon,具体设定如图增加 ZoneGeneralSettingsNetworkConfiguration日通ConfiqurmtionNetworkConfigurationsubnetO-Defaultext-1subnetDM恒,ubnetSettingsEditSubnet:Netmask:MTU:GatewaySmartConnects&rviceIP：WANtagging(B02.1Q):VLANID

29、：1010。255255255.0150010.10.254,Priority1101.0.216DisabledootsetHardwarelofidbalancingIPs：r) )ctserIPAddressP( (x) )ls(己d3ApoolODefaultext-1poolBasicsettingsEditIPrange(low-high):10,1.0.201*15Accesszone:SystemSmartConnectsettingsEditZonenarne:t&Connectionpolicy：RoundRobinSmartConnedservic

30、esubnet:subnetOPallocationmethodDynamicRebalancepolicy：AutomaticF自ilbackIPfadoverpolicy:Roundftobm修改 DNS 服务器设定修改/etc/named.conf,增加一个名为isilon”的 zone,并设定使用设置文件 db.isilonzoneisilonintypemaster;filedb.isilon;）；在/var/named 下创建 db.isilon 文件，设定内容如下$TTL86400INSOAwnsoft4.nwbcnis.root.wnsoft4.nwbcnis. （ 20080

31、7290010800360060480086400 ）INNSwnsoft4.nwbcnis.isilonnfsINNSisilonvipisilonvipINA70在/etc/named.conf 中添加 forwards 指向VIPoptionsdirectory/var/named/;forwarders00;8;运行 rndcreload 命令重新加载 named 服务的设置客户端设置为客户端设置 DNS 服务器修改/etc/resoMconf 内容，增加如下条目（客户环境的 DNS 服务器地址为 167.64.1

32、34.150）nameserver50注：如果已经设定了 DNS 服务器，此步可以省略挂载 Isilon 集群假如客户端需要挂载文件系统到/isidata1 上，执行如下命令#mountisilonnfs.isilon:/ifs/data/isidata1客户端会自动向 DNS 服务器请求 isilonnfs.isilon 的 IP 地址，此时 DNS 会根据 Zone 的设定向isilonvip.isilon（即之前设定的 70）请求 isilonnfs.isilon 这个主机的 IP 地址，SmartConnectAdvanced 功能就会根

33、据策略将不同的节点浮动 IP 地址返回给 DNS 服务器，再由 DNS 服务器返回给客户端，达到负载均衡的目的Isilon日常维护手册关闭节点/集群通过命令行关闭节点/集群打开一个安全的外壳程序（SSH）,连接到想要 shuttingdown 的节点上在提示符下输入 shutdown-pnow如果想要对集群进行操作，则执行 isi_for_arrayShutdown-pnow等待节点保存日志，完成 shutdown 进程。在节点完成 shutdown 时，LED 灯熄灭。通过 WebAdmin 方式 ShuttingDown 集群在“ClusterManagement”菜单下点击“Hardwa

34、reConfiguration”,然后点击“Shutdown/RebootCluster”“Shutdownorrebootcluster”将会出现HardwareConfigurationShutDownorRebootThisClusterShutdownRebootSubmitCaned点击“Reboot”关闭集群并重启，点击“Shutdown”停止集群不重启。DASHBOARDCLUSTERMANAGEMENTFILESYSTEMMANAGEMENTGeneralISettimNetworkConRqu 同 0nHardwareConfigurationAccessMainmoerne

35、nt替换硬盘通过命令行的方式替换硬盘在命令提示符下输入 isidevices-astatus-d,系统将显示这个节点所有硬盘的状态。例如:Node1,OKBay1Lnum0HEALTHYSN:GTF402P6GHURDF/dev/da12Bay2Lnum3HEALTHYSN:GTF402P6GHWANF/dev/da9Bay3Lnum6HEALTHYSN:GTF402P6GHSJHF/dev/da6Bay4Lnum9HEALTHYSN:GTF402P6GHUTYF/dev/da3Bay5Lnum1HEALTHYSN:GTF402P6GHW71F/dev/da11Bay6Lnum4HEALTHY

36、SN:GTF402P6GHX8DF/dev/da8Bay7Lnum7HEALTHYSN:GTF402P6GHWAZF/dev/da5Bay8Lnum10HEALTHYSN:GTF402P6GHX4TF/dev/da2Bay9Lnum2REPLACESN:GTF402P6GHSZBF/dev/da10Bay10Lnum5HEALTHYSN:GTF402P6GHWGAF/dev/da7Bay11Lnum8HEALTHYSN:GTF402P6GHWAKF/dev/da4Bay12Lnum11HEALTHYSN:GTF402P6GHX11F/dev/da12.把标记为“REPLACE 的硬盘取下，将备

37、件换上。运行 isidevices-aadd-d:,在本例子中就是isidevices-aadd-d1:93.插入的硬盘将被格式化，将出现下列信息：AOneFS-formatteddrivewasfoundinbay%dandisbeingattachedtothefilesystem.Waitafewminutesandre-runisidevicestoverifythattheattachoperationcompletedsuccessfully.通过 WebAdmin 方式替换硬盘点击“Dashboard-ClusterOverview 中“Status”中的节点名称。Cluster

38、OverviewStatus-x200-isilonStatIDAAddressInbsOutb/sTotaltaifsHDDUedHDDSize|%|SS。13addresses39.5K158K137K557GW8T1026addresses107b-3D6b564G。36addre力后s-556G10ST110STDriveStatusCluster;isilonNode:1Bay:4Status:HealthyAvailableactions:AddSrratFail.将损坏的硬盘取下.将备件换上.点选“Add”将备件添加到节点里NodeStatu号DriveStatusCluster：islbnNode:1BW：4Status:HealthyAvailableactions:久久ddSriKrjFail替换电源.在节点的后部，检查每一个电源 LED 灯去确定损坏的电源模块PowerPowerSupply1Supp