NetApp存储安装、配置与维护手册

1、NETAPP存储系统安装、配置和维护手册 Page 63 NETAPP存储系统安装、配置和维护手册 文档信息本安装和维护手册为 XXX 定制，为NetApp标准文档之补充。主题：NETAPP存储系统安装和维护手册版本：1.0关键字参考文档：提交时间：创建人：目 录1作业规划步骤12配置步骤32.1设置磁盘归属，创建ROOT卷32.2检查并更新各部件的firmware系统版本152.3检查并更新存储操作系统版本192.4输入软件许可232.5执行SETUP进行初始化设置232.6调整ROOT卷的大小292.7配置VLAN292.8修改HOSTS文件312.9修改/etc/rc文件322.10配置

2、AutoSupport服务332.11配置SSH342.12配置SNMP352.13配置NTP362.14配置MTA362.15配置IPspace372.16配置MultiStore372.17配置CIFS412.18配置ISCSI442.19配置FCP452.20配置NFS462.21配置重复数据删除472.22配置Snaprestore482.23容灾实现Snapmirror523日常维护553.1正常开关机553.2维护手段553.2.1Filerview 图形管理接口553.2.2命令行(CLI)573.3空间管理：Aggr, Volume和lun的介绍573.4常用命令基本应用583

3、.5日常系统检查583.5.1目测583.5.2例行系统检查583.6autosupport功能简介和配置594故障处理流程614.1支持方式614.1.1NetApp on the web (NOW) site和服务614.1.2GSC( Global Support Center 全球支持中心)614.2案例开立流程624.3损坏部件更换流程621 作业规划步骤作业步骤作业内容参考文档1环境准备检查NetApp_System_Configuration_Worksheet和Site Requirements Guide2开箱并验证部件是否齐全FAS32XX Installation Ins

4、tructiongs第2步和配置清单3设备上架Four-Post Rail Kit Installation Instructions4设备线缆连接FAS32XX Installation Instructiongs第6步5加电并验证设备正常DS4243 Installation and Service GuideMonitoring disk shelf components部分6设置磁盘归属，创建ROOT卷Data ONTAP的安装过程第1-8页7检查并更新各部件的firmwareupgradeUpdating firmware8检查并更新存储系统版本upgradeInstalling D

5、ata ONTAP software images部分9输入软件许可Protocol License.xlsx10调整ROOT卷的大小TR3838_Storage_Subsystem_Configuration_Guide_SEPTEMBER_2011第14页11使用SETUP进行初始化设置netapp存储系统维护手册第5-9页12配置VLANnagHow VLANs work部分13修改hosts文件nagHow the /etc/hosts file works部分14修改/etc/rc文件nagConfiguring network interfaces部分15配置AutoSupport

6、服务sysadminThe AutoSupport feature部分16配置SSHsysadminThe SSH protocol部分17配置SNMPnagHow to monitor your storage system with SNMP部分18配置NTPsysadminSynchronizing the system time部分19配置MTAsetupResponding to sp setup prompts部分20配置IpspacevfilerWhat an IPspace is部分21配置MultiStorevfilerMultiStore management部分22配置C

7、IFSfilesagFile access using CIFS部分23配置iSCSIbsagBlock access Management guide for iSCSI and FC24配置FCPbsagBlock access Management guide for iSCSI and FC25配置NFSfilesagFile access using NFS部分26配置重复数据删除A-SIS Deduplication Deployment and Implementation Guide27配置SnaprestoreonlinebkData Protection using Sna

8、presotre部分28配置容灾SnapmirroronlinebkData Protection using Snapmirror部分29控制器高可用性测试NetApp_System_Configuration_Worksheet第14页Verification Checklist部分2 配置步骤配置参数表 控制器A控制器B名称DSSSG101DSSSG102控制器序列号850000XXXXXX850000XXXXXX硬盘数量62RAID级别RAID-DP无热备RAID4+无热备vif名称vif1vif1端口e0a、e0be0a、e0bVif模式LACPLACPvif1的IP 地址

9、//e0M端口IP地址49/50/SP端口IP地址47/48/SP网关5454管理服务器地址41412.1 设置磁盘归属，创建ROOT卷#启动控制器APhoenix TrustedCore(tm) Server Copy

10、right 1985-2006 Phoenix Technologies Ltd.All Rights ReservedBIOS version: 5.1.1Portions Copyright (c) 2007-2011 NetApp, Inc. All Rights ReservedCPU = 1 Processors Detected, Cores per Processor = 2Intel(R) Xeon(R) CPU E5220 2.33GHzTesting RAM512MB RAM tested5120MB RAM installed6144 KB L2 CacheSystem

11、BIOS shadowedUSB 2.0: MICRON eUSB DISKBIOS is scanning PCI Option ROMs, this will take few seconds. .Boot Loader version 3.2 Copyright (C) 2000-2003 Broadcom Corporation.Portions Copyright (C) 2002-2008 NetAppCPU Type: Intel(R) Xeon(R) CPU E5220 2.33GHzStarting AUTOBOOT press Ctrl-C to abort.Loading

12、 X86_64/kernel/primary.krn:0x200000/49123928 0x30d9258/27512016 0x4b15f28/7980237 0x52b23f5/3 Entry at 0x00202018Starting program at 0x00202018MTRR0, will be reset to map region 3G to 4G as UCBBSP on this platform is 0x0000000000000180ipmi_init_alloc_request_pool succeed (pool entries 0x80,size per

13、entry 0xe0)ipmi_init0: DONE.Press CTRL-C for special boot menu #进入特殊启动菜单IPMI:IPMI device rev. 2, firmware rev. 1.0, version 2.0IPMI:Number of channels 0ipmi_init1: DONE.Special boot options menu will be available.Chelsio T3 RDMA Driver - version 0.1Ipspace "iwarp-ipspace" createdTue Mar 20

14、 08:49:03 GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter 0c.Tue Mar 20 08:49:03 GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter 0d.NetApp Release 7.3.6: Thu Jul 7 01:48:12 PDT 2011Copyright (c) 1992-2011 NetApp.Starting boot on

15、 Tue Mar 20 08:48:45 GMT 2012Tue Mar 20 08:49:04 GMT nvram.battery.turned.on:info: The NVRAM battery is turned ON. It is turned OFF during system shutdown.Tue Mar 20 08:49:09 GMT diskown.isEnabled:info: software ownership has been enabled for this systemTue Mar 20 08:49:13 GMT config.noPartnerDisks:

16、CRITICAL: No disks were detected for the partner; this node will be unable to takeover correctly(1) Normal boot.(2) Boot without /etc/rc.(3) Change password.(4) Assign ownership and initialize disks for root volume.(4a) Same as option 4, but create a flexible root volume.(5) Maintenance mode boot.Se

17、lection (1-5)? 5 #进入维护模式 Tue Mar 20 08:49:16 GMT shelf.config.mpha:info: All attached storage on the system is multi-pathed HA. You have selected the maintenance boot option: the system has booted in maintenance mode allowing the following operations to be performed: ? disk fcadmin fcstat sasadmin s

18、asstat acpadmin halt help ifconfig raid_config storage sesdiag sysconfig version vol aggr sldiag environment led_on led_off sata acorn scsi disk_list ha-config fcdiag fctest disktest diskcopy xortest faltest outb disk_mung Type "help <command>" for more details. In a cluster, you MUS

19、T ensure that the partner is (and remains) down, or that takeover is manually disabled on the partner node, because clustering software is not started or fully enabled in Maintenance mode. FAILURE TO DO SO CAN RESULT IN YOUR FILESYSTEMS BEING DESTROYEDContinue with boot? yTue Mar 20 08:49:40 GMT mgr

20、.boot.reason_ok:notice: System rebooted after a halt command.Tue Mar 20 08:49:41 GMT console_login_mgr:info: root logged in from console> *> Ipspace "acp-ipspace" created*> disk show a #查看当前控制器下的磁盘Local System ID: 1574659072 DISK OWNER POOL SERIAL NUMBER - - - - NOTE: Currently 12

21、 disks are unowned. Use 'disk show -n' for additional information.*> disk show -v #查看磁盘的归属关系Local System ID: 1574659072 DISK OWNER POOL SERIAL NUMBER - - - - 0a.00.10 Not Owned NONE N000ZK5L 0a.00.2 Not Owned NONE N000J71L 0a.00.5 Not Owned NONE N000J5ML 0a.00.9 Not Owned NONE N000ZN4L 0a

22、.00.1 Not Owned NONE N000J65L 0a.00.0 Not Owned NONE J830SRPL 0a.00.3 Not Owned NONE N000V8KL 0a.00.7 Not Owned NONE N000YG6L 0a.00.11 Not Owned NONE N000XZVL 0a.00.4 Not Owned NONE N001YL7L 0a.00.8 Not Owned NONE N002K7KL 0a.00.6 Not Owned NONE N000J0WL *> disk assign 0a.00.0 #把磁盘0a.00.0分配给当前控制器

23、disk assign: DisTk assigned but uunable to obtain eowner name. Re- run 'disk assignM' with -o optiona to specify namer 20 08:53:39 GMT diskown.changingOwner:info: changing ownership for disk 0a.00.0 (S/N J830SRPL) from unowned (ID -1) to (ID 1574659072).*> disk assign 0a.00.1 #把磁盘0a.00.1分

24、配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run 'disk assignM' with -o optiona to specify namer 20 08:53:57 GMT diskown.changingOwner:info: changing ownership for disk 0a.00.1 (S/N N000J65L) from unowned (ID -1) to (ID 1574659072).*> disk assign 0a.00.2 #把磁盘0

25、a.00.2分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run 'disk assignM' with -o optiona to specify namer 20 08:53:59 GMT diskown.changingOwner:info: changing ownership for disk 0a.00.2 (S/N N000J71L) from unowned (ID -1) to (ID 1574659072)*> disk assign 0a.00.3

26、 #把磁盘0a.00.3分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run 'disk assignM' with -o optiona to specify namer 20 08:54:10 GMT diskown.changingOwner:info: changing ownership for disk 0a.00.3 (S/N N000V8KL) from unowned (ID -1) to (ID 1574659072).*> disk assign

27、0a.00.4 #把磁盘0a.00.4分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run 'disk assignM' with -o optiona to specify namer. 20 08:54:13 GMT diskown.changingOwner:info: changing ownership for disk 0a.00.4 (S/N N001YL7L) from unowned (ID -1) to (ID 1574659072)*> disk

28、assign 0a.00.5 #把磁盘0a.00.5分配给当前控制器disk assign: DisTk assigned but uunable to obtain eowner name. Re- run 'disk assignM' with -o optiona to specify namer. 20 08:54:19 GMT diskown.changingOwner:info: changing ownership for disk 0a.00.5 (S/N N000J5ML) from unowned (ID -1) to (ID 1574659072)*>

29、; disk show v #查看磁盘的归属关系Local System ID: 1574659072 DISK OWNER POOL SERIAL NUMBER - - - - 0a.00.10 Not Owned NONE N000ZK5L 0a.00.3 (1574659072) Pool0 N000V8KL 0a.00.9 Not Owned NONE N000ZN4L 0a.00.2 (1574659072) Pool0 N000J71L 0a.00.1 (1574659072) Pool0 N000J65L 0a.00.4 (1574659072) Pool0 N001YL7L 0

30、a.00.7 Not Owned NONE N000YG6L 0a.00.11 Not Owned NONE N000XZVL 0a.00.5 (1574659072) Pool0 N000J5ML 0a.00.8 Not Owned NONE N002K7KL 0a.00.6 Not Owned NONE N000J0WL 0a.00.0 (1574659072) Pool0 J830SRPL *> disk show v #拔掉多的4块硬盘后，查看磁盘的归属关系Local System ID: 1574659072Tue Mar 20 08:55:02 GMT disk.readRe

31、servationFailed:error: Disk read reservation failed on 0a.00.11 CDB 0x5e:01 - SCSI:no sense (0 0 0)Tue Mar 20 08:55:02 GMT diskown.errorDuringIO:error: error 25 (no valid path to disk) on disk 0a.00.11 (S/N N000XZVL) while reading reservation stateTue Mar 20 08:55:04 GMT disk.readReservationFailed:e

32、rror: Disk read reservation failed on 0a.00.10 CDB 0x5e:01 - SCSI:no sense (0 0 0)Tue Mar 20 08:55:04 GMT diskown.errorDuringIO:error: error 25 (no valid path to disk) on disk 0a.00.10 (S/N N000ZK5L) while reading reservation stateTue Mar 20 08:55:05 GMT disk.readReservationFailed:error: Disk read r

33、eservation failed on 0a.00.9 CDB 0x5e:01 - SCSI:no sense (0 0 0)Tue Mar 20 08:55:05 GMT diskown.errorDuringIO:error: error 25 (no valid path to disk) on disk 0a.00.9 (S/N N000ZN4L) while reading reservation stateTue Mar 20 08:55:07 GMT disk.readReservationFailed:error: Disk read reservation failed o

34、n 0a.00.8 CDB 0x5e:01 - SCSI:no sense (0 0 0)Tue Mar 20 08:55:07 GMT diskown.errorDuringIO:error: error 25 (no valid path to disk) on disk 0a.00.8 (S/N N002K7KL) while reading reservation state DISK OWNER POOL SERIAL NUMBER - - - - 0a.00.3 (1574659072) Pool0 N000V8KL 0a.00.2 (1574659072) Pool0 N000J

35、71L 0a.00.1 (1574659072) Pool0 N000J65L 0a.00.4 (1574659072) Pool0 N001YL7L 0a.00.7 Not Owned NONE N000YG6L 0a.00.5 (1574659072) Pool0 N000J5ML 0a.00.6 Not Owned NONE N000J0WL0a.00.0 (1574659072) Pool0 J830SRPL *> haltPhoenix TrustedCore(tm) Server Copyright 1985-2006 Phoenix Technologies Ltd.All

36、 Rights ReservedBIOS version: 5.1.1Portions Copyright (c) 2007-2011 NetApp, Inc. All Rights ReservedCPU = 1 Processors Detected, Cores per Processor = 2Intel(R) Xeon(R) CPU E5220 2.33GHzTesting RAM512MB RAM tested5120MB RAM installed6144 KB L2 CacheSystem BIOS shadowedUSB 2.0: MICRON eUSB DISKBIOS i

37、s scanning PCI Option ROMs, this will take few seconds. +Boot Loader version 3.2 Copyright (C) 2000-2003 Broadcom Corporation.Portions Copyright (C) 2002-2008 NetAppCPU Type: Intel(R) Xeon(R) CPU E5220 2.33GHzLOADER-A> autobootLoading X86_64/kernel/primary.krn:0x200000/49123928 0x30d9258/27512016

38、 0x4b15f28/7980237 0x52b23f5/3 Entry at 0x00202018Starting program at 0x00202018MTRR0, will be reset to map region 3G to 4G as UCBBSP on this platform is 0x0000000000000180ipmi_init_alloc_request_pool succeed (pool entries 0x80,size per entry 0xe0)ipmi_init0: DONE.Press CTRL-C for special boot menuI

39、PMI:IPMI device rev. 2, firmware rev. 1.0, version 2.0IPMI:Number of channels 0ipmi_init1: DONE.Chelsio T3 RDMA Driver - version 0.1Ipspace "iwarp-ipspace" createdTue Mar 20 08:58:55 GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter 0d.Tue Mar 20 08:58:55

40、GMT fci.initialization.failed:error: Initialization failed on Fibre Channel adapter 0c.NetApp Release 7.3.6: Thu Jul 7 01:48:12 PDT 2011Copyright (c) 1992-2011 NetApp.Starting boot on Tue Mar 20 08:58:37 GMT 2012Tue Mar 20 08:58:56 GMT nvram.battery.turned.on:info: The NVRAM battery is turned ON. It

41、 is turned OFF during system shutdown.Tue Mar 20 08:59:01 GMT diskown.isEnabled:info: software ownership has been enabled for this systemSpecial boot options menu will be available.(1) Normal boot.(2) Boot without /etc/rc.(3) Change password.(4) Initialize owned disks (6 disks are owned by this file

42、r).(4a) Same as option 4, but create a flexible root volume.(5) Maintenance mode boot.Selection (1-5)? 4aTue Mar 20 08:59:08 GMT shelf.config.mpha:info: All attached storage on the system is multi-pathed HA.The system has 6 disks assigned whereas it needs 3 to boot, will try to assign the required n

43、umber.Zero disks and install a new file system? yThis will erase all the data on the disks, are you sure? yZeroing disks takes about 255 minutes.Tue Mar 20 09:02:31 GMT coredump.spare.none:info: No sparecore disk was found.#启动控制器B,插上1块多的硬盘Phoenix TrustedCore(tm) Server Copyright 1985-2006 Phoenix Technologies Ltd.All Rights ReservedBIOS version: 5.1.1Portions Copyright (c) 2007-2011 NetApp, Inc. All Rights ReservedCPU = 1 Processors Detected, Cores per Processor = 2Intel(R) Xeon(R) CPU E5220 2.33GHzTesting RAM512MB RAM tested5120MB RAM installed6144 KB L2 CacheSyst