ORACLE_11.2.0.3_RAC_FOR_REHL6.3(64BIT)安装文档.docx

ORACLE 11.2.0.3 RAC for REHL6.3(64bit)安装文档1、安装环境22、安装前系统配置22.1存储规划22.2 ip地址规划32.3创建用户、组(所有节点)32.4配置各节点环境变量42.5关闭所有节点防火墙42.6配置NTP服务(所有节点)52.7系统参数设置52.8存储分区52.9 UDEV绑定裸设备63、安装GRID74、创建ASM磁盘组225、安装数据库246、建库291、安装环境 rootdb1 # uname -a Linux db1 2.6.32-279.el6.x86_64 #1 SMP Wed Jun 13 18:24:36 EDT 2012 x86_64 x86_64 x86_64 GNU/Linuxrootdb1 # lsb_releaseLSBVersion: :core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch2、安装前系统配置2.1存储规划名称映射裸设备大小OCR_VOTING/dev/sdb1/dev/raw/raw11.5G/dev/sdb2/dev/raw/raw21.5G/dev/sdb3/dev/raw/raw31.5GFlash_Recovery/dev/sdc1/dev/raw/raw4145G/dev/sdc2/dev/raw/raw5145G/dev/sdc3/dev/raw/raw6145GDATA/dev/sdd1/dev/raw/raw9350G/dev/sdd2/dev/raw/raw10350G/dev/sdd3/dev/raw/raw11350G2.2 ip地址规划主机名称YJWWDB1YJWWDB2eth0 IP(PUBLIC)172.16.50.11172.16.50.12eth0 IP(VIP)172.16.50.15172.16.50.16eth1(PRIV)192.168.0.1192.168.0.2SCAN IP172.16.50.13SIDorcl1orcl2ORACLE 版本11.2.0.4修改所有节点hosts文件rootdb1 # cat /etc/hosts127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4172.16.50.11 yjwwdb1172.16.50.12 yjwwdb2172.16.50.15 yjwwdb1-vip172.16.50.16 yjwwdb2-vip192.168.0.1 yjwwdb1-priv192.168.0.2 yjwwdb2-priv172.16.50.13 rac-scan2.3创建用户、组(所有节点)groupadd -g 1000 oinstallgroupadd -g 1200 asmadmingroupadd -g 1201 asmdbagroupadd -g 1202 asmopergroupadd -g 1300 dbagroupadd -g 1301 operuseradd -m -u 1100 -g oinstall -G asmadmin,asmdba,asmoper griduseradd -m -u 1101 -g oinstall -G dba,oper,asmdba oraclemkdir -p /oracle/gridchown -R grid:oinstall /oracle/grid#chown -R grid:oinstall /oracle/grid/11.2.0mkdir -p /oracle/dbchown -R oracle:oinstall /oracle/dbchmod -R 775 /oraclepasswd gridpasswd oracle2.4配置各节点环境变量修改grid用户.bash_profileexport ORACLE_SID=+ASM1#节点2为+ASM2export ORACLE_BASE=/oracle/oracle11gexport ORACLE_HOME=/oracle/grid/11.2.0export PATH=$ORACLE_HOME/bin:$PATH:/usr/local/bin/:.export TEMP=/tmpexport TMP=/tmpexport TMPDIR=/tmpumask 022修改oracle用户.bash_profileumask 022export ORACLE_SID=orcl1export ORACLE_UNQNAME=orclexport ORACLE_BASE=/oracle/dbexport ORACLE_HOME=/oracle/db/11.2.0#export NLS_LANG=AMERICAN_AMERICA.UTF8export NLS_DATE_FORMAT=yyyy-mm-dd hh24:mi:ssexport PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/binexport PATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/binexport PATH=$PATH:$ORACLE_BASE/common/oracle/binexport ORACLE_PATH=$PATH:$ORACLE_BASE/common/oracle/sql:.:$ORACLE_HOME/rdbms/admin export ORACLE_TERM=xtermexport TNS_ADMIN=$ORACLE_HOME/network/adminexport ORA_NLS10=$ORACLE_HOME/nls/dataexport LD_LIBRARY_PATH=$ORACLE_HOME/libexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$ORACLE_HOME/oracm/libexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/lib:/usr/lib:/usr/local/libexport CLASSPATH=$ORACLE_HOME/JREexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/jlibexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/rdbms/jlibexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/network/jlibexport THREADS_FLAG=nativeexport TEMP=/tmpexport TMPDIR=/tmpexport PS1=hostname:$PWD$2.5关闭所有节点防火墙Service iptables status Service iptables stop chkconfig iptables off chkconfig iptables list设置/etc/selinux/config 文件，将 SELINUX 设置为 disabledrootdb1 # cat /etc/selinux/config# This file controls the state of SELinux on the system.# SELINUX= can take one of these three values:# enforcing - SELinux security policy is enforced.# permissive - SELinux prints warnings instead of enforcing.# disabled - No SELinux policy is loaded.SELINUX=disabled# SELINUXTYPE= can take one of these two values:# targeted - Targeted processes are protected,# mls - Multi Level Security protection.SELINUXTYPE=targeted2.6配置NTP服务(所有节点)LINUX客户端使用ntpdate 172.30.218.114来向NTP服务器同步自己的时间其它LINUX如果仅作为只客户端的话,则不能启动ntpd服务!否则无法运行ntpdata 服务器地址 来同步时间之后可以使用cron或修改crontab文件定期向NTP服务器更新时间,并用# hwclock -systohc将系统时间设置为硬件时间rootdb2 # crontab -l*/15 * * * * ntpdate 172.30.218.1142.7系统参数设置/etc/security/limits.conf文件添加如下内容：grid soft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536 oracle soft nproc 2047 oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536/etc/pam.d/login添加：session required pam_limits.so2.8存储分区所有规划的设备进行分区，例如在节点1执行：rootYJWWDB1 /# fdisk /dev/sdbWARNING: DOS-compatible mode is deprecated. Its strongly recommended to switch off the mode (command c) and change display units to sectors (command u). Command (m for help): pDisk /dev/sdb: 5368 MB, 5368709120 bytes166 heads, 62 sectors/track, 1018 cylindersUnits = cylinders of 10292 * 512 = 5269504 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0xf6108dd3 Device Boot Start End Blocks Id SystemCommand (m for help): Command (m for help): Command (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 1First cylinder (1-1018, default 1): Using default value 1Last cylinder, +cylinders or +sizeK,M,G (1-1018, default 1018): +1700MCommand (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 2First cylinder (340-1018, default 340): Using default value 340Last cylinder, +cylinders or +sizeK,M,G (340-1018, default 1018): +1700MCommand (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 3First cylinder (679-1018, default 679): Using default value 679Last cylinder, +cylinders or +sizeK,M,G (679-1018, default 1018): +1700MCommand (m for help): Command (m for help): Command (m for help): Command (m for help): Command (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.rootYJWWDB1 /# rootYJWWDB1 /# rootYJWWDB1 /# fdisk /dev/sdb -lDisk /dev/sdb: 5368 MB, 5368709120 bytes166 heads, 62 sectors/track, 1018 cylindersUnits = cylinders of 10292 * 512 = 5269504 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0xf6108dd3 Device Boot Start End Blocks Id System/dev/sdb1 1 339 1744463 83 Linux/dev/sdb2 340 678 1744494 83 Linux/dev/sdb3 679 1017 1744494 83 LinuxrootYJWWDB1 /# rootYJWWDB1 /# fdisk -l /dev/sdcDisk /dev/sdc: 472.4 GB, 472446402560 bytes255 heads, 63 sectors/track, 57438 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x7a7da770 Device Boot Start End Blocks Id System/dev/sdc1 1 18930 152055193+ 83 Linux/dev/sdc2 18931 37860 152055225 83 Linux/dev/sdc3 37861 56790 152055225 83 LinuxrootYJWWDB1 /#rootYJWWDB1 /# fdisk -l /dev/sddDisk /dev/sdd: 1099.5 GB, 1099511627776 bytes255 heads, 63 sectors/track, 133674 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x03ef9cdf Device Boot Start End Blocks Id System/dev/sdd1 1 44385 356522481 83 Linux/dev/sdd2 44386 88770 356522512+ 83 Linux/dev/sdd3 88771 133155 356522512+ 83 LinuxrootYJWWDB1 /#partprobe2.9 UDEV绑定裸设备vi /etc/udev/rules.d/60-raw.rules# Enter raw device bindings here.# An example would be:# ACTION=add, KERNEL=sda, RUN+=/bin/raw /dev/raw/raw1 %N# to bind /dev/raw/raw1 to /dev/sda, or# ACTION=add, ENVMAJOR=8, ENVMINOR=1, RUN+=/bin/raw /dev/raw/raw2 %M %m# to bind /dev/raw/raw2 to the device with major 8, minor 1.#for ocr_voting#for ocr_votingACTION=add,KERNEL=sdb1,RUN+=/bin/raw /dev/raw/raw1 %NACTION=add,KERNEL=sdb2,RUN+=/bin/raw /dev/raw/raw2 %NACTION=add,KERNEL=sdb3,RUN+=/bin/raw /dev/raw/raw3 %N#for Flash_RecoveryACTION=add,KERNEL=sdc1,RUN+=/bin/raw /dev/raw/raw4 %NACTION=add,KERNEL=sdc2,RUN+=/bin/raw /dev/raw/raw5 %NACTION=add,KERNEL=sdc3,RUN+=/bin/raw /dev/raw/raw6 %N#for dataACTION=add,KERNEL=sdd1,RUN+=/bin/raw /dev/raw/raw7 %NACTION=add,KERNEL=sdd2,RUN+=/bin/raw /dev/raw/raw8 %NACTION=add,KERNEL=sdd3,RUN+=/bin/raw /dev/raw/raw9 %NKERNEL=raw1-9*, OWNER=grid, GROUP=asmadmin, MODE=660重启 UDEV： # /sbin/start_udev以上内容需要在所有节点执行验证：rootYJWWDB1 raw# ll /dev/raw/total 0crw-rw- 1 grid asmadmin 162, 1 May 13 12:24 raw1crw-rw- 1 grid asmadmin 162, 2 May 13 12:24 raw2crw-rw- 1 grid asmadmin 162, 3 May 13 12:24 raw3crw-rw- 1 grid asmadmin 162, 4 May 13 12:24 raw4crw-rw- 1 grid asmadmin 162, 5 May 13 12:24 raw5crw-rw- 1 grid asmadmin 162, 6 May 13 12:24 raw6crw-rw- 1 grid asmadmin 162, 7 May 13 12:24 raw7crw-rw- 1 grid asmadmin 162, 8 May 13 12:24 raw8crw-rw- 1 grid asmadmin 162, 9 May 13 12:24 raw9crw-rw- 1 root disk 162, 0 May 13 12:24 rawctl2.10 验证硬件和操作系统设置gridYJWWDB1 grid$ ./runcluvfy.sh stage -pre crsinst -n yjwwdb1,yjwwdb2 -fixup -verbosePerforming pre-checks for cluster services setup Checking node reachability.Check: Node reachability from node YJWWDB1 Destination Node Reachable? - - yjwwdb1 yes yjwwdb2 yes Result: Node reachability check passed from node YJWWDB1Checking user equivalence.Check: User equivalence for user grid Node Name Status - - yjwwdb1 passed yjwwdb2 passed Result: User equivalence check passed for user gridChecking node connectivity.Checking hosts config file. Node Name Status - - yjwwdb1 passed yjwwdb2 passed Verification of the hosts config file successfulInterface information for node yjwwdb1 Name IP Address Subnet Gateway Def. Gateway HW Address MTU - - - - - - - eth0 172.16.50.11 172.16.50.0 0.0.0.0 172.16.50.30 C4:54:44:2D:5D:CE 1500 eth1 192.168.0.1 192.168.0.0 0.0.0.0 172.16.50.30 C4:54:44:2D:5D:CF 1500 Interface information for node yjwwdb2 Name IP Address Subnet Gateway Def. Gateway HW Address MTU - - - - - - - eth0 172.16.50.12 172.16.50.0 0.0.0.0 172.16.50.30 C4:54:44:2D:5D:92 1500 eth1 192.168.0.2 192.168.0.0 0.0.0.0 172.16.50.30 C4:54:44:2D:5D:93 1500 Check: Node connectivity of subnet 172.16.50.0 Source Destination Connected? - - - yjwwdb1172.16.50.11 yjwwdb2172.16.50.12 yes Result: Node connectivity passed for subnet 172.16.50.0 with node(s) yjwwdb1,yjwwdb2Check: TCP connectivity of subnet 172.16.50.0 Source Destination Connected? - - - YJWWDB1:172.16.50.11 yjwwdb1:172.16.50.11 passed YJWWDB1:172.16.50.11 yjwwdb2:172.16.50.12 passed Result: TCP connectivity check passed for subnet 172.16.50.0Check: Node connectivity of subnet 192.168.0.0 Source Destination Connected? - - - yjwwdb1192.168.0.1 yjwwdb2192.168.0.2 yes Result: Node connectivity passed for subnet 192.168.0.0 with node(s) yjwwdb1,yjwwdb2Check: TCP connectivity of subnet 192.168.0.0 Source Destination Connected? - - - YJWWDB1:192.168.0.1 yjwwdb1:192.168.0.1 passed YJWWDB1:192.168.0.1 yjwwdb2:192.168.0.2 passed Result: TCP connectivity check passed for subnet 192.168.0.0Interfaces found on subnet 172.16.50.0 that are likely candidates for VIP are:yjwwdb1 eth0:172.16.50.11yjwwdb2 eth0:172.16.50.12Interfaces found on subnet 192.168.0.0 that are likely candidates for a private interconnect are:yjwwdb1 eth1:192.168.0.1yjwwdb2 eth1:192.168.0.2Checking subnet mask consistency.Subnet mask consistency check passed for subnet 172.16.50.0.Subnet mask consistency check passed for subnet 192.168.0.0.Subnet mask consistency check passed.Result: Node connectivity check passedChecking multicast communication.Checking subnet 172.16.50.0 for multicast communication with multicast group 230.0.1.0.Check of subnet 172.16.50.0 for multicast communication with multicast group 230.0.1.0 passed.Checking subnet 192.168.0.0 for multicast communication with multicast group 230.0.1.0.Check of subnet 192.168.0.0 for multicast communication with multicast group 230.0.1.0 passed.Check of multicast communication passed.Checking ASMLib configuration. Node Name Status - - yjwwdb1 passed yjwwdb2 passed Result: Check for ASMLib configuration passed.Check: Total memory Node Name Available Required Status - - - - yjwwdb1 252.1751GB (2.64424796E8KB) 1.5GB (1572864.0KB) passed yjwwdb2 252.1751GB (2.64424796E8KB) 1.5GB (1572864.0KB) passed Result: Total memory check passedCheck: Available memory Node Name Available Required Status - - - - yjwwdb1 248.9729GB (2.61066964E8KB) 50MB (51200.0KB) passed yjwwdb2 249.447GB (2.6156416E8KB) 50MB (51200.0KB) passed Result: Available memory check passedCheck: Swap space Node Name Available Required Status - - - - yjwwdb1 15.625GB (1.6383992E7KB) 16GB (1.6777216E7KB) failed yjwwdb2 15.625GB (1.6383992E7KB) 16GB (1.6777216E7KB) failed Result: Swap space check failedCheck: Free disk space for yjwwdb1:/tmp Path Node Name Mount point Available Required Status - - - - - - /tmp yjwwdb1 / 693.4214GB 1GB passed Result: Free disk space check passed for yjwwdb1:/tmpCheck: Free disk space for yjwwdb2:/tmp Path Node Name Mount point Available Required Status - - - - - - /tmp yjwwdb2 / 698.375GB 1GB passed Result: Free disk space check passed for yjwwdb2:/tmpCheck: User existence for grid Node Name Status Comment - - - yjwwdb1 passed exists(1100) yjwwd