RHEL7_11gR2_RAC安装

1、ORACLE 11gR2 For RHEL7.1安装目录1安装前须知21.1 安装流程21.2 注意事项22安装规划22.1规划目的22.2命名规划22.2.1节点命名规划22.2.2双机集群命名规划32.3本地数据库双机方案32.4网络IP规划32.5磁盘阵列及ASM规划43检查和设置系统环境53.1操作前须知53.2检查系统环境53.3设置系统环境63.3.1配置主机名63.3.2禁用透明巨页63.3.3关闭防火墙及安全增强SELINUX63.3.4配置缺省网关73.3.5停用ntp时间服务73.3.6配置文件系统描述符73.3.7配置内核参数73.3.8设置环境变量83.3.9配置YUM

2、93.3.10配置DNS域名解析93.3.11配置SSH143.3.12配置ISCSI（RAC测试平台配置共享存储）153.3.13配置UDEV163.4配置RAC集群软件184安装配置Oracle数据库184.1数据库规划184.2安装前准备184.3GRID集群软件安装及配置184.3.1集群名称规划：184.4安装数据库软件274.4.1 RAC集群时间同步284.5创建Listener284.6创建数据库实例284.6.1使用ASMCA划分ASM卷组284.6.2使用DBCA创建数据库实例284.7配置Oracle数据库服务端375.FAQ37插图目录表格目录1安装前须知介绍 数据库系

3、统的总体安装流程和安装前注意事项。1.1 安装流程介绍系统的安装流程。1.2 注意事项介绍安装人员应仔细阅读和确认的事项。2安装规划2.1规划目的2.2命名规划2.2.1节点命名规划介绍系统中的节点命名规划。主机名（hostname）：（示例）域名：（示例）DNS服务器：dnsserver（示例）主备机节点命名规划：主机的节点名称规划为node1。备机的节点名称规划为node2。SCAN的虚拟IP 别名为rac-scan。Oracle RAC 所需的虚拟IP 别名node1-vip、node2-vip。Oracle RAC 所需的私网IP 别名node2-priv、node2-priv。ISC

4、SI存储私网IP 别名node1-iscsi、node2-iscsi（用于iscsi连接）。2.2.2双机集群命名规划在安装CRS 过程中，配置“Cluster Name系统名称（湖南农卫信息系统） 集群名称hnnw hnnwcluster以下使用DNS配置解析：SCAN VIP: 01 rac-SCAN VIP: 02 rac-SCAN VIP: 03 rac-2.2.3磁盘资源划分命名规划用途磁盘LUN大小RAID类型访问主机（节点）文件系统OCR_VOTE（RAC集群使用）OCR_VOTE110GBRAID1+0node1

5、，node2OCR_VOTE210GBnode1，node2OCR_VOTE310GBnode1，node2ORA_DATA1（数据文件）ORA_DISK11TBnode1，node2ORA_FLASH（数据恢复区）ORA_FLASH500GBnode1，node2ORA_DATA2（数据文件）ORA_DISK21.7TBRAID5node1，node2ORA_DISK31.7TBnode1，node2ORA_DISK41.7TBnode1，node2ORA_ARCH1（归档与RMAN数据备份）ORA_ARCH14TBRAID5node1xfsORA_ARCH2（归档与逻辑数据备份）ORA_A

6、RCH24TBnode2xfs2.3本地数据库双机方案2.4网络IP规划/etc/hosts# Public 01 node1 02 node2 # Private Interconnect 1 node1-priv node1-2 node2-priv node1-#Virtual IP 04 node1-vip node1-05 node2-vip node1-#Scan Virtual IP 01 rac-scan rac-192.168.

7、2.202 rac-scan rac-03 rac-scan rac-#DNS server dnsserver # Private Storage Network for ISCSI - 04 iscsi-server00 iscsi-server-priv 01 node1-iscsi 02 node2-iscsi如果网卡不够，就ISCSI就使用公有IP2.5磁盘阵列及ASM规划RHEL7系统安装规划：16G内存，交换空间为24GB。2.6用户规划建立用户和组：gr

8、oupadd -g 1010 oinstallgroupadd -g 1020 asmadmingroupadd -g 1021 asmdbagroupadd -g 1031 dbagroupadd -g 1022 asmoperuseradd -u 1100 -g oinstall -G asmadmin,asmdba,asmoper,dba griduseradd -u 1101 -g oinstall -G dba,asmdba oracle分配目录及权限设置：mkdir -p /u01/app/11.2.0/gridmkdir -p /u01/app/gridmkdir -p /u01

9、/app/oraclechown -R grid:oinstall /u01chown grid:oinstall /u01/app/11.2.0/gridchown grid:oinstall /u01/app/gridchown oracle:oinstall /u01/app/oraclechmod -R 775 /u013检查和设置系统环境3.1操作前须知3.2检查系统环境3.2.1检查系统内存配置：操作系统版本检查：cat /proc/version检查系统架构：uname -m检查内存：grep MemTotal /proc/meminfo 或使用free检查交换空间:grep S

10、wapTotal /proc/meminfo 或使用free检查共享内存空间：df -h /dev/shm/必须要确保共享内存大于ORACLE 中初始化参数MEMORY_MAX_TARGET 和MEMORY_TARGET(特别提示，这两个参数即自动内存管理特性对应的初始化参数)的值。mount -t tmpfs shmfs -o size=16g /dev/shm加入到文件/etc/fstab，系统重启了也生效。shmfs /dev/shm tmpfs size=16g 0检查临时目录空间:df -k /tmp检查文件系统空间:df h显示VG卷组信息：vgdisplay显示LV逻辑卷信息:l

11、vdisplay系统包的检查：rpm qa|grep package_name查询不同架构的RPM包版本：rpm -qa -queryformat "%NAME-%VERSION-%RELEASE (%ARCH)n" | grep package_name3.2.2 RHEL7安装Oracle11gR2版本要求操作系统包安装及配置:make-3.82-21.el7binutils-.1-12.el7.x86_64 compat-libcap1-1.10-3.el7.x86_64 gcc-4.8.2-3.el7.x86_64 gcc-c+-4.8.2-3.e

12、l7.x86_64 glibc-2.17-36.el7.i686 glibc-2.17-36.el7.x86_64 glibc-devel-2.17-36.el7.i686 glibc-devel-2.17-36.el7.x86_64 glibc-common-2.17-78.el7 ksh libaio-0.3.109-9.el7.i686 libaio-0.3.109-9.el7.x86_64 libaio-devel-0.3.109-9.el7.i686 libaio-devel-0.3.109-9.el7.x86_64 libgcc-4.8.2-3.el7.i686 libgcc-4.

13、8.2-3.el7.x86_64 libstdc+-4.8.2-3.el7.i686 libstdc+-4.8.2-3.el7.x86_64 libstdc+-devel-4.8.2-3.el7.i686 libstdc+-devel-4.8.2-3.el7.x86_64 libXi-1.7.2-1.el7.i686 libXi-1.7.2-1.el7.x86_64 libXtst-1.2.2-1.el7.i686 libXtst-1.2.2-1.el7.x86_64 make-3.82-19.el7.x86_64 sysstat-10.1.5-1.el7.x86_64 elfutils-li

14、belf(x86_64)-0.160-1.el7elfutils-libelf-devel-0.160-1.el7.x86_64compat-libstdc+-33(x86_64)-3.2.3 perl-Env-1.04-2.el7.noarchcpp-4.8.2-16.el7.x86_64 glibc-headers-2.17-55.el7.x86_64 expat-2.1.0-8.el7.x86_64mpfr-3.1.1-4.el7.x86_64 安装 cvuqdisk包，文件在ORACLE安装盘/grid/rpm目录下rpm -iv cvuqdisk-1.0.9-1.rpm3.3设置系统

15、环境3.3.1配置主机名修改配置文件：/etc/hostnamerootnode1 /# hostname 3.3.2禁用透明巨页Disabling Transparent HugePages# cat /sys/kernel/mm/transparent_hugepage/enabledAdd the following entry to the kernel boot line in the /etc/grub.conf file:transparent_hugepage=nevervi /etc/default/grubGRUB_CMDLINE_LINUX="rd.lvm.lv

16、=rhel/swap rd.lvm.lv=rhel/root rhgb quiet transparent_hugepage=never"使修改生效：grub2-mkconfig -o /boot/grub2/grub.cfg上面的方法重启之后好像并没生效，可用以下方法：或：Add the following lines in /etc/rc.local and reboot the server:if test -f /sys/kernel/mm/transparent_hugepage/enabled; then echo never > /sys/kernel/mm/tr

17、ansparent_hugepage/enabledfiif test -f /sys/kernel/mm/transparent_hugepage/defrag; then echo never > /sys/kernel/mm/transparent_hugepage/defragfi3.3.3关闭防火墙及安全增强SELINUXselinuxiptables关闭RAC的内部通信还要用到net=/16的IP，禁止防火墙和selinux# systemctl disable firewalld# systemctl stop firewalld# 修改/etc/sy

18、sconfig/selinux确保SELINUX=disabled，然后执行setenforce 0或者reboot服务器以生效最小配置，将SElinux设置为PERMISSIVE模式：#setenforce 0 #getenforce3.3.4配置缺省网关route -nroute add default gw route -n3.3.5停用ntp时间服务使用集群自带的ctss时间同步服务 systemctl is-enabled ntpdate.servicesystemctl disable ntpdate.servicemv /etc/ntp.conf /etc/

19、ntp.conf.originalrm /var/run/ntpd.pid3.3.6配置文件系统描述符编辑文件/etc/security/limits.conf，加入以下条目：grid soft nproc 2047grid hard nproc 16384grid soft nofile 1024grid hard nofile 65536grid soft stack 10240oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 65536oracle soft sta

20、ck 102403.3.7配置内核参数编辑文件/etc/sysctl.conf，加入以下条目：fs.aio-max-nr = 1048576kernel.shmall = 2097152 physical RAM size / pagesize ，8GB物理内存设置为2097152查看pagesize：$ getconf PAGE_SIZE4096kernel.shmmax = 805941248 （内存的1/2，11gR2要求内存1.5GB）kernel.shmmni = 4096kernel.sem = 250 32000 100 128#kernel.randomize_va_space

21、 = 0#kernel.exec-shield=0fs.file-max = 6815744 512 x processes (for example 6815744 for 13312 processes)net.ipv4.ip_local_port_range = 9000 65500net.core.rmem_default = 262144net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 10485763.3.8设置环境变量设置pam_limits验证最新版的PAM 已

22、经被加载，如果不存在的话，在 /etc/pam.d/login 文件中添加如下内容：session required pam_limits.so 设置ulimit验证当前的ulimits，在/etc/profile添加如下内容是if $USER = "oracle" ; then if $SHELL = "/bin/ksh" ; then ulimit -u 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi fi 对于RAC应该按以下配置：if /$USER = "ora

23、cle" | /$USER = "grid" ; then if /$SHELL = "/bin/ksh" ; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fi umask 022fi设置文件.bashrc修改GRID及ORACLE用户HOME目录下的文件：$HOME/.bashrc加入以下代码：if -t 0 ; then stty intr Cfi设置文件.bash_profile$HOME/.bash_profile加入以

24、下代码：if -f /.bashrc ; then . /.bashrcfi# User specific environment and startup programsPATH=$PATH:$HOME/.local/bin:$HOME/binexport ORACLE_SID=+ASM1 #export ORACLE_SID=rac1 export ORACLE_BASE=/u01/app/gridexport ORACLE_HOME=/u01/app/11.2.0/grid#export ORACLE_BASE=/u01/app/oracle#export ORACLE_HOME=/u0

25、1/app/oracle/product/11.2.0/dbhome_1export ORACLE_TERM=xterm export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"export TNS_ADMIN=$ORACLE_HOME/network/adminexport PATH=.:/usr/sbin:$ORACLE_HOME/bin:$ORACLE_HOME/jdk/bin:$PATH#export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/usr/X11R6/lib:$LD_LIBRARY_PATH

26、export CLASSPATH=$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib:$CLASSPATH#export NLS_LANG="american_america.AL32UTF8"export NLS_LANG="american_america.ZHS16GBK"export EDITOD=vimexport DISPLAY=0:0.0（xmanager图形模式服务端IP）export LANG=en_US.UTF-8#expprt LANG=zh_CN.UTF-8export NLS

27、_DATE_FORMAT=yyyy-mm-dd:hh24:mi:ssexport TEMP=/tmpexport TMPDIR=/tmpexport CVUQDISK_GRP=oinstall#export ORACLE_HOSTNAME=umask 0223.3.9配置YUM建立rhel-media.repo 配置文件：Cd /etc/yum.repos.drootiscsi yum.repos.d# more rhel-media.reporhel-medianame=Red Hat Enterprise Linux 7.1baseurl=file:/media/RHEL7enable=1

28、gpgcheck=1gpgkey=file:/media/RHEL7/RPM-GPG-KEY-redhat-release使用yum命令自动安装软件yum clean all #清除yum缓存 yum makecache #缓存本地yum源中的软件包信息rpm -import /media/RHEL7/RPM-GPG-KEY-redhat-release3.3.10配置DNS域名解析域名 #关于DNS的配置，分为以下几个步骤 #a.安装所需的rpm包及准备好脚本 #b.配置named.conf文件 #d.rfc1912.zones文件 #d.配置zone文件，包括正向和反向zone

29、文件 #e.配置解析文件resolv.conf #f.启动dns服务 配置文件脚本：示例脚本目录：/usr/share/doc/bind*/sample/cp /usr/share/doc/bind-9.9.4/sample/etc/* /etccp -R /usr/share/doc/bind*/sample/var/named /var/named配置named.conf如果在/var/named/chroot/var/named下你找不到相关的zone文件，也没关系，在/usr/share/doc/bind-9.9.4/sample/var/named下就

30、有相关的sample文件（RHEL7），我们拷贝过来就可以用。cd /etcrootnode1 etc# more named.conf/ named.conf for Red Hat caching-nameserver/options / Put files that named is allowed to write in the data/ directory: directory "/var/named" / "Working" directory dump-file "data/cache_dump.db" statist

31、ics-file "data/named_stats.txt" memstatistics-file "data/named_mem_stats.txt" /listen-on port 53 any; ; listen-on port 53 any; ; /listen-on-v6 port 53 any; ; listen-on-v6 port 53 :1; ; allow-query any; ; allow-query-cache any; ; recursion yes; pid-file "/run/named/named.pid&

32、quot; session-keyfile "/run/named/session.key" managed-keys-directory "/var/named/dynamic"logging channel default_debug file "data/named.run" severity dynamic; ; view "localhost_resolver" match-clients any; ; recursion yes; # all views must contain the root hi

33、nts zone: zone "." IN type hint; file "/var/named/named.ca" ; include "/etc/named.rfc1912.zones"配置named.rfc1912.zones（RHEL7配置）more /etc/named.rfc1912.zones/ named.rfc1912.zones:/ Provided by Red Hat caching-nameserver package / ISC BIND named zone configuration

34、for zones recommended by/ RFC 1912 section 4.1 : localhost TLDs and address zones/ and /internet-drafts/draft-ietf-dnsop-default-local-zones-02.txt/ (c)2007 R W Franks/ / See /usr/share/doc/bind*/sample/ for example named configuration files./zone "localhost.localdomain"

35、IN type master; file "named.localhost" allow-update none; ;zone "localhost" IN type master; file "named.localhost" allow-update none; ;zone "........" IN type master; file "named.loopback&quo

36、t; allow-update none; ;zone "27." IN type master; file "named.loopback" allow-update none; ;zone "0." IN type master; file "named.empty" allow-update none; ;zone "2.0.192." IN type master; file "2.0.192

37、.in-addr.local" allow-update none; ;zone "" IN type master; file ".zone" allow-update none; ; 上面有6个zone，其中前面4个zone是系统的，后面红色的2个zone是我们给RAC的SCAN配置的。对应的每个zone，我们都有一个对应的file放在/var/named目录下。以/var/name目录下建立文件.zone及 2.0.192.in-addr.local配置zone文件，包括正向和反向zone文件 cd /var/namedr

38、ootiscsi named# more .zone$TTL 86400 IN SOA . . (/其中SOA后面分别是域名服务器和管理员邮箱 42 ; serial (d. adams) 3H ; refresh 15M ; retry 1W ; expiry 1D ) ; minimum IN NS ./NS 它定义了为本域(domain)(这个例子中是)服务的域名服务器node1 IN A 01node2 IN A 02rac-scan IN A 01rac-scan IN A 02rac-scan IN A 192

39、.0.2.203node1-vip IN A 04node2-vip IN A 05dnsserver IN A rootiscsi named# more 2.0.192.in-addr.local$TTL 86400 IN SOA . . ( 1997022700 ; Serial 28800 ; Refresh 14400 ; Retry 3600000 ; Expire 86400 ) ; Minimum IN NS .101 IN PTR .102 IN PTR .104 IN PTR node1-.105 IN PTR nod

40、e2-.201 IN PTR rac-.202 IN PTR rac-.203 IN PTR rac-.1 IN PTR .配置文件语法测试named-checkconf -z /etc/named.confnamed-checkconf配置DNS后，重启DNS服务rootnode1 named# systemctl start named.service配置Resolv.conf 设置完成DNS服务器，我们还需要在所有的数据库服务器端做一些设置：在数据库服务器端，修改/etc/resolv.conf文件，设置DNS服务器，加上搜索域：rootrac2 # ca

41、t /etc/resolv.confsearch nameserver 建立/etc/host.conf文件，指定解析顺序，先DNS，再hostsorder bind,hostsmulti on默认的，linux的解析是先经过/etc/hosts文件，再经过DNS的解析，此解析方式在/etc/nsswitch.conf文件中是由明确规定的，如下：hosts: files dns使用nslookup命令验证文件/var/named/named.ca里的IP，如果解析超时，则修改文件：named.confzone "." IN type hint; / fil

42、e "named.ca" file "/dev/null" 重载named配置文件：systemctl reload named.service修改文件加入/etc/resolv.confsearch nameserver 04options rotateoptions timeout:2options attempts:23.3.11配置SSH节点间信任关系配置过程如下：对于grid 及oracle用户都执行一遍各节点生成Keys：rootrac1 # su - oracleoraclerac1 $ mkdir /.sshorac

43、lerac1 $ chmod 700 /.sshoraclerac1 $ ssh-keygen -t rsaoraclerac1 $ ssh-keygen -t dsarootrac2 # su - oracleoraclerac2 $ mkdir /.sshoraclerac2 $ chmod 700 /.sshoraclerac2 $ ssh-keygen -t rsaoraclerac2 $ ssh-keygen -t dsa在节点1上进行互信配置：oraclerac1 $ touch /.ssh/authorized_keysoraclerac1 $ cd /.sshoraclerac

44、1 .ssh$ ssh node1 cat /.ssh/id_rsa.pub >> authorized_keysoraclerac1 .ssh$ ssh node2 cat /.ssh/id_rsa.pub >> authorized_keysoraclerac1 .ssh$ ssh node1 cat /.ssh/id_dsa.pub >> authorized_keysoraclerac1 .ssh$ ssh node2 cat /.ssh/id_dsa.pub >> authorized_keys在rac1把存储公钥信息的验证文件传送到r

45、ac2上oraclerac1 .ssh$ pwd/home/oracle/.sshoraclerac1 .ssh$ scp authorized_keys node2:pwdoraclerac2's password:authorized_keys 100% 1644 1.6KB/s 00:00设置验证文件的权限在每一个节点执行：$ chmod 600 /.ssh/authorized_keys启用用户一致性在你要运行OUI的节点以oracle用户运行(这里选择rac1)：oraclerac1 .ssh$ exec /usr/bin/ssh-agent $SHELLoraclerac1

46、 .ssh$ ssh-addIdentity added: /home/oracle/.ssh/id_rsa (/home/oracle/.ssh/id_rsa)Identity added: /home/oracle/.ssh/id_dsa (/home/oracle/.ssh/id_dsa)验证ssh配置是否正确以oracle用户在所有节点分别执行：ssh node1 datessh node2 datessh node1-priv datessh node2-priv date如果不需要输入密码就可以输出时间，说明ssh验证配置成功。必须把以上命令在两个节点都运行，每一个命令在第一次执行

47、的时候需要输入yes。如果不运行这些命令，即使ssh验证已经配好，安装clusterware的时候也会出现错误：The specified nodes are not clusterable因为，配好ssh后，还需要在第一次访问时输入yes，才算是真正的无障碍访问其他服务器。3.3.12配置ISCSI（RAC测试平台配置共享存储）检查端口号不被占用：netstat -antup | grep 3260防火墙打开3260端口：firewall-cmd -permanent -add-port=3260/tcp;firewall-cmd -reloadsystemctl enable target

48、.servicesystemctl start target.servicesystemctl status target.service建立块设备：targetcli/backstores/block> create ocr_vote /dev/sdb1Created block storage object ocr_vote using /dev/sdb1./backstores/block> create oradata1 /dev/sdb2Created block storage object oradata1 using /dev/sdb2./backstores/bl

49、ock> create oradata2 /dev/sdb3Created block storage object oradata2 using /dev/sdb3./backstores/block> create oraflash /dev/sdb4Created block storage object oraflash using /dev/sdb4.刷新：/backstores/block> refresh/iscsi> create iqn.2015-.vqiu.iscsi.server0/iscsi/iqn.2015-.vqiu.iscsi.server0/tpg1/portals> delete 3260/iscsi/iqn.2015-.vqiu.iscsi.server0/tpg1/portals> create 00 3260/iscsi/iqn.2015-.vqiu.iscsi.server0/tpg1/acls> create iqn.2015-.desktop/iscsi/iqn.2015-.vqiu.iscsi.server0/tpg1/luns> create /back