cdh6.3.x安装详细文档

cdh6.3.x安装文档

1.安装文档链接

官方

/documentation/enterprise/6/6.0/topics/installation.html

网友贡献1

/swordfall/p/10816797.html

网友贡献2

/TXBSW/article/details/846482692.配置hosts

vim/etc/hosts

将集群的每台机器的域名与ip的映射追加至/etc/hosts3.关闭防火墙

临时关闭防火墙

#systemctlstopfirewalld

永久防火墙开机自启动

#systemctldisablefirewalld

查看防火墙状态

#systemctlstatusfirewalld4.selinux关闭

#vim/etc/sysconfig/selinux

SELINUX=disabled

重启机器，命令：

#reboot

重启后检查：

#sestatus–v5.mysql

mysql版本建议

5.7.29MySQLCommunityServer(GPL)

CREATEDATABASEscmDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASEamonDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASEhueDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASEmetastoreDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASErmanDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

GRANTALLONscm.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONamon.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONhue.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONmetastore.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONrman.*TO'cdh6'@'%'IDENTIFIEDBY'12345678’;

GRANTALLONsentry.*TO'cdh6'@'%'IDENTIFIEDBY'aB!12345678';

FLUSHPRIVILEGES;

6.安装jdk

安装之前先卸载CentOS7自带的JDK

选择

jdk-8u181-linux-x64.tar.gz下载

/technetwork/java/javase/downloads/java-archive-javase8-2177648.html

查看系统已经装的jdk：

#rpm-qa|grepjdk

卸载jdk：

#rpm-e--nodepsjava-1.6.0-openjdk-javadoc--3.0.el6.x86_64

1.下载“jdk-8u131-linux-x64.tar.gz”，放到/usr/java/目录下

2.解压

#tar-xzvfjdk-8u131-linux-x64.tar.gz

3.在任何目录下均可编辑

#vim/etc/profile

exportJAVA_HOME=/usr/java/jdk1.8.0_131

exportJRE_HOME=$JAVA_HOME/jre

exportPATH=$PATH:$JAVA_HOME/bin

exportCLASSPATH=.:$JAVA_HOME/lib:$JRE_HOME/lib7.配置NTP服务（所有节点）

a.修改时区（改为中国标准时区）ln-sf/usr/share/zoneinfo/Asia/Shanghai/etc/localtime

b.安装ntpyum-yinstallntp

c.ntp主机配置vim/etc/ntp.conf

sed's/tinker/#tinker/g'-i

/etc/ntp.conf

重新启动ntp服务：systemctlrestartntpd.service

设置开机自启：systemctlenablentpd.service

ntpdc-cloopinfo#查看与时间同步服务器的时间偏差

ntpq-p#查看当前同步的时间服务器

ntpstat#查看状态

5分钟后执行ntptime查看是否存在error，没有的话则代表启动成功8.配置各节点之间ssh免密登录

@运维9.优化虚拟内存需求率

检查虚拟内存需求率

#cat/proc/sys/vm/swappiness

显示如下：

30

临时降低虚拟内存需求率

#sysctlvm.swappiness=10

永久降低虚拟内存需求率

#echo'vm.swappiness=10'>/etc/sysctl.d/swappiness.conf

并运行如下命令使生效

#sysctl-p10.检查透明大页面问题

#cat/sys/kernel/mm/transparent_hugepage/defrag

如果显示为：

[always]madvisenever

临时关闭透明大页面问题

#echonever>/sys/kernel/mm/transparent_hugepage/defrag

确认配置生效

#cat/sys/kernel/mm/transparent_hugepage/defrag

应该显示为：

alwaysmadvise[never]

配置开机自动生效

#echonever>/sys/kernel/mm/transparent_hugepage/enabled

11.拷贝mysql-connector-java到各个节点指定目录下

mkdir-p/usr/share/java

cpmysql-connector-java-5.1.44-bin.jar/usr/share/java/mysql-connector-java.jar12.配置ClouderaManager仓库

a.wget'/cm6/6.3.1/redhat7/yum/cloudera-manager.repo'-P/etc/yum.repos.d/

b.rpm--import/cm6/6.3.1/redhat7/yum/RPM-GPG-KEY-cloudera

c.yuminstallcloudera-manager-daemonscloudera-manager-agentcloudera-manager-server(主节点，其余执行yuminstallcloudera-manager-daemonscloudera-manager-agent)13.设置ClouderaManager数据库

cd

/opt/cloudera/cm/schema/

shscm_prepare_database.shmysql-h

-uroot-p'Root!!2018'--scm-host7db_cdh6_scmroot'Root!!2018’

最后出现

Alldone,yourSCMdatabaseisconfiguredcorrectly!代表初始化数据库成功14.修改scm-agent配置

sudovi

/etc/cloudera-scm-agent/config.ini

server_host=cdh1（这里我是以cdh1作为scm-server节点）15.启动cloudera-scm-server

systemctlstartcloudera-scm-server16.错误汇总

a.kudu启动失败问题

Checkfailed:_s.ok()Badstatus:Service