教学Sqoop安装与配置

主讲：张义0102目录Sqoop下载安装Sqoop配置Sqoop下载安装1Sqoop下载安装下载地址：/cdh5/cdh/5/sqoop-1.4.6-cdh5.5.2.tar.gz解压到／opt/cdh5/sqoop拷贝mysql的jdbc驱动包mysql-connector-java-5.1.31-bin.jar到sqoop/lib目录下。Sqoop配置2Sqoop配置配置环境变量#sqoopexportSQOOP_HOME=/opt/cdh5/sqoopexportPATH=$PATH:$SQOOP_HOME/binSqoop配置设置sqoop-env.sh文件#Setpathtowherebin/hadoopisavailableexportHADOOP_COMMON_HOME=/opt/cdh5/hadoop#Setpathtowherehadoop-*-core.jarisavailableexportHADOOP_MAPRED_HOME=/opt/cdh5/hadoop#setthepathtowherebin/hbaseisavailableexportHBASE_HOME=/opt/cdh5/hbase

#Setthepathtowherebin/hiveisavailableexportHIVE_HOME=/opt/cdh5/hive#SetthepathforwherezookeperconfigdirisexportZOOCFGDIR=/opt/cdh5/zookeeperSqoop配置测试Sqoopsqoopversion发现有警告修改$SQOOP_HOME/bin/configure-sqoop注释掉HCatalog，Accumulo检查(除非你准备使用HCatalog，Accumulo等HADOOP上的组件)

##Movedtobearuntimecheckinsqoop.#if[!-d"${HCAT_HOME}"];then#

echo"Warning:$HCAT_HOMEdoesnotexist!HCatalogjobswillfail."#

echo'Pleaseset$HCAT_HOMEtotherootofyourHCataloginstallation.'#fi#if[!-d"${ACCUMULO_HOME}"];then#

echo"Warning:$ACCUMULO_HOMEdoesnotexist!Accumuloimportswillfail."#

echo'Pleaseset$ACCUMULO_HOMEtotherootofyourAccumuloinstallation.'#fi

Sqoop配置测试Sqoop再次执行sqoopversion你也可以查看某一个命令的使用说明：$sqoopimport--help$sqoophelpimportsqoopimport的一个示例如下：$sqoopimport--connectjdbc:mysql://21:3306/metastore--usernamehiveuser--passwordredhat--tableTBLS

Sqoop配置测试Sqoop还可以使用

--options-file

来传入一个文件，使用这种方式可以重用一些配置参数：$sqoop--options-file/users/homer/work/import.txt--tableTEST/users/homer/work/import.txt文件内容如