1.去官網(wǎng)下載sqoop，直接百度即可

2.解壓后進(jìn)入conf目錄

guo@drguo1:/opt/sqoop-1.4.6.bin__hadoop-2.0.4-alpha/conf$ cp sqoop-env-template.sh sqoop-env.sh

3.在sqoop-env.sh添加各種home

#Set path to where bin/hadoop is available

export HADOOP_COMMON_HOME=/opt/Hadoop/hadoop-2.7.2

#Set path to where hadoop-*-core.jar is available

export HADOOP_MAPRED_HOME=/opt/Hadoop/hadoop-2.7.2

#set the path to where bin/hbase is available

export HBASE_HOME=/opt/hbase

#Set the path to where bin/hive is available

export HIVE_HOME=/opt/apache-hive-2.0.0-bin

#Set the path for where zookeper config dir is

export ZOOCFGDIR=/opt/zookeeper-3.4.8/conf

4.把MySQL驅(qū)動jar包導(dǎo)入lib/下

5.建表

mysql> use hive;

Database changed

mysql> create table urlrule(

-> url varchar(1024),

-> info varchar(50)

-> );

Query OK, 0 rows affected (0.12 sec)

mysql> show tables;

+---------------+

| Tables_in_hive |

+---------------+

| urlrule |

+---------------+

1 row in set (0.00 sec)

6.將數(shù)據(jù)從HDFS導(dǎo)入MySQL

sqoop export --connect jdbc:mysql://drguo1:3306/url --username hive --password guo \

--table urlrule \

--export-dir /flow/topkurl/ \

--columns url \

--input-fields-terminated-by '\t'

7.將數(shù)據(jù)從MySQL導(dǎo)入HDFS

[hdfs@ws1dn1 root]$ sqoop import -m 1 --connect jdbc:mysql://192.168.1.65:3306/v3 --username root --password guo --table t_log_2016_done --target-dir /user/hdfs/testdata/

總結(jié)

以上是生活随笔為你收集整理的sqoop同步hdfs与mysql端口_使用Sqoop将数据在HDFS与MySQL互导的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。