Hive的下載和安裝

下載地址：https://hive.apache.org/downloads.html

啟動hive前，先啟動zookeeper、hdfs和yarn

安裝Hive

上傳壓縮包 路徑：E:\大數(shù)據(jù)開發(fā)課程\大數(shù)據(jù)\大數(shù)據(jù)組件\apache-hive-1.2.2-bin.tar.gz

解壓

[hadoop@hadoop101 installPkg]$ tar -zxvf apache-hive-1.2.2-bin.tar.gz -C ../apps/

創(chuàng)建軟連接

[hadoop@hadoop101 apps]$ ln -s apache-hive-1.2.2-bin/ hive

編輯hive-env.sh

[hadoop@hadoop101 conf]$ mv hive-env.sh.template hive-env.shHADOOP_HOME=/home/hadoop/apps/hadoop # Hive Configuration Directory can be controlled by: export HIVE_CONF_DIR=/home/hadoop/apps/hive/conf

在hdfs上創(chuàng)建相關(guān)目錄，并設(shè)置權(quán)限

[hadoop@hadoop101 conf]$ hdfs dfs -mkdir /tmp [hadoop@hadoop101 conf]$ hdfs dfs -mkdir -p /user/hive/warehouse [hadoop@hadoop101 conf]$ hdfs dfs -chmod g+w /tmp [hadoop@hadoop101 conf]$ hdfs dfs -chmod g+w /user/hive/warehouse

配置hive（conf目錄沒有hive-site.xml，是自己創(chuàng)建的）

[hadoop@hadoop101 conf]$ vim hive-site.xml <?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <!--hive數(shù)據(jù)數(shù)據(jù)庫存儲的路徑--> <property><name>hive.metastore.warehouse.dir</name><value>/user/hive/warehouse</value><description>location of default database for the warehouse</description> </property> </configuration>

配置環(huán)境變量

[hadoop@hadoop101 conf]$ sudo vim /etc/profile ## Hive的環(huán)境變量 export HIVE_HOME=/home/hadoop/apps/hive export PATH=$PATH:$HIVE_HOME/bin[hadoop@hadoop101 conf]$ . /etc/profile

啟動hive

[hadoop@hadoop101 bin]$ hive hive>

hive交互式命令配置

[hadoop@hadoop101 conf]$ vim hivesite.xml <property> <name>hive.cli.print.header</name> <value>true</value> </property><property> <name>hive.cli.print.current.db</name> <value>true</value> </property>

derby數(shù)據(jù)庫的弊端

安裝MySQL

上傳MySQL服務(wù)端和客戶端的安裝包到installPkg目錄下

位置：E:\大數(shù)據(jù)開發(fā)課程\大數(shù)據(jù)\Source\MySQL-client-5.5.28-1.linux2.6.x86_64.rpm

? E:\大數(shù)據(jù)開發(fā)課程\大數(shù)據(jù)\Source\MySQL-server-5.5.28-1.linux2.6.x86_64.rpm

檢查是否安裝過MySQL

[hadoop@hadoop101 ~]$ rpm -qa | grep -i mysql

卸載自帶的MySQL

[hadoop@hadoop101 ~]$ sudo rpm -e --nodeps mysql-libs-5.1.71-1.el6.x86_64

安裝MySQL服務(wù)，需要將MySQL安裝成系統(tǒng)服務(wù)，開機(jī)啟動。需要root權(quán)限。

[hadoop@hadoop101 installPkg]$ sudo rpm -ivh MySQL-server-5.5.28-1.linux2.6.x86_64.rpm

安裝完成后會有一些提示信息，最好記下來，很重要

PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER !
To do so, start the server, then issue the following commands:

/usr/bin/mysqladmin -u root password ‘new-password’
/usr/bin/mysqladmin -u root -h hadoop101 password ‘new-password’

Alternatively you can run:
/usr/bin/mysql_secure_installation

which will also give you the option of removing the test
databases and anonymous user created by default. This is
strongly recommended for production servers.

See the manual for more instructions.

Please report any problems with the /usr/bin/mysqlbug script!

安裝MySQL客戶端

[hadoop@hadoop101 installPkg]$ sudo rpm -ivh MySQL-client-5.5.28-1.linux2.6.x86_64.rpm

啟動MySQL服務(wù)（設(shè)置為開機(jī)啟動）

[hadoop@hadoop101 installPkg]$ sudo service mysql start [hadoop@hadoop101 installPkg]$ sudo service mysql status MySQL running (6145) [ OK ] [hadoop@hadoop101 installPkg]$ sudo chkconfig mysql on

運(yùn)行MySQL服務(wù)的腳本，對MySQL進(jìn)行配置

[hadoop@hadoop101 installPkg]$ /usr/bin/mysql_secure_installation Enter current password for root (enter for none): Set root password? [Y/n] y New password: Re-enter new password: Password updated successfully! Reloading privilege tables.. ... Success! Remove anonymous users? [Y/n] y Disallow root login remotely? [Y/n] n Remove test database and access to it? [Y/n] y Reload privilege tables now? [Y/n] y## 有這段提示則表示設(shè)置成功 All done! If you've completed all of the above steps, your MySQL installation should now be secure. Thanks for using MySQL!

配置Hive，將元數(shù)據(jù)信息存儲在MySQL上

編輯 hive-site.xml

[hadoop@hadoop101 conf]$ vim hive-site.xml <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://hadoop101:3306/hive?createDatabaseIfNotExist=true</value> <description>JDBC connect string for a JDBC metastore</description> </property><property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> <description>Driver class name for a JDBC metastore</description> </property><property> <name>javax.jdo.option.ConnectionUserName</name> <value>root</value> <description>Username to use againstmetastore database</description> </property><property> <name>javax.jdo.option.ConnectionPassword</name> <value>123456</value> <description>password to use againstmetastore database</description> </property>

將mysql的驅(qū)動jar包上傳到hive的lib目錄下 （classpath）

位置：E:\大數(shù)據(jù)開發(fā)課程\大數(shù)據(jù)\大數(shù)據(jù)組件\mysql-connector-java-5.1.39.jar

配置MySQL遠(yuǎn)程連接(無主機(jī)登錄)

• 方式一（用%代表所有主機(jī)）：

mysql> show databases; mysql> use mysql; mysql> show tables; mysql> select Host,User from user;+-----------+------+ | Host | User | +-----------+------+ | 127.0.0.1 | root | | ::1 | root | | hadoop101 | root | | localhost | root | +-----------+------+mysql> update user set Host='%' where Host='hadoop101'; mysql> select Host,User from user;+-----------+------+ | Host | User | +-----------+------+ | % | root | | 127.0.0.1 | root | | ::1 | root | | localhost | root | +-----------+------+mysql> delete from user where Host != '%'; mysql> select Host,User from user; +-----------+------+ | Host | User | +-----------+------+ | % | root | +-----------+------+ mysql> flush privileges;

• 方式二：

mysql> grant all privileges on *.* to 'root'@'%' identified by '密碼'; mysql> flush privileges;

配置Hive日志目錄

[hadoop@hadoop101 hive]$ mkdir logs [hadoop@hadoop101 conf]$ mv hivelog4j.properties.template hivelog4j.properties [hadoop@hadoop101 conf]$ vim hivelog4j.properties hive.log.dir=/home/hadoop/apps/hive/logs

如果想在console控制臺顯示log信息，使用以下參數(shù)： 只有當(dāng)前會話有效。

[hadoop@hadoop101 conf]$ hive -help ##查看幫助 [hadoop@hadoop101 conf]$ hive --hiveconf hive.root.logger=INFO,console

hive交互式客戶端

• 執(zhí)行HQL

  [hadoop@hadoop101 bin]$ hive hive>

• 操作hdfs

  hive> dfs -ls /;

• 操作本地文件系統(tǒng)

  hive> ! ls /home/hadoop;

hive非交互式客戶端

[hadoop@hadoop101 conf]$ hive -help -e <quoted-query-string> SQL from command line -f <filename> SQL from files[hadoop@hadoop101 conf]$ hive -e 'show databases;' [hadoop@hadoop101 conf]$ hive -f /home/hadoop/data/mysql.sql ## mysql.sql是本地sql文件

啟動hive的服務(wù)，使用客戶端 連接服務(wù)操作HQL

• 后臺啟動hive的服務(wù)

  [hadoop@hadoop101 bin]$ hiveserver2 &

• 使用beeline客戶端連接

  beeline> !help beeline> !connect Usage: connect <url> <username> <password> [driver]## <username> 是hdfs的用戶，因?yàn)闆]設(shè)置過密碼，所以密碼不用寫或者順便寫 beeline> !connect jdbc:hive2://hadoop101:10000 hadoop

• 使用beeline客戶端連接

  [hadoop@hadoop101 bin]$ beeline -xxxxx -u <database url> the JDBC URL to connect to -n <username> the username to connect as -p <password> the password to connect as [hadoop@hadoop101 bin]$ beeline -u jdbc:hive2://hadoop101:10000 -n hadoop -p### 也可以操作hdfs文件系統(tǒng)；但是不能操作本地文件系統(tǒng) 0: jdbc:hive2://hadoop101:10000> dfs -ls /;

總結(jié)

以上是生活随笔為你收集整理的Hive的下载和安装的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。