日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程资源 > 编程问答 >内容正文

编程问答

【hadoop】hive 安装实践

發(fā)布時間:2025/3/20 编程问答 28 豆豆
生活随笔 收集整理的這篇文章主要介紹了 【hadoop】hive 安装实践 小編覺得挺不錯的,現(xiàn)在分享給大家,幫大家做個參考.

1.下載Hive安裝包:

  官網(wǎng)下載:http://hive.apache.org/downloads.html

2.上傳Hive的tar包,并解壓:
建議和hadoop目錄在一級,方便后續(xù)使用;

  解壓:tar -zxvf apache-hive-1.2.1-bin.tar.gz -C /home/hadoop/hive

  修改解壓后的文件名稱:mv apache-hive-1.2.1-bin hive-1.2.1

3.安裝MySql:
  MySQL用于存儲Hive的元數(shù)據(jù),(安裝教程見之前的文章)

4.修改配置文件:主要是配置metastore(元數(shù)據(jù)存儲)存儲方式
  4.1. vi /home/hadoop/hive/hive-1.2.1/conf/hive-site.xml(存儲方式:內嵌Derby方式、本地mysql、遠端mysql)

  4.2 粘貼如下內容:

<configuration><property><name>javax.jdo.option.ConnectionURL</name><value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true</value><description>JDBC connect string for a JDBC metastore</description></property><property><name>javax.jdo.option.ConnectionDriverName</name><value>com.mysql.jdbc.Driver</value><description>Driver class name for a JDBC metastore</description></property><property><name>javax.jdo.option.ConnectionUserName</name><value>root</value><description>username to use against metastore database</description></property><property><name>javax.jdo.option.ConnectionPassword</name><value>root</value> <description>password to use against metastore database</description></property> </configuration>

5.拷貝jar包:

  拷貝mysql驅動jar包到Hive的lib目錄下面去,

下載路徑:https://pan.baidu.com/s/17iHOIjt4XZbRAngGFf_GgA

6.啟動Hive:
 (1)啟動Hive之前需要先把Hadoop集群啟動起來。

(2)使用hadoop用戶

  啟動命令:/usr/local/src/hive-1.2.1/bin/hive

  出現(xiàn)如下表示啟動成功:
hive>
  

7、驗證Hive運行正常:啟動Hive以后輸入下面的命令:

hive> show databases;
OK
default
test_db
Time taken: 0.567 seconds, Fetched: 2 row(s)

hive> use default;
OK
Time taken: 0.068 seconds

hive> show tables;
OK
Time taken: 0.086 seconds

8、 創(chuàng)建數(shù)據(jù)庫, 數(shù)據(jù)庫的數(shù)據(jù)文件被存放在HDFS的/user/hive/warehouse/test_db.db下面

hive> create database test_db;
OK
Time taken: 0.505 seconds

9、在test_db里創(chuàng)建表,表的數(shù)據(jù)文件被存放在HDFS的/user/hive/warehouse/test_db.db/t_test下面;
并且表的數(shù)據(jù)文件字段以“|”分割開;  

use test_db;

create table flat1_test (mobile string,opr_type string,lastupdatetime string,monthly string,sp_code string,oper_code string,unknown string,subtime string)
row format delimited
fields terminated by '|';

10、上傳數(shù)據(jù)文件到hdfs指定目錄,目錄為hive數(shù)據(jù)庫表文件目錄
  hadoop fs -put hivefile1.txt /user/hive/warehouse/test_db.db/flat1_test

11、使用sql查詢數(shù)據(jù)
hive> select * from flat1_test;

12、查詢Hive的元數(shù)據(jù),進入mysql中查詢

mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | hive | | mysql | | performance_schema | | test | +--------------------+ 5 rows in set (0.00 sec)mysql> use hive; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -ADatabase changed mysql> mysql> show tables; +---------------------------+ | Tables_in_hive | +---------------------------+ | BUCKETING_COLS | | CDS | | COLUMNS_V2 | | DATABASE_PARAMS | | DBS | | FUNCS | | FUNC_RU | | GLOBAL_PRIVS | | IDXS | | INDEX_PARAMS | | PARTITIONS | | PARTITION_KEYS | | PARTITION_KEY_VALS | | PARTITION_PARAMS | | PART_COL_PRIVS | | PART_COL_STATS | | PART_PRIVS | | ROLES | | SDS | | SD_PARAMS | | SEQUENCE_TABLE | | SERDES | | SERDE_PARAMS | | SKEWED_COL_NAMES | | SKEWED_COL_VALUE_LOC_MAP | | SKEWED_STRING_LIST | | SKEWED_STRING_LIST_VALUES | | SKEWED_VALUES | | SORT_COLS | | TABLE_PARAMS | | TAB_COL_STATS | | TBLS | | TBL_COL_PRIVS | | TBL_PRIVS | | VERSION | +---------------------------+ 35 rows in set (0.01 sec)mysql> select * from DBS; +-------+-----------------------+-----------------------------------------------------------+---------+------------+------------+ | DB_ID | DESC | DB_LOCATION_URI | NAME | OWNER_NAME | OWNER_TYPE | +-------+-----------------------+-----------------------------------------------------------+---------+------------+------------+ | 1 | Default Hive database | hdfs://XXXXXXXXXX:9000/user/hive/warehouse | default | public | ROLE | | 6 | NULL | hdfs://XXXXXXXXXX:9000/user/hive/warehouse/test_db.db | test_db | hadoop | USER | +-------+-----------------------+-----------------------------------------------------------+---------+------------+------------+ 2 rows in set (0.00 sec)mysql>

轉載于:https://blog.51cto.com/devops2016/2312670

與50位技術專家面對面20年技術見證,附贈技術全景圖

總結

以上是生活随笔為你收集整理的【hadoop】hive 安装实践的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內容還不錯,歡迎將生活随笔推薦給好友。