2019獨角獸企業重金招聘Python工程師標準>>>

環境準備：

hadoop環境搭建

安裝mysql

hive環境搭建

hadoop環境搭建參考：http://my.oschina.net/u/2311010/blog/508139

安裝mysql

卸載自帶的mysql?

rpm?-qa?|?grep?mysql rpm?-e?mysql-libs-5.1.71-1.el6.x86_64??--nodeps

????2.yum安裝mysql

yum?install?-y?mysql-server?mysql?mysql-devel

????3.啟動mysql服務，添加mysql用戶

service?mysqld?start/usr/bin/mysqladmin?-u?root?password?hadoop /usr/bin/mysqladmin?-u?root?-h?master?password?hadoopmysql?-uroot?-hmaster?-phadoop創建用戶hive@master（密碼hive）并分配權限CREATE?USER?'hive'?IDENTIFIED?BY?'hive'; GRANT?ALL?PRIVILEGES?ON?*.*?TO?'hive'@'master'?WITH?GRANT?OPTION; flush?privileges;用戶名hive登錄mysql?-h?master?-uhive set?password?=?password('hive'); 建立?Hive?專用的元數據庫 create?database?hive; 查看MYSQL數據庫中所有用戶 SELECT?DISTINCT?CONCAT('User:?''',user,'''@''',host,''';')?AS?query?FROM?mysql.user; 查看用戶是否設置了密碼select?user,host,password?from?mysql.user;

????4.hive環境搭建

修改hive的配置文件，位置在hive/conf/hive-site.xml。幾個較為重要的metastore配置屬性見下表：

hive.metastore.warehouse.dir	相對于fs.default.name的目錄，托管表存儲在這里
javax.jdo.option.ConnectionURL	metastore數據庫的JDBC URL
javax.jdo.option.ConnectionDriverName	JDBC驅動器的類名
javax.jdo.option.ConnectionUserName	JDBC用戶名
javax.jdo.option.ConnectionConnectionPassword	JDBC密碼

進入到hive的配置文件目錄下，找到hive-default.xml.template，另存為hive-site.xml并修改參數。Hive 系統會加載兩個配置文件一個默認配置文件“hive-default.xml”，另一個就是用戶自定義文件“hive-site.xml”。當“hive-site.xml”中的配置參數的值與“hive-default.xml”文件中不一致時，以用戶自定義的為準。所以可將不需要的參數都刪除掉，只留下下面所示的內容。

<?xml?version=”1.0″?> <?xml-stylesheet?type=”text/xsl”?href=”configuration.xsl”?> <configuration> <property> <name>javax.jdo.option.ConnectionURL</name> <value>jdbc:mysql://master:3306/hive?characterEncoding=UTF-8</value> </property> <property> <name>javax.jdo.option.ConnectionDriverName</name> <value>com.mysql.jdbc.Driver</value> </property> <property> <name>javax.jdo.option.ConnectionUserName</name> <value>hive</value> </property> <property> <name>javax.jdo.option.ConnectionPassword</name> <value>hive</value> </property> <property><name>hive.querylog.location</name><value>/usr/local/hive/iotmp</value><description>Location?of?Hive?run?time?structured?log?file</description></property><property><name>hive.exec.local.scratchdir</name><value>/usr/local/hive/iotmp</value><description>Local?scratch?space?for?Hive?jobs</description></property><property><name>hive.downloaded.resources.dir</name><value>/usr/local/hive/iotmp</value><description>Temporary?local?directory?for?added?resources?in?the?remote?file?system.</description></property> </configuration>

????5.拷貝jdbc驅動包

把MySQL的JDBC驅動包復制到Hive的lib目錄下（mysql-connector-java）

?6.修改環境變量

vi?~/.bashrcexport?HIVE_HOME=/app/Servers/apache-hive-1.2.1-bin export?PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HIVE_HOME/bin:$PATH

啟動hive

hive [hadoop@master?conf]$?hive jarLogging?initialized?using?configuration?in?jar:file:/app/Servers/apache-hive-1.2.1-bin/lib/hive-common-1.2.1.jar!/hive-log4j.properties hive>?show?databases; OK default Time?taken:?1.458?seconds,?Fetched:?1?row(s) hive>

轉載于:https://my.oschina.net/u/2311010/blog/625339

總結

以上是生活随笔為你收集整理的hive环境搭建的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。