日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程资源 > 编程问答 >内容正文

编程问答

CDH- Hive HWI 配置

發布時間:2024/8/23 编程问答 32 豆豆
生活随笔 收集整理的這篇文章主要介紹了 CDH- Hive HWI 配置 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

目錄

?

一、HWI安裝

二、其中遇到一些問題:

1.遇到如下問題,將jre環境中的toos.jar 服務到lib目錄下

2.CDH中沒有hwi相關配置參數,手動加入并修改端口為9998,發現并未生效,暫時未找到原因所在。


一、HWI安裝

通過查看《Hadoop權威指南》發現hive有 hwi功能研究一下看看是否方便

執行

[root@test111 lib]# hive --service hwi OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release ls: cannot access /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/hive-hwi-*.war: No such file or directory OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 18/09/21 11:16:03 INFO hwi.HWIServer: HWI is starting up 18/09/21 11:16:03 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 18/09/21 11:16:03 INFO mortbay.log: jetty-6.1.26.cloudera.4 18/09/21 11:16:04 INFO mortbay.log: Started SocketConnector@0.0.0.0:9999

訪問鏈接發現根本不是web頁面,媽的。都是文件

后來發現需要編譯相關war包,傳入服務器。?

首先下載相對應的源碼下載地址:http://www.apache.org/dyn/closer.cgi/hive/

進入hwi目錄

apache-hive-1.2.2-src/hwi

編譯成war包?

注意打包方式要使用這種,網上很多種方式,使用完之后發現還不是web操作頁面

jar cvfM0 hive-hwi-1.2.1.war -C web/ .

?查找hive的目錄安裝在

/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hive/lib

?將hive-hwi-1.2.1.war 復制到該目錄下,運行報錯如下

[root@test111 hive]# hive --service hwi OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 18/09/21 11:11:25 INFO hwi.HWIServer: HWI is starting up 18/09/21 11:11:26 ERROR hwi.HWIServer: HWI WAR file not found at /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/hive-hwi-1.1.0.war

?提示文件沒有在目錄中找到,cd進這個目錄發現沒有該目錄,手動創建

[root@test111 hive]# mkdir -p /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/

將文件?hive-hwi-1.2.1.war 也復制到該目錄下

再次執行

[root@test111 lib]# hive --service hwi OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 OpenJDK 64-Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 18/09/21 11:15:00 INFO hwi.HWIServer: HWI is starting up 18/09/21 11:15:00 INFO mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 18/09/21 11:15:00 INFO mortbay.log: jetty-6.1.26.cloudera.4 18/09/21 11:15:00 INFO mortbay.log: Extract /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/bin/../lib/hive/lib/hive-hwi-1.1.0.war to /tmp/Jetty_0_0_0_0_9999_hive.hwi.1.1.0.war__hwi__.4otk49/webapp 18/09/21 11:15:00 INFO mortbay.log: Started SocketConnector@0.0.0.0:9999

訪問http://192.168.2.111:9999/hwi/? ?一定要加上hwi 否則無法訪問

?

二、其中遇到一些問題:

1.遇到如下問題,將jre環境中的toos.jar 服務到lib目錄下

cp tools.jar /opt/cloudera/parcels/CDH-5.13.0-1.cdh5.13.0.p0.29/lib/hive/lib 18/09/21 10:35:21 ERROR mortbay.log: /hwi/hwi/web/ Unable to find a javac compiler; com.sun.tools.javac.Main is not on the classpath. Perhaps JAVA_HOME does not point to the JDK. It is currently set to "/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.181-3.b13.el7_5.x86_64/jre"at org.apache.tools.ant.taskdefs.compilers.CompilerAdapterFactory.getCompiler(CompilerAdapterFactory.java:129)at org.apache.tools.ant.taskdefs.Javac.findSupportedFileExtensions(Javac.java:979)at org.apache.tools.ant.taskdefs.Javac.scanDir(Javac.java:956)at org.apache.tools.ant.taskdefs.Javac.execute(Javac.java:927)at org.apache.jasper.compiler.AntCompiler.generateClass(AntCompiler.java:220)at org.apache.jasper.compiler.Compiler.compile(Compiler.java:298)at org.apache.jasper.compiler.Compiler.compile(Compiler.java:277)at org.apache.jasper.compiler.Compiler.compile(Compiler.java:265)at org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:564)at org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:299)at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:315)at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:265)at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:327)at org.mortbay.jetty.servlet.Dispatcher.forward(Dispatcher.java:126)at org.mortbay.jetty.servlet.DefaultServlet.doGet(DefaultServlet.java:503)at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401)at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767)at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)at org.mortbay.jetty.handler.RequestLogHandler.handle(RequestLogHandler.java:49)at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)at org.mortbay.jetty.Server.handle(Server.java:326)at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

2.CDH中沒有hwi相關配置參數,修改端口為9991

CDH中修改配置參數,hive-site相關有很多個配置,修改如圖所示的那個參數,其他的修改無法生效。

hive-site.xml 的 Hive 客戶端高級配置代碼段(安全閥) <property><name>hive.hwi.listen.port</name><value>9991</value><final>true</final> </property>

HWI 簡單使用 參考:https://blog.csdn.net/zhangshenghang/article/details/82800390?

總結

以上是生活随笔為你收集整理的CDH- Hive HWI 配置的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。