當(dāng)前位置：首頁 > 编程资源 > 编程问答 >内容正文

编程问答

搭建本地Yum软件源安装Cloudera Manager 5

發(fā)布時間：2025/4/16 编程问答 22 豆豆

生活随笔收集整理的這篇文章主要介紹了搭建本地Yum软件源安装Cloudera Manager 5 小編覺得挺不錯的,現(xiàn)在分享給大家,幫大家做個參考.

?記錄操作過程，不過多介紹相關(guān)知識以及原理，有問題自行百度或留言討論。

一、搭建web服務(wù)服務(wù)器

? ? 有兩臺虛擬機，elephant用于安裝cdh-server相關(guān)作為管理者，monkey用于安裝cdh-agent相關(guān)，作為被管理者。

? ? 我選擇的是nginx，網(wǎng)上安裝教程較多，不在贅述，把用于放置Cloudera安裝文件的conf配置貼上來。關(guān)閉防火墻之類的也不多講，注意如果是centos7，防火墻服務(wù)不是iptables了，也許如下命令會用的著。

   ?firewall-cmd?--state   ?systemctl?stop?firewalld.service   ?systemctl?disable?firewalld.service   

   [root@elephant?cloudera-cdh5]#?cat?/etc/nginx/conf.d/elephant.conf  server?{  ????listen???????80;   ????server_name?elephant?www.elephant.com;    ????location?/?{   ????????root???/data/webapps/elephant;   ????????autoindex?on;??#允許瀏覽文件   ????}    ????#error_page??404??????????????/404.html;    ????#?redirect?server?error?pages?to?the?static?page?/50x.html   ????#   ????error_page???500?502?503?504??/50x.html;   ????location?=?/50x.html?{   ????????root???/usr/share/nginx/html;   ????}  }  

通過如上的操作，我在宿主機和monkey虛擬機添加host，就可以通過http協(xié)議來瀏覽文件了。

   [root@elephant?cloudera-cdh5]#?cat?/etc/hosts  192.168.1.109?elephant 192.168.1.110?monkey  [root@elephant?cloudera-cdh5]#?curl?http://elephant   

   <html>   <head><title>Index?of?/</title></head>   <body?bgcolor="white">   <h1>Index?of?/</h1><hr><pre><a?href="../">../</a>   <a?href="cdh/">cdh/</a>???????????????????????????????????????????????22-Mar-2017?15:12???????????????????-   <a?href="cm/">cm/</a>????????????????????????????????????????????????24-Mar-2017?13:02???????????????????-   <a?href="index.html_txt">index.html_txt</a>?????????????????????????????????????19-Mar-2017?07:15??????????????????40   </pre><hr></body>   </html>   

二、下載CM資源包

在/data/webapps/elephant下新建目錄，最終目錄結(jié)構(gòu)如下：

1 2	[root@elephant?cm]#?pwd /data/webapps/elephant/cm

瀏覽網(wǎng)頁，找到適合你自己環(huán)境的安裝包，我選擇的是 cm5.10.0-centos7.tar.gz

http://archive-primary.cloudera.com/cm5/repo-as-tarball/5.10.0/

注意版本要和你的cdh一致。800多M，虛擬機中直接wget很慢，于是宿主機中打開迅雷，添加下載地址?http://archive-primary.cloudera.com/cm5/repo-as-tarball/5.10.0/cm5.10.0-centos7.tar.gz?，然后去睡覺了。

第二天晚上下班回來繼續(xù)操作。

把下載的軟件包復(fù)制到虛擬機的 web目錄，也就是上面的cm目錄，解壓

1	tar?-zxvf?cm5.10.0-centos7.tar.gz

解壓后的目錄結(jié)構(gòu)，進入到?5.10.0 目錄可以看到下載的安裝文件。

   [root@elephant?cm]#?ll  total?8 lrwxrwxrwx?1?1106?592????6?Jan?21?03:38?5?->?5.10.0 lrwxrwxrwx?1?1106?592????6?Jan?21?03:38?5.10?->?5.10.0 drwxrwxr-x?4?1106?592???49?Mar?24?21:06?5.10.0 -rw-rw-r--?1?1106?592?1690?Jan?21?03:35?RPM-GPG-KEY-cloudera -rw-rw-r--?1?1106?592??347?Jan?26?05:35?cloudera-cm.repo  

三、重新生成repodata

進入到/data/webapps/elephant/cm/5.10 目錄，執(zhí)行如下命令，重新生成repodata。下一步配置yum源的baseurl，一定是有repodata的目錄。

1	[root@elephant?5.10]#?createrepo?.

如果你的虛擬機沒有repodata命令，請執(zhí)行下面命令安裝。

1	sudo?yum?install?yum-utils?createrepo

四、配置 yum 源

把上面cm目錄中的?cloudera-cm.repo 復(fù)制到 ?/etc/yum.repos.d 目錄，并進行編輯

   [root@elephant?yum.repos.d]#?vim?cloudera-cm.repo  [cloudera-cm] #?Packages?for?Cloudera's?Distribution?for?cm,?Version?5,?on?RedHat?????or?CentOS?7?x86_64  name=Cloudera's?Distribution?for?cm,?Version?5  #baseurl=http://repos.jenkins.cloudera.com/cm5.10.0-release/redhat/7/x86_64/cm/5/ #gpgkey?=?http://repos.jenkins.cloudera.com/cm5.10.0-release/redhat/7/x86_64/cm/RPM-GPG-KEY-cloudera #gpgcheck?=?1  baseurl=http://elephant/cm/5.10  #gpgkey?=?http://repos.jenkins.cloudera.com/cm5.10.0-release/redhat/7/x86_64/cm/RPM-GPG-KEY-cloudera gpgcheck?=?0  

在管理機上運行?yum clean all 后，就可以如下命令安裝cm了。

   [root@elephant?x86_64]#?yum?install?-y?cloudera-manager-server  Loaded?plugins:?fastestmirror base??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?3.6?kB??00:00:00 cloudera-cdh5?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?2.9?kB??00:00:00 cloudera-cm???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?2.9?kB??00:00:00 extras????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?3.4?kB??00:00:00 nginx?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?2.9?kB??00:00:00 updates???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?3.4?kB??00:00:00  (1/7):?cloudera-cdh5/primary_db???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|??77?kB??00:00:00   (2/7):?cloudera-cm/primary_db?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|??11?kB??00:00:00   (3/7):?base/7/x86_64/group_gz?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?155?kB??00:00:00   (4/7):?extras/7/x86_64/primary_db?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?139?kB??00:00:00   (5/7):?updates/7/x86_64/primary_db????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?3.8?MB??00:00:03   (6/7):?nginx/x86_64/primary_db????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|??21?kB??00:00:06   (7/7):?base/7/x86_64/primary_db???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????|?5.6?MB??00:00:21  Determining?fastest?mirrors  ?*?base:?mirrors.tuna.tsinghua.edu.cn   ?*?extras:?mirrors.tuna.tsinghua.edu.cn   ?*?updates:?mirrors.tuna.tsinghua.edu.cn  Resolving?Dependencies -->?Running?transaction?check --->?Package?cloudera-manager-server.x86_64?0:5.10.0-1.cm5100.p0.85.el7?will?be?installed  -->?Processing?Dependency:?cloudera-manager-daemons?=?5.10.0?for?package:?cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64  -->?Running?transaction?check --->?Package?cloudera-manager-daemons.x86_64?0:5.10.0-1.cm5100.p0.85.el7?will?be?installed -->?Finished?Dependency?Resolution …… …… Downloading?packages:  (1/2):?cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm???????????????????????????????????????????????????????????????????????????????????????????|?8.4?kB??00:00:00   (2/2):?cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm??????????????????????????????????????????????????????????????????????????????????????????|?570?MB??00:00:09  -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------  Total?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????60?MB/s?|?570?MB??00:00:09  Running?transaction?check  Running?transaction?test   Transaction?test?succeeded  Running?transaction  ??Installing?:?cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64?????????????????????????????????????????????????????????????????????????????????????????????????????????1/2   ??Installing?:?cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64??????????????????????????????????????????????????????????????????????????????????????????????????????????2/2   ??Verifying??:?cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64??????????????????????????????????????????????????????????????????????????????????????????????????????????1/2   ??Verifying??:?cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64?????????????????????????????????????????????????????????????????????????????????????????????????????????2/2   Installed:  ??cloudera-manager-server.x86_64?0:5.10.0-1.cm5100.p0.85.el7   Dependency?Installed:  ??cloudera-manager-daemons.x86_64?0:5.10.0-1.cm5100.p0.85.el7   Complete!  

為了驗證是從本地源下載，特意查看了nginx訪問日志

   127.0.0.1?-?-?[24/Mar/2017:22:19:55?+0800]?"GET?/cdh/cloudera-cdh5/repodata/repomd.xml?HTTP/1.1"?200?2987?"-"?"urlgrabber/3.10?yum/3.4.3"?"-"   127.0.0.1?-?-?[24/Mar/2017:22:19:55?+0800]?"GET?/cm/5.10/repodata/repomd.xml?HTTP/1.1"?200?2980?"-"?"urlgrabber/3.10?yum/3.4.3"?"-"   127.0.0.1?-?-?[24/Mar/2017:22:20:05?+0800]?"GET?/cdh/cloudera-cdh5/repodata/09b008ab02bc0b4f4b4279e2f0c0a5fb8ce53c5d0dcbd5258d32657a390f64fb-primary.sqlite.bz2?HTTP/1.1"?200?78773?"-"?"urlgrabber/3.10?yum/3.4.3"?"-"   127.0.0.1?-?-?[24/Mar/2017:22:20:05?+0800]?"GET?/cm/5.10/repodata/600a57f21246adc3f5d159a4daa0ce8f74d860234b6943b7ce978682b2f6f0ad-primary.sqlite.bz2?HTTP/1.1"?200?11313?"-"?"urlgrabber/3.10?yum/3.4.3"?"-"   127.0.0.1?-?-?[24/Mar/2017:22:20:30?+0800]?"GET?/cm/5.10/RPMS/x86_64/cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm?HTTP/1.1"?200?8648?"-"?"urlgrabber/3.10?yum/3.4.3"?"-"   127.0.0.1?-?-?[24/Mar/2017:22:20:37?+0800]?"GET?/cm/5.10/RPMS/x86_64/cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm?HTTP/1.1"?200?597309256?"-"?"urlgrabber/3.10?yum/3.4.3"?"-"   

到此，yum本地源方式安裝Cloudera Manager 5已經(jīng)完成。

補充：

1 2	關(guān)于如何以類似的方式安裝CDH，可以參考官網(wǎng)的博文，如果有問題可以留言。 https://www.cloudera.com/documentation/enterprise/5-9-x/topics/cdh_ig_yumrepo_local_create.html

1 2	這個命令會下載cdh的全部包，想到耗時間，做好心理準(zhǔn)備 reposync?-r?cloudera-cdh5

本文轉(zhuǎn)自 byteh 51CTO博客，原文鏈接：http://blog.51cto.com/byteh/1910197，如需轉(zhuǎn)載請自行聯(lián)系原作者

總結(jié)

以上是生活随笔為你收集整理的搭建本地Yum软件源安装Cloudera Manager 5的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。

上一篇： wxWidgets第九课 wx绘图工具
下一篇： jQuery,data()方法学习