參考：https://www.ibm.com/developerworks/cn/opensource/os-cn-bigdata-ambari/index.html

Ambari 是什么

Ambari 的作用來就是創建、管理、監視 Hadoop 集群，但是這里的 Hadoop 是廣義，指的是 Hadoop 整個生態圈（例如 Hive，Hbase，Sqoop，Zookeeper 等），而并不僅是特指 Hadoop。用一句話來說，Ambari 就是為了讓 Hadoop 以及相關的大數據軟件更容易使用的一個工具。
Ambari 自身也是一個分布式架構的軟件，主要由兩部分組成：Ambari Server 和 Ambari Agent。簡單來說，用戶通過 Ambari Server 通知 Ambari Agent 安裝對應的軟件；Agent 會定時地發送各個機器每個軟件模塊的狀態給 Ambari Server，最終這些狀態信息會呈現在 Ambari 的 GUI，方便用戶了解到集群的各種狀態，并進行相應的維護

Ambari 2.5.0源碼編譯安裝

三臺機器(centeros)分別是m1、m2、m3，m1為Ambari Server，m2、m3為Ambari Agent

Ambari 2.5.0源碼編譯安裝
三臺機器(centeros)分別是m1、m2、m3，m1為Ambari Server，m2、m3為Ambari Agent
準備工作：
1、SSH 的無密碼登錄
Ambari 的 Server 會 SSH 到 Agent 的機器，拷貝并執行一些命令。因此我們需要配置 Ambari Server 到 Agent 的 SSH 無密碼登錄。在這里就是，m1可以 SSH 無密碼登錄 m2 和 m3

2、確保 Yum 可以正常工作
通過公共庫（public repository），安裝 Hadoop 這些軟件，背后其實就是應用 Yum 在安裝公共庫里面的 rpm 包。所以這里需要您的機器都能訪問 Internet。

3、確保機器的 Python 版本大于或等于 2.6

4、安裝好maven

參考官網：https://cwiki.apache.org/confluence/display/AMBARI/Installation+Guide+for+Ambari+2.5.0

pushd命令常用于將目錄加入到棧中，加入記錄到目錄棧頂部，并切換到該目錄；若pushd命令不加任何參數，則會將位于記錄棧最上面的2個目錄對換位置

popd用于刪除目錄棧中的記錄；如果popd命令不加任何參數，則會先刪除目錄棧最上面的記錄，然后切換到刪除過后的目錄棧中的最上面的目錄

?

預先安裝的軟件

參考：https://cwiki.apache.org/confluence/display/AMBARI/Ambari+Development
JDK 7 ?
Apache Maven 3.3.x
Python 2.6
rpmbuild
g++ (gcc-c++ package)
ant
python-devel
git

psutils

setuptools

第一步：下載編譯 Ambari 2.5.0源碼

wget http://www.apache.org/dist/ambari/ambari-2.5.0/apache-ambari-2.5.0-src.tar.gz tar xfvz apache-ambari-2.5.0-src.tar.gz cd apache-ambari-2.5.0-src mvn versions:set -DnewVersion=2.5.0.0.0 pushd ambari-metrics mvn versions:set -DnewVersion=2.5.0.0.0 popdmvn -B clean install package rpm:rpm -DnewVersion=2.5.0.0.0 -DskipTests -Dpython.ver="python >= 2.6" -Drat.skip=true

?

第一步常見的錯誤

[ERROR] Failed to execute goal on project ambari-metrics-kafka-sink: Could not resolve dependencies for project org.apache.ambari:ambari-metrics-kafka-sink:jar:2.2.2-0: The following artifacts could not be resolved: javax.jms:jms:jar:1.1, com.sun.jdmk:jmxtools:jar:1.2.1, com.sun.jmx:jmxri:jar:1.2.1: Could not transfer artifact javax.jms:jms:jar:1.1 from/to java.net (https://maven-repository.dev.java.net/nonav/repository): No connector available to access repository java.net (https://maven-repository.dev.java.net/nonav/repository) of type legacy using the available factories WagonRepositoryConnectorFactory

解決方法

jmxri-1.2.1.pom

<?xml version="1.0" encoding="UTF-8"?> <project><modelVersion>4.0.0</modelVersion><groupId>javax.jms</groupId><artifactId>jms</artifactId><version>1.1</version><name>Java Message Service</name><description>The Java Message Service (JMS) API is a messaging standard that allows application components based on the Java 2 Platform, Enterprise Edition (J2EE) to create, send, receive, and read messages. It enables distributed communication that is loosely coupled, reliable, and asynchronous.</description><url>http://java.sun.com/products/jms</url><distributionManagement><downloadUrl>http://java.sun.com/products/jms/docs.html</downloadUrl></distributionManagement> </project>

jmxri-1.2.1.pom

<?xml version="1.0" encoding="UTF-8"?> <project><modelVersion>4.0.0</modelVersion><groupId>com.sun.jmx</groupId><artifactId>jmxri</artifactId><version>1.2.1</version><distributionManagement><status>deployed</status></distributionManagement> </project>

jmxtools-1.2.1.pom

<?xml version="1.0" encoding="UTF-8"?> <project><modelVersion>4.0.0</modelVersion><groupId>com.sun.jdmk</groupId><artifactId>jmxtools</artifactId><version>1.2.1</version><distributionManagement><status>deployed</status></distributionManagement> </project>

?

mvn install:install-file -Dfile=jms-1.1.pom -DgroupId=javax.jms -DartifactId=jms -Dversion=1.1 -Dpackaging=jarmvn install:install-file -Dfile=jmxri-1.2.1.pom -DgroupId=com.sun.jmx -DartifactId=jmxri -Dversion=1.2.1 -Dpackaging=jarmvn install:install-file -Dfile=jmxtools-1.2.1.pom -DgroupId=com.sun.jdmk -DartifactId=jmxtools -Dversion=1.2.1 -Dpackaging=jar

錯誤

?Failed to execute goal org.apache.rat:apache-rat-plugin:0.11:check (default) on project ambari: Too many files with unapproved license: 3 See RAT report in: /home/hadoop/apache-ambari-2.5.0-src/target/rat.txt -> [Help 1]

mvn -B clean install package rpm:rpm -DnewVersion=2.5.0.0.0 -DskipTests -Dpython.ver="python >= 2.6" -Drat.skip=true -DskipTests

?添加：-Drat.skip=true

Failed to execute goal org.codehaus.mojo:rpm-maven-plugin:2.0.1:rpm (default-cli) on project ambari: RPM build execution returned: '127' executing '/bin/sh -c cd /home/hadoop/apache-ambari-2.5.0-src/target/rpm/ambari/SPECS && rpmbuild -bb --buildroot /home/hadoop/apache-ambari-2.5.0-src/target/rpm/ambari/buildroot --define '_topdir /home/hadoop/apache-ambari-2.5.0-src/target/rpm/ambari' --target noarch-redhat-linux ambari.spec' -> [Help 1]

原因是rpm或者rpm-build不存在
安裝 rpm rpm-build

yum install rpm yum install -y rpm-build.x86_64

??[ERROR] Failed to execute goal on project ambari-metrics-storm-sink: Could not resolve dependencies for project org.apache.ambari:ambari-metrics-storm-sink:jar:2.5.0.0.0: Could not find artifact org.apache.storm:storm-core:jar:1.1.0-SNAPSHOT in alimaven (http://maven.aliyun.com/nexus/content/groups/public/) -> [Help 1]

這是因為org.apache.storm:storm-core:jar:1.1.0-SNAPSHOT不存在導致的問題
修改/apache-ambari-2.5.0-src/ambari-metrics/ambari-metrics-storm-sink/pox.xml修改storm為1.1.0版本

[INFO] Downloaded: http://maven.aliyun.com/nexus/content/groups/public/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar (54 kB at 168 kB/s)
bower angular-mocks#1.2.26????? ENOGIT git is not installed or not in the PATH
[ERROR] Command execution failed.
沒有安裝git，安裝git即可

yum -y install git

??[ERROR] around Ant part ...<get dest="/home/hadoop/apache-ambari-2.5.0-src/ambari-metrics/ambari-metrics-timelineservice/target/embedded/phoenix.tar.gz" src="http://private-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0-3347/tars/phoenix-4.4.0.2.3.4.0-3347.tar.gz" usetimestamp="true"/>... @ 5:270 in /home/hadoop/apache-ambari-2.5.0-src/ambari-metrics/ambari-metrics-timelineservice/target/antrun/build-Download Phoenix.xml

?沒有安裝ant，安裝ant

??[ERROR] Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.7:run (psutils-compile) on project ambari-metrics-host-monitoring: An Ant BuildException has occured: exec returned: 1
[ERROR] around Ant part ...<exec dir="/home/hadoop/apache-ambari-2.5.0-src/ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil" executable="/home/hadoop/apache-ambari-2.5.0-src/ambari-metrics/ambari-metrics-host-monitoring/../../ambari-common/src/main/unix/ambari-python-wrap" failοnerrοr="true">... @ 4:289 in /home/hadoop/apache-ambari-2.5.0-src/ambari-metrics/ambari-metrics-host-monitoring/target/antrun/build-psutils-compile.xml

缺少python? psutils模塊，安裝如下

wget https://pypi.python.org/packages/source/p/psutil/psutil-2.0.0.tar.gz tar -xzvf psutil-2.0.0.tar.gz cd psutil-2.0.0 python setup.py install

安裝python setup.py install時出現如下錯誤
psutil/_psutil_linux.c:12:20: error: Python.h: No such file or directory
需要安裝

yum -y install python-devel

配置Maven內存

Linux

export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:MaxPermSize=512m"

windows

set MAVEN_OPTS=-Xms512m -Xmx1024m -XX:MaxPermSize=512m

[INFO] --- exec-maven-plugin:1.2.1:exec (python-package) @ python-client ---
Traceback (most recent call last):
? File "/home/hadoop/apache-ambari-2.5.0-src/ambari-client/python-client/src/main/python/setup.py", line 18, in <module>
??? from setuptools import setup, find_packages
ImportError: No module named setuptools
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (python-package) on project python-client: Command execution failed. Process exited with an error: 1 (Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (python-package) on project python-client: Command execution failed.

setuptools安裝
http://blog.chinaunix.net/uid-26000296-id-4769414.html

?

編譯ambari-metrics時比較慢，主要是因為里面包含的幾個文件下載時間太長，可以修改apache-ambari-2.5.0-src/ambari-metrics/pom.xml中properties屬性下的文件下載地址為本地，然后，通過迅雷下載，如下

http://private-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0-3347/tars/hbase-1.1.2.2.3.4.0-3347.tar.gz

http://private-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.0-3347/tars/hadoop-2.7.1.2.3.4.0-3347.tar.gz

https://msibuilds.blob.core.windows.net/hdp/2.x/2.2.4.2/2/hbase-0.98.4.2.2.4.2-0002-hadoop2.winpkg.zip

https://msibuilds.blob.core.windows.net/hdp/2.x/2.2.4.2/2/hadoop-2.6.0.2.2.4.2-0002.winpkg.zip

https://grafanarel.s3.amazonaws.com/builds/grafana-2.6.0.linux-x64.tar.gz

<properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> <python.ver>python >= 2.6</python.ver> <deb.python.ver>python (>= 2.6)</deb.python.ver> <!--TODO change to HDP URL--> <hbase.tar>file:///home/hadoop/apache-ambari-2.5.0-src/tars/hbase-1.1.2.2.3.4.0-3347.tar.gz</hbase.tar> <hbase.folder>hbase-1.1.2.2.3.4.0-3347</hbase.folder> <hadoop.tar>file:///home/hadoop/apache-ambari-2.5.0-src/tars/hadoop-2.7.1.2.3.4.0-3347.tar.gz</hadoop.tar> <hadoop.folder>hadoop-2.7.1.2.3.4.0-3347</hadoop.folder> <hbase.winpkg.zip>file:///home/hadoop/apache-ambari-2.5.0-src/tars/hbase-0.98.4.2.2.4.2-0002-hadoop2.winpkg.zip</hbase.winpkg.zip> <hbase.winpkg.folder>hbase-0.98.4.2.2.4.2-0002-hadoop2</hbase.winpkg.folder> <hadoop.winpkg.zip>file:///home/hadoop/apache-ambari-2.5.0-src/tars/hadoop-2.6.0.2.2.4.2-0002.winpkg.zip</hadoop.winpkg.zip> <hadoop.winpkg.folder>hadoop-2.6.0.2.2.4.2-0002</hadoop.winpkg.folder> <grafana.folder>grafana-2.6.0</grafana.folder> <grafana.tar>file:///home/hadoop/apache-ambari-2.5.0-src/tars/grafana-2.6.0.linux-x64.tar.gz</grafana.tar> <phoenix.tar>file:///home/hadoop/apache-ambari-2.5.0-src/tars/phoenix-4.4.0.2.3.4.0-3347.tar.gz</phoenix.tar> <phoenix.folder>phoenix-4.4.0.2.3.4.0-3347</phoenix.folder> <resmonitor.install.dir> /usr/lib/python2.6/site-packages/resource_monitoring </resmonitor.install.dir> <powermock.version>1.6.2</powermock.version> <distMgmtSnapshotsId>apache.snapshots.https</distMgmtSnapshotsId> <distMgmtSnapshotsName>Apache Development Snapshot Repository</distMgmtSnapshotsName> <distMgmtSnapshotsUrl>https://repository.apache.org/content/repositories/snapshots</distMgmtSnapshotsUrl> <distMgmtStagingId>apache.staging.https</distMgmtStagingId> <distMgmtStagingName>Apache Release Distribution Repository</distMgmtStagingName> <distMgmtStagingUrl>https://repository.apache.org/service/local/staging/deploy/maven2</distMgmtStagingUrl> </properties>

第二步: 安裝 Ambari Server

cd apache-ambari-2.5.0-src/ambari-server/target/rpm/ambari-server/RPMS/x86_64yum -y install ambari-server*.rpm

第三步：設置啟動ambari-server（使用root進行設置和啟動）

安裝Mysql

yum install -y mysql-server

配置mysql數據庫
啟動Mysql：

service mysqld start

連接數據庫：

mysql -u root -p create database ambari; use ambari; source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql mysqladmin -u root password "root"

mysql -u root -p直接回車，此時不需要輸入密碼

ambari-server setup /usr/sbin/ambari-server: line 34: buildNumber: unbound variable

腳本/usr/sbin/ambari-server中的變量buildNumber沒有定義

export buildNumber=2.5.0.0 ambari-server setup

?

?WARNING: Before starting Ambari Server, you must copy the MySQL JDBC driver JAR file to /usr/share/java and set property "server.jdbc.driver.path=[path/to/custom_jdbc_driver]" in ambari.properties.
Press <enter> to continue.

拷貝/usr/share/java，設置ambari.properties? server.jdbc.driver.path=[path/to/custom_jdbc_driver]
server.jdbc.driver.path=/usr/share/java/mysql-connector-java-5.1.42-bin.jar
ambari.properties文件在/etc/ambari-server/conf下

配置好后需要在重新的ambari-server setup一次，不然啟動是不成功

ambari-server start

啟動日志
/var/log/ambari-server/ambari-server-command.log

WARNING: The hostname was not found in the reverse DNS lookup. This may result in incorrect behavior

主機名有問題，在hosts文件中配置一下就好了

啟動成功應該如下

[root@bogon ambari-server]# ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources... Ambari database consistency check started... Server PID at: /var/run/ambari-server/ambari-server.pid Server out at: /var/log/ambari-server/ambari-server.out Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start........................... Server started listening on 8080DB configs consistency check: no errors and warnings were found. Ambari Server 'start' completed successfully.

?

?web訪問地址
http://192.168.1.105:8080/
用戶名和密碼都是admin

?

?

配置私鑰的時候紅色的部分也要一起拷貝

上面的錯誤是因為其他節點沒有安裝ambari-agent

?

轉載于:https://www.cnblogs.com/heml/p/6882336.html

總結

以上是生活随笔為你收集整理的ambari 2.5.0源码编译安装的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。