當(dāng)前位置：首頁(yè) > 编程资源 > 编程问答 >内容正文

编程问答

Burrow 服务的安装部署

發(fā)布時(shí)間：2024/4/14 编程问答 51 豆豆

生活随笔收集整理的這篇文章主要介紹了 Burrow 服务的安装部署小編覺得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.

　　　　　　　　　　　　　　　　　　Burrow 服務(wù)的安裝部署

　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　　作者：尹正杰

版權(quán)聲明：原創(chuàng)作品，謝絕轉(zhuǎn)載！否則將追究法律責(zé)任。

　　最近協(xié)助開發(fā)的同時(shí)幫忙把10個(gè)topic的數(shù)據(jù)使用5個(gè)topic的來(lái)工作。結(jié)果發(fā)現(xiàn)數(shù)據(jù)flume在手機(jī)數(shù)據(jù)時(shí)存在延遲消費(fèi)的問(wèn)題。因此遇到了不少坑，要是有個(gè)專門監(jiān)控kafka consumer lag的開源軟件就好了！當(dāng)然我們通過(guò)kafka-consumer-groups.sh這個(gè)命令也可以查看到相應(yīng)的參數(shù)，但每次都需要敲擊命令行。無(wú)意間聽網(wǎng)友說(shuō)有LinkedIn公司開源有一款叫做Burrow都軟件，專門是對(duì)kafka消費(fèi)這延遲檢查。

一.Burrow概述

1>.什么是Burrow

　　Burrow是Apache Kafka的監(jiān)控伴侶，它將消費(fèi)者滯后檢查作為服務(wù)提供，無(wú)需指定閾值。它監(jiān)控所有消費(fèi)者的承諾抵消額，并根據(jù)需要計(jì)算這些消費(fèi)者的狀態(tài)。提供HTTP端點(diǎn)以按需請(qǐng)求狀態(tài)，以及提供其他Kafka群集信息。還有可配置的通知程序可以通過(guò)電子郵件或HTTP調(diào)用將狀態(tài)發(fā)送到另一個(gè)服務(wù)。

2>.Burrow特征?

沒有門檻！通過(guò)滑動(dòng)窗口評(píng)估組。
多個(gè)Kafka群集支持
使用Kafka提交的偏移自動(dòng)監(jiān)視所有使用者
可配置支持Zookeeper提交的偏移量
可配置支持Storm-committed offsets
消費(fèi)者組狀態(tài)的HTTP端點(diǎn)，以及代理和消費(fèi)者信息
可配置的電子郵件程序，用于發(fā)送特定組的警報(bào)
可配置的HTTP客戶端，用于向所有組的另一個(gè)系統(tǒng)發(fā)送警報(bào)

3>.先決條件

　　Burrow是用Go編寫的，所以在開始之前，你應(yīng)該安裝并設(shè)置Go。

二.安裝Golang環(huán)境

1>.下載 go 的安裝包?

[root@node101.yinzhengjie.org.cn ~/Downloads]# wget https://dl.google.com/go/go1.12.1.linux-amd64.tar.gz --2019-03-28 16:09:35-- https://dl.google.com/go/go1.12.1.linux-amd64.tar.gz Resolving dl.google.com (dl.google.com)... 203.208.41.70, 203.208.41.72, 203.208.41.65, ... Connecting to dl.google.com (dl.google.com)|203.208.41.70|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 127906702 (122M) [application/octet-stream] Saving to: ‘go1.12.1.linux-amd64.tar.gz’100%[=========================================================================================================================================================================>] 127,906,702 2.27MB/s in 54s 2019-03-28 16:10:29 (2.28 MB/s) - ‘go1.12.1.linux-amd64.tar.gz’ saved [127906702/127906702][root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# wget https://dl.google.com/go/go1.12.1.linux-amd64.tar.gz

2>.解壓go的安裝包到指定目錄

[root@node101.yinzhengjie.org.cn ~/Downloads]# tar -zxf go1.12.1.linux-amd64.tar.gz -C /yinzhengjie/softwares/ [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# ll /yinzhengjie/softwares/go/ total 208 drwxr-xr-x. 2 root root 4096 Mar 15 03:43 api -rw-r--r--. 1 root root 55358 Mar 15 03:43 AUTHORS drwxr-xr-x. 2 root root 4096 Mar 15 03:46 bin -rw-r--r--. 1 root root 1339 Mar 15 03:43 CONTRIBUTING.md -rw-r--r--. 1 root root 78132 Mar 15 03:43 CONTRIBUTORS drwxr-xr-x. 8 root root 4096 Mar 15 03:43 doc -rw-r--r--. 1 root root 5686 Mar 15 03:43 favicon.ico drwxr-xr-x. 3 root root 4096 Mar 15 03:43 lib -rw-r--r--. 1 root root 1479 Mar 15 03:43 LICENSE drwxr-xr-x. 13 root root 4096 Mar 15 03:43 misc -rw-r--r--. 1 root root 1303 Mar 15 03:43 PATENTS drwxr-xr-x. 6 root root 4096 Mar 15 03:46 pkg -rw-r--r--. 1 root root 1607 Mar 15 03:43 README.md -rw-r--r--. 1 root root 26 Mar 15 03:43 robots.txt drwxr-xr-x. 46 root root 4096 Mar 15 03:43 src drwxr-xr-x. 21 root root 12288 Mar 15 03:43 test -rw-r--r--. 1 root root 8 Mar 15 03:43 VERSION [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# tar -zxf go1.12.1.linux-amd64.tar.gz -C /yinzhengjie/softwares/

3>.配置go到環(huán)境變量?

[root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# mkdir /yinzhengjie/goproject [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# tail -5 /etc/profile #ADD GO_PATH export GO_HOME=/yinzhengjie/softwares/go export PATH=$PATH:$GO_HOME/bin export GOPATH=/yinzhengjie/goproject[root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# tail -5 /etc/profile [root@node101.yinzhengjie.org.cn ~/Downloads]# source /etc/profile [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# go env GOARCH="amd64" GOBIN="" GOCACHE="/root/.cache/go-build" GOEXE="" GOFLAGS="" GOHOSTARCH="amd64" GOHOSTOS="linux" GOOS="linux" GOPATH="/yinzhengjie/goproject" GOPROXY="" GORACE="" GOROOT="/yinzhengjie/softwares/go" GOTMPDIR="" GOTOOLDIR="/yinzhengjie/softwares/go/pkg/tool/linux_amd64" GCCGO="gccgo" CC="gcc" CXX="g++" CGO_ENABLED="1" GOMOD="" CGO_CFLAGS="-g -O2" CGO_CPPFLAGS="" CGO_CXXFLAGS="-g -O2" CGO_FFLAGS="-g -O2" CGO_LDFLAGS="-g -O2" PKG_CONFIG="pkg-config" GOGCCFLAGS="-fPIC -m64 -pthread -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build685793832=/tmp/go-build -gno-record-gcc-switches" [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# [root@node101.yinzhengjie.org.cn ~/Downloads]# go env

三.Burrow安裝

1>.Burrow的github地址（https://github.com/linkedin/Burrow）

2>.安裝git工具

[root@node101.yinzhengjie.org.cn ~]# yum -y install git Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile* base: mirrors.aliyun.com* extras: mirrors.aliyun.com* updates: mirrors.aliyun.com Resolving Dependencies --> Running transaction check ---> Package git.x86_64 0:1.8.3.1-20.el7 will be installed --> Processing Dependency: perl-Git = 1.8.3.1-20.el7 for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Term::ReadKey) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Git) for package: git-1.8.3.1-20.el7.x86_64 --> Processing Dependency: perl(Error) for package: git-1.8.3.1-20.el7.x86_64 --> Running transaction check ---> Package perl-Error.noarch 1:0.17020-2.el7 will be installed ---> Package perl-Git.noarch 0:1.8.3.1-20.el7 will be installed ---> Package perl-TermReadKey.x86_64 0:2.30-20.el7 will be installed --> Finished Dependency ResolutionDependencies Resolved===================================================================================================================================================================================================================Package Arch Version Repository Size =================================================================================================================================================================================================================== Installing:git x86_64 1.8.3.1-20.el7 updates 4.4 M Installing for dependencies:perl-Error noarch 1:0.17020-2.el7 base 32 kperl-Git noarch 1.8.3.1-20.el7 updates 55 kperl-TermReadKey x86_64 2.30-20.el7 base 31 kTransaction Summary =================================================================================================================================================================================================================== Install 1 Package (+3 Dependent packages)Total download size: 4.5 M Installed size: 22 M Downloading packages: (1/4): perl-Error-0.17020-2.el7.noarch.rpm | 32 kB 00:00:00 perl-TermReadKey-2.30-20.el7.x FAILED http://mirrors.cloud.aliyuncs.com/centos/7/os/x86_64/Packages/perl-TermReadKey-2.30-20.el7.x86_64.rpm: [Errno 14] curl#6 - "Could not resolve host: mirrors.cloud.aliyuncs.com; Unknown error" 0 B --:--:-- ETA Trying other mirror. (2/4): perl-TermReadKey-2.30-20.el7.x86_64.rpm | 31 kB 00:00:00 perl-Git-1.8.3.1-20.el7.noarch FAILED http://mirrors.cloud.aliyuncs.com/centos/7/updates/x86_64/Packages/perl-Git-1.8.3.1-20.el7.noarch.rpm: [Errno 14] curl#6 - "Could not resolve host: mirrors.cloud.aliyuncs.com; Unknown error" 0 B --:--:-- ETA Trying other mirror. (3/4): git-1.8.3.1-20.el7.x86_64.rpm | 4.4 MB 00:00:01 (4/4): perl-Git-1.8.3.1-20.el7.noarch.rpm | 55 kB 00:00:01 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 2.1 MB/s | 4.5 MB 00:00:02 Running transaction check Running transaction test Transaction test succeeded Running transactionInstalling : 1:perl-Error-0.17020-2.el7.noarch 1/4 Installing : perl-TermReadKey-2.30-20.el7.x86_64 2/4 Installing : git-1.8.3.1-20.el7.x86_64 3/4 Installing : perl-Git-1.8.3.1-20.el7.noarch 4/4 Verifying : perl-Git-1.8.3.1-20.el7.noarch 1/4 Verifying : 1:perl-Error-0.17020-2.el7.noarch 2/4 Verifying : git-1.8.3.1-20.el7.x86_64 3/4 Verifying : perl-TermReadKey-2.30-20.el7.x86_64 4/4 Installed:git.x86_64 0:1.8.3.1-20.el7 Dependency Installed:perl-Error.noarch 1:0.17020-2.el7 perl-Git.noarch 0:1.8.3.1-20.el7 perl-TermReadKey.x86_64 0:2.30-20.el7 Complete! [root@node101.yinzhengjie.org.cn ~]# [root@node101.yinzhengjie.org.cn ~]# yum -y install git

2>.

3>.

4>.

5>.?

轉(zhuǎn)載于:https://www.cnblogs.com/yinzhengjie/p/10544629.html

總結(jié)

以上是生活随笔為你收集整理的Burrow 服务的安装部署的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問(wèn)題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。

Burrow

上一篇：细述：nginx http内核模块提供的
下一篇： Bootstrap3基础 input-g