2019獨角獸企業(yè)重金招聘Python工程師標準>>>

一、配置啟動flume

? ? ①flume的配置文件 ?conf/flume-conf.properties（這個文件一般是flume-conf.properties.default），復制修改后綴即可；

? ? 配置文件如下：

????agent1.channels = ch1
????agent1.sources = avro-source1
????agent1.sinks = log-sink1


????# 定義channel
????agent1.channels.ch1.type = memory ? ?#mem channel


????# 定義source
????agent1.sources.avro-source1.channels = ch1
????agent1.sources.avro-source1.type = avro????? ? #avro source
????agent1.sources.avro-source1.bind = 0.0.0.0
????agent1.sources.avro-source1.port = 41414


????# 定義sink
????agent1.sinks.log-sink1.channel = ch1
????agent1.sinks.log-sink1.type = logger????????????? ? #logger sink

? ? 啟動flume

????bin/flume-ng agent --conf conf --conf-file conf/flume-conf.properties --name agent1 -Dflume.root.logger=INFO,console

二、log4j的配置

? ? ①在log4j.properties文件中添加flume appender

????log4j.rootLogger=INFO,flume ? #日志級別，info和flume

????log4j.appender.flume = org.apache.flume.clients.log4jappender.Log4jAppender
????log4j.appender.flume.Hostname = 192.168.57.133? ? #flume地址
????log4j.appender.flume.Port = 41414????????????????????????? #flume source監(jiān)聽的端口
????log4j.appender.flume.UnsafeMode = true
????log4j.appender.flume.layout=org.apache.log4j.PatternLayout?
????log4j.appender.flume.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss,SSS} [%t] [%c] [%p] - %m%n

三、測試

? ? 在maven中添加flume appender依賴

<dependency> <groupId>org.apache.flume.flume-ng-clients</groupId> <artifactId>flume-ng-log4jappender</artifactId> <version>1.6.0</version> </dependency>

? ? 編寫簡單的測試類：

????

public class Log4jTest {Logger logger = LoggerFactory.getLogger(Log4jTest.class); /*** 測試flume* @Title: flumeTest * @Description: TODO* @param @throws Exception * @return void * @throws*/@Testpublic void flumeTest() throws Exception {while(true){logger.info("spider", System.currentTimeMillis());try {Thread.sleep(1000);} catch (Exception e) {// TODO: handle exceptione.printStackTrace();}}}

? ? 運行測試類，可以看到flume在控制臺的輸出

????

轉載于:https://my.oschina.net/u/780876/blog/603731

總結

以上是生活随笔為你收集整理的loh4j整合flume（log4jsource）的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。