2019獨角獸企業重金招聘Python工程師標準>>>

1.安裝gityum install -y git 2.切換到/usr/local/src目錄，然后將kafka的c客戶端源碼clone到本地cd /usr/local/srcgit clone https://github.com/edenhill/librdkafka 3.進入到librdkafka，然后進行編譯cd librdkafkayum install -y gcc gcc-c++ pcre-devel zlib-devel./configuremake && make install4.安裝nginx整合kafka的插件，進入到/usr/local/src，clone nginx整合kafka的源碼cd /usr/local/srcgit clone https://github.com/brg-liuwei/ngx_kafka_module5.進入到nginx的源碼包目錄下 （編譯nginx，然后將將插件同時編譯）cd /usr/local/src/nginx-1.12.2./configure --add-module=/usr/local/src/ngx_kafka_module/makemake install6.修改nginx的配置文件，詳情請查看當前目錄的nginx.conf7.啟動zk和kafka集群(創建topic)/bigdata/zookeeper-3.4.9/bin/zkServer.sh start/bigdata/kafka_2.11-0.10.2.1/bin/kafka-server-start.sh -daemon /bigdata/kafka_2.11-0.10.2.1/config/server.properties8.啟動nginx，報錯，找不到kafka.so.1的文件error while loading shared libraries: librdkafka.so.1: cannot open shared object file: No such file or directory 9.加載so庫echo "/usr/local/lib" >> /etc/ld.so.confldconfig10.測試，向nginx中寫入數據，然后觀察kafka的消費者能不能消費到數據curl localhost/kafka/track -d "message send to kafka topic"curl localhost/kafka/track -d "何洪波666" 附件：nginx.conf#user nobody; worker_processes 1;#error_log logs/error.log; #error_log logs/error.log notice; #error_log logs/error.log info;#pid logs/nginx.pid;events {worker_connections 1024; }http {include mime.types;default_type application/octet-stream;#log_format main '$remote_addr - $remote_user [$time_local] "$request" '# '$status $body_bytes_sent "$http_referer" '# '"$http_user_agent" "$http_x_forwarded_for"';#access_log logs/access.log main;sendfile on;#tcp_nopush on;#keepalive_timeout 0;keepalive_timeout 65;#gzip on;kafka;kafka_broker_list node-1.xiaoniu.com:9092 node-2.xiaoniu.com:9092 node-3.xiaoniu.com:9092; server {listen 80;server_name node-6.xiaoniu.com;#charset koi8-r;#access_log logs/host.access.log main;location = /kafka/track {kafka_topic track;}location = /kafka/user {kafka_topic user;}#error_page 404 /404.html;# redirect server error pages to the static page /50x.html#error_page 500 502 503 504 /50x.html;location = /50x.html {root html;}}}

轉載于:https://my.oschina.net/hehongbo/blog/1818974

總結

以上是生活随笔為你收集整理的安装nginx-kafka插件ngx_kafka_module笔记的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。