有三個(gè)節(jié)點(diǎn)分別是node-master（192.168.152.45），node-data1（192.168.152.39）, node-data2（192.168.152.29）

在每一太節(jié)點(diǎn)上，使用docker安裝elasticsearch

docker pull docker.elastic.co/elasticsearch/elasticsearch:6.2.3

Master node

在node-master節(jié)點(diǎn)上，新建一個(gè)配置文件：

bootstrap.memory_lock: false bootstrap.system_call_filter: falsecluster.name: my-application node.name: node-master node.master: true node.data: false network.publish_host: 192.168.152.45 network.host: 0.0.0.0 http.max_content_length: 1024mb http.cors.enabled: true http.cors.allow-origin: "*" discovery.zen.ping_timeout: 10s discovery.zen.fd.ping_timeout: 10000s discovery.zen.fd.ping_retries: 10

network.publish_host，表示發(fā)布地址，是唯一的，用來集群各節(jié)點(diǎn)的相互通信。

執(zhí)行命令運(yùn)行ES：

docker run --name esmaster --ulimit nofile=65536:131072 -p 9200:9200 -p 9300:9300 -v /home/iie4bu/ddy/docker-elasticsearch/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml -v /home/iie4bu/ddy/docker-elasticsearch/data:/usr/share/elasticsearch/data -e "ES_JAVA_OPTS=-Xms5120m -Xmx5120m" docker.elastic.co/elasticsearch/elasticsearch:6.2.3

如果想要在后臺(tái)運(yùn)行，可以添加 -d 選項(xiàng)

Data node

data node 的配置文件如下:

bootstrap.memory_lock: false bootstrap.system_call_filter: falsecluster.name: my-application node.name: node-data1 node.master: false node.data: true network.publish_host: 192.168.152.39 network.host: 0.0.0.0 http.max_content_length: 1024mb discovery.zen.ping.unicast.hosts: ["192.168.152.45"] http.cors.enabled: true http.cors.allow-origin: "*" discovery.zen.ping_timeout: 10s discovery.zen.fd.ping_timeout: 10000s discovery.zen.fd.ping_retries: 10

運(yùn)行docker命令：

docker run --name es-data1 --ulimit nofile=65536:131072 -p 9200:9200 -p 9300:9300 -v /home/iie4bu/ddy/docker-elasticsearch/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml -v /home/iie4bu/ddy/docker-elasticsearch/data:/usr/share/elasticsearch/data -e "ES_JAVA_OPTS=-Xms5120m -Xmx5120m" docker.elastic.co/elasticsearch/elasticsearch:6.2.3

如果想要在后臺(tái)運(yùn)行，可以添加 -d 選項(xiàng)

在每個(gè)節(jié)點(diǎn)上啟動(dòng)ES后，使用docker container ls 查看：

iie4bu@swarm-manager:~$ docker container ls CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 869fcd7708ed docker.elastic.co/elasticsearch/elasticsearch:6.2.3 "/usr/local/bin/dock…" About a minute ago Up About a minute 0.0.0.0:9200->9200/tcp, 0.0.0.0:9300->9300/tcp esmaster iie4bu@swarm-worker1:~$ docker container ls CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES c8c97f4d0685 docker.elastic.co/elasticsearch/elasticsearch:6.2.3 "/usr/local/bin/dock…" About a minute ago Up About a minute 0.0.0.0:9200->9200/tcp, 0.0.0.0:9300->9300/tcp es-data1 iie4bu@swarm-worker2:~$ docker container ls CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 518ce01ecdd7 docker.elastic.co/elasticsearch/elasticsearch:6.2.3 "/usr/local/bin/dock…" About a minute ago Up About a minute 0.0.0.0:9200->9200/tcp, 0.0.0.0:9300->9300/tcp es-data2

安裝elasticsearch-head

獲取鏡像：

iie4bu@swarm-manager:~$ docker pull tobias74/elasticsearch-head

執(zhí)行容器：

iie4bu@swarm-manager:~$ docker run -d --name es-head -p 9100:9100 --restart always tobias74/elasticsearch-head

使用elasticsearch-head查看

可以成功運(yùn)行。

安裝kibana

安裝kibana：

docker pull docker.elastic.co/kibana/kibana:6.2.3

運(yùn)行kibana：

docker run -e ELASTICSEARCH_URL=http://192.168.152.45:9200 -p 5601:5601 --name kibana docker.elastic.co/kibana/kibana:6.2.3

在一個(gè)數(shù)據(jù)節(jié)點(diǎn)上開啟兩個(gè)ES

在節(jié)點(diǎn)node-data1（192.168.152.39）上在新建一個(gè)elasticsearch節(jié)點(diǎn)node-data3

elasticsearch.yml文件內(nèi)容如下：

cluster.name: my-application node.name: node-data3 node.master: false node.data: true transport.tcp.port: 9301 http.port: 9201 network.publish_host: 192.168.152.39 network.host: 0.0.0.0 http.max_content_length: 1024mb discovery.zen.ping.unicast.hosts: ["192.168.152.45:9300"] http.cors.enabled: true http.cors.allow-origin: "*" discovery.zen.ping_timeout: 10s discovery.zen.fd.ping_timeout: 10000s discovery.zen.fd.ping_retries: 10

network.bind_host: 192.168.152.39因?yàn)槭窃赿ocker中，所以不需要綁定ip

這里需要注意的是transport.tcp.port和http.port必須設(shè)置，因?yàn)閚ode-data1與node-data3在同一臺(tái)服務(wù)器上，否則報(bào)錯(cuò)信息如下:

[2019-07-11T08:11:50,250][INFO ][o.e.d.z.ZenDiscovery ] [node-data3] failed to send join request to master [{node-master}{ahgcLIkTT32KVcZORZzUZQ}{CueMB9y5TVWEi_h7B0I9QA}{192.168.152.45}{192.168.152.45:9300}{ml.machine_memory=67430027264, ml.max_open_jobs=20, ml.enabled=true}], reason [RemoteTransportException[[node-master][172.17.0.2:9300][internal:discovery/zen/join]]; nested: ConnectTransportException[[node-data3][192.168.152.39:9300] handshake failed. unexpected remote node {node-data1}{jji1eahBReWUu-IfBLEMyg}{Jo_QU2nlS8Oea0JundbRMQ}{192.168.152.39}{192.168.152.39:9300}{ml.machine_memory=67430027264, ml.max_open_jobs=20, ml.enabled=true}]; ]

運(yùn)行命令：

docker run --name es-data3 --ulimit nofile=65536:131072 -p 9201:9201 -p 9301:9301 -v /home/iie4bu/ddy/docker-elasticsearch2/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml -v /home/iie4bu/ddy/docker-elasticsearch2/data:/usr/share/elasticsearch/data -e "ES_JAVA_OPTS=-Xms5120m -Xmx5120m" docker.elastic.co/elasticsearch/elasticsearch:6.2.3

這樣就在一臺(tái)服務(wù)器上啟動(dòng)兩個(gè)ES節(jié)點(diǎn)了。

ES安裝過程中出現(xiàn)的問題：

問題1：

[temuser@n1 data-node1]$ docker run --name esmaster --ulimit nofile=65536:131072 -p 9202:9202 -p 9302:9302 -v /home/temuser/ddy/elasticsearch/master/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml -v /home/temuser/ddy/elasticsearch/master/data:/usr/share/elasticsearch/data -e "ES_JAVA_OPTS=-Xms5120m -Xmx5120m" docker.elastic.co/elasticsearch/elasticsearch:6.2.3 [2019-07-13T05:01:57,878][INFO ][o.e.n.Node ] [node-master2] initializing ... [2019-07-13T05:01:57,890][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [node-master2] uncaught exception in thread [main] org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: Failed to create node environmentat org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:125) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:112) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.2.3.jar:6.2.3]at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:85) ~[elasticsearch-6.2.3.jar:6.2.3] Caused by: java.lang.IllegalStateException: Failed to create node environmentat org.elasticsearch.node.Node.<init>(Node.java:267) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.node.Node.<init>(Node.java:246) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:323) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:121) ~[elasticsearch-6.2.3.jar:6.2.3]... 6 more Caused by: java.nio.file.AccessDeniedException: /usr/share/elasticsearch/data/nodesat sun.nio.fs.UnixException.translateToIOException(UnixException.java:84) ~[?:?]at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) ~[?:?]at java.nio.file.Files.createDirectory(Files.java:674) ~[?:1.8.0_161]at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) ~[?:1.8.0_161]at java.nio.file.Files.createDirectories(Files.java:767) ~[?:1.8.0_161]at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:204) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.node.Node.<init>(Node.java:264) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.node.Node.<init>(Node.java:246) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:213) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:213) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:323) ~[elasticsearch-6.2.3.jar:6.2.3]at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:121) ~[elasticsearch-6.2.3.jar:6.2.3]... 6 more

原因是宿主機(jī)上的/home/temuser/ddy/elasticsearch/master/data權(quán)限不足導(dǎo)致的。但是錯(cuò)誤日志報(bào)的卻是docker容器下的 /usr/share/elasticsearch/data/nodes目錄。

解決辦法：chmod 777 /home/temuser/ddy/elasticsearch/master/data

問題2:

elasticsearch訪問時(shí)需要登錄：

方法一：

原因是在docker中默認(rèn)安裝了x-pack。需要卸載x-pack:

步驟：

?docker exec -it es1 /bin/bash 進(jìn)入容器

?卸載x-pack插件

• ? ? ./bin/elasticsearch-plugin remove x-pack
• 刪除配置文件（由于配置文件保護(hù)，需要手動(dòng)刪除）
  • cd /usr/share/elasticsearch/config
  • rm -rf x-pack
• 重啟。docker restart es1

方法二(推薦)：

將x-pack關(guān)閉：

elasticsearch.yml文件內(nèi)容如下：

cluster.name: my-application2 node.name: node-master2 node.master: true node.data: false transport.tcp.port: 9312 http.port: 9212 network.publish_host: 192.168.152.39 network.host: 0.0.0.0 http.max_content_length: 1024mb discovery.zen.ping.unicast.hosts: ["192.168.152.39:9312"] http.cors.enabled: true http.cors.allow-origin: "*" discovery.zen.ping_timeout: 10s discovery.zen.fd.ping_timeout: 10000s discovery.zen.fd.ping_retries: 10xpack.security.enabled: false xpack.monitoring.enabled: false xpack.graph.enabled: false xpack.watcher.enabled: false

kibana.yml文件內(nèi)容如下：

server.host: "0.0.0.0" elasticsearch.url: "http://192.168.152.39:9212"xpack.security.enabled: false xpack.monitoring.enabled: false xpack.graph.enabled: false xpack.reporting.enabled: false

運(yùn)行kibana：

docker run -d --name kibana -v /home/vincent/docker/kibana/kibana.yml:/usr/share/kibana/config/kibana.yml -p 5601:5601 docker.elastic.co/kibana/kibana:6.2.3

參考：https://www.cnblogs.com/blogjun/articles/8072751.html

安裝cerebro

docker pull lmenezes/cerebro

然后直接運(yùn)行：

docker run -d -p 9000:9000 --name cerebro --restart always lmenezes/cerebro

?安裝ik分詞器

可以修改elasticsearch.yml文件：

cluster.name: my-application node.name: node-data4 node.master: false node.data: true # network.bind_host: 192.168.171.29 transport.tcp.port: 9301 http.port: 9201 network.publish_host: 192.168.171.29 network.host: 0.0.0.0 http.max_content_length: 1024mb discovery.zen.ping.unicast.hosts: ["192.168.171.45:9300","192.168.171.45:9301","192.168.171.45:9302"] http.cors.enabled: true http.cors.allow-origin: "*" discovery.zen.ping_timeout: 10s discovery.zen.fd.ping_timeout: 10000s discovery.zen.fd.ping_retries: 10

將ik分詞器拷貝到服務(wù)器中，目錄結(jié)構(gòu)如下：

然后執(zhí)行命令：

docker run -d --name esmaster --ulimit nofile=65536:131072 -p 9200:9200 -p 9300:9300 -v /home/iie4bu/ddy/docker-elasticsearch/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml -v /home/iie4bu/ddy/elasticsearch-analysis-ik-6.2.3:/usr/share/elasticsearch/plugins/ -v /home/iie4bu/ddy/docker-elasticsearch/data:/usr/share/elasticsearch/data -e "ES_JAVA_OPTS=-Xms5120m -Xmx5120m" docker.elastic.co/elasticsearch/elasticsearch:6.2.3

修改了es中的plugins之后，需要修改kibana的plugin否則無法進(jìn)入kibana：

docker run -d --name kibana -v /home/iie4bu/ddy/docker-kibana/kibana.yml:/usr/share/kibana/config/kibana.yml -v /home/iie4bu/ddy/docker-kibana/plugins:/usr/share/kibana/plugins/ -p 5601:5601 docker.elastic.co/kibana/kibana:6.2.3

?

總結(jié)

以上是生活随笔為你收集整理的docker安装配置分布式elasticsearch、kibana、head、cerebro的全部?jī)?nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。