Dolphinscheduler的安裝

• 一、預安裝
• • 1.1 安裝節(jié)點規(guī)劃
  • 1.2 軟件下載
• 二、安裝
• • 2.1 創(chuàng)建dolphinscheduler用戶
  • 2.2 安裝Java
  • 2.3 安裝Zookeeper
  • • Step1.
    • Step2.
    • Step3.
    • Step4.
    • Step5.
    • Step6.
  • 2.4 安裝PostgreSQL數(shù)據(jù)庫
  • 2.5 創(chuàng)建dolphinscheduler數(shù)據(jù)庫
  • 2.6 安裝Dolphinscheduler軟件

一、預安裝

1.1 安裝節(jié)點規(guī)劃

ips=${ips:-"ds-it-001,ds-it-002,ds-it-003"} sshPort=${sshPort:-"22"} masters=${masters:-"ds-it-001,ds-it-002"} workers=${workers:-"ds-it-001:default,ds-it-002:default,ds-it-003:default"} alertServer=${alertServer:-"ds-it-002"} apiServers=${apiServers:-"ds-it-002,ds-it-003"} installPath=${installPath:-"/data/dolphinscheduler"} deployUser=${deployUser:-"dolphinscheduler"}

1.2 軟件下載

JDK(1.8.0_144)

Zookeeper(3.8.0)

Postgresql(14.2)

dolphinscheduler(3.0.0-alpha)

二、安裝

2.1 創(chuàng)建dolphinscheduler用戶

#使用root用戶創(chuàng)建用戶 useradd dolphinscheduler#配置sudo免密 sed -i '$adolphinscheduler ALL=(ALL) NOPASSWD: NOPASSWD: ALL' /etc/sudoers sed -i 's/Defaults requirett/#Defaults requirett/g' /etc/sudoers#配置免密登錄 #在各節(jié)點生成公鑰和私鑰 su - dolphinscheduler ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa touch /home/dolphinscheduler/.ssh/authorized_keys chmod 600 ~/.ssh/authorized_keys#將各節(jié)點生成的公鑰粘貼進authorized_keys cat > ~/.ssh/authorized_keys

2.2 安裝Java

#用服務器現(xiàn)有的Java配置，但是必須確保Java版本是在8以上 export JAVA_HOME=/opt/third/jdk export JRE_HOME=$JAVA_HOME/jre export PATH=$PATH:$JAVA_HOME/bin export CLASSPATH=./:$JAVA_HOME/lib:$JAVA_HOME/jre/lib#確認Java版本 [root@dp-test-003 ~]# java -version java version "1.8.0_144" Java(TM) SE Runtime Environment (build 1.8.0_144-b01) Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)

2.3 安裝Zookeeper

Step1.

#在三個節(jié)點上分別下載zookeeper安裝包 curl -O https://dlcdn.apache.org/zookeeper/zookeeper-3.8.0/apache-zookeeper-3.8.0-bin.tar.gz

Step2.

#解壓安裝包 cd /opt sudo tar -zxf apache-zookeeper-3.8.0-bin.tar.gz

Step3.

#創(chuàng)建zookeeper軟鏈接 sudo ln -s /opt/apache-zookeeper-3.8.0-bin /opt/zookeeper

Step4.

#修改zoo.cfg配置文件 cd /opt/zookeeper/confsudo cp zoo_sample.cfg zoo.cfgsudo vi zoo.cfg#修改內(nèi)容如下： dataDir=/data/zookeeper/zkdataserver.1=10.10.14.134:2888:3888;2181 server.2=10.10.14.212:2888:3888;2181 server.3=10.10.14.211:2888:3888;2181

注意如下節(jié)點跟IP務必匹配，否則啟動失敗，并提示如下錯誤：

2022-05-09 16:12:33,558 [myid:] - ERROR [QuorumPeer[myid=2](plain=0.0.0.0:2181)(secure=disabled):o.a.z.s.q.Leader@325] - Couldn't bind to /10.10.14.211:2888 java.net.BindException: Cannot assign requested address (Bind failed) at java.net.PlainSocketImpl.socketBind(Native Method) at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387) at java.net.ServerSocket.bind(ServerSocket.java:375) at java.net.ServerSocket.bind(ServerSocket.java:329) at org.apache.zookeeper.server.quorum.Leader.createServerSocket(Leader.java:322) at org.apache.zookeeper.server.quorum.Leader.lambda$new$0(Leader.java:301) at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) at java.util.concurrent.ConcurrentHashMap$KeySpliterator.forEachRemaining(ConcurrentHashMap.java:3527) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) at org.apache.zookeeper.server.quorum.Leader.(Leader.java:304) at org.apache.zookeeper.server.quorum.QuorumPeer.makeLeader(QuorumPeer.java:1340) at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:1551)

Step5.

#創(chuàng)建myid文件#如下步驟在zookeeper集群3個節(jié)點上分別執(zhí)行，myid文件對應節(jié)點序號，例如節(jié)點1只需寫入1，節(jié)點2寫入2，節(jié)點3寫入3 mkdir -p /data/zookeeper/zkdataecho 1 > /data/zookeeper/zkdata/myidecho 2 > /data/zookeeper/zkdata/myidecho 3 > /data/zookeeper/zkdata/myid

Step6.

#啟動zookeeper cd /opt/zookeeper sudo ./bin/zkServer.sh start#啟動成功會顯示如下 [root@dp-test-001 zookeeper]# ./bin/zkServer.sh start ZooKeeper JMX enabled by default Using config: /opt/zookeeper/bin/../conf/zoo.cfg Starting zookeeper ... STARTED

2.4 安裝PostgreSQL數(shù)據(jù)庫

訪問postgresql官網(wǎng)選擇下載對應的版本https://www.postgresql.org/download/linux/redhat/#登錄10.10.14.134和10.10.14.211節(jié)點，安裝數(shù)據(jù)庫軟件# Install the repository RPM:sudo yum install -y https://download.postgresql.org/pub/repos/yum/reporpms/EL-7-x86_64/pgdg-redhat-repo-latest.noarch.rpm# Install PostgreSQL:sudo yum install -y postgresql14-server#登錄主節(jié)點10.10.14.134初始化數(shù)據(jù)庫sudo /usr/pgsql-14/bin/postgresql-14-setup initdbsudo systemctl enable postgresql-14sudo systemctl start postgresql-14

2.5 創(chuàng)建dolphinscheduler數(shù)據(jù)庫

su - postgrespsqlpostgres=# create role dolphinscheduler with login password 'xxxxx'; CREATE ROLE postgres=# create database dolphinscheduler owner dolphinscheduler; CREATE DATABASE

2.6 安裝Dolphinscheduler軟件

注意下面的步驟只需在一個節(jié)點上執(zhí)行，在執(zhí)行部署腳本時，會復制軟件至配置文件中指定的節(jié)點和目錄。

#解壓軟件 cd /opt curl -O https://dlcdn.apache.org/dolphinscheduler/3.0.0-alpha/apache-dolphinscheduler-3.0.0-alpha-bin.tar.gz tar -zxf apache-dolphinscheduler-3.0.0-alpha-bin.tar.gz sudo chown -R dolphinscheduler.dolphinscheduler /opt/apache-dolphinscheduler-3.0.0-alpha-bin #修改dolphinscheduler_env.sh配置文件，JAVA_HOME，數(shù)據(jù)庫、zookeeper地址 export JAVA_HOME=${JAVA_HOME:-/opt/third/jdk} export SPRING_JACKSON_TIME_ZONE=${SPRING_JACKSON_TIME_ZONE:-UTC} export DATABASE=${DATABASE:-postgresql} export SPRING_PROFILES_ACTIVE=${DATABASE} export SPRING_DATASOURCE_DRIVER_CLASS_NAME=org.postgresql.Driver export SPRING_DATASOURCE_URL=jdbc:postgresql://dsdb-dp.gz.cvte.cn:5432/dolphinscheduler export SPRING_DATASOURCE_USERNAME=dolphinscheduler export SPRING_DATASOURCE_PASSWORD=xxxx export SPRING_CACHE_TYPE=${SPRING_CACHE_TYPE:-none} export MASTER_FETCH_COMMAND_NUM=${MASTER_FETCH_COMMAND_NUM:-10} export REGISTRY_TYPE=${REGISTRY_TYPE:-zookeeper} export REGISTRY_ZOOKEEPER_CONNECT_STRING=${REGISTRY_ZOOKEEPER_CONNECT_STRING:-ds-it-001:2181,ds-it-002:2181,ds-it-003:2181} #修改install_env.sh ips=${ips:-"ds-it-001,ds-it-002,ds-it-003"} sshPort=${sshPort:-"22"} masters=${masters:-"ds-it-001,ds-it-002"} workers=${workers:-"ds-it-001:default,ds-it-002:default,ds-it-003:default"} alertServer=${alertServer:-"ds-it-002"} apiServers=${apiServers:-"ds-it-002,ds-it-003"} installPath=${installPath:-"/data/dolphinscheduler"} deployUser=${deployUser:-"dolphinscheduler"} #初始化數(shù)據(jù)庫 su - dolphinschedulercd /opt/apache-dolphinscheduler-3.0.0-alpha-binsh tools/bin/create-schema.sh #部署dolphinscheduler集群 su - dolphinschedulercd /opt/apache-dolphinscheduler-3.0.0-alpha-binsh ./bin/install.sh

總結

以上是生活随笔為你收集整理的Dolphinscheduler/海豚调度器的安装的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯，歡迎將生活随笔推薦給好友。