當(dāng)前位置：首頁 > 编程资源 > 编程问答 >内容正文

编程问答

一份详尽的利用 Kubeadm部署 Kubernetes 1.13.1 集群指北

發(fā)布時(shí)間：2023/12/6 编程问答 52 豆豆

生活随笔收集整理的這篇文章主要介紹了一份详尽的利用 Kubeadm部署 Kubernetes 1.13.1 集群指北小編覺得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.

2019獨(dú)角獸企業(yè)重金招聘Python工程師標(biāo)準(zhǔn)>>>

概述

Kubernetes集群的搭建方法其實(shí)有多種，比如我在之前的文章《利用K8S技術(shù)棧打造個(gè)人私有云（連載之：K8S集群搭建）》中使用的就是二進(jìn)制的安裝方法。雖然這種方法有利于我們理解 k8s集群，但卻過于繁瑣。而 kubeadm是 Kubernetes官方提供的用于快速部署Kubernetes集群的工具，其歷經(jīng)發(fā)展如今已經(jīng)比較成熟了，利用其來部署 Kubernetes集群可以說是非常好上手，操作起來也簡便了許多，因此本文詳細(xì)敘述之。

注：本文首發(fā)于 My Personal Blog：CodeSheep·程序羊，歡迎光臨小站

節(jié)點(diǎn)規(guī)劃

本文準(zhǔn)備部署一個(gè) 一主兩從 的 三節(jié)點(diǎn) Kubernetes集群，整體節(jié)點(diǎn)規(guī)劃如下表所示：

主機(jī)名IP角色

k8s-master	192.168.39.79	k8s主節(jié)點(diǎn)
k8s-node-1	192.168.39.77	k8s從節(jié)點(diǎn)
k8s-node-2	192.168.39.78	k8s從節(jié)點(diǎn)

下面介紹一下各個(gè)節(jié)點(diǎn)的軟件版本：

操作系統(tǒng)：CentOS-7.4-64Bit
Docker版本：1.13.1
Kubernetes版本：1.13.1

所有節(jié)點(diǎn)都需要安裝以下組件：

Docker：不用多說了吧
kubelet：運(yùn)行于所有 Node上，負(fù)責(zé)啟動容器和 Pod
kubeadm：負(fù)責(zé)初始化集群
kubectl： k8s命令行工具，通過其可以部署/管理應(yīng)用以及CRUD各種資源

準(zhǔn)備工作

所有節(jié)點(diǎn)關(guān)閉防火墻

systemctl disable firewalld.service systemctl stop firewalld.service

禁用SELINUX

setenforce 0vi /etc/selinux/config SELINUX=disabled

所有節(jié)點(diǎn)關(guān)閉 swap

swapoff -a

設(shè)置所有節(jié)點(diǎn)主機(jī)名

hostnamectl --static set-hostname k8s-master hostnamectl --static set-hostname k8s-node-1 hostnamectl --static set-hostname k8s-node-2

所有節(jié)點(diǎn) 主機(jī)名/IP加入 hosts解析

編輯 /etc/hosts文件，加入以下內(nèi)容：

192.168.39.79 k8s-master 192.168.39.77 k8s-node-1 192.168.39.78 k8s-node-2

組件安裝

0x01. Docker安裝（所有節(jié)點(diǎn)）

不贅述 ! ! !

0x02. kubelet、kubeadm、kubectl安裝（所有節(jié)點(diǎn)）

首先準(zhǔn)備repo

cat>>/etc/yum.repos.d/kubrenetes.repo<<EOF [kubernetes] name=Kubernetes Repo baseurl=https://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64/ gpgcheck=0 gpgkey=https://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg EOF

然后執(zhí)行如下指令來進(jìn)行安裝

setenforce 0 sed -i 's/^SELINUX=enforcing$/SELINUX= disabled/' /etc/selinux/configyum install -y kubelet kubeadm kubectl systemctl enable kubelet && systemctl start kubelet

Master節(jié)點(diǎn)配置

0x01. 初始化 k8s集群

為了應(yīng)對網(wǎng)絡(luò)不暢通的問題，我們國內(nèi)網(wǎng)絡(luò)環(huán)境只能提前手動下載相關(guān)鏡像并重新打 tag :

docker pull mirrorgooglecontainers/kube-apiserver:v1.13.1 docker pull mirrorgooglecontainers/kube-controller-manager:v1.13.1 docker pull mirrorgooglecontainers/kube-scheduler:v1.13.1 docker pull mirrorgooglecontainers/kube-proxy:v1.13.1 docker pull mirrorgooglecontainers/pause:3.1 docker pull mirrorgooglecontainers/etcd:3.2.24 docker pull coredns/coredns:1.2.6 docker pull registry.cn-shenzhen.aliyuncs.com/cp_m/flannel:v0.10.0-amd64docker tag mirrorgooglecontainers/kube-apiserver:v1.13.1 k8s.gcr.io/kube-apiserver:v1.13.1 docker tag mirrorgooglecontainers/kube-controller-manager:v1.13.1 k8s.gcr.io/kube-controller-manager:v1.13.1 docker tag mirrorgooglecontainers/kube-scheduler:v1.13.1 k8s.gcr.io/kube-scheduler:v1.13.1 docker tag mirrorgooglecontainers/kube-proxy:v1.13.1 k8s.gcr.io/kube-proxy:v1.13.1 docker tag mirrorgooglecontainers/pause:3.1 k8s.gcr.io/pause:3.1 docker tag mirrorgooglecontainers/etcd:3.2.24 k8s.gcr.io/etcd:3.2.24 docker tag coredns/coredns:1.2.6 k8s.gcr.io/coredns:1.2.6 docker tag registry.cn-shenzhen.aliyuncs.com/cp_m/flannel:v0.10.0-amd64 quay.io/coreos/flannel:v0.10.0-amd64docker rmi mirrorgooglecontainers/kube-apiserver:v1.13.1 ? ? ? ? ?? docker rmi mirrorgooglecontainers/kube-controller-manager:v1.13.1 ? docker rmi mirrorgooglecontainers/kube-scheduler:v1.13.1 ? ? ? ? ?? docker rmi mirrorgooglecontainers/kube-proxy:v1.13.1 ? ? ? ? ? ? ?? docker rmi mirrorgooglecontainers/pause:3.1 ? ? ? ? ? ? ? ? ? ? ? ? docker rmi mirrorgooglecontainers/etcd:3.2.24 ? ? ? ? ? ? ? ? ? ? ? docker rmi coredns/coredns:1.2.6 docker rmi registry.cn-shenzhen.aliyuncs.com/cp_m/flannel:v0.10.0-amd64

然后再在 Master節(jié)點(diǎn)上執(zhí)行如下命令初始化 k8s集群：

kubeadm init --kubernetes-version=v1.13.1 --apiserver-advertise-address 192.168.39.79 --pod-network-cidr=10.244.0.0/16

--kubernetes-version: 用于指定 k8s版本
--apiserver-advertise-address：用于指定使用 Master的哪個(gè)network interface進(jìn)行通信，若不指定，則 kubeadm會自動選擇具有默認(rèn)網(wǎng)關(guān)的 interface
--pod-network-cidr：用于指定Pod的網(wǎng)絡(luò)范圍。該參數(shù)使用依賴于使用的網(wǎng)絡(luò)方案，本文將使用經(jīng)典的flannel網(wǎng)絡(luò)方案。

執(zhí)行命令后，控制臺給出了如下所示的詳細(xì)集群初始化過程：

[root@localhost ~]# kubeadm init --config kubeadm-config.yaml W1224 11:01:25.408209 10137 strict.go:54] error unmarshaling configuration schema.GroupVersionKind{Group:"kubeadm.k8s.io", Version:"v1beta1", Kind:"ClusterConfiguration"}: error unmarshaling JSON: while decoding JSON: json: unknown field "\u00a0 podSubnet” [init] Using Kubernetes version: v1.13.1 [preflight] Running pre-flight checks [preflight] Pulling images required for setting up a Kubernetes cluster [preflight] This might take a minute or two, depending on the speed of your internet connection [preflight] You can also perform this action in beforehand using 'kubeadm config images pull’ [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env” [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml” [kubelet-start] Activating the kubelet service [certs] Using certificateDir folder "/etc/kubernetes/pki” [certs] Generating "etcd/ca" certificate and key [certs] Generating "etcd/healthcheck-client" certificate and key [certs] Generating "etcd/server" certificate and key [certs] etcd/server serving cert is signed for DNS names [localhost.localdomain localhost] and IPs [192.168.39.79 127.0.0.1 ::1] [certs] Generating "etcd/peer" certificate and key [certs] etcd/peer serving cert is signed for DNS names [localhost.localdomain localhost] and IPs [192.168.39.79 127.0.0.1 ::1] [certs] Generating "apiserver-etcd-client" certificate and key [certs] Generating "ca" certificate and key [certs] Generating "apiserver-kubelet-client" certificate and key [certs] Generating "apiserver" certificate and key [certs] apiserver serving cert is signed for DNS names [localhost.localdomain kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local] and IPs [10.96.0.1 192.168.39.79] [certs] Generating "front-proxy-ca" certificate and key [certs] Generating "front-proxy-client" certificate and key [certs] Generating "sa" key and public key [kubeconfig] Using kubeconfig folder "/etc/kubernetes” [kubeconfig] Writing "admin.conf" kubeconfig file [kubeconfig] Writing "kubelet.conf" kubeconfig file [kubeconfig] Writing "controller-manager.conf" kubeconfig file [kubeconfig] Writing "scheduler.conf" kubeconfig file [control-plane] Using manifest folder "/etc/kubernetes/manifests” [control-plane] Creating static Pod manifest for "kube-apiserver” [control-plane] Creating static Pod manifest for "kube-controller-manager” [control-plane] Creating static Pod manifest for "kube-scheduler” [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests” [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s [apiclient] All control plane components are healthy after 24.005638 seconds [uploadconfig] storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system” Namespace [kubelet] Creating a ConfigMap "kubelet-config-1.13" in namespace kube-system with the configuration for the kubelets in the cluster [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "localhost.localdomain" as an annotation [mark-control-plane] Marking the node localhost.localdomain as control-plane by adding the label "node-role.kubernetes.io/master=''” [mark-control-plane] Marking the node localhost.localdomain as control-plane by adding the taints [node-role.kubernetes.io/master:NoSchedule] [bootstrap-token] Using token: 26uprk.t7vpbwxojest0tvq [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles [bootstraptoken] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials [bootstraptoken] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token [bootstraptoken] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster [bootstraptoken] creating the "cluster-info" ConfigMap in the "kube-public” namespace [addons] Applied essential addon: CoreDNS [addons] Applied essential addon: kube-proxyYour Kubernetes master has initialized successfully!To start using your cluster, you need to run the following as a regular user:mkdir -p $HOME/.kubesudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/configsudo chown $(id -u):$(id -g) $HOME/.kube/configYou should now deploy a pod network to the cluster. Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:https://kubernetes.io/docs/concepts/cluster-administration/addons/You can now join any number of machines by running the following on each node as root:kubeadm join 192.168.39.79:6443 --token 26uprk.t7vpbwxojest0tvq --discovery-token-ca-cert-hash sha256:028727c0c21f22dd29d119b080dcbebb37f5545e7da1968800140ffe225b0123[root@localhost ~]#

0x02. 配置 kubectl

在 Master上用 root用戶執(zhí)行下列命令來配置 kubectl：

echo "export KUBECONFIG=/etc/kubernetes/admin.conf" >> /etc/profile source /etc/profile? echo $KUBECONFIG

0x03. 安裝Pod網(wǎng)絡(luò)

安裝 Pod網(wǎng)絡(luò)是 Pod之間進(jìn)行通信的必要條件，k8s支持眾多網(wǎng)絡(luò)方案，這里我們依然選用經(jīng)典的 flannel方案

首先設(shè)置系統(tǒng)參數(shù)：

sysctl net.bridge.bridge-nf-call-iptables=1

然后在 Master節(jié)點(diǎn)上執(zhí)行如下命令：

kubectl apply -f kube-flannel.yaml

kube-flannel.yaml 文件在此

一旦 Pod網(wǎng)絡(luò)安裝完成，可以執(zhí)行如下命令檢查一下 CoreDNS Pod此刻是否正常運(yùn)行起來了，一旦其正常運(yùn)行起來，則可以繼續(xù)后續(xù)步驟

kubectl get pods --all-namespaces -o wide

同時(shí)我們可以看到主節(jié)點(diǎn)已經(jīng)就緒：kubectl get nodes

添加 Slave節(jié)點(diǎn)

在兩個(gè) Slave節(jié)點(diǎn)上分別執(zhí)行如下命令來讓其加入Master上已經(jīng)就緒了的 k8s集群：

kubeadm join --token <token> <master-ip>:<master-port> --discovery-token-ca-cert-hash sha256:<hash>

如果 token忘記，則可以去 Master上執(zhí)行如下命令來獲取：

kubeadm token list

上述kubectl join命令的執(zhí)行結(jié)果如下：

[root@localhost ~]# kubeadm join 192.168.39.79:6443 --token yndddp.oamgloerxuune80q --discovery-token-ca-cert-hash sha256:7a45c40b5302aba7d8b9cbd3afc6d25c6bb8536dd6317aebcd2909b0427677c8 [preflight] Running pre-flight checks [discovery] Trying to connect to API Server "192.168.39.79:6443” [discovery] Created cluster-info discovery client, requesting info from "https://192.168.39.79:6443” [discovery] Requesting info from "https://192.168.39.79:6443" again to validate TLS against the pinned public key [discovery] Cluster info signature and contents are valid and TLS certificate validates against pinned roots, will use API Server "192.168.39.79:6443” [discovery] Successfully established connection with API Server "192.168.39.79:6443” [join] Reading configuration from the cluster… [join] FYI: You can look at this config file with 'kubectl -n kube-system get cm kubeadm-config -oyaml’ [kubelet] Downloading configuration for the kubelet from the "kubelet-config-1.13" ConfigMap in the kube-system namespace [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml” [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env” [kubelet-start] Activating the kubelet service [tlsbootstrap] Waiting for the kubelet to perform the TLS Bootstrap… [patchnode] Uploading the CRI Socket information "/var/run/dockershim.sock" to the Node API object "localhost.localdomain" as an annotationThis node has joined the cluster: * Certificate signing request was sent to apiserver and a response was received. * The Kubelet was informed of the new secure connection details.Run 'kubectl get nodes' on the master to see this node join the cluster.

效果驗(yàn)證

查看節(jié)點(diǎn)狀態(tài)

kubectl get nodes

查看所有 Pod狀態(tài)

kubectl get pods --all-namespaces -o wide

好了，集群現(xiàn)在已經(jīng)正常運(yùn)行了，接下來看看如何正常的拆卸集群。

拆卸集群

首先處理各節(jié)點(diǎn)：

kubectl drain <node name> --delete-local-data --force --ignore-daemonsets kubectl delete node <node name>

一旦節(jié)點(diǎn)移除之后，則可以執(zhí)行如下命令來重置集群：

kubeadm reset

安裝 dashboard

就像給elasticsearch配一個(gè)可視化的管理工具一樣，我們最好也給 k8s集群配一個(gè)可視化的管理工具，便于管理集群。

因此我們接下來安裝 v1.10.0版本的 kubernetes-dashboard，用于集群可視化的管理。

首先手動下載鏡像并重新打標(biāo)簽：（所有節(jié)點(diǎn)）

docker pull registry.cn-qingdao.aliyuncs.com/wangxiaoke/kubernetes-dashboard-amd64:v1.10.0 docker tag registry.cn-qingdao.aliyuncs.com/wangxiaoke/kubernetes-dashboard-amd64:v1.10.0 k8s.gcr.io/kubernetes-dashboard-amd64:v1.10.0 docker image rm registry.cn-qingdao.aliyuncs.com/wangxiaoke/kubernetes-dashboard-amd64:v1.10.0

安裝 dashboard：

kubectl create -f dashboard.yaml

dashboard.yaml 文件在此

查看 dashboard的 pod是否正常啟動，如果正常說明安裝成功:

kubectl get pods --namespace=kube-system [root@k8s-master ~]# kubectl get pods --namespace=kube-system NAME READY STATUS RESTARTS AGE coredns-86c58d9df4-4rds2 1/1 Running 0 81m coredns-86c58d9df4-rhtgq 1/1 Running 0 81m etcd-k8s-master 1/1 Running 0 80m kube-apiserver-k8s-master 1/1 Running 0 80m kube-controller-manager-k8s-master 1/1 Running 0 80m kube-flannel-ds-amd64-8qzpx 1/1 Running 0 78m kube-flannel-ds-amd64-jvp59 1/1 Running 0 77m kube-flannel-ds-amd64-wztbk 1/1 Running 0 78m kube-proxy-crr7k 1/1 Running 0 81m kube-proxy-gk5vf 1/1 Running 0 78m kube-proxy-ktr27 1/1 Running 0 77m kube-scheduler-k8s-master 1/1 Running 0 80m kubernetes-dashboard-79ff88449c-v2jnc 1/1 Running 0 21s

查看 dashboard的外網(wǎng)暴露端口

kubectl get service --namespace=kube-system NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE kube-dns ClusterIP 10.96.0.10 <none> 53/UDP,53/TCP 5h38m kubernetes-dashboard NodePort 10.99.242.186 <none> 443:31234/TCP 14

生成私鑰和證書簽名：

openssl genrsa -des3 -passout pass:x -out dashboard.pass.key 2048 openssl rsa -passin pass:x -in dashboard.pass.key -out dashboard.key rm dashboard.pass.key openssl req -new -key dashboard.key -out dashboard.csr【如遇輸入，一路回車即可】

生成SSL證書：

openssl x509 -req -sha256 -days 365 -in dashboard.csr -signkey dashboard.key -out dashboard.crt

然后將生成的 dashboard.key 和 dashboard.crt置于路徑 /home/share/certs下，該路徑會配置到下面即將要操作的

dashboard-user-role.yaml文件中

創(chuàng)建 dashboard用戶

kubectl create -f dashboard-user-role.yaml

dashboard-user-role.yaml 文件在此

獲取登陸token

kubectl describe secret/$(kubectl get secret -nkube-system |grep admin|awk '{print $1}') -nkube-system [root@k8s-master ~]# kubectl describe secret/$(kubectl get secret -nkube-system |grep admin|awk '{print $1}') -nkube-system Name: admin-token-9d4vl Namespace: kube-system Labels: <none> Annotations: kubernetes.io/service-account.name: adminkubernetes.io/service-account.uid: a320b00f-07ed-11e9-93f2-000c2978f207Type: kubernetes.io/service-account-tokenData ==== ca.crt: 1025 bytes namespace: 11 bytes token: eyJhbGciOiJSUzI1NiIsImtpZCI6IiJ9.eyJpc3MiOiJrdWJlcm5ldGVzL3NlcnZpY2VhY2NvdW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9uYW1lc3BhY2UiOiJrdWJlLXN5c3RlbSIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VjcmV0Lm5hbWUiOiJhZG1pbi10b2tlbi05ZDR2bCIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJhZG1pbiIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50LnVpZCI6ImEzMjBiMDBmLTA3ZWQtMTFlOS05M2YyLTAwMGMyOTc4ZjIwNyIsInN1YiI6InN5c3RlbTpzZXJ2aWNlYWNjb3VudDprdWJlLXN5c3RlbTphZG1pbiJ9.WbaHx-BfZEd0SvJwA9V_vGUe8jPMUHjKlkT7MWJ4JcQldRFY8Tdpv5GKCY25JsvT_GM3ob303r0yE6vjQdKna7EfQNO_Wb2j1Yu5UvZnWw52HhNudHNOVL_fFRKxkSVjAILA_C_HvW6aw6TG5h7zHARgl71I0LpW1VESeHeThipQ-pkt-Dr1jWcpPgE39cwxSgi-5qY4ssbyYBc2aPYLsqJibmE-KUhwmyOheF4Lxpg7E3SQEczsig2HjXpNtJizCu0kPyiR4qbbsusulH-kdgjhmD9_XWP9k0BzgutXWteV8Iqe4-uuRGHZAxgutCvaL5qENv4OAlaArlZqSgkNWw

token既然生成成功，接下來就可以打開瀏覽器，輸入 token來登錄進(jìn)集群管理頁面：

后記

由于能力有限，若有錯(cuò)誤或者不當(dāng)之處，還請大家批評指正，一起學(xué)習(xí)交流！

My Personal Blog：CodeSheep 程序羊
我的半年技術(shù)博客之路

轉(zhuǎn)載于:https://my.oschina.net/hansonwang99/blog/2993870

總結(jié)

以上是生活随笔為你收集整理的一份详尽的利用 Kubeadm部署 Kubernetes 1.13.1 集群指北的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。

上一篇：在Kubernetes集群上部署和管理J
下一篇：图表库