耶耶耶耶耶 发表于 6 天前

Rocky Linux 9.x 基于 kubeadm部署k8s

搭建集群使用docker下载K8s,使用一主两从模式
https://i-blog.csdnimg.cn/img_convert/1c43aca0038254796ef6c97bfdfba8bd.png
主机名IP地点k8s- master192.168.1.141k8s- node-1192.168.1.142k8s- node-2192.168.1.143 一:准备工作

VMware Workstation Pro新建三台假造机Rocky Linux 9(体系推荐最小化安装) 。
如果VMware Workstation Pro(如低于 16.x 的版本)中,如果新建假造机向导没有 Rocky Linux 9 的预设选项,可以 Red Hat Enterprise Linux 9 或相近版本作为替换模板。
主机硬件设置说明

作用IP地点操作体系设置关键组件k8s-master01192.168.1.11Rocky Linux release 92颗CPU 4G内存 100G硬盘kube-apiserver, etcd, etck8s-node01192.168.1.12Rocky Linux release 92颗CPU 4G内存 100G硬盘kubelet, kube-proxyk8s-node02192.168.1.13Rocky Linux release 92颗CPU 4G内存 100G硬盘kubelet, kube-proxy
yum源搭建

   1、体系最小化安装。
2、更换默认源。
sed -e 's|^mirrorlist=|#mirrorlist=|g' \
    -e 's|^#baseurl=http://dl.rockylinux.org/$contentdir|baseurl=https://mirrors.aliyun.com/rockylinux|g' \
    -i.bak \
    /etc/yum.repos.d/rocky*.repo
dnf makecache

3、安装epel软件堆栈,更换国内源
1>. 在 Rocky Linux 9 中启用并安装 EPEL Repo。
# Rocky Linux 9
dnf config-manager --set-enabled crb
dnf install epel-release

2>. 备份(如有设置其他epel源)并更换为国内镜像
留意末了这个库,阿里云没有对应的镜像,不要修改它,如果误改恢复原版源即可
cp /etc/yum.repos.d/epel.repo  /etc/yum.repos.d/epel.repo.backup 
cp /etc/yum.repos.d/epel-testing.repo  /etc/yum.repos.d/epel-testing.repo.backup
cp /etc/yum.repos.d/epel-cisco-openh264.repo  /etc/yum.repos.d/epel-cisco-openh264.repo.backup

3>. 将 repo 设置中的地点更换为阿里云镜像站地点
执行下面语句,它会更换epel.repo、eple-testing.repo中的网址,不会修改epel-cisco-openh264.repo,可以正常使用。
sed -e 's!^metalink=!#metalink=!g' \
    -e 's!^#baseurl=!baseurl=!g' \
    -e 's!https\?://download\.fedoraproject\.org/pub/epel!https://mirrors.aliyun.com/epel!g' \
    -e 's!https\?://download\.example/pub/epel!https://mirrors.aliyun.com/epel!g' \
    -i /etc/yum.repos.d/epel{,-testing}.repo
现在我们有了 EPEL 堆栈,更新堆栈缓存
dnf clean all 
dnf makecache
设置主机名和IP

   #hostnamectl set-hostname k8s-master01
#hostnamectl set-hostname k8s-node01
#hostnamectl set-hostname k8s-node02

#master01设置ip地点
#vi /etc/NetworkManager/system-connections/ens160.nmconnection


id=ens160
uuid=ff8b8a02-ec88-301d-8e64-4f88b4551949
type=ethernet
autoconnect-priority=-999
interface-name=ens160
timestamp=1744709836


method=manual
address=192.168.1.11/24,192.168.1.2
dns=114.114.114.114

addr-gen-mode=eui64
method=auto


# nmcli connection reload
# nmcli connection up ens160

#同理node01和node02设置ip地点
# vi /etc/sysconfig/network-scripts/ifcfg-ens160address=192.168.1.11/24,192.168.1.2
# nmcli connection reload
# nmcli connection up ens160

# vi /etc/sysconfig/network-scripts/ifcfg-ens160address=192.168.1.11/24,192.168.1.2
# nmcli connection reload
# nmcli connection up ens160
设置hosts解析

   # vim /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.11 k8s-master01
192.168.1.12 k8s-node01
192.168.1.13 k8s-node02

# vim /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.11 k8s-master01
192.168.1.12 k8s-node01
192.168.1.13 k8s-node02

# vim /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.1.11 k8s-master01
192.168.1.12 k8s-node01
192.168.1.13 k8s-node02

# 设置免密登录,只在k8s-master01上操作
# ssh-keygen -f ~/.ssh/id_rsa -N '' -q
# 点拷贝秘钥到其他 2 台节点
# ssh-copy-id k8s-node01
# ssh-copy-id k8s-node02
https://i-blog.csdnimg.cn/direct/c785c577108545fea765fa8d003926cc.png
开启多执行关闭防火墙和SELinux,设置时间同步

   #systemctl disable --now firewalld            
#sed -i '/^SELINUX=/ c SELINUX=disabled' /etc/selinux/config
#setenforce 0

#systemctl disable --now firewalld
#sed -i '/^SELINUX=/ c SELINUX=disabled' /etc/selinux/config
#setenforce 0

#systemctl disable --now firewalld
#sed -i '/^SELINUX=/ c SELINUX=disabled' /etc/selinux/config
#setenforce 0
https://i-blog.csdnimg.cn/direct/57314b69035f4ed6aad571d0c9a34430.png
   #dnf install -y chrony
# 修改同步服务器
#sed -i '/^pool/ c pool ntp1.aliyun.com  iburst' /etc/chrony.conf
#systemctl restart chronyd
#systemctl enable chronyd
# chronyc sources
MS Name/IP address         Stratum Poll Reach LastRx Last sample               
===============================================================================
^* 47.96.149.233                 2   6    17     2  -2147us[-2300us] +/-   46ms

#同理其他主机也必要举行时间同步安装,千篇一律的设置
https://i-blog.csdnimg.cn/direct/80345e92e7fa449488855bf881080807.png
https://i-blog.csdnimg.cn/direct/f7bad2918e3e4c1d8b9f41650adaad79.png
启用ipvs

   #cat >> /etc/modules-load.d/ipvs.conf << EOF
br_netfilter
ip_conntrack
ip_vs
ip_vs_lc
ip_vs_wlc
ip_vs_rr
ip_vs_wrr
ip_vs_lblc
ip_vs_lblcr
ip_vs_dh
ip_vs_sh
ip_vs_fo
ip_vs_nq
ip_vs_sed
ip_vs_ftp
ip_vs_sh
nf_conntrack
ip_tables
ip_set
xt_set
ipt_set
ipt_rpfilter
ipt_REJECT
ipip
EOF
#dnf install ipvsadm ipset sysstat conntrack libseccomp -y
#systemctl restart systemd-modules-load.service

#cat >> /etc/modules-load.d/ipvs.conf << EOF
br_netfilter
ip_conntrack
ip_vs
ip_vs_lc
ip_vs_wlc
ip_vs_rr
ip_vs_wrr
ip_vs_lblc
ip_vs_lblcr
ip_vs_dh
ip_vs_sh
ip_vs_fo
ip_vs_nq
ip_vs_sed
ip_vs_ftp
ip_vs_sh
nf_conntrack
ip_tables
ip_set
xt_set
ipt_set
ipt_rpfilter
ipt_REJECT
ipip
EOF
#dnf install ipvsadm ipset sysstat conntrack libseccomp -y
#systemctl restart systemd-modules-load.service

#cat >> /etc/modules-load.d/ipvs.conf << EOF
br_netfilter
ip_conntrack
ip_vs
ip_vs_lc
ip_vs_wlc
ip_vs_rr
ip_vs_wrr
ip_vs_lblc
ip_vs_lblcr
ip_vs_dh
ip_vs_sh
ip_vs_fo
ip_vs_nq
ip_vs_sed
ip_vs_ftp
ip_vs_sh
nf_conntrack
ip_tables
ip_set
xt_set
ipt_set
ipt_rpfilter
ipt_REJECT
ipip
EOF
#dnf install ipvsadm ipset sysstat conntrack libseccomp -y
#systemctl restart systemd-modules-load.service
https://i-blog.csdnimg.cn/direct/850885cd3ae84b08b2e7aa2d9d3f1c6f.png
https://i-blog.csdnimg.cn/direct/e875ac7a81e04675a22a21727a7c0e5f.png
句柄数最大

   #ulimit -SHn 65535
cat >> /etc/security/limits.conf <<EOF
* soft nofile 655360
* hard nofile 131072
* soft nproc 655350
* hard nproc 655350
* seft memlock unlimited
* hard memlock unlimitedd
EOF
查看修改结果
#ulimit -a
https://i-blog.csdnimg.cn/direct/3c59a306453a429690efde97304c8d75.png
举行体系优化

   #cat > /etc/sysctl.d/k8s_better.conf << EOF
net.bridge.bridge-nf-call-iptables=1
net.bridge.bridge-nf-call-ip6tables=1
net.ipv4.ip_forward=1
vm.swappiness=0
vm.overcommit_memory=1
vm.panic_on_oom=0
fs.inotify.max_user_instances=8192
fs.inotify.max_user_watches=1048576
fs.file-max=52706963
fs.nr_open=52706963
net.ipv6.conf.all.disable_ipv6=1
net.netfilter.nf_conntrack_max=2310720
EOF
#modprobe br_netfilter
#lsmod |grep conntrack
#modprobe ip_conntrack
#sysctl -p /etc/sysctl.d/k8s_better.conf

https://i-blog.csdnimg.cn/direct/f0083c9fdee4477babb40ee88ff1a630.png

二:容器运行时工具安装及运行

   #安装依赖
# yum install -y yum-utils device-mapper-persistent-data lvm2

#添加软件源信息
# yum-config-manager --add-repo https://mirrors.aliyun.com/docker-ce/linux/rhel/docker-ce.repo

#安装Docker-CE
# yum makecache fast
# yum -y install docker-ce
# docker -v
Docker version 28.0.4, build b8034c0
 

# 设置国内镜像加速
# mkdir -p /etc/docker/
cat  >> /etc/docker/daemon.json << EOF
{
   "registry-mirrors":["https://p3kgr6db.mirror.aliyuncs.com",
   "https://docker.m.daocloud.io",
   "https://your_id.mirror.aliyuncs.com",
   "https://docker.nju.edu.cn/",
    "https://docker.anyhub.us.kg",
    "https://dockerhub.jobcher.com",
    "https://dockerhub.icu",
    "https://docker.ckyl.me",
       "https://cr.console.aliyun.com"
   ],
"exec-opts": ["native.cgroupdriver=systemd"]
}
EOF

设置docker开机启动并启动
# # systemctl enable --now docker
#k8s-node01和k8s-node02举行千篇一律的命令
查看docker版本
# docker version
https://i-blog.csdnimg.cn/direct/0194ab19e47a482db521e227e8495317.png
三台同时安装cri-docker

   wget -c https://github.com/Mirantis/cri-dockerd/releases/download/v0.3.16/cri-dockerd-0.3.16-3.fc35.x86_64.rpm
wget -c https://rpmfind.net/linux/almalinux/8.10/BaseOS/x86_64/os/Packages/libcgroup-0.41-19.el8.x86_64.rpm
yum install libcgroup-0.41-19.el8.x86_64.rpm
yum install cri-dockerd-0.3.16-3.fc35.x86_64.rpm
https://i-blog.csdnimg.cn/direct/2552ec68d3404e41adbd28ebaf5e7c73.png
启动cri-docker服务

   systemctl enable cri-docker
https://i-blog.csdnimg.cn/direct/521ce9d0e5754760b7a9a6f7973bcf63.png
cri-dockerd设置国内镜像加速

   #vim /usr/lib/systemd/system/cri-docker.service
# vim /usr/lib/systemd/system/cri-docker.service
# vim /usr/lib/systemd/system/cri-docker.service
https://i-blog.csdnimg.cn/direct/0816799bf3514150b47c024f168e4013.png
   # 重启Docker组件
# systemctl daemon-reload && systemctl restart docker cri-docker.socket cri-docker
#检查Docker组件状态
#systemctl status docker cir-docker.socket cri-docker

#systemctl daemon-reload && systemctl restart docker cri-docker.socket cri-docker
#systemctl status docker cir-docker.socket cri-docker

#systemctl daemon-reload && systemctl restart docker cri-docker.socket cri-docker
#systemctl status docker cir-docker.socket cri-docker
三:三台一起举行K8S软件安装

   #添加阿里云YUM软件源,设置kubernetes源
#
cat <<EOF | tee /etc/yum.repos.d/kubernetes.repo

name=Kubernetes
baseurl=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/
enabled=1
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/repodata/repomd.xml.key
EOF
#安装kubelet、kubeadm、kubectl、kubernetes-cni
#yum install -y kubelet kubeadm kubectl kubernetes-cni
#设置cgroup为了实现docker使用的cgroupdriver与kubelet使用的cgroup的同等性,建议修改如下文件内容。
#vim /etc/sysconfig/kubelet
KUBELET_EXTRA_ARGS="--cgroup-driver=systemd"
# systemctl enable kubelet
 
#node1
#
cat <<EOF | tee /etc/yum.repos.d/kubernetes.repo

name=Kubernetes
baseurl=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/
enabled=1
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/repodata/repomd.xml.key
EOF
#yum install -y kubelet kubeadm kubectl kubernetes-cni
#vim /etc/sysconfig/kubelet
KUBELET_EXTRA_ARGS="--cgroup-driver=systemd"
# systemctl enable kubelet
 

#node2
#
cat <<EOF | tee /etc/yum.repos.d/kubernetes.repo

name=Kubernetes
baseurl=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/
enabled=1
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/kubernetes-new/core/stable/v1.32/rpm/repodata/repomd.xml.key
EOF
#yum install -y kubelet kubeadm kubectl kubernetes-cni
#vim /etc/sysconfig/kubelet
KUBELET_EXTRA_ARGS="--cgroup-driver=systemd"
# systemctl enable kubelet
四:K8S集群初始化

   #在master上面举行修改
#kubeadm config print init-defaults > kubeadm-init.yaml
#vi kubeadm-init.yaml
修改为 advertiseAddress: 192.168.1.11
修改为 criSocket: unix:///var/run/cri-dockerd.sock
修改为 name: k8s-master01
修改为:imageRepository: registry.aliyuncs.com/google_containers
修改为:kubernetesVersion: 1.32.2
    文件末尾增长启用ipvs功能
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
mode: ipvs
https://i-blog.csdnimg.cn/direct/04369469d83d42ce85177f01d8dc3c24.png
   #根据设置文件启动 kubeadm 初始化 k8s
#kubeadm init --config=kubeadm-init.yaml --upload-certs --v=6
https://i-blog.csdnimg.cn/direct/16a62940c8524db8a274188ac6e706f5.png
   #master主机上
#mkdir -p $HOME/.kube 
#sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config 
#sudo chown $(id -u):$(id -g) $HOME/.kube/config
# export KUBECONFIG=/etc/kubernetes/admin.conf

#将node-1和node-2参加到k8s集群中
# kubeadm join 192.168.1.11:6443 --token abcdef.0123456789abcdef --discovery-token-ca-cert-hash sha256:1c8cadee79fc7739c3084fa08f1d4347bb0f0ae67d7cb38b329c7f2481ee0048 --cri-socket unix:///var/run/cri-dockerd.sock
#  kubeadm join 192.168.1.11:6443 --token abcdef.0123456789abcdef --discovery-token-ca-cert-hash sha256:1c8cadee79fc7739c3084fa08f1d4347bb0f0ae67d7cb38b329c7f2481ee0048 --cri-socket unix:///var/run/cri-dockerd.sock
    #maste查看集群
# kubectl get node
https://i-blog.csdnimg.cn/direct/b2200da131254093b859206f86b4d93b.png

   # 只在master01上操作
# curl -O https://docs.projectcalico.org/archive/v3.28/manifests/calico.yaml

# vim calico.yaml
以下两行默认没有开启,开始后修改第二举动kubeadm初始化使用指定的pod network即可。
3680             # The default IPv4 pool to create on startup if none exists. Pod IPs will be
3681             # chosen from this range. Changing this value after installation will have
3682             # no effect. This should fall within `--cluster-cidr`.
3683             - name: CALICO_IPV4POOL_CIDR
3684               value: "10.244.0.0/16"
3685             # Disable file logging so `kubectl logs` works.

# ls
anaconda-ks.cfg  calico.tar.gz  calico.yaml  kubeadm-init.yaml

# docker load -i calico.tar.gz
29ebc113185d: Loading layer  3.582MB/3.582MB
de34b16b5b80: Loading layer  75.58MB/75.58MB
Loaded image: calico/kube-controllers:v3.28.0
3ba0ed02b4de: Loading layer  205.4MB/205.4MB
5f70bf18a086: Loading layer  1.024kB/1.024kB
Loaded image: calico/cni:v3.28.0
30d979f3b1cb: Loading layer  354.5MB/354.5MB
Loaded image: calico/node:v3.28.0

# scp calico.tar.gz k8s-node01:~
calico.tar.gz                                                   100%  610MB  92.1MB/s   00:06
# scp calico.tar.gz k8s-node02:~
calico.tar.gz                                                   100%  610MB  89.3MB/s   00:06

# docker load -i calico.tar.gz
# docker load -i calico.tar.gz
29ebc113185d: Loading layer  3.582MB/3.582MB
de34b16b5b80: Loading layer  75.58MB/75.58MB
Loaded image: calico/kube-controllers:v3.28.0
3ba0ed02b4de: Loading layer  205.4MB/205.4MB
5f70bf18a086: Loading layer  1.024kB/1.024kB
Loaded image: calico/cni:v3.28.0
30d979f3b1cb: Loading layer  354.5MB/354.5MB
Loaded image: calico/node:v3.28.0
    部署calico网络
# kubectl apply -f calico.yaml
检查:
# kubectl get pod -n kube-system 
    # kubectl get nodes
# kubectl get pod -n kube-system
https://i-blog.csdnimg.cn/direct/6f907c9248524fab965316d8dd49e6d7.png
扩展~Kubectl命令自动补全

   yum -y install bash-completion
source /usr/share/bash-completion/bash_completion
source <(kubectl completion bash)
echo "source <(kubectl completion bash)" >> ~/.bashrc

免责声明:如果侵犯了您的权益,请联系站长,我们会及时删除侵权内容,谢谢合作!更多信息从访问主页:qidao123.com:ToB企服之家,中国第一个企服评测及商务社交产业平台。
页: [1]
查看完整版本: Rocky Linux 9.x 基于 kubeadm部署k8s