Prometheus多集群监控的3种方案，你选哪种？ - ToB企服应用市场:ToB评测及商务社交产业平台

apiVersion: v1
kind: ServiceAccount
metadata:
name: prometheus-test
namespace: kube-system
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
name: prometheus-test
rules:
- apiGroups:
- ""
resources:
- nodes
- services
- endpoints
- pods
- nodes/proxy
verbs:
- get
- list
- watch
- apiGroups:
- "extensions"
resources:
- ingresses
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
- configmaps
- nodes/metrics
verbs:
- get
- nonResourceURLs:
- /metrics
verbs:
- get
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: prometheus-test
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: prometheus-test
subjects:
- kind: ServiceAccount
name: prometheus-test
namespace: kube-system

复制代码

- job_name: k8s_cAdvisor
scheme: https
bearer_token_file: k8s_token
tls_config:
insecure_skip_verify: true
kubernetes_sd_configs: #kubernetes 自动发现配置
- role: node #node类型的自动发现
bearer_token_file: k8s_token #步骤1中创建的token文件
api_server: https://192.168.0.153:5443 #k8s集群 apiserver地址
tls_config:
insecure_skip_verify: true #跳过对服务端的认证
relabel_configs: #用于在抓取metrics之前修改target的已有标签
- target_label: __address__
replacement: 192.168.0.153:5443
action: replace
##将metrics_path地址转换为/api/v1/nodes/${1}/proxy/metrics/cadvisor
#相当于通过APIServer代理到kubelet上获取数据
- source_labels: [__meta_kubernetes_node_name] #指定我们需要处理的源标签
regex: (.+) #匹配源标签的值,(.+)表示源标签什么值都可以匹配上
target_label: __metrics_path__ #指定了需要replace后的标签
replacement: /api/v1/nodes/${1}/proxy/metrics/cadvisor # 表示替换后的标签即__metrics_path__ 对应的值。其中${1}表示正则匹配的值，即nodename
- target_label: cluster 为该集群下的node节点打上cluster标签便于分组管理
replacement: k8s #为cluster标签赋值，值可以是集群名称或者其他唯一标识符
###该job用于监控另一个集群
- job_name: k8s02_cAdvisor
scheme: https
bearer_token_file: k8s02_token
tls_config:
insecure_skip_verify: true
kubernetes_sd_configs:
- role: node
bearer_token_file: k8s02_token #步骤1中创建的token文件
api_server: https://192.168.0.147:5443
tls_config:
insecure_skip_verify: true
relabel_configs:
- target_label: __address__
replacement: 192.168.0.147:5443
action: replace
- source_labels: [__meta_kubernetes_node_name]
regex: (.+)
target_label: __metrics_path__
replacement: /api/v1/nodes/${1}/proxy/metrics/cadvisor
- target_label: cluster
replacement: k8s02

复制代码

- job_name: 'federate-k8s01'
scrape_interval: 15s
honor_labels: true
metrics_path: '/federate' #固定配置
params:
'match[]':
- '{job="istio-mesh"}' #目标prometheus的监控job列表，根据实际情况填写
- '{job="kubernetes-cadvisor"}'
static_configs:
- targets:
- '100.85.123.205:32298' #目标prometheus的访问地址

复制代码