用户国营 发表于 2024-11-29 10:42:36

kafka管理工具

前言

提示:这里可以添加本文要记录的大概内容:
一个好的界面管理工具可以使得开发效率更为高效,因kafka本身没有自研的管理工具!于是尝试安装市面上的一些辅助工具。


[*]Kafka Assistan
[*]Conduktor
[*]kafka-maneger(已更名cmak)
一、Kafka Assistan

1.1 描述

Kafka Assistan——是一款对服务器状态监控的可视化图形工具,界面比较友好


[*]window可用,linux安装失败
[*]localhost可用,非本机利用需付费购买
[*]参考文档较少
192.168.10.101:9092
1.2、设置安装

地点阐明http://www.redisant.cn/ka 界面如下:
https://i-blog.csdnimg.cn/direct/4996b195c9004146bc0a435b403c6965.png
二、Conduktor

2.1、描述

Conduktor是一款商业化的Apache Kafka Connector,可以利用该工具毗连Kafka Cluster


[*]需注册账户
[*]window可装,linux安装需授权(付费)
[*]免费版仅支持一个地点接入,且功能较少
[*]参考文档较少
2.2、设置安装

地点阐明https://conduktor.io/download?spm=a2c6h.12873639.article-detail.7.39085cc0ygCD4y 界面如下:
https://i-blog.csdnimg.cn/direct/dd89807e57004509b071761166a8a829.png
https://i-blog.csdnimg.cn/direct/f910f7c0f1d64cdfad62752f2da6c1d4.png
https://i-blog.csdnimg.cn/direct/e3240584d10e4c63989ca90a0e93b0bd.png
三、kafka-maneger

3.1、描述

利用人群最多,因为功能不受限且免费!!!


[*]需要启动zookeeper服务
[*]极大概率java版本不兼容,需升级java版本(文内会附带教程)
3.2、设置安装

地点阐明https://https://github.com/yahoo/CMAK/releases利用已编译的格式为cmak-x.0.0.0.zip wget https://github.com/yahoo/CMAK/releases/download/3.0.0.6/cmak-3.0.0.6.zip
unzip cmak-3.0.0.6.zip -d /opt/module/
cd /opt/module/
ln -s cmak-3.0.0.3/ KafkaGUI
vim /opt/module/KafkaGUI/conf/application.conf# 编辑配置文件
新增参数,kafka-manager.zkhosts;cmak.zkhosts
# Copyright 2015 Yahoo Inc. Licensed under the Apache License, Version 2.0
# See accompanying LICENSE file.

# This is the main configuration file for the application.
# ~~~~~

# Secret key
# ~~~~~
# The secret key is used to secure cryptographics functions.
# If you deploy your application to several instances be sure to use the same key!
play.crypto.secret="^<csmm5Fx4d=r2HEX8pelM3iBkFVv?k[mc;IZE<_Qoq8EkX_/7@Zt6dP05Pzea3U"
play.crypto.secret=${?APPLICATION_SECRET}
play.http.session.maxAge="1h"

# The application languages
# ~~~~~
play.i18n.langs=["en"]

play.http.requestHandler = "play.http.DefaultHttpRequestHandler"
play.http.context = "/"
play.application.loader=loader.KafkaManagerLoader

# Settings prefixed with 'kafka-manager.' will be deprecated, use 'cmak.' instead.
# https://github.com/yahoo/CMAK/issues/713
kafka-manager.zkhosts="kafka-manager-zookeeper:2181"
kafka-manager.zkhosts=${?ZK_HOSTS}
cmak.zkhosts="kafka-manager-zookeeper:2181"
cmak.zkhosts=${?ZK_HOSTS}
kafka-manager.zkhosts="127.0.0.1:2181"# 浏览器访问服务地址,依据实际(127.0.0.1|192.168.10.101)填写为准
cmak.zkhosts="127.0.0.1:2181"

pinned-dispatcher.type="PinnedDispatcher"
pinned-dispatcher.executor="thread-pool-executor"
application.features=["KMClusterManagerFeature","KMTopicManagerFeature","KMPreferredReplicaElectionFeature","KMReassignPartitionsFeature", "KMScheduleLeaderElectionFeature"]

akka {
loggers = ["akka.event.slf4j.Slf4jLogger"]
loglevel = "INFO"
}

akka.logger-startup-timeout = 60s

basicAuthentication.enabled=false
basicAuthentication.enabled=${?KAFKA_MANAGER_AUTH_ENABLED}

basicAuthentication.ldap.enabled=false
basicAuthentication.ldap.enabled=${?KAFKA_MANAGER_LDAP_ENABLED}
basicAuthentication.ldap.server=""
basicAuthentication.ldap.server=${?KAFKA_MANAGER_LDAP_SERVER}
basicAuthentication.ldap.port=389
basicAuthentication.ldap.port=${?KAFKA_MANAGER_LDAP_PORT}
basicAuthentication.ldap.username=""
basicAuthentication.ldap.username=${?KAFKA_MANAGER_LDAP_USERNAME}
basicAuthentication.ldap.password=""
basicAuthentication.ldap.password=${?KAFKA_MANAGER_LDAP_PASSWORD}
basicAuthentication.ldap.search-base-dn=""
basicAuthentication.ldap.search-base-dn=${?KAFKA_MANAGER_LDAP_SEARCH_BASE_DN}
basicAuthentication.ldap.search-filter="(uid=$capturedLogin$)"
basicAuthentication.ldap.search-filter=${?KAFKA_MANAGER_LDAP_SEARCH_FILTER}
basicAuthentication.ldap.group-filter=""
basicAuthentication.ldap.group-filter=${?KAFKA_MANAGER_LDAP_GROUP_FILTER}
basicAuthentication.ldap.connection-pool-size=10
basicAuthentication.ldap.connection-pool-size=${?KAFKA_MANAGER_LDAP_CONNECTION_POOL_SIZE}
basicAuthentication.ldap.ssl=false
basicAuthentication.ldap.ssl=${?KAFKA_MANAGER_LDAP_SSL}

basicAuthentication.username="admin"
basicAuthentication.username=${?KAFKA_MANAGER_USERNAME}
basicAuthentication.password="password"
basicAuthentication.password=${?KAFKA_MANAGER_PASSWORD}

basicAuthentication.realm="Kafka-Manager"
basicAuthentication.excluded=["/api/health"] # ping the health of your instance without authentification


kafka-manager.consumer.properties.file=${?CONSUMER_PROPERTIES_FILE}
3.3、下令启动

cd /opt/module/KafkaGUI/bin
./cmak
浏览器访问:http://127.0.0.1:9000
https://i-blog.csdnimg.cn/direct/fa67577facb94b6b8ceda5df9806906e.png
https://i-blog.csdnimg.cn/direct/1ad8d125f87e489fad16062d6df64913.png
https://i-blog.csdnimg.cn/direct/79e7c49571ea44898fc1cd83ea59f910.png
https://i-blog.csdnimg.cn/direct/decf97b4ea8342dca8783208959be1cd.png
3.4、JAVA升级

更新软件包列表,检查可用的软件包更新
sudo apt update
更新已安装的软件包至最新版
sudo apt upgrade

sudo apt install openjdk-8-jdk
java -version
# 检索java安装位置,如果有多个版本,会有多个版本文件。格式如java-x.yy.0-openjdk-amd64
ls /usr/lib/jvm/
配置环境变量,将java路径指向高版本java文件,见->
nano ~/.bashrc
->
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export PATH=$PATH:$JAVA_HOME/bin
# 使环境变量生效
source ~/.bashrc
3.5、refer to


免责声明:如果侵犯了您的权益,请联系站长,我们会及时删除侵权内容,谢谢合作!更多信息从访问主页:qidao123.com:ToB企服之家,中国第一个企服评测及商务社交产业平台。
页: [1]
查看完整版本: kafka管理工具