ToB企服应用市场:ToB评测及商务社交产业平台

标题: Kraft模式安装Kafka（含常规、容器两种安装方式）、Kafka镜像下载 [打印本页]
作者: 冬雨财经    时间: 3 天前
标题: Kraft模式安装Kafka（含常规、容器两种安装方式）、Kafka镜像下载
 一、#创作灵感#

公司利用Kafka的软件项目较多，故写技术条记巩固知识要点
二、软件环境

- Kafka 3.9.0  官方下载地点：Kafka 3.9.0
- Docker Desktop 4.37 容器图形化工具  官方下载地点：Docker Desktop 4.37
特别说明
- Docker Desktop仅仅是Windows下镜像用，如有能爬楼的服务器可不安装此软件
- 本文以单机模式为例
三、常规方式安装

非容器化Kraft Mode（模式）安装
1、下载Kafka

参见上面的软件环境章节的下载地点
2、修改Kafka配置

# Kraft模式启动
vi $KAFKA_HOME/config/kraft/server.properties
关键设置包罗
  1. # 指定此节点是否应该成为控制平面的一部分
  2. process.roles=controller,kafka
  4. # KRaft模式下的节点ID，每个节点的ID必须唯一
  5. node.id=1
  7. # 监听器地址，用于集群内通信
  8. listeners=PLAINTEXT://localhost:9092
  10. # 控制平面监听器地址
  11. controller.listeners=PLAINTEXT://localhost:9090
  13. # 用于集群通信的安全协议以及相关的认证和授权配置
  14. inter.broker.listener.name=CONTROLLER
  16. # 控制平面的ADVERTISED.LISTENERS，用于其他节点发现
  17. controller.listener.names=CONTROLLER
  18. controller.advertised.listeners=PLAINTEXT://localhost:9090
  20. # 用于KRaft模式的元数据复制因子，通常设置为集群中控制器的数量
  21. metadata.max.age=300000
  23. # 日志存储配置，指定日志的位置和格式
  24. log.dirs=/tmp/kraft-logs
  25. log.retention.hours=168
  27. # 控制平面的选举配置和集群成员配置
  28. control.plane.listener.name=CONTROLLER
  29. control.plane.advertised.listeners=PLAINTEXT://localhost:9090
  31. # 集群的初始/bootstrap状态
  32. process.roles=controller
  33. node.id=1
  34. listeners=CONTROLLER://localhost:9090
  35. inter.broker.listener.name=CONTROLLER
复制代码

3、Kraft模式启动Kafka

  
  1. # Start the Kafka broker service
  2. $ bin/kafka-server-start.sh config/kraft/server.properties
复制代码

四、docker方式安装

容器化Kraft Mode（模式）安装
1、容器启动Kafka

- 下载镜像

下载一体化官方镜像
  
  1. $ docker pull confluentinc/cp-kafka:7.0.1
复制代码
windows下载镜像（内网安装）方式见作者其他docker安装其他组件的文章，如：docker安装MySQL8:docker离线安装MySQL、docker在线安装MySQL、MySQL镜像下载、MySQL配置、MySQL下令-CSDN博客 
-  创建 Docker 网络

  1. docker network create kafka-network
  3. # docker查看所有网络
  4. docker network ls
复制代码


- (Kraft模式)利用镜像启动容器

  
  1. docker run -d \
  2.   --name=kafka \
  3.   --network=kafka-network \
  4.   -e KAFKA_KRAFT_MODE=true \
  5.   -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092 \
  6.   -v $(pwd)/kafka.properties:/etc/kafka/kafka.properties \
  7.   -e KAFKA_CONFIG_FILE=/etc/kafka/kafka.properties \
  8.   -p 2181:2181 \
  9.   -p 9092:9092 \
  10.   -p 19092:19092 \
  11.   confluentinc/cp-kafka:7.0.1
复制代码
这条下令的各个部分功能如下：

#   ***********  ～～～～～   重点：上面的下令很多版本不好使   ～～～～～   **********
下面的下令针对3.8.1亲测可用，没错Kraft 就是这么简单，启动成功就完事了，就有服务了～
  1. docker run \
  2.  --name=smet-kafka \
  3.  -v /data1/kafka/docker-kafka/log:/kafka-logs \
  4.  -p 19092:9092 \
  5.  -p 19093:9093 \
  6.  -d 1756e53f57e1
复制代码
按官方的说法，不增长任何配置，也可以直接启动

  1. [docker@GZ***-PM153160 ~]$ docker images
  2. REPOSITORY                                 TAG       IMAGE ID       CREATED        SIZE
  3. apache/kafka                               3.8.1     1756e53f57e1   3 months ago   385MB
复制代码
  1. [docker@GZ***-PM153160 ~]$ docker run -p 9092:9092 c2b75a96e17e
  2. ZooKeeper JMX enabled by default
  3. Using config: /conf/zoo.cfg
  4. 2025-01-27 03:55:46,842 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@177] - Reading configuration from: /conf/zoo.cfg
  5. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@431] - clientPort is not set
  6. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@444] - secureClientPort is not set
  7. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@460] - observerMasterPort is not set
  8. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@477] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
  9. 2025-01-27 03:55:46,851 [myid:] - ERROR [main:o.a.z.s.q.QuorumPeerConfig@702] - Invalid configuration, only one server specified (ignoring)
  10. 2025-01-27 03:55:46,852 [myid:1] - INFO  [main:o.a.z.s.DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
  11. 2025-01-27 03:55:46,852 [myid:1] - INFO  [main:o.a.z.s.DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
  12. 2025-01-27 03:55:46,852 [myid:1] - INFO  [main:o.a.z.s.DatadirCleanupManager@101] - Purge task is not scheduled.
  13. 2025-01-27 03:55:46,853 [myid:1] - WARN  [main:o.a.z.s.q.QuorumPeerMain@139] - Either no config or no quorum defined in config, running in standalone mode
  14. 2025-01-27 03:55:46,854 [myid:1] - INFO  [main:o.a.z.j.ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled.
  15. 2025-01-27 03:55:46,854 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@177] - Reading configuration from: /conf/zoo.cfg
  16. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@431] - clientPort is not set
  17. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@444] - secureClientPort is not set
  18. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@460] - observerMasterPort is not set
  19. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@477] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
  20. 2025-01-27 03:55:46,855 [myid:1] - ERROR [main:o.a.z.s.q.QuorumPeerConfig@702] - Invalid configuration, only one server specified (ignoring)
  21. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServerMain@123] - Starting server
  22. 2025-01-27 03:55:46,865 [myid:1] - INFO  [main:o.a.z.s.ServerMetrics@64] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@4550bb58
  23. 2025-01-27 03:55:46,867 [myid:1] - INFO  [main:o.a.z.s.a.DigestAuthenticationProvider@51] - ACL digest algorithm is: SHA1
  24. 2025-01-27 03:55:46,867 [myid:1] - INFO  [main:o.a.z.s.a.DigestAuthenticationProvider@65] - zookeeper.DigestAuthenticationProvider.enabled = true
  25. 2025-01-27 03:55:46,869 [myid:1] - INFO  [main:o.a.z.s.p.FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : false
  26. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -
  27. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -   ______                  _                                          
  28. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -  |___  /                 | |                                         
  29. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -     / /    ___     ___   | | __   ___    ___   _ __     ___   _ __   
  30. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -    / /    / _ \   / _ \  | |/ /  / _ \  / _ \ | '_ \   / _ \ | '__|
  31. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -   / /__  | (_) | | (_) | |   <  |  __/ |  __/ | |_) | |  __/ | |   
  32. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -  /_____|  \___/   \___/  |_|\_\  \___|  \___| | .__/   \___| |_|
  33. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -                                               | |                     
  34. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -                                               |_|                     
  35. 2025-01-27 03:55:46,878 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -
  36. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:zookeeper.version=3.9.3-c26634f34490bb0ea7a09cc51e05ede3b4e320ee, built on 2024-10-17 23:21 UTC
  37. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:host.name=501da54a316f
  38. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.version=17.0.13
  39. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.vendor=Eclipse Adoptium
  40. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.home=/opt/java/openjdk
  41. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.9.3-bin/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/classes:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.9.3-bin/bin/../build/classes:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/lib/*.jar:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.9.3-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/zookeeper-prometheus-metrics-3.9.3.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/zookeeper-jute-3.9.3.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/zookeeper-3.9.3.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/snappy-java-1.1.10.5.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/slf4j-api-1.7.30.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-native-unix-common-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-classes-epoll-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-classes-2.0.66.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-windows-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-osx-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-osx-aarch_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-linux-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-linux-aarch_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-resolver-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-handler-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-common-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-codec-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-buffer-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/logback-core-1.2.13.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/logback-classic-1.2.13.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-util-ajax-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-util-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-servlet-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-server-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-security-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-io-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-http-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jackson-databind-2.15.2.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jackson-core-2.15.2.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jackson-annotations-2.15.2.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/commons-io-2.17.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/commons-cli-1.5.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf:
  42. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
  43. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.io.tmpdir=/tmp
  44. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.compiler=<NA>
  45. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.name=Linux
  46. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.arch=amd64
  47. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.version=4.19.90-2102.2.0.0062.ctl2.x86_64
  48. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:user.name=zookeeper
  49. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:user.home=/home/zookeeper
  50. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:user.dir=/apache-zookeeper-3.9.3-bin
  51. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.memory.free=981MB
  52. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.memory.max=1000MB
  53. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.memory.total=1000MB
  54. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@149] - zookeeper.enableEagerACLCheck = false
  55. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@162] - zookeeper.digest.enabled = true
  56. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@166] - zookeeper.closeSessionTxn.enabled = true
  57. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@2242] - zookeeper.serializeLastProcessedZxid.enabled = true
  58. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1585] - zookeeper.flushDelay = 0 ms
  59. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1594] - zookeeper.maxWriteQueuePollTime = 0 ms
  60. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1603] - zookeeper.maxBatchSize=1000
  61. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@287] - zookeeper.intBufferStartingSizeBytes = 1024
  62. 2025-01-27 03:55:46,882 [myid:1] - INFO  [main:o.a.z.s.BlueThrottle@141] - Weighed connection throttling is disabled
  63. 2025-01-27 03:55:46,882 [myid:1] - INFO  [main:o.a.z.s.AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false
  64. 2025-01-27 03:55:46,883 [myid:1] - INFO  [main:o.a.z.s.AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = []
  65. 2025-01-27 03:55:46,883 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1395] - minSessionTimeout set to 4000 ms
  66. 2025-01-27 03:55:46,883 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1404] - maxSessionTimeout set to 40000 ms
  67. 2025-01-27 03:55:46,884 [myid:1] - INFO  [main:o.a.z.s.ResponseCache@45] - getData response cache size is initialized with value 400.
  68. 2025-01-27 03:55:46,885 [myid:1] - INFO  [main:o.a.z.s.ResponseCache@45] - getChildren response cache size is initialized with value 400.
  69. 2025-01-27 03:55:46,885 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60
  70. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15
  71. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6
  72. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5
  73. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5
  74. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false
  75. 2025-01-27 03:55:46,888 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1622] - The max bytes for all large requests are set to 104857600
  76. 2025-01-27 03:55:46,888 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1636] - The large request threshold is set to -1
  77. 2025-01-27 03:55:46,888 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@385] - Created server with tickTime 2000 ms minSessionTimeout 4000 ms maxSessionTimeout 40000 ms clientPortListenBacklog -1 dataLogdir /datalog/version-2 snapdir /data/version-2
  78. 2025-01-27 03:55:46,905 [myid:1] - INFO  [main:o.e.j.u.l.Log@170] - Logging initialized @481ms to org.eclipse.jetty.util.log.Slf4jLog
  79. 2025-01-27 03:55:46,961 [myid:1] - WARN  [main:o.e.j.s.h.ContextHandler@1662] - o.e.j.s.ServletContextHandler@52af26ee{/,null,STOPPED} contextPath ends with /*
  80. 2025-01-27 03:55:46,961 [myid:1] - WARN  [main:o.e.j.s.h.ContextHandler@1673] - Empty contextPath
  81. 2025-01-27 03:55:46,978 [myid:1] - INFO  [main:o.e.j.s.Server@375] - jetty-9.4.56.v20240826; built: 2024-08-26T17:15:05.868Z; git: ec6782ff5ead824dabdcf47fa98f90a4aedff401; jvm 17.0.13+11
  82. 2025-01-27 03:55:47,001 [myid:1] - INFO  [main:o.e.j.s.s.DefaultSessionIdManager@334] - DefaultSessionIdManager workerName=node0
  83. 2025-01-27 03:55:47,001 [myid:1] - INFO  [main:o.e.j.s.s.DefaultSessionIdManager@339] - No SessionScavenger set, using defaults
  84. 2025-01-27 03:55:47,002 [myid:1] - INFO  [main:o.e.j.s.s.HouseKeeper@132] - node0 Scavenging every 660000ms
  85. 2025-01-27 03:55:47,006 [myid:1] - WARN  [main:o.e.j.s.ConstraintSecurityHandler@759] - ServletContext@o.e.j.s.ServletContextHandler@52af26ee{/,null,STARTING} has uncovered http methods for path: /*
  86. 2025-01-27 03:55:47,015 [myid:1] - INFO  [main:o.e.j.s.h.ContextHandler@921] - Started o.e.j.s.ServletContextHandler@52af26ee{/,null,AVAILABLE}
  87. 2025-01-27 03:55:47,027 [myid:1] - INFO  [main:o.e.j.s.AbstractConnector@333] - Started ServerConnector@67080771{HTTP/1.1, (http/1.1)}{0.0.0.0:8080}
  88. 2025-01-27 03:55:47,027 [myid:1] - INFO  [main:o.e.j.s.Server@415] - Started @603ms
  89. 2025-01-27 03:55:47,027 [myid:1] - INFO  [main:o.a.z.s.a.JettyAdminServer@201] - Started AdminServer on address 0.0.0.0, port 8080 and command URL /commands
  90. 2025-01-27 03:55:47,031 [myid:1] - INFO  [main:o.a.z.s.ServerCnxnFactory@172] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
  91. 2025-01-27 03:55:47,032 [myid:1] - WARN  [main:o.a.z.s.ServerCnxnFactory@337] - maxCnxns is not configured, using default value 0.
  92. 2025-01-27 03:55:47,033 [myid:1] - INFO  [main:o.a.z.s.NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 4 selector thread(s), 80 worker threads, and 64 kB direct buffers.
  93. 2025-01-27 03:55:47,034 [myid:1] - INFO  [main:o.a.z.s.NIOServerCnxnFactory@660] - binding to port /0.0.0.0:2181
  94. 2025-01-27 03:55:47,045 [myid:1] - INFO  [main:o.a.z.s.w.WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
  95. 2025-01-27 03:55:47,046 [myid:1] - INFO  [main:o.a.z.s.w.WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
  96. 2025-01-27 03:55:47,046 [myid:1] - INFO  [main:o.a.z.s.ZKDatabase@134] - zookeeper.snapshotSizeFactor = 0.33
  97. 2025-01-27 03:55:47,046 [myid:1] - INFO  [main:o.a.z.s.ZKDatabase@154] - zookeeper.commitLogCount=500
  98. 2025-01-27 03:55:47,051 [myid:1] - INFO  [main:o.a.z.s.p.SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED
  99. 2025-01-27 03:55:47,051 [myid:1] - INFO  [main:o.a.z.s.p.FileTxnSnapLog@480] - Snapshotting: 0x0 to /data/version-2/snapshot.0
  100. 2025-01-27 03:55:47,054 [myid:1] - INFO  [main:o.a.z.s.ZKDatabase@291] - Snapshot loaded in 8 ms, highest zxid is 0x0, digest is 1371985504
  101. 2025-01-27 03:55:47,055 [myid:1] - INFO  [main:o.a.z.s.p.FileTxnSnapLog@480] - Snapshotting: 0x0 to /data/version-2/snapshot.0
  102. 2025-01-27 03:55:47,055 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@589] - Snapshot taken in 0 ms
  103. 2025-01-27 03:55:47,062 [myid:] - INFO  [ProcessThread(sid:0 cport:2181)::o.a.z.s.PrepRequestProcessor@138] - PrepRequestProcessor (sid:0) started, reconfigEnabled=false
  104. 2025-01-27 03:55:47,062 [myid:1] - INFO  [main:o.a.z.s.RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 ms
  105. 2025-01-27 03:55:47,076 [myid:1] - INFO  [main:o.a.z.s.ContainerManager@83] - Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0
  106. 2025-01-27 03:55:47,077 [myid:1] - INFO  [main:o.a.z.a.ZKAuditProvider@42] - ZooKeeper audit is disabled.
复制代码

五、k8s方式安装

k8s环境容器化Kraft Mode（模式）安装
1、容器启动Kafka

 - 创建ConfigMap资源

用于界说Kafka配置
  1. apiVersion: v1
  2. kind: ConfigMap
  3. metadata:
  4.   name: kafka-config
  5. data:
  6.   config.properties: |
  7.     process.roles=broker
  8.     node.id=1
  9.     listeners=PLAINTEXT://:9092
  10.     inter.broker.listener.name=PLAINTEXT
  11.     ...
复制代码
- 创建Deployment资源

用于部署Kafka Pod
  1. apiVersion: apps/v1
  2. kind: Deployment
  3. metadata:
  4.   name: kafka-deployment
  5. spec:
  6.   replicas: 3
  7.   selector:
  8.     matchLabels:
  9.       app: kafka
  10.   template:
  11.     metadata:
  12.       labels:
  13.         app: kafka
  14.     spec:
  15.       containers:
  16.         - name: kafka
  17.           image: confluentinc/cp-kafka:7.0.1
  18.           ports:
  19.             - containerPort: 9092
  20.           env:
  21.             - name: CONFIG_FILE
  22.               value: "/etc/kafka/conf/config.properties"
  23.             ...
  24.           volumeMounts:
  25.             - name: config-volume
  26.               mountPath: /etc/kafka/conf
  27.       volumes:
  28.         - name: config-volume
  29.           configMap:
  30.             name: kafka-config
复制代码
- 创建Service资源

用于对外暴露Kafka服务
  1. apiVersion: v1
  2. kind: Service
  3. metadata:
  4.   name: kafka-service
  5. spec:
  6.   selector:
  7.     app: kafka
  8.   ports:
  9.     - protocol: TCP
  10.       port: 9092
  11.       targetPort: 9092
复制代码
- 应用到你的Kubernetes集群

这些YAML文件界说了Kafka的配置、部署和服务。你需要将它们生存为文件，然后利用kubectl 应用到你的Kubernetes集群
  1. kubectl apply -f configmap.yaml
  2. kubectl apply -f deployment.yaml
  3. kubectl apply -f service.yaml
复制代码
- （或）利用镜像启动容器

  
  1. # 假设打好的镜像id是fe7e6a65afa5
  2. docker run \
  3. --name=cp-kafka \
  4. -p 2181:2181 \
  5. -p 9092:9092 \
  6. -p 19092:19092 \
  7. -d fe7e6a65afa5
复制代码

六、要点总结

      - Zookeeper Mode利用的配置是$KFAKA_HOME/config/server.properties
      - Kraft Mode利用的配置是$KFAKA_HOME/config/kraft/server.properties
      - Zookeeper Mode启动见作者的文章：Zookeeper模式安装Kafka

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。



欢迎光临 ToB企服应用市场:ToB评测及商务社交产业平台 (https://dis.qidao123.com/) Powered by Discuz! X3.4