Kraft模式安装Kafka（含常规、容器两种安装方式）、Kafka镜像下载 ...

 一、#创作灵感#

公司利用Kafka的软件项目较多，故写技术条记巩固知识要点
二、软件环境

- Kafka 3.9.0  官方下载地点：Kafka 3.9.0
- Docker Desktop 4.37 容器图形化工具  官方下载地点：Docker Desktop 4.37
特别说明
- Docker Desktop仅仅是Windows下镜像用，如有能爬楼的服务器可不安装此软件
- 本文以单机模式为例
三、常规方式安装

非容器化Kraft Mode（模式）安装
1、下载Kafka

参见上面的软件环境章节的下载地点
2、修改Kafka配置

# Kraft模式启动
vi $KAFKA_HOME/config/kraft/server.properties
关键设置包罗

1. # 指定此节点是否应该成为控制平面的一部分
2. process.roles=controller,kafka
4. # KRaft模式下的节点ID，每个节点的ID必须唯一
5. node.id=1
7. # 监听器地址，用于集群内通信
8. listeners=PLAINTEXT://localhost:9092
10. # 控制平面监听器地址
11. controller.listeners=PLAINTEXT://localhost:9090
13. # 用于集群通信的安全协议以及相关的认证和授权配置
14. inter.broker.listener.name=CONTROLLER
16. # 控制平面的ADVERTISED.LISTENERS，用于其他节点发现
17. controller.listener.names=CONTROLLER
18. controller.advertised.listeners=PLAINTEXT://localhost:9090
20. # 用于KRaft模式的元数据复制因子，通常设置为集群中控制器的数量
21. metadata.max.age=300000
23. # 日志存储配置，指定日志的位置和格式
24. log.dirs=/tmp/kraft-logs
25. log.retention.hours=168
27. # 控制平面的选举配置和集群成员配置
28. control.plane.listener.name=CONTROLLER
29. control.plane.advertised.listeners=PLAINTEXT://localhost:9090
31. # 集群的初始/bootstrap状态
32. process.roles=controller
33. node.id=1
34. listeners=CONTROLLER://localhost:9090
35. inter.broker.listener.name=CONTROLLER

复制代码

3、Kraft模式启动Kafka

  

1. # Start the Kafka broker service
2. $ bin/kafka-server-start.sh config/kraft/server.properties

复制代码

四、docker方式安装

容器化Kraft Mode（模式）安装
1、容器启动Kafka

- 下载镜像

下载一体化官方镜像
  

1. $ docker pull confluentinc/cp-kafka:7.0.1

复制代码

windows下载镜像（内网安装）方式见作者其他docker安装其他组件的文章，如：docker安装MySQL8:docker离线安装MySQL、docker在线安装MySQL、MySQL镜像下载、MySQL配置、MySQL下令-CSDN博客 
-  创建 Docker 网络

1. docker network create kafka-network
3. # docker查看所有网络
4. docker network ls

复制代码

- (Kraft模式)利用镜像启动容器

  

1. docker run -d \
2.   --name=kafka \
3.   --network=kafka-network \
4.   -e KAFKA_KRAFT_MODE=true \
5.   -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092 \
6.   -v $(pwd)/kafka.properties:/etc/kafka/kafka.properties \
7.   -e KAFKA_CONFIG_FILE=/etc/kafka/kafka.properties \
8.   -p 2181:2181 \
9.   -p 9092:9092 \
10.   -p 19092:19092 \
11.   confluentinc/cp-kafka:7.0.1

复制代码

这条下令的各个部分功能如下：

• -d: 在背景运行容器。
  
• --name=cp-kafka: 为容器命名为的cp-kafka。
  
• --network=kafka-network: 将容器连接到之前创建的网络。
  
• -e KAFKA_KRAFT_MODE=true: 启用KRaft模式。
  
• -e KAFKA_LISTENERS=PLAINTEXT://0.0.0.0:9092: 设置监听地点。
  
• -v $(pwd)/kafka.properties:/etc/kafka/kafka.properties: 将工作目录下的kafka.properties文件挂载到容器中。
  
• -e KAFKA_CONFIG_FILE=/etc/kafka/kafka.properties: 指定利用的Kafka配置文件。
  
• confluentinc/cp-kafka:latest: 利用最新的Confluent Kafka镜像。
  
• -p 做端口映射
  

#   ***********  ～～～～～   重点：上面的下令很多版本不好使   ～～～～～   **********
下面的下令针对3.8.1亲测可用，没错Kraft 就是这么简单，启动成功就完事了，就有服务了～

1. docker run \
2.  --name=smet-kafka \
3.  -v /data1/kafka/docker-kafka/log:/kafka-logs \
4.  -p 19092:9092 \
5.  -p 19093:9093 \
6.  -d 1756e53f57e1

复制代码

按官方的说法，不增长任何配置，也可以直接启动

1. [docker@GZ***-PM153160 ~]$ docker images
2. REPOSITORY                                 TAG       IMAGE ID       CREATED        SIZE
3. apache/kafka                               3.8.1     1756e53f57e1   3 months ago   385MB

复制代码

1. [docker@GZ***-PM153160 ~]$ docker run -p 9092:9092 c2b75a96e17e
2. ZooKeeper JMX enabled by default
3. Using config: /conf/zoo.cfg
4. 2025-01-27 03:55:46,842 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@177] - Reading configuration from: /conf/zoo.cfg
5. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@431] - clientPort is not set
6. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@444] - secureClientPort is not set
7. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@460] - observerMasterPort is not set
8. 2025-01-27 03:55:46,845 [myid:] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@477] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
9. 2025-01-27 03:55:46,851 [myid:] - ERROR [main:o.a.z.s.q.QuorumPeerConfig@702] - Invalid configuration, only one server specified (ignoring)
10. 2025-01-27 03:55:46,852 [myid:1] - INFO  [main:o.a.z.s.DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3
11. 2025-01-27 03:55:46,852 [myid:1] - INFO  [main:o.a.z.s.DatadirCleanupManager@79] - autopurge.purgeInterval set to 0
12. 2025-01-27 03:55:46,852 [myid:1] - INFO  [main:o.a.z.s.DatadirCleanupManager@101] - Purge task is not scheduled.
13. 2025-01-27 03:55:46,853 [myid:1] - WARN  [main:o.a.z.s.q.QuorumPeerMain@139] - Either no config or no quorum defined in config, running in standalone mode
14. 2025-01-27 03:55:46,854 [myid:1] - INFO  [main:o.a.z.j.ManagedUtil@46] - Log4j 1.2 jmx support not found; jmx disabled.
15. 2025-01-27 03:55:46,854 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@177] - Reading configuration from: /conf/zoo.cfg
16. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@431] - clientPort is not set
17. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@444] - secureClientPort is not set
18. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@460] - observerMasterPort is not set
19. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.q.QuorumPeerConfig@477] - metricsProvider.className is org.apache.zookeeper.metrics.impl.DefaultMetricsProvider
20. 2025-01-27 03:55:46,855 [myid:1] - ERROR [main:o.a.z.s.q.QuorumPeerConfig@702] - Invalid configuration, only one server specified (ignoring)
21. 2025-01-27 03:55:46,855 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServerMain@123] - Starting server
22. 2025-01-27 03:55:46,865 [myid:1] - INFO  [main:o.a.z.s.ServerMetrics@64] - ServerMetrics initialized with provider org.apache.zookeeper.metrics.impl.DefaultMetricsProvider@4550bb58
23. 2025-01-27 03:55:46,867 [myid:1] - INFO  [main:o.a.z.s.a.DigestAuthenticationProvider@51] - ACL digest algorithm is: SHA1
24. 2025-01-27 03:55:46,867 [myid:1] - INFO  [main:o.a.z.s.a.DigestAuthenticationProvider@65] - zookeeper.DigestAuthenticationProvider.enabled = true
25. 2025-01-27 03:55:46,869 [myid:1] - INFO  [main:o.a.z.s.p.FileTxnSnapLog@124] - zookeeper.snapshot.trust.empty : false
26. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -
27. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -   ______                  _                                          
28. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -  |___  /                 | |                                         
29. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -     / /    ___     ___   | | __   ___    ___   _ __     ___   _ __   
30. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -    / /    / _ \   / _ \  | |/ /  / _ \  / _ \ | '_ \   / _ \ | '__|
31. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -   / /__  | (_) | | (_) | |   <  |  __/ |  __/ | |_) | |  __/ | |   
32. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -  /_____|  \___/   \___/  |_|\_\  \___|  \___| | .__/   \___| |_|
33. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -                                               | |                     
34. 2025-01-27 03:55:46,877 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -                                               |_|                     
35. 2025-01-27 03:55:46,878 [myid:1] - INFO  [main:o.a.z.ZookeeperBanner@42] -
36. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:zookeeper.version=3.9.3-c26634f34490bb0ea7a09cc51e05ede3b4e320ee, built on 2024-10-17 23:21 UTC
37. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:host.name=501da54a316f
38. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.version=17.0.13
39. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.vendor=Eclipse Adoptium
40. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.home=/opt/java/openjdk
41. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.class.path=/apache-zookeeper-3.9.3-bin/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/classes:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-server/target/classes:/apache-zookeeper-3.9.3-bin/bin/../build/classes:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-metrics-providers/zookeeper-prometheus-metrics/target/lib/*.jar:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-server/target/lib/*.jar:/apache-zookeeper-3.9.3-bin/bin/../build/lib/*.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/zookeeper-prometheus-metrics-3.9.3.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/zookeeper-jute-3.9.3.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/zookeeper-3.9.3.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/snappy-java-1.1.10.5.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/slf4j-api-1.7.30.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient_servlet-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient_hotspot-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient_common-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/simpleclient-0.9.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-native-unix-common-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-native-epoll-4.1.113.Final-linux-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-classes-epoll-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-transport-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-classes-2.0.66.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-windows-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-osx-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-osx-aarch_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-linux-x86_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final-linux-aarch_64.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-tcnative-boringssl-static-2.0.66.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-resolver-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-handler-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-common-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-codec-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/netty-buffer-4.1.113.Final.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/metrics-core-4.1.12.1.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/logback-core-1.2.13.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/logback-classic-1.2.13.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jline-2.14.6.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-util-ajax-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-util-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-servlet-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-server-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-security-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-io-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jetty-http-9.4.56.v20240826.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/javax.servlet-api-3.1.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jackson-databind-2.15.2.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jackson-core-2.15.2.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/jackson-annotations-2.15.2.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/commons-io-2.17.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/commons-cli-1.5.0.jar:/apache-zookeeper-3.9.3-bin/bin/../lib/audience-annotations-0.12.0.jar:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-*.jar:/apache-zookeeper-3.9.3-bin/bin/../zookeeper-server/src/main/resources/lib/*.jar:/conf:
42. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib
43. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.io.tmpdir=/tmp
44. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:java.compiler=<NA>
45. 2025-01-27 03:55:46,879 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.name=Linux
46. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.arch=amd64
47. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.version=4.19.90-2102.2.0.0062.ctl2.x86_64
48. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:user.name=zookeeper
49. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:user.home=/home/zookeeper
50. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:user.dir=/apache-zookeeper-3.9.3-bin
51. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.memory.free=981MB
52. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.memory.max=1000MB
53. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.Environment@98] - Server environment:os.memory.total=1000MB
54. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@149] - zookeeper.enableEagerACLCheck = false
55. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@162] - zookeeper.digest.enabled = true
56. 2025-01-27 03:55:46,880 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@166] - zookeeper.closeSessionTxn.enabled = true
57. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@2242] - zookeeper.serializeLastProcessedZxid.enabled = true
58. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1585] - zookeeper.flushDelay = 0 ms
59. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1594] - zookeeper.maxWriteQueuePollTime = 0 ms
60. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1603] - zookeeper.maxBatchSize=1000
61. 2025-01-27 03:55:46,881 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@287] - zookeeper.intBufferStartingSizeBytes = 1024
62. 2025-01-27 03:55:46,882 [myid:1] - INFO  [main:o.a.z.s.BlueThrottle@141] - Weighed connection throttling is disabled
63. 2025-01-27 03:55:46,882 [myid:1] - INFO  [main:o.a.z.s.AuthenticationHelper@66] - zookeeper.enforce.auth.enabled = false
64. 2025-01-27 03:55:46,883 [myid:1] - INFO  [main:o.a.z.s.AuthenticationHelper@67] - zookeeper.enforce.auth.schemes = []
65. 2025-01-27 03:55:46,883 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1395] - minSessionTimeout set to 4000 ms
66. 2025-01-27 03:55:46,883 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1404] - maxSessionTimeout set to 40000 ms
67. 2025-01-27 03:55:46,884 [myid:1] - INFO  [main:o.a.z.s.ResponseCache@45] - getData response cache size is initialized with value 400.
68. 2025-01-27 03:55:46,885 [myid:1] - INFO  [main:o.a.z.s.ResponseCache@45] - getChildren response cache size is initialized with value 400.
69. 2025-01-27 03:55:46,885 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@109] - zookeeper.pathStats.slotCapacity = 60
70. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@110] - zookeeper.pathStats.slotDuration = 15
71. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@111] - zookeeper.pathStats.maxDepth = 6
72. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@112] - zookeeper.pathStats.initialDelay = 5
73. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@113] - zookeeper.pathStats.delay = 5
74. 2025-01-27 03:55:46,886 [myid:1] - INFO  [main:o.a.z.s.u.RequestPathMetricsCollector@114] - zookeeper.pathStats.enabled = false
75. 2025-01-27 03:55:46,888 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1622] - The max bytes for all large requests are set to 104857600
76. 2025-01-27 03:55:46,888 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@1636] - The large request threshold is set to -1
77. 2025-01-27 03:55:46,888 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@385] - Created server with tickTime 2000 ms minSessionTimeout 4000 ms maxSessionTimeout 40000 ms clientPortListenBacklog -1 dataLogdir /datalog/version-2 snapdir /data/version-2
78. 2025-01-27 03:55:46,905 [myid:1] - INFO  [main:o.e.j.u.l.Log@170] - Logging initialized @481ms to org.eclipse.jetty.util.log.Slf4jLog
79. 2025-01-27 03:55:46,961 [myid:1] - WARN  [main:o.e.j.s.h.ContextHandler@1662] - o.e.j.s.ServletContextHandler@52af26ee{/,null,STOPPED} contextPath ends with /*
80. 2025-01-27 03:55:46,961 [myid:1] - WARN  [main:o.e.j.s.h.ContextHandler@1673] - Empty contextPath
81. 2025-01-27 03:55:46,978 [myid:1] - INFO  [main:o.e.j.s.Server@375] - jetty-9.4.56.v20240826; built: 2024-08-26T17:15:05.868Z; git: ec6782ff5ead824dabdcf47fa98f90a4aedff401; jvm 17.0.13+11
82. 2025-01-27 03:55:47,001 [myid:1] - INFO  [main:o.e.j.s.s.DefaultSessionIdManager@334] - DefaultSessionIdManager workerName=node0
83. 2025-01-27 03:55:47,001 [myid:1] - INFO  [main:o.e.j.s.s.DefaultSessionIdManager@339] - No SessionScavenger set, using defaults
84. 2025-01-27 03:55:47,002 [myid:1] - INFO  [main:o.e.j.s.s.HouseKeeper@132] - node0 Scavenging every 660000ms
85. 2025-01-27 03:55:47,006 [myid:1] - WARN  [main:o.e.j.s.ConstraintSecurityHandler@759] - ServletContext@o.e.j.s.ServletContextHandler@52af26ee{/,null,STARTING} has uncovered http methods for path: /*
86. 2025-01-27 03:55:47,015 [myid:1] - INFO  [main:o.e.j.s.h.ContextHandler@921] - Started o.e.j.s.ServletContextHandler@52af26ee{/,null,AVAILABLE}
87. 2025-01-27 03:55:47,027 [myid:1] - INFO  [main:o.e.j.s.AbstractConnector@333] - Started ServerConnector@67080771{HTTP/1.1, (http/1.1)}{0.0.0.0:8080}
88. 2025-01-27 03:55:47,027 [myid:1] - INFO  [main:o.e.j.s.Server@415] - Started @603ms
89. 2025-01-27 03:55:47,027 [myid:1] - INFO  [main:o.a.z.s.a.JettyAdminServer@201] - Started AdminServer on address 0.0.0.0, port 8080 and command URL /commands
90. 2025-01-27 03:55:47,031 [myid:1] - INFO  [main:o.a.z.s.ServerCnxnFactory@172] - Using org.apache.zookeeper.server.NIOServerCnxnFactory as server connection factory
91. 2025-01-27 03:55:47,032 [myid:1] - WARN  [main:o.a.z.s.ServerCnxnFactory@337] - maxCnxns is not configured, using default value 0.
92. 2025-01-27 03:55:47,033 [myid:1] - INFO  [main:o.a.z.s.NIOServerCnxnFactory@652] - Configuring NIO connection handler with 10s sessionless connection timeout, 4 selector thread(s), 80 worker threads, and 64 kB direct buffers.
93. 2025-01-27 03:55:47,034 [myid:1] - INFO  [main:o.a.z.s.NIOServerCnxnFactory@660] - binding to port /0.0.0.0:2181
94. 2025-01-27 03:55:47,045 [myid:1] - INFO  [main:o.a.z.s.w.WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
95. 2025-01-27 03:55:47,046 [myid:1] - INFO  [main:o.a.z.s.w.WatchManagerFactory@42] - Using org.apache.zookeeper.server.watch.WatchManager as watch manager
96. 2025-01-27 03:55:47,046 [myid:1] - INFO  [main:o.a.z.s.ZKDatabase@134] - zookeeper.snapshotSizeFactor = 0.33
97. 2025-01-27 03:55:47,046 [myid:1] - INFO  [main:o.a.z.s.ZKDatabase@154] - zookeeper.commitLogCount=500
98. 2025-01-27 03:55:47,051 [myid:1] - INFO  [main:o.a.z.s.p.SnapStream@61] - zookeeper.snapshot.compression.method = CHECKED
99. 2025-01-27 03:55:47,051 [myid:1] - INFO  [main:o.a.z.s.p.FileTxnSnapLog@480] - Snapshotting: 0x0 to /data/version-2/snapshot.0
100. 2025-01-27 03:55:47,054 [myid:1] - INFO  [main:o.a.z.s.ZKDatabase@291] - Snapshot loaded in 8 ms, highest zxid is 0x0, digest is 1371985504
101. 2025-01-27 03:55:47,055 [myid:1] - INFO  [main:o.a.z.s.p.FileTxnSnapLog@480] - Snapshotting: 0x0 to /data/version-2/snapshot.0
102. 2025-01-27 03:55:47,055 [myid:1] - INFO  [main:o.a.z.s.ZooKeeperServer@589] - Snapshot taken in 0 ms
103. 2025-01-27 03:55:47,062 [myid:] - INFO  [ProcessThread(sid:0 cport:2181)::o.a.z.s.PrepRequestProcessor@138] - PrepRequestProcessor (sid:0) started, reconfigEnabled=false
104. 2025-01-27 03:55:47,062 [myid:1] - INFO  [main:o.a.z.s.RequestThrottler@75] - zookeeper.request_throttler.shutdownTimeout = 10000 ms
105. 2025-01-27 03:55:47,076 [myid:1] - INFO  [main:o.a.z.s.ContainerManager@83] - Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0
106. 2025-01-27 03:55:47,077 [myid:1] - INFO  [main:o.a.z.a.ZKAuditProvider@42] - ZooKeeper audit is disabled.

复制代码

五、k8s方式安装

k8s环境容器化Kraft Mode（模式）安装
1、容器启动Kafka

 - 创建ConfigMap资源

用于界说Kafka配置

1. apiVersion: v1
2. kind: ConfigMap
3. metadata:
4.   name: kafka-config
5. data:
6.   config.properties: |
7.     process.roles=broker
8.     node.id=1
9.     listeners=PLAINTEXT://:9092
10.     inter.broker.listener.name=PLAINTEXT
11.     ...

复制代码

- 创建Deployment资源

用于部署Kafka Pod

1. apiVersion: apps/v1
2. kind: Deployment
3. metadata:
4.   name: kafka-deployment
5. spec:
6.   replicas: 3
7.   selector:
8.     matchLabels:
9.       app: kafka
10.   template:
11.     metadata:
12.       labels:
13.         app: kafka
14.     spec:
15.       containers:
16.         - name: kafka
17.           image: confluentinc/cp-kafka:7.0.1
18.           ports:
19.             - containerPort: 9092
20.           env:
21.             - name: CONFIG_FILE
22.               value: "/etc/kafka/conf/config.properties"
23.             ...
24.           volumeMounts:
25.             - name: config-volume
26.               mountPath: /etc/kafka/conf
27.       volumes:
28.         - name: config-volume
29.           configMap:
30.             name: kafka-config

复制代码

- 创建Service资源

用于对外暴露Kafka服务

1. apiVersion: v1
2. kind: Service
3. metadata:
4.   name: kafka-service
5. spec:
6.   selector:
7.     app: kafka
8.   ports:
9.     - protocol: TCP
10.       port: 9092
11.       targetPort: 9092

复制代码

- 应用到你的Kubernetes集群

这些YAML文件界说了Kafka的配置、部署和服务。你需要将它们生存为文件，然后利用kubectl 应用到你的Kubernetes集群

1. kubectl apply -f configmap.yaml
2. kubectl apply -f deployment.yaml
3. kubectl apply -f service.yaml

复制代码

- （或）利用镜像启动容器

  

1. # 假设打好的镜像id是fe7e6a65afa5
2. docker run \
3. --name=cp-kafka \
4. -p 2181:2181 \
5. -p 9092:9092 \
6. -p 19092:19092 \
7. -d fe7e6a65afa5

复制代码

六、要点总结

      - Zookeeper Mode利用的配置是$KFAKA_HOME/config/server.properties
      - Kraft Mode利用的配置是$KFAKA_HOME/config/kraft/server.properties
      - Zookeeper Mode启动见作者的文章：Zookeeper模式安装Kafka

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。