ToB企服应用市场:ToB评测及商务社交产业平台

标题: Kettle集群搭建与配置 [打印本页]

作者: 杀鸡焉用牛刀 时间: 2024-9-21 03:47
标题: Kettle集群搭建与配置
1、环境预备

1.1、环境信息

1.1.1、使用系统

版本：
名称环境Ipkettle(主)Windows172.16.16.119kettle(从)Centos 7(64 位)172.16.16.127kettle(从)Centos 7(64 位)172.16.16.128 1.2、软件信息

1.2.1、版本信息

版本：
名称版本jdk-8u411-windows-x64.exe1.8.4pdi-ce-9.2.0.0-290.zip9.2.0jdk-8u411-linux-x64.tar.gz1.8.4webkitgtk-2.4.9-1.el7.x86_64.rpm2.4.9mysql-connector-java-8.0.25.jar8.0.25

1.3、软件获取

1.3.1、获取途径

百度网盘连接：链接：https://pan.baidu.com/s/1LqEhGNFTK4ptOl4ebd1f8w
提取码：uhbj
2、环境搭建

2.1、主机搭建

2.1.1、主机信息

2.1.2、Windows安装jdk

安装请参考：windows-jdk安装与配置_jdk-8u411-windows-x64.exe-CSDN博客。
2.1.3、Windows安装kettle

安装请参考：windows-kettle安装与配置_pdi-ce-9.2.0.0-290-CSDN博客。
按照2.1.2与2.1.3步调安装完成，自此主机搭建乐成。
2.2、从机搭建

2.2.1、从机信息

2.2.2、linux安装jdk

安装请参考：linux-java1.8安装与配置_linux 安装java1.8-CSDN博客。
2.2.3、linux安装kettle

安装请参考：linux-kettle环境搭建与配置-CSDN博客。
从机172.16.16.127按照2.2.2与2.2.3步调安装完成，自此从机172.16.16.127搭建乐成。
从机172.16.16.128按照2.2.2与2.2.3步调安装完成，自此从机172.16.16.128搭建乐成。
3、集群配置

3.1、主机配置

3.1.1、主机信息

3.1.2、配置内容

进入pwd目录，配置carte-config-master-8080.xml。

##172.16.16.119
<slave_config>
<!--
Document description...
- masters: You can list the slave servers to which this slave has to report back to.
If this is a master, we will contact the other masters to get a list of all the slaves in the cluster.
- report_to_masters : send a message to the defined masters to let them know we exist (Y/N)
- slaveserver : specify the slave server details of this carte instance.
IMPORTANT : the username and password specified here are used by the master instances to connect to this slave.
-->
<slaveserver>
<name>80</name>
<hostname>172.16.16.119</hostname>
<port>8081</port>
<master>Y</master>
</slaveserver>
</slave_config>

复制代码

3.2、从机配置

3.2.1、从机信息

3.2.2、配置内容

##172.16.16.127
<slave_config>
<!--
Document description...
- masters: You can list the slave servers to which this slave has to report back to.
If this is a master, we will contact the other masters to get a list of all the slaves in the cluster.
- report_to_masters : send a message to the defined masters to let them know we exist (Y/N)
- slaveserver : specify the slave server details of this carte instance.
IMPORTANT : the username and password specified here are used by the master instances to connect to this slave.
-->
<masters>
<slaveserver>
<name>80</name>
<hostname>172.16.16.119</hostname>
<port>8081</port>
<username>cluster</username>
<password>cluster</password>
<master>Y</master>
</slaveserver>
</masters>
<report_to_masters>Y</report_to_masters>
<slaveserver>
<name>81</name>
<hostname>172.16.16.127</hostname>
<port>8082</port>
<username>cluster01</username>
<password>cluster01</password>
<master>N</master>
</slaveserver>
</slave_config>

复制代码

##172.16.16.128
<slave_config>
<!--
Document description...
- masters: You can list the slave servers to which this slave has to report back to.
If this is a master, we will contact the other masters to get a list of all the slaves in the cluster.
- report_to_masters : send a message to the defined masters to let them know we exist (Y/N)
- slaveserver : specify the slave server details of this carte instance.
IMPORTANT : the username and password specified here are used by the master instances to connect to this slave.
-->
<masters>
<slaveserver>
<name>80</name>
<hostname>172.16.16.119</hostname>
<port>8081</port>
<username>cluster</username>
<password>cluster</password>
<master>Y</master>
</slaveserver>
</masters>
<report_to_masters>Y</report_to_masters>
<slaveserver>
<name>82</name>
<hostname>172.16.16.128</hostname>
<port>8083</port>
<username>cluster03</username>
<password>cluster03</password>
<master>N</master>
</slaveserver>
</slave_config>