kafka-manager搭建
kafka-manager管理多个kafka集群便捷的检查kafka集群状态选择要运行的副本为已存在的topic增加分区
·
前置准备
基础环境规划
JDK版本11.x
Kafka-manager端口19099
firewall-cmd --zone=public --add-port=19099/tcp --permanent
firewall-cmd --reload
1、kafka-manager安装
1.1 程序安装
上传cmak-3.0.0.5.zip至该目录下并解压
cd /usr/local
unzip x cmak-3.0.0.5.zip
mv cmak-3.0.0.5 kafka-manager
1.2 修改配置文件
kafka-manager.zkhosts和cmak.zkhosts改为自己的zookeeper服务器地址
vi /usr/local/kafka-manager/conf/application.conf
1.3 启动kafka-manager
cd /usr/local/kafka-manager
./bin/cmak -Dconfig.file=/usr/local/kafka-manager/conf/application.conf -java-home /usr/java/jdk-11.0.9 -Dhttp.port=19099
1.4 状态检查
curl http://172.27.10.71:19099/api/health
kafka-manager进程启动成功!
2、Web配置
2.1 添加cluster
点击Add Cluster
配置Cluster Zookeeper Hosts和Kafka Version
配置完成后,点击save!
至此,kafka-manager搭建成功!
3、配置kafka-manager自启动
3.1 创建文件启动脚本
cat >/usr/lib/systemd/system/kafka-manager.service <<EOF
[Unit]
Description=kafka-manager server service
After=network.target
[Service]
WorkingDirectory=/usr/local/kafka-manager/
ExecStart=/usr/local/kafka-manager/bin/cmak -Dconfig.file=/usr/local/kafka-manager/conf/application.conf -java-home /usr/java/jdk-11.0.9 -Dhttp.port=19099
Restart=on-failure
RestartSec=60
[Install]
WantedBy=multi-user.target
EOF
添加为系统服务并配置自启动:
systemctl daemon-reload
systemctl enable --now kafka-manager
systemctl status kafka-manager
3.2 配置日志切割
cat >/etc/logrotate.d/kafka-manager <<EOF
/usr/local/kafka-manager/logs/application.log {
daily
rotate 10
dateext
missingok
notifempty
}
EOF
4、异常解决
4.1 异常1:Timeout
Yikes! Ask timed out on [ActorSelection[Anchor(akka://kafka-manager-system/), Path(/user/kafka-manager)]] after [1000 ms] Try again.
异常原因可能为zookeeper端口配置错误
4.2 异常2:未创建kafka锁
Yikes! KeeperErrorCode = Unimplemented for /kafka-manager/mutex Try again.
CDH集成的ZK集群:
参考链接:https://github.com/yahoo/CMAK/issues/731https://github.com/yahoo/CMAK/issues/731
zookeeper-client
[zk: localhost:2181(CONNECTED) 1] create /kafka-manager/mutex ""
Created /kafka-manager/mutex
[zk: localhost:2181(CONNECTED) 2] create /kafka-manager/mutex/locks ""
Created /kafka-manager/mutex/locks
[zk: localhost:2181(CONNECTED) 3] create /kafka-manager/mutex/leases ""
Created /kafka-manager/mutex/leases
[zk: localhost:2181(CONNECTED) 4] ls /kafka-manager
[configs, mutex, deleteClusters, clusters]
原生kafka集群同样手动创建即可!
更多推荐
已为社区贡献2条内容
所有评论(0)