问题

docker 容器日志报java.io.IOException: Can't resolve address: node04:9092

 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_272]
 Caused by: java.nio.channels.UnresolvedAddressException: null
 	at sun.nio.ch.Net.checkAddress(Net.java:104) ~[na:1.8.0_272]
 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621) ~[na:1.8.0_272]
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar!/:na]
 	... 19 common frames omitted
 
 2021-02-07 14:54:07.591  WARN 6 --- [ntainer#3-0-C-1] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-4, groupId=databank-broker2] Error connecting to node node04:9092 (id: 189 rack: null)
 
 java.io.IOException: Can't resolve address: node04:9092
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:235) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.common.network.Selector.connect(Selector.java:214) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:864) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:265) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.trySend(ConsumerNetworkClient.java:485) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:261) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:242) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:230) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:314) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentbroker2IfNeeded(KafkaConsumer.java:1218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1175) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1154) [kafka-clients-2.0.1.jar!/:na]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke(KafkaMessageListenerContainer.java:742) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:699) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_272]
 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_272]
 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_272]
 Caused by: java.nio.channels.UnresolvedAddressException: null
 	at sun.nio.ch.Net.checkAddress(Net.java:104) ~[na:1.8.0_272]
 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621) ~[na:1.8.0_272]
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar!/:na]
 	... 17 common frames omitted
 
 2021-02-07 14:54:07.592  WARN 6 --- [ntainer#1-0-C-1] org.apache.kafka.clients.NetworkClient   : [Consumer clientId=consumer-8, groupId=databank-broker2] Error connecting to node node05:9092 (id: 187 rack: null)
 
 java.io.IOException: Can't resolve address: node05:9092
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:235) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.common.network.Selector.connect(Selector.java:214) ~[kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:864) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:265) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.trySend(ConsumerNetworkClient.java:485) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:261) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:242) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureCoordinatorReady(AbstractCoordinator.java:230) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:314) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentbroker2IfNeeded(KafkaConsumer.java:1218) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1175) [kafka-clients-2.0.1.jar!/:na]
 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1154) [kafka-clients-2.0.1.jar!/:na]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke(KafkaMessageListenerContainer.java:742) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:699) [spring-kafka-2.2.4.RELEASE.jar!/:2.2.4.RELEASE]
 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_272]
 	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_272]
 	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_272]
 Caused by: java.nio.channels.UnresolvedAddressException: null
 	at sun.nio.ch.Net.checkAddress(Net.java:104) ~[na:1.8.0_272]
 	at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621) ~[na:1.8.0_272]
 	at org.apache.kafka.common.network.Selector.doConnect(Selector.java:233) ~[kafka-clients-2.0.1.jar!/:na]
 	... 17 common frames omitted

本模块，连接的是cdh集群的kafka集群

解决方案

在cdh中搜索http://$(host_ip):7180/cmf/services/44/config#filterfreeText=kafka.p

 

在“kafka.properties 的 Kafka Broker 高级配置代码段（安全阀）”的列表中，每个broker节点，加入如下配置

listeners=PLAINTEXT://0.0.0.0:9092
advertised.listeners=PLAINTEXT://196.168.6.18:9092

有几个对应的broker，添加几个，这样项目就可以正常连接cdh中的kafka集群了。

Logo
Kafka开源项目指南

Kafka开源项目指南提供详尽教程，助开发者掌握其架构、配置和使用，实现高效数据流管理和实时处理。它高性能、可扩展，适合日志收集和实时数据处理，通过持久化保障数据安全，是企业大数据生态系统的核心。

更多推荐

Kafka入门（一） 概述、部署与API的简单使用

Kafka概述、部署与API的简单使用

avatar Kafka开源项目指南

基于canal和kafka同步，实现binlog同步ElasticSearch

文章目录前言elasticsearch 安装canal安装canal-adapter 安装及配置mysql 安装zk及kafaka安装查看效果注意事项前言中间件版本elasticsearch7.5.2canal1.1.4client-adapter1.1.5-alpha-1zookeeper3.4.13kafka2.6.0mysql5.7.31elasticsearch 安装{"settings"

avatar Kafka开源项目指南

基于 Iceberg 的湖仓一体架构在 B 站的实践

背景在B站，每天都有PB级的数据注入到大数据平台，经过离线或实时的ETL建模后，提供给下游的分析、推荐及预测等场景使用。面对如此大规模的数据，如何高效低成本地满足下游数据的分析需求，一直是我们重点的工作方向。我们之前的数据处理流程基本上是这样的：采集端将客户端埋点、服务端埋点、日志、业务数据库等数据收集到HDFS、Kafka等存储系统中，然后通过Hive、Spark、Fl...

avatar Kafka开源项目指南