kafka发送消息出现的问题KafKa error java.nio.channels.UnresolvedAddressException

出现以下的错124 [main] INFO kafka.utils.VerifiableProperties - Verifying properties157 [main] INFO kafka.utils.VerifiableProperties - Property compression.codec is overridden to 1157 [main] I

杰灵

18066人浏览 · 2016-01-22 18:47:44

杰灵 · 2016-01-22 18:47:44 发布

出现以下的错

124 [main] INFO kafka.utils.VerifiableProperties - Verifying properties
157 [main] INFO kafka.utils.VerifiableProperties - Property compression.codec is overridden to 1
157 [main] INFO kafka.utils.VerifiableProperties - Property metadata.broker.list is overridden to 112.74.109.244:9092
157 [main] INFO kafka.utils.VerifiableProperties - Property producer.type is overridden to async
157 [main] INFO kafka.utils.VerifiableProperties - Property serializer.class is overridden to kafka.serializer.StringEncoder
158 [main] WARN kafka.utils.VerifiableProperties - Property zk.connect is not valid
203 [main] INFO kafka.producer.Producer - Shutting down producer
204 [main] INFO kafka.producer.async.ProducerSendThread - Begin shutting down ProducerSendThread
272 [ProducerSendThread-] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:112.74.109.244,port:9092 with correlation id 0 for 1 topic(s) Set(order)
293 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Connected to 112.74.109.244:9092 for producing
327 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Disconnecting from 112.74.109.244:9092
2629 [ProducerSendThread-] ERROR kafka.producer.SyncProducer - Producer connection to iZ943qtt41eZ:9092 unsuccessful
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
2640 [ProducerSendThread-] WARN kafka.producer.async.DefaultEventHandler - Failed to send producer request with correlation id 2 to broker 0 with data for partitions [order,0]
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
2651 [ProducerSendThread-] INFO kafka.producer.async.DefaultEventHandler - Back off for 100 ms before retrying send. Remaining retries = 3
2754 [ProducerSendThread-] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:112.74.109.244,port:9092 with correlation id 3 for 1 topic(s) Set(order)
2769 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Connected to 112.74.109.244:9092 for producing
3094 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Disconnecting from 112.74.109.244:9092
3098 [ProducerSendThread-] ERROR kafka.producer.SyncProducer - Producer connection to iZ943qtt41eZ:9092 unsuccessful
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
3101 [ProducerSendThread-] WARN kafka.producer.async.DefaultEventHandler - Failed to send producer request with correlation id 5 to broker 0 with data for partitions [order,0]
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
3103 [ProducerSendThread-] INFO kafka.producer.async.DefaultEventHandler - Back off for 100 ms before retrying send. Remaining retries = 2
3203 [ProducerSendThread-] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:112.74.109.244,port:9092 with correlation id 6 for 1 topic(s) Set(order)
3220 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Connected to 112.74.109.244:9092 for producing
3541 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Disconnecting from 112.74.109.244:9092
3544 [ProducerSendThread-] ERROR kafka.producer.SyncProducer - Producer connection to iZ943qtt41eZ:9092 unsuccessful
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
3546 [ProducerSendThread-] WARN kafka.producer.async.DefaultEventHandler - Failed to send producer request with correlation id 8 to broker 0 with data for partitions [order,0]
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
3547 [ProducerSendThread-] INFO kafka.producer.async.DefaultEventHandler - Back off for 100 ms before retrying send. Remaining retries = 1
3648 [ProducerSendThread-] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:112.74.109.244,port:9092 with correlation id 9 for 1 topic(s) Set(order)
6661 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Connected to 112.74.109.244:9092 for producing
9698 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Disconnecting from 112.74.109.244:9092
9702 [ProducerSendThread-] ERROR kafka.producer.SyncProducer - Producer connection to iZ943qtt41eZ:9092 unsuccessful
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
9705 [ProducerSendThread-] WARN kafka.producer.async.DefaultEventHandler - Failed to send producer request with correlation id 11 to broker 0 with data for partitions [order,0]
java.nio.channels.UnresolvedAddressException: null
at sun.nio.ch.Net.checkAddress(Net.java:29) ~[na:1.6.0_43]
at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:512) ~[na:1.6.0_43]
at kafka.network.BlockingChannel.connect(BlockingChannel.scala:57) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.connect(SyncProducer.scala:141) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.getOrMakeConnection(SyncProducer.scala:156) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:68) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1$$anonfun$apply$mcV$sp$1.apply(SyncProducer.scala:102) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply$mcV$sp(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer$$anonfun$send$1.apply(SyncProducer.scala:101) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.SyncProducer.send(SyncProducer.scala:100) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:255) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:106) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$2.apply(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at scala.collection.Iterator$class.foreach(Iterator.scala:772) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:157) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:190) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:45) [scala-library-2.9.2.jar:na]
at scala.collection.mutable.HashMap.foreach(HashMap.scala:95) [scala-library-2.9.2.jar:na]
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:100) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:72) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
9706 [ProducerSendThread-] INFO kafka.producer.async.DefaultEventHandler - Back off for 100 ms before retrying send. Remaining retries = 0
9807 [ProducerSendThread-] INFO kafka.client.ClientUtils$ - Fetching metadata from broker id:0,host:112.74.109.244,port:9092 with correlation id 12 for 1 topic(s) Set(order)
9821 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Connected to 112.74.109.244:9092 for producing
10137 [ProducerSendThread-] INFO kafka.producer.SyncProducer - Disconnecting from 112.74.109.244:9092
10138 [ProducerSendThread-] ERROR kafka.producer.async.DefaultEventHandler - Failed to send requests for topics order with correlation ids in [0,12]
10139 [ProducerSendThread-] ERROR kafka.producer.async.ProducerSendThread - Error in handling batch of 1 events
kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries.
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:90) ~[kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93) [kafka_2.9.2-0.8.1.1.jar:na]
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44) [kafka_2.9.2-0.8.1.1.jar:na]
10139 [main] INFO kafka.producer.async.ProducerSendThread - Shutdown ProducerSendThread complete
10139 [main] INFO kafka.producer.ProducerPool - Closing all sync producers

这问题搞了我很多久，主要没仔细看日志，当我认真看时，注要看到一句 kafka.producer.SyncProducer - Producer connection to iZ943qtt41eZ:9092 unsuccessful

然后我就想这应是识别不了主机名的原因，然后在 hosts文件上加上就可以了。当不知为什么他要用主机名，明明我是用了IP的

另一个错是消费者里报的：ERROR backtype.storm.daemon.executor - java.lang.NoClassDefFoundError: org/I0Itec/zkclient/serialize/ZkSerializer

找不到文件，这是在zkclient.jar里，加上就行了，下载地址如下：

http://repo1.maven.org/maven2/com/101tec/zkclient/0.1.0/zkclient-0.1.0.jar

Kafka开源项目指南

Kafka开源项目指南提供详尽教程，助开发者掌握其架构、配置和使用，实现高效数据流管理和实时处理。它高性能、可扩展，适合日志收集和实时数据处理，通过持久化保障数据安全，是企业大数据生态系统的核心。

更多推荐

Kafka入门（一）概述、部署与API的简单使用

Kafka概述、部署与API的简单使用

Kafka开源项目指南

基于canal和kafka同步，实现binlog同步ElasticSearch

文章目录前言elasticsearch 安装canal安装canal-adapter 安装及配置mysql 安装zk及kafaka安装查看效果注意事项前言中间件版本elasticsearch7.5.2canal1.1.4client-adapter1.1.5-alpha-1zookeeper3.4.13kafka2.6.0mysql5.7.31elasticsearch 安装{"settings"

Kafka开源项目指南

基于 Iceberg 的湖仓一体架构在 B 站的实践

背景在B站，每天都有PB级的数据注入到大数据平台，经过离线或实时的ETL建模后，提供给下游的分析、推荐及预测等场景使用。面对如此大规模的数据，如何高效低成本地满足下游数据的分析需求，一直是我们重点的工作方向。我们之前的数据处理流程基本上是这样的：采集端将客户端埋点、服务端埋点、日志、业务数据库等数据收集到HDFS、Kafka等存储系统中，然后通过Hive、Spark、Fl...