Error connecting to node kafka1:9092 (id: 0 rack: null) ，marathon docker镜像添加hosts

业务需求为处理数据推到另一台机器得kafka中 kafka配置地址为ip加端口形式但实际试用环境中报错

2021-07-27 05:18:18.366  WARN 1 --- [-b726640983cc-1] org.apache.kafka.clients.NetworkClient   : [Producer clientId=nettyKafkaProducer98b74cc5-dfb5-4d68-9a14-b726640983cc-1] Error connecting to node kafka1:9092 (id: 0 rack: null)java.net.UnknownHostException: kafka1: Name or service not knownat java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) ~[na:1.8.0_111]at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928) ~[na:1.8.0_111]at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323) ~[na:1.8.0_111]at java.net.InetAddress.getAllByName0(InetAddress.java:1276) ~[na:1.8.0_111]at java.net.InetAddress.getAllByName(InetAddress.java:1192) ~[na:1.8.0_111]at java.net.InetAddress.getAllByName(InetAddress.java:1126) ~[na:1.8.0_111]at org.apache.kafka.clients.ClientUtils.resolve(ClientUtils.java:110) ~[kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.currentAddress(ClusterConnectionStates.java:403) ~[kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.ClusterConnectionStates$NodeConnectionState.access$200(ClusterConnectionStates.java:363) ~[kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.ClusterConnectionStates.currentAddress(ClusterConnectionStates.java:151) ~[kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:958) [kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.NetworkClient.ready(NetworkClient.java:294) [kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.producer.internals.Sender.sendProducerData(Sender.java:351) [kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.producer.internals.Sender.runOnce(Sender.java:324) [kafka-clients-2.6.0.jar!/:na]at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:240) [kafka-clients-2.6.0.jar!/:na]at java.lang.Thread.run(Thread.java:745) [na:1.8.0_111]

配置端其实并没有用kafka1:9090 而是直接使用ip加端口得配置，所以应该是kafka端做了限制需要试用host得模式去推送

百度了好久处理方案多是添加hosts 但发布环境特殊是基于mesos+marathon得docker部署环境
无法在docker run得时候使用–addhosts
现记录下解决方案
marathonjson中添加如下配置启动时便回添加相应host 同理可添加dns-search

"container": {"type": "DOCKER","docker": {"network": "HOST","image": "your/image","parameters": [{ "key": "add-host", "value": "host:ip" },{ "key": "dns-search", "value": "url" }]}
}

Error connecting to node kafka1:9092 (id: 0 rack: null) ，marathon docker镜像添加hosts相关推荐

kafka发送数据报错： Error connecting to node xxxxx:9092 (id: 1 rack: null)java.net.UnknownHostExceptio
报错内容: warn报错: [kafka-producer-network-thread | producer-1] WARN org.apache.kafka.clients.NetworkCli ...
Group coordinator 192.169.0.16:9092 (id: 2147483647 rack: null) is unavailable or invalid due to cau
kafka报错 [Consumer clientId=consumer-qizidou-1, groupId=qizidou] Group coordinator 192.169.0.16:9092 ...
Kafka Group coordinator xxx:9092 (id: xxx rack: null) is unavailable or invalid
问题描述: Kafka本身启动和相互通信没有问题,但是在使用Java API 模拟消费者连接到Kafka的时候出现报错 2022-03-03 09:31:22[Consumer clientId=co ...
【问题解决】Kafka报错 Bootstrap broker x.x.x.x:9092 (id: -1 rack: null) disconnected
问题复现近日针对某一客户需求开发了一个需要使用Kafka的功能,功能是什么暂且不论,在本地虚机的Kafka连接一切正常遂放到测试服务器上验证功能,以下是监听topic成功和警告报错: 2023-05 ...
Error connecting to node localhost.localdomain:9092 (id: 2147483647 rack: null)
这个是Kafka常见的错误:(场景:我在win10本地跑代码,去消费我配置在服务器Kafka) 1.修改本地物理机hosts文件.文件目录:C:\Windows\System32\drivers\et ...
kafka java.net.UnknownHostException: node4 Error connecting to node node4:9092
解决:修改kafka的server.properties文件 vim /kafka安装路径/config/server.properties 去除下面这行配置的注释,并设置对应的ip地址 #adver ...
【Kafka】kafka 卡死 Discovered coordinator xx:9092 (id: xxx rack: null) for group xxx
文章目录 1.背景 1.背景构建了一个kafka消费组,然后主要是想获取kafka的partition的开始offset 和结束的offset,但是获取的时候这里再某些环境下这里卡死了. 程序如下 ...
Spark消费kafka任务卡死：Marking the coordinator xxx:9092 (id: 2147483647 rack: null) dead for group xxx
1.背景 2. 问题出现运行了一个spark任务,然后,发现有一个Job特别的慢,其他的最多用了30分钟,但是这个任务却运行了 1.1个小时,数据量是100万的数据. 2.1 任务点击进入 2.2 ...
kafka报错：Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected
这是一个惨痛的教训就在昨天我和我四个同事因为这个问题搞到了夜里十一点半,啊啊啊啊啊!!!太恶心了!!! 在启动工程时,kafka报这个错误,在配置文件中配置kafka的依赖,和另一个服务器上配置的一 ...
Group coordinator ali-ddd-cdhdev-04:9092 (id: 2147483643 rack: null) is unavailable or invalid, wil
kafka 相应的hostname 和ip 对应关系没有配置

Error connecting to node kafka1:9092 (id: 0 rack: null) ，marathon docker镜像添加hosts

Error connecting to node kafka1:9092 (id: 0 rack: null) ，marathon docker镜像添加hosts相关推荐

最新文章

热门文章