阿里云 搭建flink 后 web界面可以访问 但是没有task manager节点存活
现象 : flink web界面可以访问 但是没有task manager节点存活
查看启动日志 : 报错 failed to bind to /0.0.0.0:6123, shutting down Netty transport
2019-11-07 16:31:45,150 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2019-11-07 16:31:45,151 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint (Version: 1.9.1, Rev:4d56de8, Date:30.09.2019 @ 11:32:19 CST)
2019-11-07 16:31:45,151 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - OS current user: root
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Current Hadoop/Kerberos user:
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM: Java HotSpot™ 64-Bit Server VM - Oracle Corporation - 1.8/25.231-b11
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Maximum heap size: 989 MiBytes
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JAVA_HOME: /home/app/jdk1.8.0_231
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - No Hadoop Dependency available
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - JVM Options:
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xms1024m
2019-11-07 16:31:45,152 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Xmx1024m
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog.file=/home/app/flink-1.9.1/log/flink-root-standalonesession-3-iZ2zecm2bsuv242q0grs37Z.log
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlog4j.configuration=file:/home/app/flink-1.9.1/conf/log4j.properties
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - -Dlogback.configurationFile=file:/home/app/flink-1.9.1/conf/logback.xml
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Program Arguments:
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --configDir
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - /home/app/flink-1.9.1/conf
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --executionMode
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - cluster
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Classpath: /home/app/flink-1.9.1/lib/flink-table_2.11-1.9.1.jar:/home/app/flink-1.9.1/lib/flink-table-blink_2.11-1.9.1.jar:/home/app/flink-1.9.1/lib/log4j-1.2.17.jar:/home/app/flink-1.9.1/lib/slf4j-log4j12-1.7.15.jar:/home/app/flink-1.9.1/lib/flink-dist_2.11-1.9.1.jar:::
2019-11-07 16:31:45,153 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - --------------------------------------------------------------------------------
2019-11-07 16:31:45,154 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Registered UNIX signal handlers for [TERM, HUP, INT]
2019-11-07 16:31:45,182 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.address, 172.17.57.173
2019-11-07 16:31:45,189 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.rpc.port, 6123
2019-11-07 16:31:45,189 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.heap.size, 1024m
2019-11-07 16:31:45,189 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.heap.size, 1024m
2019-11-07 16:31:45,189 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2019-11-07 16:31:45,189 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: parallelism.default, 1
2019-11-07 16:31:45,190 INFO org.apache.flink.configuration.GlobalConfiguration - Loading configuration property: jobmanager.execution.failover-strategy, region
2019-11-07 16:31:45,297 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Starting StandaloneSessionClusterEntrypoint.
2019-11-07 16:31:45,297 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install default filesystem.
2019-11-07 16:31:45,323 INFO org.apache.flink.core.fs.FileSystem - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2019-11-07 16:31:45,346 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Install security context.
2019-11-07 16:31:45,353 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2019-11-07 16:31:45,365 INFO org.apache.flink.runtime.security.SecurityUtils - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2019-11-07 16:31:45,365 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Initializing cluster services.
2019-11-07 16:31:45,708 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils - Trying to start actor system at 172.17.57.173:6123
2019-11-07 16:31:46,323 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
2019-11-07 16:31:46,346 INFO akka.remote.Remoting - Starting remoting
2019-11-07 16:31:46,480 ERROR akka.remote.transport.netty.NettyTransport - failed to bind to /0.0.0.0:6123, shutting down Netty transport
2019-11-07 16:31:46,485 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Shutting StandaloneSessionClusterEntrypoint down with application status FAILED. Diagnostics java.net.BindException: Could not start actor system on any port in port range 6123
at org.apache.flink.runtime.clusterframework.BootstrapTools.startActorSystem(BootstrapTools.java:172)
at org.apache.flink.runtime.clusterframework.BootstrapTools.startActorSystem(BootstrapTools.java:112)
at org.apache.flink.runtime.clusterframework.BootstrapTools.startActorSystem(BootstrapTools.java:87)
at org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils.createRpcService(AkkaRpcServiceUtils.java:84)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.createRpcService(ClusterEntrypoint.java:272)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:248)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:202)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster0(ClusterEntrypoint.java:164)atorg.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)atorg.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:163)atorg.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:501)atorg.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65).2019−11−0716:31:46,509INFOakka.remote.RemoteActorRefProvider0(ClusterEntrypoint.java:164) at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:163) at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:501) at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65) . 2019-11-07 16:31:46,509 INFO akka.remote.RemoteActorRefProvider0(ClusterEntrypoint.java:164)atorg.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)atorg.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:163)atorg.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:501)atorg.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65).2019−11−0716:31:46,509INFOakka.remote.RemoteActorRefProviderRemotingTerminator - Shutting down remote daemon.
2019-11-07 16:31:46,510 INFO akka.remote.RemoteActorRefProviderRemotingTerminator−Remotedaemonshutdown;proceedingwithflushingremotetransports.2019−11−0716:31:46,510ERRORakka.remote.Remoting−Remotingsystemhasbeenterminatedabrubtly.Attemptingtoshutdowntransports2019−11−0716:31:46,515INFOakka.remote.RemoteActorRefProviderRemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports. 2019-11-07 16:31:46,510 ERROR akka.remote.Remoting - Remoting system has been terminated abrubtly. Attempting to shut down transports 2019-11-07 16:31:46,515 INFO akka.remote.RemoteActorRefProviderRemotingTerminator−Remotedaemonshutdown;proceedingwithflushingremotetransports.2019−11−0716:31:46,510ERRORakka.remote.Remoting−Remotingsystemhasbeenterminatedabrubtly.Attemptingtoshutdowntransports2019−11−0716:31:46,515INFOakka.remote.RemoteActorRefProviderRemotingTerminator - Remoting shut down.
2019-11-07 16:31:46,540 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint - Could not start cluster entrypoint StandaloneSessionClusterEntrypoint.
org.apache.flink.runtime.entrypoint.ClusterEntrypointException: Failed to initialize the cluster entrypoint StandaloneSessionClusterEntrypoint.
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:182)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runClusterEntrypoint(ClusterEntrypoint.java:501)
at org.apache.flink.runtime.entrypoint.StandaloneSessionClusterEntrypoint.main(StandaloneSessionClusterEntrypoint.java:65)
Caused by: java.net.BindException: Could not start actor system on any port in port range 6123
at org.apache.flink.runtime.clusterframework.BootstrapTools.startActorSystem(BootstrapTools.java:172)
at org.apache.flink.runtime.clusterframework.BootstrapTools.startActorSystem(BootstrapTools.java:112)
at org.apache.flink.runtime.clusterframework.BootstrapTools.startActorSystem(BootstrapTools.java:87)
at org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils.createRpcService(AkkaRpcServiceUtils.java:84)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.createRpcService(ClusterEntrypoint.java:272)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:248)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:202)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$0(ClusterEntrypoint.java:164)
at org.apache.flink.runtime.security.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:30)
at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:163)
总结 : 最后其实也没有找到具体原因
总结一下最终我改过几个地方:
1 ip地址 ,因为刚开始使用阿里云服务器 最初将ip设置的是外网地址 这是一个明显的错误
2.查询过有说6123端口是ipv6的端口 需要改为6124 然而在我这里并没后什么用处
3. 使用bin/stop-cluster.sh 之后standalonesession 没有杀死 ,然后修改完ip地址 重新启动的时候 还是使用的最初的配置 (因该是这个问题 , 只有大胆猜测 没有去验证) 解决方式 jps 找到对应进程id kill -9 id 杀死该进程 重新启动就好了
阿里云 搭建flink 后 web界面可以访问 但是没有task manager节点存活相关推荐
- Flink的web界面无法访问
Flink的web界面无法访问问题 这里记录一下遇到的一个问题,由于租用了华为云服务器部署Flink,在部署完成后 试图用自己电脑访问Flink的 web界面时总是显示无法连接,如下图所示 关闭防火墙 ...
- 基于阿里云搭建的适合初创企业的轻量级架构--架构总结
----基于阿里云搭建的适合初创企业的轻量级架构 前言 在项目的初期往往存在很多变数,业务逻辑时刻在变,而且还要保证快速及时,所以,一个灵活多变.快速部署.持续集成并可以适应多种情况的架构便显得尤为重 ...
- 如何基于阿里云搭建适合初创企业的轻量级架构?
----基于阿里云搭建的适合初创企业的轻量级架构 前言 在项目的初期往往存在很多变数,业务逻辑时刻在变,而且还要保证快速及时,所以,一个灵活多变.快速部署.持续集成并可以适应多种情况的架构便显得尤为重 ...
- 手把手教你使用阿里云搭建个人网站(上云良心品,细致到想哭)
时间过得真快,备案快要通过下来了,自己也马上要成为一个真正的站长了,今天就来说一下我如何使用"云平台方案调研/技术选型"."云上建站/开发过程"."架 ...
- 使用阿里云搭建自己的原型发布站点
最近在做项目时,使用了Axure团队协同工具"AxureShare"时,发现了一个问题:由于AxureShare服务器在国外,Axure共享生成的链接访问时非常慢,网上找了很多解决 ...
- 阿里云搭建自己的anki服务器
阿里云搭建自己的anki服务器 @[Toc](阿里云搭建自己的anki服务器) 背景 需要买一台云服务器 云服务器 远程登录 一些准备工作 关于操作系统的适应 我踩的一些坑 搭建过程 打开端口 输入命 ...
- 阿里云搭建完全分布式
阿里云搭建完全分布式 文章目录 阿里云搭建完全分布式 1. 三台改主机名 2.三台修改hosts文件 ping不通 4. 配置 ssh 免密登录 4.1 在 master 生成公钥 4.2 将 pub ...
- 挑战一个人搭建一套完整直播系统5:基于阿里云搭建外网直播系统
本节将来介绍如何基于阿里云搭建一个真正的外网直播系统,其实平台的搭建在前面已经做了介绍,这里的区别是在云平台上重新搭建系统,这里采用了阿里云服务器ECS来实现(可以免费使用薅羊毛),选择的系统为ubu ...
- 阿里云搭建Tomcat+Jdk+Mysql(阿里云系统CentOs)特完整
(本文太过潦草,特用Markdown重新排版了下:阿里云搭建Tomcat+Jdk+Mysql(阿里云系统CentOs)_李小白的博客的博客-CSDN博客) 1.首先我们应该先去百度云盘下载安装包资源: ...
- 阿里云白嫖计划:在阿里云搭建自己的云服务器
阿里云白嫖计划:在阿里云搭建自己的云服务器 最近阿里云推出了学生"在家实践"计划,经过认证的在校生可以免费获得6个月的一台入门云服务器! 总的来说这次阿里云的优惠力度还是挺大的,使 ...
最新文章
- 现代传感器的接口:中断驱动的ADC驱动程序
- Nat. Mach. Intell. | 深度神经网络中的捷径学习
- 新手搭建简洁的Express-React-Redux脚手架
- Apache shutdown unexpectedly启动错误解决方法
- SQL Server 2008 收缩日志 清空删除大日志文件
- FTPClient.listFiles() 放到linux上,返回值为null或数组长度为0
- 第21讲:IP代理池的搭建和使用
- strak组件(3):URL别名的优化
- Missing artifact net.sf.json-lib:json-lib:jar:2.4错误和Eclipse安装Maven插件错误
- 前端学习(512):两列布局的第一种方式的优缺点
- reset.css(样式重置)
- 将rgba图片信息转换为bmp图片文件
- Crystal Reports - Add CheckBox
- 18124 N皇后问题
- 2003服务器系统密匙,windows server 2003 安装密钥
- “我等了三年,就是想等一个机会!” 谈谈数据团队如何为自己争取资源!
- 阿里云上部署的SQL Server服务器和SVN服务器不能远程访问
- MySQL Deamon少量解读
- 纯css hover放大图片
- javassist技术研究Sql注入检测
热门文章
- 单片机 74HC573
- Shell中的括号、方括号、花括号、双括号和双方括号使用场景总结
- Mybatis OGNL表达式报错
- latex 两行 大括号_用laTeX排版大括号的三种方法
- facebook登陆接入
- 低效程序员的九个坏习惯
- 9个offer,12家公司,35场面试,从微软到谷歌,应届计算机毕业生的2012求职之路
- linux 终端翻译,linux下终端使用有道翻译
- 网络限制计算机连接怎么办,电脑本地连接受限制或无连接怎么办,教您解决方法...
- 安装 Ubuntu 21.04 后必备的绝佳应用大合集(持续更新中)