hadoop的web ui的8088端口打不开一例

首先jps看下，得到:

25013 Master
8599 SecondaryNameNode
8200 NameNode
8377 DataNode
9902 Jps

可以发现没有resourcemanager,也就是说yarn没有启动．

log路径:

/home/appleyuchi/bigdata/hadoop-2.7.7/logs/yarn-appleyuchi-resourcemanager-Desktop.log

log中报错如下:

2020-04-27 15:13:36,416 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: registered UNIX signal handlers for [TERM, HUP, INT]
2020-04-27 15:13:36,606 INFO org.apache.hadoop.conf.Configuration: found resource core-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/core-site.xml
2020-04-27 15:13:36,704 INFO org.apache.hadoop.security.Groups: clearing userToGroupsMap cache
2020-04-27 15:13:36,746 INFO org.apache.hadoop.conf.Configuration: found resource yarn-site.xml at file:/home/appleyuchi/bigdata/hadoop-2.7.7/etc/hadoop/yarn-site.xml
2020-04-27 15:13:36,767 INFO org.apache.hadoop.service.AbstractService: Service ResourceManager failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
   at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
   at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
   at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
   at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioning to standby state
2020-04-27 15:13:36,769 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Transitioned to standby state
2020-04-27 15:13:36,769 FATAL org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: Error starting ResourceManager
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! Invalid value of yarn.resourcemanager.ha.rm-ids. Current value is null
HA mode requires atleast two RMs
   at org.apache.hadoop.yarn.conf.HAUtil.throwBadConfigurationException(HAUtil.java:43)
   at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetRMHAIdsList(HAUtil.java:94)
   at org.apache.hadoop.yarn.conf.HAUtil.verifyAndSetConfiguration(HAUtil.java:80)
   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:228)
   at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
   at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:1187)
2020-04-27 15:13:36,771 INFO org.apache.hadoop.yarn.server.resourcemanager.ResourceManager: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down ResourceManager at Desktop/192.168.0.103
************************************************************/

调试的过程中还碰到下面的错误:

Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Invalid configuration! yarn.resourcemanager.hostname.rm1 or yarn.resourcemanager.address.rm1 needs to be set in a HA configuration.

＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊＊

2020-04-27 16:11:57,674 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.resourcemanager.EmbeddedElectorService failed in state INITED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not set
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Embedded automatic failover is enabled, but yarn.resourcemanager.zk-address is not se

最终会牵涉到Zookeeper,zookeeper要求运行的最低集群配置是3台，由于手头只有两台，所以没法搞．

所以最终解决方案是不要在yarn-site.xml中开启yarn.resourcemanager.ha.enabled:

<configuration>
<!-- <property><name>yarn.resourcemanager.ha.enabled</name><value>true</value>
</property> -->

hadoop的web ui的8088端口打不开一例相关推荐

通过录屏自动测试web端查询功能_海豚 Web UI自动化测试工具
http://div.io/topic/1339 海豚是什么? 没错,它是一个 Web UI自动化测试工具,专治Web UI的各种疑难杂症,目前只针对移动端Webapp量身定做. 说到 Web UI的 ...
Hadoop3.x 50070端口访问不到WEB UI页面
hadoop3 hdfs web端口改为9870 <property><name>dfs.namenode.http-address</name><value ...
Yarn Web页面 8088 端口在Windows浏览器无法访问
问题描述配置好Hadoop的Namenode节点.secondarynode节点和datanode节点之后,配置hadoop /etc目录下的mapred-site.xml.yarn-site.xm ...
spark master web ui 端口8080被占用解决方法
spark master web ui 端口8080被占用解决方法 Spark master web ui 默认端口为8080,当系统有其它程序也在使用该接口时,启动master时也不会报错,spar ...
关于hadoop访问8088端口显示只有一个节点
启动hadoop集群后,查看了50070端口,发现三台虚拟机都是有的之后查看8088端口发现只有一个节点运行很明显问题出在了yarn上,首先我查看了yarn的配置文件在这里我修改了红色部分为: ...
基于阿里云服务器搭建hadoop集群：HDFS的namenode WEB访问9870端口打不开解决方法
基于阿里云服务器搭建hadoop集群:HDFS的namenode WEB访问9870端口打不开解决方法以下是基于我所面临问题的解决办法. 1.在本地的c:windows/system32/dirve ...
Spark Streaming在Spark Web UI上的显示办法
下面开始注意: 不要改变这个实验中各个步骤的顺序!!! 启动spark集群和HDFS集群(搞不定的请自行百度) 然后 ① $ nc -lk 9999 test test home home scho ...
使用Arquillian，Docker和Selenium使Web UI测试再次变得出色（第1部分）
问题简介大多数时候,当您需要为Web UI编写功能测试/端到端测试时,您最终会使用Selenium ,它可以被视为Java世界中用于Web UI测试的事实上的工具. 我确定您已经将其用于此类测试. ...
ZooKeeper Web UI -- Shovel
前言由于在分布式系统内修改应用的配置文件并使其生效是一件比较繁琐的事情,机器数量少还行,如果机器数量几十台甚至几百台的话,稍不留神,就有可能遗漏某些机器,介于类似场景存在,自己花了一些时间对ZooK ...

hadoop的web ui的8088端口打不开一例

hadoop的web ui的8088端口打不开一例相关推荐

最新文章

热门文章