错误信息

org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1648284477641_0003 failed 2 times due to AM Container for appattempt_1648284477641_0003_000002 exited with exitCode: 1

报错原因

hadoop集群上从机上运行的Container试图使用过多的内存，被NodeManager kill掉了。

[摘录] The NodeManager is killing your container. It sounds like you are trying to use hadoop streaming which is running as a child process of the map-reduce task. The NodeManager monitors the entire process tree of the task and if it eats up more memory than the maximum set in mapreduce.map.memory.mb or mapreduce.reduce.memory.mb respectively, we would expect the Nodemanager to kill the task, otherwise your task is stealing memory belonging to other containers, which you don’t want.

解决方案

方案一

修改 yarn的 hadoop-2.7.2/etc/hadoop/yarn-site.xml，指定内存为6个G；

 <property><name>yarn.nodemanager.vmem-pmem-ratio</name><value>6.0</value></property>

方案二

关掉虚拟内存检查，修改yarn-site.xml。

<property><name>yarn.nodemanager.vmem-check-enabled</name><value>false</value>
</property>

方案三

修改mapred-site.xml中设置Map和Reduce任务的内存配置（value中的值根据实际实况灵活修改）

<property><name>mapreduce.map.memory.mb</name><value>1536</value>
</property>
<property><name>mapreduce.map.java.opts</name><value>-Xmx2048M</value>
</property>
<property><name>mapreduce.reduce.memory.mb</name><value>3072</value>
</property>
<property><name>mapreduce.reduce.java.opts</name><value>-Xmx2560M</value>
</property>

TezSession has already shutdown.Application XXX failed 2 times due to AM Container相关推荐

hive on Tez :TezSession has already shutdown
今天搭建hive on tez 报错误 Caused by: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shut ...
TezSession has already shutdown. No cluster diagnostics found.
问题 ERROR [HiveServer2-Background-Pool: Thread-5702712]: tez.TezTask (:()) - Failed to execute tez gr ...
Installation failed with message Invalid File:(Application Installatino Failed)
导入一个demo 运行发现上图问题, Application Installation Failed 最后自己清理下工程就好了参考方法: Click Build tab ---> Clean ...
成功解决 raise RuntimeError(“The JPMML-SkLearn conversion application has failed. The Java executable
成功解决 raise RuntimeError("The JPMML-SkLearn conversion application has failed. The Java execu ...
ERROR 2384 — [ main] o.s.boot.SpringApplication : Application run failed
springboot数据库建表运行后报错: ERROR 2384 - [ main] o.s.boot.SpringApplication : Application run failed org.s ...
Cygwin Application initialization failed: no display name and no $DISPLAY environment
使用新版本的Cygwin,安装时出现很多问题.------------------留作参考---------------------- 首先从官网下载setup.exe后运行安装,选择需要的包. 在终 ...
【Java】application run failed Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and
springboot 启动时报这个错:application run failed Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and ...
fatal: unable to access ‘https://github.com/xxx/‘: Failed to connect to 127.0.0.1 port 7890: Connect
git clone 项目的时候遇到报错: fatal: unable to access 'https://github.com/xxx/': Failed to connect to 127.0.0 ...
Springboot启动报错[ main] o.s.boot.SpringApplication: Application run failed（佷有可能是版本问题）
前言:本人小白一枚,最近在自学JAVA时遇到了一个小问题,在网上求解无果后,自己找到了原因,这里跟大家分享一下. 开发环境:Win10:IntelliJ IDEA 2021.3.2 版本信息:Java ...

TezSession has already shutdown.Application XXX failed 2 times due to AM Container

错误信息

报错原因

解决方案

方案一

方案二

方案三

TezSession has already shutdown.Application XXX failed 2 times due to AM Container相关推荐

最新文章

热门文章