一：背景

Spark 任务出现了container内存负载出现OOM

二：问题

Application application_xxx_xxxx failed 2 times due to AM Container for appattempt_xxxx_xxxx_xxxx exited with exitCode: -104
Failing this attempt.Diagnostics: Container [pid=78835,containerID=container_e14_1611819047508_2623322_02_000003] is running beyond physical memory limits. Current usage: 6.6 GB of 6.6 GB physical memory used; 11.9 GB of 32.3 TB virtual memory used. Killing container.
Dump of the process-tree for container_e14_1611819047508_2623322_02_000003 :
|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE

三、分析

1、Spark OOM主要出现方：Drive和Executor。

Driver:主要是collect、show等

Executor：主要是缓存RDD等

2、查看UI

4、内存简介

参考Spark （一）：Executor内存_在前进的路上-CSDN博客一、背景 Spark是基于内存的分布式计算引擎，我们需对Executor内存管理的详细了解，方便我们遇到OOM解决问题、或者优化时更好调优，，Spark任务启动时有两个进程，分别为Driver、Executor进程，Driver进程（内存默认1G）可能在本地启动，也可能在集群中某个工作节点上启动（根据提交模式client、Cluster等）。Driver启动会申请资源（Executor），根据配置启动对应Executor数量，每个Executor进程都会对应一定数量的内存和CPU COR...https://blog.csdn.net/congcong68/article/details/122274441

3、调整对应参数

executor-memory
num-executors
driver-memory

spark实战问题（一）：is running beyond physical memory limits. Current usage: xx GB of xx GB physical memory相关推荐

is running beyond physical memory limits. Current usage: 2.0 GB of 2 GB physical memory used; 2.6 GB
背景执行一个kylin任务然后报错 TaskAttempt killed because it ran on unusable nodekylin1.dtwave.dev.local:8041 C ...
is running beyond physical memory limits. Current usage: 1.0 GB of 1 GB physical memory used......
0.任务执行报错截图: 1.错误分析:显示物理内存和虚拟内存的占用情况 Container [pid=24845,containerID=container_1625047493764_0479_01 ...
hive报错：running beyond physical memory limits. Current usage: 2.0 GB of 2 GB physica终极解决方式
1.案例描述: hive有个定时任务平时正常,没有啥问题,正常一般大概执行1个小时左右,但是今天突然报错了,报错代码::running beyond physical memory l ...
is running beyond the ‘VIRTUAL‘ memory limit. Current usage: 123.5 MB of 1 GB physical memory used
is running beyond the 'VIRTUAL' memory limit. Current usage: 123.5 MB of 1 GB physical memory used; ...
beyond the ‘PHYSICAL‘ memory limit. Current usage: 1.0 GB of 1 GB physical memory used；
腾讯云 hive3.1.1版本执行HQL时报如下错误报错信息: Error while processing statement: FAILED: Execution Error, return c ...
【Hive】报错Container is running beyond physical memory limits.4.0 GB of 4 GB physical memory used
最近碰到任务报错如下: Container [pid=105939,containerID=container_e03_1599034722009_11568264_01_000200] is run ...
Container is running beyond physical memory limits
1.Hive执行SQL语句,出现如下错误: Container is running beyond physical memory limits. Current usage: 4.3 GB of 4 ...
【Hadoop】运行MR任务，出现Container is running beyond physical memory limits错误
运行一次任务,运行了很长时间,出现了 ***Container is running beyond physical memory limits***的错误. Container [pid=27842 ...
hive任务优化-Current usage: 2.0 GB of 2 GB physical memory used; 4.0 GB of 16.2 GB virtual memory used.
目录错误背景错误信息定位 client端日志 APPlication日志 map和reduce单个错误日志错误分析解决方案 1. 取消虚拟内存的检查(不建议): 2.增大mapreduce.m ...

spark实战问题（一）：is running beyond physical memory limits. Current usage: xx GB of xx GB physical memory

一：背景

二：问题

三、分析

spark实战问题（一）：is running beyond physical memory limits. Current usage: xx GB of xx GB physical memory相关推荐

最新文章

热门文章