Requested resource=＜memory:-1, vCores:1＞问题解决

场景：

故障出现在hive on tez的地方

故障复现:

启动hadoop并且离开安全模式

startmeta

hiveserver2

$HADOOP_HOME/bin/yarn timelineserver

beeline>insert into test(name,pwd,createdate)values('name1','pwd1','2017-06-20 14:14:09');

如下:

根据前面的info信息,得到application的id是:

1608265226746

打开yarn界面

报错是:

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException): Invalid resource request, requested resource type=[memory-mb] < 0 or greater than maximum allowed allocation.
Requested resource=<memory:-1, vCores:1>, maximum allowed allocation=<memory:4096, vCores:2>,
please note that maximum allowed allocation is calculated by scheduler based on maximum resource of registered NodeManagers, which might be less than configured maximum allocation=<memory:9216, vCores:4>

讲人话是:

可分配的资源是<memory:4096, vCores:2>,

你要求的是<memory:-1, vCores:1>

你一定会问:

memory:-1啥意思?

这是因为

hive.tez.container.size默认值为-1

解决方案:

$HADOOP/etc/hadoop/tez-site.xml中修改为

<name>hive.tez.container.size</name>
<value>2048</value>
</property>

<name>tez.am.resource.memory.mb</name>
<value>2048</value>
</property>

注意这里的2048都需要大于等于yarn.scheduler.minimum-allocation-mb

我知道你会有疑问,我的tez-site.xml里面原本没有上述两个变量啊.

没事,你新添上去就好了.

最终效果:

Reference:
[1]Tez优化参数设置
[2]hive tez调优（3）

Requested resource=＜memory:-1, vCores:1＞问题解决相关推荐

The requested resource is not available 问题解决
错误信息:The requested resource is not available 今天使用idea启动Tomcat服务器,访问web工程时出现了The requested resource i ...
报错：跨域问题解决 No ‘Access-Control-Allow-Origin‘ header is present on the requested resource.
报错: Access to XMLHttpRequest at 'http://127.0.0.1:8088/user/list' from origin 'http://localhost:8080 ...
解决springboot跨域问题No ‘Access-Control-Allow-Origin’ header is present on the requested resource.
文章目录 1.问题描述 2.问题产生 3.解决方案 1. 在WebMvcConfig添加(推荐使用) 2.直接采用SpringBoot的注解@CrossOrigin 1.Controller层在需要跨 ...
【Ambari】设置yarn队列资源为绝对值[memory=10240,vcores=12,yarn.io/gpu=4]
目录 1.介绍 2 修改资源队列 API步骤 2.1 获取capacity-scheduler配置的tag和version 2.2 获取capacity-scheduler指定版本的配置 2.3 通过 ...
No 'Access-Control-Allow-Origin' header is present on the requested resource.
/********************************************************************************** No 'Access-Contr ...
js跨域访问，No 'Access-Control-Allow-Origin' header is present on the requested resource
js跨域访问提示错误:XMLHttpRequest cannot load http://...... No 'Access-Control-Allow-Origin' header is prese ...
新版本Chrome同源策略、跨域问题处理No ‘Access-Control-Allow-Origin‘ header is present on the requested resource.
本文的方法实用于本地调试浏览器的设置,如果想要彻底解决需要使用 CORS(跨域资源共享) [ 相关文章 ] Python 使用 CORS 跨域资源共享解决 flask 服务器跨域问题.浏览器同源策略 ...
解决跨域问题：No ‘Access-Control-Allow-Origin‘ header is present on the requested resource.
前些天发现了一个巨牛的人工智能学习网站,通俗易懂,风趣幽默,忍不住分享一下给大家.点击跳转到教程. PS:如果遇到这个问题 Request header field Content-Type is ...
Oops! the requested resource is not found!
前些天发现了一个巨牛的人工智能学习网站,通俗易懂,风趣幽默,忍不住分享一下给大家.点击跳转到教程. 情况一:调用 dubbo 服务失败,报错如题:Oops! the requested resourc ...

Requested resource=＜memory:-1, vCores:1＞问题解决

Requested resource=＜memory:-1, vCores:1＞问题解决相关推荐

最新文章

热门文章