hive3.x异常- return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask

提交joinsql核心异常如下

return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask

The value of property yarn.resourcemanager.zk-address must not be null

org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTaskat org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:379)at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:257)at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91)at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:348)at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:362)at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)at java.lang.Thread.run(Thread.java:748)

2020-05-08T17:33:37,426  INFO [HiveServer2-Background-Pool: Thread-6487] Configuration.deprecation: yarn.resourcemanager.zk-address i
s deprecated. Instead, use hadoop.zk.address
2020-05-08T17:33:37,426 ERROR [HiveServer2-Background-Pool: Thread-6487] mr.MapredLocalTask: Exception:
java.lang.IllegalArgumentException: The value of property yarn.resourcemanager.zk-address must not be null

经测试，有join的sql需要本地mr的时候会报以上异常

解决方案：

1 关闭本地mr

set hive.mapjoin.localtask.max.memory.usage=0.99;
set hive.auto.convert.join=false;

2 在hive-site.xml修改参数

<property>
<name>hadoop.zk.address</name>
<value>node1.test.com:2181,node2.test.com:2181,node3.test.com:2181</value>

如果有其他解决方案欢迎一起交流

hive3.x异常- return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask相关推荐

hive异常 return code X from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask 解决
转自:https://www.iteye.com/blog/vase-2090320 不知道是不是hive-0.12版增强了local mode的原因,在之前版本运行好好的Hive-QL在这个版本上错 ...
Hive报错FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
Hive报错Error while processing statement: FAILED: Execution Error, return code 3 from org.apache.hadoo ...
FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
报错信息 [2020-09-23 19:26:35] hive:Execution log at: /tmp/mqq/mqq_20200923191542_f05d782a-27c8-4e09-a6e ...
hive-05-Execution Error, return code 3 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask
hive命令行里执行了一句话: select * from person join zhanghao on person.zjhm = zhanghao.zjhm limit 100 ; 就是两个表做 ...
Hive return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask一种解决办法
尝试在sql执行前加配置参数,以下几种配置参数考虑选择 set hive.auto.convert.join=false; set hive.ignore.mapjoin.hint=false; se ...
使用hive报 return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask解决方法
1.情况两表join 其他时间数据正常插入.唯独插入7月1日数据时 , 报错: join 语句 insert overwrite table A partition (log_date= '2021 ...
成功解决: return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
异常: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop. ...
hive -- return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
异常: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop. ...
Hive任务执行报错：FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
报错内容如下: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask 22/ ...

hive3.x异常- return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask

hive3.x异常- return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask相关推荐

最新文章

热门文章