Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2

spark任务提交cdh集群yarn模式执行报错：

Exception in thread "main" java.lang.ExceptionInInitializerError
   at org.apache.hadoop.hive.conf.HiveConf.<clinit>(HiveConf.java:105)
   at java.lang.Class.forName0(Native Method)
   at java.lang.Class.forName(Class.java:348)
   at org.apache.spark.util.Utils$.classForName(Utils.scala:238)
   at org.apache.spark.sql.SparkSession$.hiveClassesArePresent(SparkSession.scala:1117)
   at org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(SparkSession.scala:866)
   at com.tyx.ml.Run$.main(Run.scala:26)
   at com.tyx.ml.Run.main(Run.scala)
Caused by: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2
   at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:174)
   at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:139)
   at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:100)
   at org.apache.hadoop.hive.conf.HiveConf$ConfVars.<clinit>(HiveConf.java:368)
   ... 8 more

解决办法：

打开pom文件

注释掉：

<dependency><groupId>org.apache.spark</groupId><artifactId>spark-hive_2.11</artifactId><version>${spark.version}</version>
</dependency>

Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2相关推荐

＜转载＞Presto对接华为HDFS 3.X，Unrecognized Hadoop major version number解决方案
简介这篇文章主要介绍了Presto对接华为HDFS 3.X,Unrecognized Hadoop major version number解决方案以及相关的经验技巧,文章约15691字,浏览量5 ...
HBase major version number must be less than 2 for hbase-sink
2019独角兽企业重金招聘Python工程师标准>>> org.apache.flume.conf.ConfigurationException: HBase major versi ...
hadoop伪分布式搭建 java_hadoop2.2.0伪分布式搭建
第一步:安装jdk 我的linux版本是centos7,使用最简单的安装方式,这里首先说一下,由于系统会预装openjdk版本等其他各种版本,首先要做的是清除这些版本,然后iu安装oracle的jdk ...
CentOS 7安装Hadoop 3.0.0
最近在学习大数据,需要安装Hadoop,自己弄了好久,最后终于弄好了.网上也有很多文章关于安装Hadoop的,但总会遇到一些问题,所以把在CentOS 7安装Hadoop 3.0.0的整个过程记录下来 ...
hadoop Error: JAVA_HOME is incorrectly set.Please update C:\hadoop-3.0.0\etc\hadoop\hadoop-env.cmd
一般情况下,我们都会放在C:\Program Files\Java或hadoop这样的目录下.但是hadoop version的时候会报错. Error: JAVA_HOME IS INCORRECT ...
hbase-default.xml file seems to be for an older version of HBase ,this version is 1.2.0
habase编程过程中遇到如下错误 <span style="color:#cc0000;">Caused by: java.lang.RuntimeException ...
hadoop下载地址与配置hadoop3.0集群
hadoop版本下载访问地址:http://mirrors.hust.edu.cn/apache/hadoop/common 搭建hadoop集群访问地址:https://blog.csdn.net/ ...
OGG 的最新版本Version 11.2.1.0.25 BLR 19358139– 1 September 2014
Version 11.2.1.0.25 BLR 19358139 fix了如下的bug: 19358139 - GoldenGate parsing multiple times. Cache th ...
No cached version of com.android.tools.build:gradle:2.0.0 available for offline mode.
异常场景从AS2.0升级到2.1,重新编译工程后,抛出了如下异常 Error:A problem occurred configuring root project 'AndroidStudioPr ...

Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2

Unrecognized Hadoop major version number: 3.0.0-cdh6.3.2相关推荐

最新文章

热门文章