kerberos 下运行spark 报错 Requested user hdfs is banned

启动运行报错

main : run as user is hdfs
main : requested yarn user is hdfs
Requested user hdfs is bannedFailing this attempt. Failing the application.ApplicationMaster host: N/AApplicationMaster RPC port: -1queue: root.defaultstart time: 1565170753121final status: FAILEDtracking URL: http://xxx:8088/cluster/app/application_1565170276877_0003user: hdfs
19/08/07 17:39:15 INFO yarn.Client: Deleting staging directory .sparkStaging/application_1565170276877_0003
Exception in thread "main" org.apache.spark.SparkException: Application application_1565170276877_0003 finished with failed statusat org.apache.spark.deploy.yarn.Client.run(Client.scala:1025)at org.apache.spark.deploy.yarn.Client$.main(Client.scala:1072)at org.apache.spark.deploy.yarn.Client.main(Client.scala)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:730)at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

原因：CDH默认禁止hdfs用户提交

kerberos 下运行spark 报错 Requested user hdfs is banned相关推荐

Kerberos 下运行spark 报错 Requested user hdfs is not whitelisted and has id 995,which is below the minimu
异常如下 main : run as user is hdfs main : requested yarn user is hdfs Requested user hdfs is not whitel ...
Yarn Clinet模式运行spark报错问题
应用场景安装部署完完全分布式的spark后,发现yarn-cluster模式可以运行不报错,但是yarn-client报错,无法进行计算PI的值,导致spark并不能使用,报错信息如下所示,只需要修 ...
Spark on YARN - Clinet模式运行spark报错问题
应用场景安装部署完完全分布式的spark后,发现yarn-cluster模式可以运行不报错,但是yarn-client报错,无法进行计算PI的值,导致spark并不能使用,报错信息如下所示,只需要修 ...
ubuntu18.04 下运行roscore报错：[rosout-1] process has died [pid 13103, exit code 127
roscore之后报错: [rosout-1] process has died [pid 13103, exit code 127, cmd /opt/ros/melodic/lib/rosout/ ...
Mac下运行git报错xcrun: error: invalid active developer path ..
错误:xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun ...
应用在vs的ide调试环境下运行顺利，但是在bin目录直接运行exe报错的问题
在项目中需要获取摄像头的实时视频,因为不想安装第三方的安装文件来实现,经过筛选找到了easydarwin中的libEasyPlayer. 我们的项目语言是C#,libEasyPlayer的语言是C++ ...
Spark 中 JVM 内存使用及配置详情、spark报错与调优、Spark内存溢出OOM异常
一般在我们开发spark程序的时候,从代码开发到上线以及后期的维护中,在整个过程中都需要涉及到调优的问题,即一开始需要考虑如何把代码写的更简洁高效调优(即代码优化),待开发测试完成后,提交任务时综合考 ...
Spark报错:Error:scalac: Scala compiler JARs not found (module ‘Spark_two‘): C:\Users\沫小新\.m2\repo
Spark报错: 找不到scala-compiler-2.11.8.jar的包 Error:scalac: Scala compiler JARs not found (module 'Spark_t ...
Android运行时候报错：android.view.InflateException: Binary XML file line #19: Binary XML file lin
Android运行时候报错:android.view.InflateException: Binary XML file line #19: Binary XML file lin 这个问题自己大致在 ...

kerberos 下运行spark 报错 Requested user hdfs is banned

kerberos 下运行spark 报错 Requested user hdfs is banned相关推荐

最新文章

热门文章