WARN RestSubmissionClient: Unable to connect to server spark://master:

完整报错如下:

$ spark-submit --class WordCountLocal --deploy-mode cluster --driver-memory 1g --executor-memory 1g --executor-cores 1 /home/appleyuchi/IdeaProjects/scala-learn/target/scala-learn-1.0-SNAPSHOT.jar
Running Spark using the REST application submission protocol.
20/04/26 21:48:35 WARN RestSubmissionClient: Unable to connect to server spark://master:7077.
Warning: Master endpoint spark://master:7077 was not a REST server. Falling back to legacy submission gateway instead.
Exception in thread "main" org.apache.spark.SparkException: Exception thrown in awaitResult:
   at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:205)
   at org.apache.spark.rpc.RpcTimeout.awaitResult(RpcTimeout.scala:75)
   at org.apache.spark.rpc.RpcEnv.setupEndpointRefByURI(RpcEnv.scala:101)
   at org.apache.spark.rpc.RpcEnv.setupEndpointRef(RpcEnv.scala:109)
   at org.apache.spark.deploy.ClientApp$$anonfun$7.apply(Client.scala:238)
   at org.apache.spark.deploy.ClientApp$$anonfun$7.apply(Client.scala:238)
   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
   at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
   at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
   at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186)
   at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
   at scala.collection.mutable.ArrayOps$ofRef.map(ArrayOps.scala:186)
   at org.apache.spark.deploy.ClientApp.start(Client.scala:238)
   at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:894)
   at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:198)
   at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:228)
   at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:137)
   at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.io.IOException: Failed to connect to master/192.168.0.103:7077
   at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
   at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:187)
   at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
   at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:194)
   at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)
   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: 連線被拒絕: master/192.168.0.103:7077
   at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323)
   at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
   at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:633)
   at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
   at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
   at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
   at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
   at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
   ... 1 more
Caused by: java.net.ConnectException: 連線被拒絕
   ... 11 more

解决方案:

spark-defaults.conf设置好:

spark.master spark://master:7077

start-master.sh -h master

再次执行:

报错消失

参考:

https://blog.csdn.net/ybdesire/article/details/70666544

WARN RestSubmissionClient: Unable to connect to server spark://master:相关推荐

aspera 下载ENA 数据报错Error: Client unable to connect to server (check UDP port and firewall
在使用aspera下载ENA数据时报错 opt/.aspera/connect/bin/ascp -QT -l 300m -P33001 -i opt/.aspera/connect/etc/asp ...
pymssql连接sql server报错Unable to connect: Adaptive Server is unavailable
1.报错现象 b'DB-Lib error message 20009, severity 9:\nUnable to connect: Adaptive Server is unavailable ...
解决aspera 下载ENA 数据报错Session Stop (Error: Client unable to connect to server (check UDP port and fire
需要在root权限下设置udp端口使用iptable设置如下: iptables -I INPUT -p udp --dport 33001 -j ACCEPT iptables -I OUTPUT ...
kubectl get node运行时出现：Unable to connect to the server: x509: certificate signed by unknown authority
kubectl get nodes运行时出现:Unable to connect to the server: x509: certificate signed by unknown authorit ...
解决： Unable to connect to zookeeper server within timeout: 5000
前些天发现了一个巨牛的人工智能学习网站,通俗易懂,风趣幽默,忍不住分享一下给大家.点击跳转到教程. 一个项目启动不起来了,报错如题: Caused by: org.I0Itec.zkclient.ex ...
Android 模拟器连接异常：Unable to connect to ADB server
简介在使用Android Studio开始的过程是,偶尔会突然出现一只在检测设备,导致无法进行运行的调试的情况,本文记录下解决方法现象描述在启动Android Studio后,在设备状态栏中一直 ...
kubesphere master节点执行kubectl get po Unable to connect to the server: Forbidden
在kubesphere master节点上执行kubectl get po -n xx报出Unable to connect to the server: Forbidden的错误信息,但是集群整体运 ...
启动oracle时报错：PuTTY X11 proxy: unable to connect to forwarded X server: Network error:
在启动oracle时报如下错误是因为没有启动Xming,确保Xming启动之后再启动oracle即可. [oracle@localhost ~]$ cd /data/oracle/product/19 ...
aks Unable to connect to the server: x509
问题: aks 执行kubectl get pods 等命令遇到: Unable to connect to the server: x509: certificate signed by unkn ...

WARN RestSubmissionClient: Unable to connect to server spark://master:

WARN RestSubmissionClient: Unable to connect to server spark://master:相关推荐

最新文章

热门文章