今天在Spark测试时异常 报错 一直 提示 找不到 该方法

因为 本身代码量很小 而且  没有用到 错误提示的类  找了许久 才发现是 版本 对应问题

/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/bin/java "-javaagent:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar=49322:/Applications/IntelliJ IDEA.app/Contents/bin" -Dfile.encoding=UTF-8 -classpath /Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_181.jdk/Contents/Home/lib/tools.jar:/Users/wh/IdeaProjects/test/target/classes:/Users/wh/.m2/repository/org/scala-lang/scala-reflect/2.11.12/scala-reflect-2.11.12.jar:/Users/wh/.m2/repository/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar:/server/mavenrepository/org/apache/spark/spark-core_2.10/1.6.3/spark-core_2.10-1.6.3.jar:/server/mavenrepository/org/apache/avro/avro-mapred/1.7.7/avro-mapred-1.7.7-hadoop2.jar:/server/mavenrepository/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7.jar:/server/mavenrepository/org/apache/avro/avro-ipc/1.7.7/avro-ipc-1.7.7-tests.jar:/server/mavenrepository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/server/mavenrepository/com/twitter/chill_2.10/0.5.0/chill_2.10-0.5.0.jar:/server/mavenrepository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar:/server/mavenrepository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/server/mavenrepository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/server/mavenrepository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/server/mavenrepository/com/twitter/chill-java/0.5.0/chill-java-0.5.0.jar:/server/mavenrepository/org/apache/xbean/xbean-asm5-shaded/4.4/xbean-asm5-shaded-4.4.jar:/server/mavenrepository/org/apache/spark/spark-launcher_2.10/1.6.3/spark-launcher_2.10-1.6.3.jar:/server/mavenrepository/org/apache/spark/spark-network-common_2.10/1.6.3/spark-network-common_2.10-1.6.3.jar:/server/mavenrepository/org/apache/spark/spark-network-shuffle_2.10/1.6.3/spark-network-shuffle_2.10-1.6.3.jar:/server/mavenrepository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/server/mavenrepository/com/fasterxml/jackson/core/jackson-annotations/2.4.4/jackson-annotations-2.4.4.jar:/server/mavenrepository/org/apache/spark/spark-unsafe_2.10/1.6.3/spark-unsafe_2.10-1.6.3.jar:/server/mavenrepository/net/java/dev/jets3t/jets3t/0.7.1/jets3t-0.7.1.jar:/server/mavenrepository/org/apache/curator/curator-recipes/2.4.0/curator-recipes-2.4.0.jar:/server/mavenrepository/org/apache/curator/curator-framework/2.4.0/curator-framework-2.4.0.jar:/server/mavenrepository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/server/mavenrepository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/server/mavenrepository/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/server/mavenrepository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/server/mavenrepository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/server/mavenrepository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/server/mavenrepository/org/slf4j/slf4j-api/1.7.10/slf4j-api-1.7.10.jar:/server/mavenrepository/org/slf4j/jul-to-slf4j/1.7.10/jul-to-slf4j-1.7.10.jar:/server/mavenrepository/org/slf4j/jcl-over-slf4j/1.7.10/jcl-over-slf4j-1.7.10.jar:/server/mavenrepository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/server/mavenrepository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar:/server/mavenrepository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/server/mavenrepository/org/xerial/snappy/snappy-java/1.1.2.6/snappy-java-1.1.2.6.jar:/server/mavenrepository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar:/server/mavenrepository/org/roaringbitmap/RoaringBitmap/0.5.11/RoaringBitmap-0.5.11.jar:/server/mavenrepository/commons-net/commons-net/2.2/commons-net-2.2.jar:/server/mavenrepository/com/typesafe/akka/akka-remote_2.10/2.3.11/akka-remote_2.10-2.3.11.jar:/server/mavenrepository/com/typesafe/akka/akka-actor_2.10/2.3.11/akka-actor_2.10-2.3.11.jar:/server/mavenrepository/com/typesafe/config/1.2.1/config-1.2.1.jar:/server/mavenrepository/io/netty/netty/3.8.0.Final/netty-3.8.0.Final.jar:/server/mavenrepository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/server/mavenrepository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/server/mavenrepository/com/typesafe/akka/akka-slf4j_2.10/2.3.11/akka-slf4j_2.10-2.3.11.jar:/server/mavenrepository/org/scala-lang/scala-library/2.10.5/scala-library-2.10.5.jar:/server/mavenrepository/org/json4s/json4s-jackson_2.10/3.2.10/json4s-jackson_2.10-3.2.10.jar:/server/mavenrepository/org/json4s/json4s-core_2.10/3.2.10/json4s-core_2.10-3.2.10.jar:/server/mavenrepository/org/json4s/json4s-ast_2.10/3.2.10/json4s-ast_2.10-3.2.10.jar:/server/mavenrepository/org/scala-lang/scalap/2.10.0/scalap-2.10.0.jar:/server/mavenrepository/org/scala-lang/scala-compiler/2.10.0/scala-compiler-2.10.0.jar:/server/mavenrepository/com/sun/jersey/jersey-server/1.9/jersey-server-1.9.jar:/server/mavenrepository/asm/asm/3.1/asm-3.1.jar:/server/mavenrepository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/server/mavenrepository/org/apache/mesos/mesos/0.21.1/mesos-0.21.1-shaded-protobuf.jar:/server/mavenrepository/io/netty/netty-all/4.0.29.Final/netty-all-4.0.29.Final.jar:/server/mavenrepository/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/server/mavenrepository/io/dropwizard/metrics/metrics-core/3.1.2/metrics-core-3.1.2.jar:/server/mavenrepository/io/dropwizard/metrics/metrics-jvm/3.1.2/metrics-jvm-3.1.2.jar:/server/mavenrepository/io/dropwizard/metrics/metrics-json/3.1.2/metrics-json-3.1.2.jar:/server/mavenrepository/io/dropwizard/metrics/metrics-graphite/3.1.2/metrics-graphite-3.1.2.jar:/server/mavenrepository/com/fasterxml/jackson/core/jackson-databind/2.4.4/jackson-databind-2.4.4.jar:/server/mavenrepository/com/fasterxml/jackson/core/jackson-core/2.4.4/jackson-core-2.4.4.jar:/server/mavenrepository/com/fasterxml/jackson/module/jackson-module-scala_2.10/2.4.4/jackson-module-scala_2.10-2.4.4.jar:/server/mavenrepository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar:/server/mavenrepository/com/thoughtworks/paranamer/paranamer/2.6/paranamer-2.6.jar:/server/mavenrepository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/server/mavenrepository/oro/oro/2.0.8/oro-2.0.8.jar:/server/mavenrepository/org/tachyonproject/tachyon-client/0.8.2/tachyon-client-0.8.2.jar:/server/mavenrepository/commons-lang/commons-lang/2.4/commons-lang-2.4.jar:/server/mavenrepository/commons-io/commons-io/2.4/commons-io-2.4.jar:/server/mavenrepository/org/tachyonproject/tachyon-underfs-hdfs/0.8.2/tachyon-underfs-hdfs-0.8.2.jar:/server/mavenrepository/org/tachyonproject/tachyon-underfs-s3/0.8.2/tachyon-underfs-s3-0.8.2.jar:/server/mavenrepository/org/tachyonproject/tachyon-underfs-local/0.8.2/tachyon-underfs-local-0.8.2.jar:/server/mavenrepository/net/razorvine/pyrolite/4.9/pyrolite-4.9.jar:/server/mavenrepository/net/sf/py4j/py4j/0.9/py4j-0.9.jar:/server/mavenrepository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/server/mavenrepository/org/apache/spark/spark-sql_2.10/1.6.3/spark-sql_2.10-1.6.3.jar:/server/mavenrepository/org/apache/spark/spark-catalyst_2.10/1.6.3/spark-catalyst_2.10-1.6.3.jar:/server/mavenrepository/org/codehaus/janino/janino/2.7.8/janino-2.7.8.jar:/server/mavenrepository/org/apache/parquet/parquet-column/1.7.0/parquet-column-1.7.0.jar:/server/mavenrepository/org/apache/parquet/parquet-common/1.7.0/parquet-common-1.7.0.jar:/server/mavenrepository/org/apache/parquet/parquet-encoding/1.7.0/parquet-encoding-1.7.0.jar:/server/mavenrepository/org/apache/parquet/parquet-generator/1.7.0/parquet-generator-1.7.0.jar:/server/mavenrepository/org/apache/parquet/parquet-hadoop/1.7.0/parquet-hadoop-1.7.0.jar:/server/mavenrepository/org/apache/parquet/parquet-format/2.3.0-incubating/parquet-format-2.3.0-incubating.jar:/server/mavenrepository/org/apache/parquet/parquet-jackson/1.7.0/parquet-jackson-1.7.0.jar:/server/mavenrepository/org/apache/spark/spark-hive_2.10/1.6.3/spark-hive_2.10-1.6.3.jar:/server/mavenrepository/com/twitter/parquet-hadoop-bundle/1.6.0/parquet-hadoop-bundle-1.6.0.jar:/server/mavenrepository/org/spark-project/hive/hive-cli/1.2.1.spark/hive-cli-1.2.1.spark.jar:/server/mavenrepository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/server/mavenrepository/jline/jline/2.12/jline-2.12.jar:/server/mavenrepository/org/spark-project/hive/hive-exec/1.2.1.spark/hive-exec-1.2.1.spark.jar:/server/mavenrepository/javolution/javolution/5.5.1/javolution-5.5.1.jar:/server/mavenrepository/log4j/apache-log4j-extras/1.2.17/apache-log4j-extras-1.2.17.jar:/server/mavenrepository/org/antlr/antlr-runtime/3.4/antlr-runtime-3.4.jar:/server/mavenrepository/org/antlr/stringtemplate/3.2.1/stringtemplate-3.2.1.jar:/server/mavenrepository/antlr/antlr/2.7.7/antlr-2.7.7.jar:/server/mavenrepository/org/antlr/ST4/4.0.4/ST4-4.0.4.jar:/server/mavenrepository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/server/mavenrepository/org/tukaani/xz/1.0/xz-1.0.jar:/server/mavenrepository/com/googlecode/javaewah/JavaEWAH/0.3.2/JavaEWAH-0.3.2.jar:/server/mavenrepository/org/iq80/snappy/snappy/0.2/snappy-0.2.jar:/server/mavenrepository/org/json/json/20090211/json-20090211.jar:/server/mavenrepository/stax/stax-api/1.0.1/stax-api-1.0.1.jar:/server/mavenrepository/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/server/mavenrepository/org/spark-project/hive/hive-metastore/1.2.1.spark/hive-metastore-1.2.1.spark.jar:/server/mavenrepository/com/jolbox/bonecp/0.8.0.RELEASE/bonecp-0.8.0.RELEASE.jar:/server/mavenrepository/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/server/mavenrepository/org/apache/derby/derby/10.10.2.0/derby-10.10.2.0.jar:/server/mavenrepository/org/datanucleus/datanucleus-api-jdo/3.2.6/datanucleus-api-jdo-3.2.6.jar:/server/mavenrepository/org/datanucleus/datanucleus-rdbms/3.2.9/datanucleus-rdbms-3.2.9.jar:/server/mavenrepository/commons-pool/commons-pool/1.5.4/commons-pool-1.5.4.jar:/server/mavenrepository/commons-dbcp/commons-dbcp/1.4/commons-dbcp-1.4.jar:/server/mavenrepository/javax/jdo/jdo-api/3.0.1/jdo-api-3.0.1.jar:/server/mavenrepository/javax/transaction/jta/1.1/jta-1.1.jar:/server/mavenrepository/org/apache/avro/avro/1.7.7/avro-1.7.7.jar:/server/mavenrepository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/server/mavenrepository/org/apache/calcite/calcite-avatica/1.2.0-incubating/calcite-avatica-1.2.0-incubating.jar:/server/mavenrepository/org/apache/calcite/calcite-core/1.2.0-incubating/calcite-core-1.2.0-incubating.jar:/server/mavenrepository/org/apache/calcite/calcite-linq4j/1.2.0-incubating/calcite-linq4j-1.2.0-incubating.jar:/server/mavenrepository/net/hydromatic/eigenbase-properties/1.1.5/eigenbase-properties-1.1.5.jar:/server/mavenrepository/org/codehaus/janino/commons-compiler/2.7.6/commons-compiler-2.7.6.jar:/server/mavenrepository/org/apache/httpcomponents/httpclient/4.3.2/httpclient-4.3.2.jar:/server/mavenrepository/org/apache/httpcomponents/httpcore/4.3.1/httpcore-4.3.1.jar:/server/mavenrepository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/server/mavenrepository/commons-codec/commons-codec/1.10/commons-codec-1.10.jar:/server/mavenrepository/joda-time/joda-time/2.9.3/joda-time-2.9.3.jar:/server/mavenrepository/org/jodd/jodd-core/3.5.2/jodd-core-3.5.2.jar:/server/mavenrepository/org/datanucleus/datanucleus-core/3.2.10/datanucleus-core-3.2.10.jar:/server/mavenrepository/org/apache/thrift/libthrift/0.9.2/libthrift-0.9.2.jar:/server/mavenrepository/org/apache/thrift/libfb303/0.9.2/libfb303-0.9.2.jar:/server/mavenrepository/org/apache/spark/spark-streaming_2.10/1.6.3/spark-streaming_2.10-1.6.3.jar:/server/mavenrepository/org/apache/hadoop/hadoop-client/2.6.0/hadoop-client-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-common/2.6.0/hadoop-common-2.6.0.jar:/server/mavenrepository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/server/mavenrepository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/server/mavenrepository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/server/mavenrepository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/server/mavenrepository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/server/mavenrepository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/server/mavenrepository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/server/mavenrepository/org/apache/hadoop/hadoop-auth/2.6.0/hadoop-auth-2.6.0.jar:/server/mavenrepository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/server/mavenrepository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/server/mavenrepository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/server/mavenrepository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/server/mavenrepository/org/apache/curator/curator-client/2.6.0/curator-client-2.6.0.jar:/server/mavenrepository/org/htrace/htrace-core/3.0.4/htrace-core-3.0.4.jar:/server/mavenrepository/org/apache/hadoop/hadoop-hdfs/2.6.0/hadoop-hdfs-2.6.0.jar:/server/mavenrepository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/server/mavenrepository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/server/mavenrepository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/server/mavenrepository/org/apache/hadoop/hadoop-mapreduce-client-app/2.6.0/hadoop-mapreduce-client-app-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-mapreduce-client-common/2.6.0/hadoop-mapreduce-client-common-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-yarn-client/2.6.0/hadoop-yarn-client-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-yarn-server-common/2.6.0/hadoop-yarn-server-common-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.6.0/hadoop-mapreduce-client-shuffle-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-yarn-api/2.6.0/hadoop-yarn-api-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-mapreduce-client-core/2.6.0/hadoop-mapreduce-client-core-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-yarn-common/2.6.0/hadoop-yarn-common-2.6.0.jar:/server/mavenrepository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/server/mavenrepository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/server/mavenrepository/javax/activation/activation/1.1/activation-1.1.jar:/server/mavenrepository/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/server/mavenrepository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/server/mavenrepository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/server/mavenrepository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/server/mavenrepository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.6.0/hadoop-mapreduce-client-jobclient-2.6.0.jar:/server/mavenrepository/org/apache/hadoop/hadoop-annotations/2.6.0/hadoop-annotations-2.6.0.jar:/server/mavenrepository/org/apache/spark/spark-streaming-kafka_2.10/1.6.3/spark-streaming-kafka_2.10-1.6.3.jar:/server/mavenrepository/org/apache/kafka/kafka_2.10/0.8.2.1/kafka_2.10-0.8.2.1.jar:/server/mavenrepository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/server/mavenrepository/org/apache/kafka/kafka-clients/0.8.2.1/kafka-clients-0.8.2.1.jar:/server/mavenrepository/com/101tec/zkclient/0.3/zkclient-0.3.jar:/server/mavenrepository/org/apache/spark/spark-mllib_2.10/1.6.3/spark-mllib_2.10-1.6.3.jar:/server/mavenrepository/org/apache/spark/spark-graphx_2.10/1.6.3/spark-graphx_2.10-1.6.3.jar:/server/mavenrepository/com/github/fommil/netlib/core/1.1.2/core-1.1.2.jar:/server/mavenrepository/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar:/server/mavenrepository/org/scalanlp/breeze_2.10/0.11.2/breeze_2.10-0.11.2.jar:/server/mavenrepository/org/scalanlp/breeze-macros_2.10/0.11.2/breeze-macros_2.10-0.11.2.jar:/server/mavenrepository/org/scalamacros/quasiquotes_2.10/2.0.0-M8/quasiquotes_2.10-2.0.0-M8.jar:/server/mavenrepository/com/github/rwl/jtransforms/2.4.0/jtransforms-2.4.0.jar:/server/mavenrepository/org/spire-math/spire_2.10/0.7.4/spire_2.10-0.7.4.jar:/server/mavenrepository/org/spire-math/spire-macros_2.10/0.7.4/spire-macros_2.10-0.7.4.jar:/server/mavenrepository/org/jpmml/pmml-model/1.1.15/pmml-model-1.1.15.jar:/server/mavenrepository/org/jpmml/pmml-agent/1.1.15/pmml-agent-1.1.15.jar:/server/mavenrepository/org/jpmml/pmml-schema/1.1.15/pmml-schema-1.1.15.jar:/server/mavenrepository/com/sun/xml/bind/jaxb-impl/2.2.7/jaxb-impl-2.2.7.jar:/server/mavenrepository/com/sun/xml/bind/jaxb-core/2.2.7/jaxb-core-2.2.7.jar:/server/mavenrepository/mysql/mysql-connector-java/5.1.39/mysql-connector-java-5.1.39.jar:/server/mavenrepository/junit/junit/4.12/junit-4.12.jar:/server/mavenrepository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar com.scala.stackoverflow.Collection2RDD
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
18/09/12 14:24:33 INFO SparkContext: Running Spark version 1.6.3
18/09/12 14:24:34 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
18/09/12 14:24:34 INFO SecurityManager: Changing view acls to: wh
18/09/12 14:24:34 INFO SecurityManager: Changing modify acls to: wh
18/09/12 14:24:34 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(wh); users with modify permissions: Set(wh)
18/09/12 14:24:34 INFO Utils: Successfully started service 'sparkDriver' on port 49325.
Exception in thread "main" java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet;at akka.actor.ActorCell$.<init>(ActorCell.scala:336)at akka.actor.ActorCell$.<clinit>(ActorCell.scala)at akka.actor.RootActorPath.$div(ActorPath.scala:185)at akka.actor.LocalActorRefProvider.<init>(ActorRefProvider.scala:465)at akka.remote.RemoteActorRefProvider.<init>(RemoteActorRefProvider.scala:124)at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)at java.lang.reflect.Constructor.newInstance(Constructor.java:423)at akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$2.apply(DynamicAccess.scala:78)at scala.util.Try$.apply(Try.scala:192)at akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:73)at akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84)at akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84)at scala.util.Success.flatMap(Try.scala:231)at akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:84)at akka.actor.ActorSystemImpl.liftedTree1$1(ActorSystem.scala:585)at akka.actor.ActorSystemImpl.<init>(ActorSystem.scala:578)at akka.actor.ActorSystem$.apply(ActorSystem.scala:142)at akka.actor.ActorSystem$.apply(ActorSystem.scala:119)at org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:2040)at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:160)at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:2031)at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)at org.apache.spark.SparkEnv$.create(SparkEnv.scala:266)at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:288)at org.apache.spark.SparkContext.<init>(SparkContext.scala:457)at com.scala.stackoverflow.Collection2RDD$.main(Collection2RDD.scala:18)at com.scala.stackoverflow.Collection2RDD.main(Collection2RDD.scala)Process finished with exit code 1

最后 修改 maven pom 文件 将 版本 修改为 环境版本 并 将 scala 和 spark 的 版本对应起来

  <properties><project.build.sourceEncoding>UTF-8</project.build.sourceEncoding><spark.version>2.2.0</spark.version><scala.version>2.11</scala.version></properties>

保存后 自动下载新版jar 依赖包

运行 ok

Spark 启动报错时报错 java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty()Lscala/collect相关推荐

  1. Scala版本冲突--java.lang.NoSuchMethodError:scala.collection.immutable.HashSet$.empty()Lscala/collection/

    问题描述 Run 代码的时候报错 Exception in thread "main" java.lang.NoSuchMethodError:scala.collection.i ...

  2. java.lang.NoSuchMethodError:scala.collection.immutable.HashSet$.empty()Lscala/collection/

    Scala版本冲突--java.lang.NoSuchMethodError:scala.collection.immutable.HashSet$.empty()Lscala/collection/ ...

  3. Scala报错 java.lang.NoSuchMethodError:scala.collection.immutable.HashSet$.empty()Lscala/collection/

    在使用Actor通信模型的时候出现报错,表示Scala的版本冲突. File –> Other Settings –> Default Project Structure –> Gl ...

  4. Spark启动错误Exception in thread “main” java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$

    1   错误 [error] (run-main-0) java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty() ...

  5. IDEA 本地调试spark程序 Exception in thread main java.lang.NoSuchMethodError: scala.collection.immutable.

    1.很简单的一测试程序: 2.run运行时:出现ERROR,报错行显示在  new SparkContext 这行. val sc = new SparkContext(conf) Exception ...

  6. Scala版本冲突--java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty()

    问题描述 Run 代码的时候报错 Exception in thread "main" java.lang.NoSuchMethodError:scala.collection.i ...

  7. Exception in thread main java.lang.NoSuchMethodError: scala.collection.immutable.HashSet$.empty()L

    Scala 的版本与 Spark版本不匹配 博主用的是 Spark 1.5.1 之前装的 Scala 2.11.0 ,运行示例SparkPi出现上述错误. 改用Scala 2.10.6 ,问题解决了.

  8. Exception in thread “main“ java.lang.NoSuchMethodError: scala.collection.mut

    scala版本不一致,采用maven中spark自带版本即可.

  9. Exception in thread “main“ java.lang.NoSuchMethodError: scala.reflect.ClassT

    运行环境:IntelliJ + scala + spark +hadoop 出错原因:IntelliJ 中的scala版本与Spark 自带的scala版本不同导致 我刚开始以为只要把IntelliJ ...

最新文章

  1. spring+ (activeMQ) 实现queue与topic
  2. 磁珠，电感，零欧电阻之间的区别
  3. android studio点击图片,如何在Android Studio中的模拟器图库中添加图像？
  4. java char数组查找_我爱java系列---【在字符数组中查询某个字符串是否存在】
  5. 写入和读取外部存储文件
  6. 华三 h3c ppp配置
  7. Java中Dom解析xml文档
  8. 2016级算法第四次上机-A.Bamboo 和人工zz
  9. Julia: map、匿名函数和“差之毫厘，谬之千里”
  10. 《软件架构/架构师书库》读后感
  11. 火爆数字资产Vpay plustoken各种钱包开发，你看中了哪一款？
  12. 为资产分类定义折旧范围_SAP FICO-AA资产知识要点.doc
  13. MSP430F149的看门狗定时器
  14. 米兔机器人自主编程_可编程米兔机器人 让成年人回归童心的玩具
  15. Unity3D学习笔记（1）编辑器概括
  16. 苹果退款_教程：在 iTunes 申请 App Store 退款
  17. 使用 Ansible 高效交付 Docker 容器
  18. 成功解决windows系统开机时，系统提示此windows副本不是正版
  19. 【原创】企业级Linux环境部署（很全、很细）
  20. mac版免费吃鸡游戏(荒野行动)

热门文章

  1. 第十六届北京师范大学程序设计竞赛决赛
  2. 【博主推荐】html好看的音乐播放器(附源码)
  3. PCIe 5.0 spec学习4.1----PCI-PM（part1）
  4. 挑战杯获奖作品_小挑战杯-创青春创新创业竞赛
  5. 服务器全息显示修改,柔性全息显示器：通过拉伸就能切换显示信息
  6. Python经验总结
  7. 关于Windows启动RabbitMQ启动报错Applying plugin configuration to rabbit@xxx... Plugin configuration unchanged
  8. 【转】如何让后端主动给web前端发数据
  9. 如何成功发表一篇论文(最全攻略) ——建议收藏
  10. 企业会计准则（具体准则）第4号——固定资产