Spark 1.2 编译
2024-04-23 05:36:59
1：下载
wget http://d3kbcqa49mib13.cloudfront.net/spark-1.2.0.tgz
[jifeng@feng02 hadoop]$ wget http://d3kbcqa49mib13.cloudfront.net/spark-1.2.0.tgz
--2015-02-06 20:41:10-- http://d3kbcqa49mib13.cloudfront.net/spark-1.2.0.tgz
正在解析主机 d3kbcqa49mib13.cloudfront.net... 54.192.159.99, 54.230.158.182, 54.192.156.54, ...
正在连接 d3kbcqa49mib13.cloudfront.net|54.192.159.99|:80... 已连接。
已发出 HTTP 请求，正在等待回应... 200 OK
长度：10290089 (9.8M) [application/x-compressed]
正在保存至: “spark-1.2.0.tgz”5% [===> ] 548,334 170K/s eta(英国中部时99% [==========================================================================> ] 10,257,174 189K/s eta(英国中部时100%[===========================================================================>] 10,290,089 188K/s in 74s 2015-02-06 20:42:25 (136 KB/s) - 已保存 “spark-1.2.0.tgz” [10290089/10290089])2:编译
mvn -Pyarn -Phadoop-2.4.1 -Dhadoop.version=2.4.1 -Phive -DskipTests clean package
用这个命令报错，试了几次都有错误
Downloading: https://repo.spring.io/libs-release/xalan/xalan/2.7.1/xalan-2.7.1.jar
Downloading: https://repo.spring.io/libs-release/org/seleniumhq/selenium/selenium-firefox-driver/2.42.2/selenium-firefox-driver-2.42.2.jar
Downloaded: https://repo.spring.io/libs-release/org/seleniumhq/selenium/selenium-firefox-driver/2.42.2/selenium-firefox-driver-2.42.2.jar (2471 KB at 83.9 KB/sec)
Downloaded: https://repo.spring.io/libs-release/xalan/xalan/2.7.1/xalan-2.7.1.jar (3102 KB at 88.5 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-core_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-core_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-core_2.10 ---
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar (222 KB at 4.6 KB/sec)
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (default) @ spark-core_2.10 ---
[WARNING] Parameter tasks is deprecated, use target instead
[INFO] Executing tasksmain:[unzip] Expanding: /home/jifeng/hadoop/spark-1.2.0/python/lib/py4j-0.8.2.1-src.zip into /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 23 resources
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 402 Scala sources and 33 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [27:40 min]
[INFO] Spark Project Networking .......................... SUCCESS [30:09 min]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [ 10.915 s]
[INFO] Spark Project Core ................................ SKIPPED
[INFO] Spark Project Bagel ............................... SKIPPED
[INFO] Spark Project GraphX .............................. SKIPPED
[INFO] Spark Project Streaming ........................... SKIPPED
[INFO] Spark Project Catalyst ............................ SKIPPED
[INFO] Spark Project SQL ................................. SKIPPED
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Parent POM ..................... SKIPPED
[INFO] Spark Project YARN Stable API ..................... SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:30 h
[INFO] Finished at: 2015-02-09T22:49:50+08:00
[INFO] Final Memory: 51M/356M
[INFO] ------------------------------------------------------------------------
---------------------------------------------------
constituent[0]: file:/usr/local/apache-maven-3.2.1/lib/cdi-api-1.0.jar
constituent[1]: file:/usr/local/apache-maven-3.2.1/lib/commons-cli-1.2.jar
constituent[2]: file:/usr/local/apache-maven-3.2.1/lib/maven-plugin-api-3.2.1.jar
constituent[3]: file:/usr/local/apache-maven-3.2.1/lib/javax.inject-1.jar
constituent[4]: file:/usr/local/apache-maven-3.2.1/lib/maven-model-3.2.1.jar
constituent[5]: file:/usr/local/apache-maven-3.2.1/lib/slf4j-api-1.7.5.jar
constituent[6]: file:/usr/local/apache-maven-3.2.1/lib/plexus-sec-dispatcher-1.3.jar
constituent[7]: file:/usr/local/apache-maven-3.2.1/lib/commons-lang-2.6.jar
constituent[8]: file:/usr/local/apache-maven-3.2.1/lib/maven-settings-builder-3.2.1.jar
constituent[9]: file:/usr/local/apache-maven-3.2.1/lib/jsoup-1.7.2.jar
constituent[10]: file:/usr/local/apache-maven-3.2.1/lib/aopalliance-1.0.jar
constituent[11]: file:/usr/local/apache-maven-3.2.1/lib/jsr250-api-1.0.jar
constituent[12]: file:/usr/local/apache-maven-3.2.1/lib/sisu-guice-3.1.3-no_aop.jar
constituent[13]: file:/usr/local/apache-maven-3.2.1/lib/wagon-http-2.6-shaded.jar
constituent[14]: file:/usr/local/apache-maven-3.2.1/lib/maven-repository-metadata-3.2.1.jar
constituent[15]: file:/usr/local/apache-maven-3.2.1/lib/maven-embedder-3.2.1.jar
constituent[16]: file:/usr/local/apache-maven-3.2.1/lib/plexus-component-annotations-1.5.5.jar
constituent[17]: file:/usr/local/apache-maven-3.2.1/lib/aether-connector-wagon-0.9.0.M2.jar
constituent[18]: file:/usr/local/apache-maven-3.2.1/lib/slf4j-simple-1.7.5.jar
constituent[19]: file:/usr/local/apache-maven-3.2.1/lib/plexus-cipher-1.7.jar
constituent[20]: file:/usr/local/apache-maven-3.2.1/lib/commons-io-2.2.jar
constituent[21]: file:/usr/local/apache-maven-3.2.1/lib/guava-14.0.1.jar
constituent[22]: file:/usr/local/apache-maven-3.2.1/lib/plexus-interpolation-1.19.jar
constituent[23]: file:/usr/local/apache-maven-3.2.1/lib/wagon-file-2.6.jar
constituent[24]: file:/usr/local/apache-maven-3.2.1/lib/wagon-http-shared-2.6.jar
constituent[25]: file:/usr/local/apache-maven-3.2.1/lib/aether-api-0.9.0.M2.jar
constituent[26]: file:/usr/local/apache-maven-3.2.1/lib/maven-artifact-3.2.1.jar
constituent[27]: file:/usr/local/apache-maven-3.2.1/lib/aether-util-0.9.0.M2.jar
constituent[28]: file:/usr/local/apache-maven-3.2.1/lib/maven-model-builder-3.2.1.jar
constituent[29]: file:/usr/local/apache-maven-3.2.1/lib/maven-settings-3.2.1.jar
constituent[30]: file:/usr/local/apache-maven-3.2.1/lib/maven-aether-provider-3.2.1.jar
constituent[31]: file:/usr/local/apache-maven-3.2.1/lib/wagon-provider-api-2.6.jar
constituent[32]: file:/usr/local/apache-maven-3.2.1/lib/maven-core-3.2.1.jar
constituent[33]: file:/usr/local/apache-maven-3.2.1/lib/maven-compat-3.2.1.jar
constituent[34]: file:/usr/local/apache-maven-3.2.1/lib/aether-impl-0.9.0.M2.jar
constituent[35]: file:/usr/local/apache-maven-3.2.1/lib/org.eclipse.sisu.plexus-0.0.0.M5.jar
constituent[36]: file:/usr/local/apache-maven-3.2.1/lib/org.eclipse.sisu.inject-0.0.0.M5.jar
constituent[37]: file:/usr/local/apache-maven-3.2.1/lib/plexus-utils-3.0.17.jar
constituent[38]: file:/usr/local/apache-maven-3.2.1/lib/aether-spi-0.9.0.M2.jar
constituent[39]: file:/usr/local/apache-maven-3.2.1/conf/logging/
---------------------------------------------------
Exception in thread "main"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "main"[jifeng@feng02 spark-1.2.0]$ mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.1 -Phive -DskipTests clean package
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Networking
[INFO] Spark Project Shuffle Streaming Service
[INFO] Spark Project Core
[INFO] Spark Project Bagel
[INFO] Spark Project GraphX
[INFO] Spark Project Streaming
[INFO] Spark Project Catalyst
[INFO] Spark Project SQL
[INFO] Spark Project ML Library
[INFO] Spark Project Tools
[INFO] Spark Project Hive
[INFO] Spark Project REPL
[INFO] Spark Project YARN Parent POM
[INFO] Spark Project YARN Stable API
[INFO] Spark Project Assembly
[INFO] Spark Project External Twitter
[INFO] Spark Project External Flume Sink
[INFO] Spark Project External Flume
[INFO] Spark Project External MQTT
[INFO] Spark Project External ZeroMQ
[INFO] Spark Project External Kafka
[INFO] Spark Project Examples
[INFO] Spark Project YARN Shuffle Service
[INFO]
[INFO] Using the builder org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder with a thread count of 1
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Parent POM 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-parent ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-parent ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-parent ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-parent ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-parent ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-parent ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-parent ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-parent ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-parent ---
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-parent ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-parent ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 48 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Networking 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-common_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/common/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-common_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 42 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 42 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-common_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 7 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-common_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (test-jar-on-test-compile) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-common_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-common_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-common_2.10 ---
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-common_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/common/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 10 ms
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Shuffle Streaming Service 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-shuffle_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-shuffle_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 20 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 20 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-shuffle_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 11 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 11 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-shuffle_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-shuffle_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-shuffle_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-shuffle_2.10 ---
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-shuffle_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 33 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Core 1.2.0
[INFO] ------------------------------------------------------------------------
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.pom (6 KB at 2.4 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.1.2/httpcomponents-client-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.1.2/httpcomponents-client-4.1.2.pom (12 KB at 18.5 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.pom (8 KB at 12.1 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.1.2/httpcomponents-core-4.1.2.pom
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.1.2/httpcomponents-core-4.1.2.pom (10 KB at 15.9 KB/sec)
Downloading: https://repo1.maven.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloaded: https://repo1.maven.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom (0 B at 0.0 KB/sec)
Downloading: https://repository.apache.org/content/repositories/releases/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repository.jboss.org/nexus/content/repositories/releases/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repo.eclipse.org/content/repositories/paho-releases/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repository.cloudera.com/artifactory/cloudera-repos/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: http://repository.mapr.com/maven/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
二月 10, 2015 11:04:34 上午 org.apache.maven.wagon.providers.http.httpclient.client.protocol.ResponseProcessCookies processCookies
警告: Cookie rejected: "[version: 0][name: rememberMe][value: deleteMe][domain: repository.mapr.com][path: /nexus][expiry: Tue Feb 10 11:04:34 CST 2015]". Illegal path attribute "/nexus". Path of origin: "/maven/org/sonatype/oss/oss-parent/3/oss-parent-3.pom"
Downloading: https://repo.spring.io/libs-release/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloaded: https://repo.spring.io/libs-release/org/sonatype/oss/oss-parent/3/oss-parent-3.pom (0 B at 0.0 KB/sec)
Downloading: https://oss.sonatype.org/content/repositories/orgspark-project-1085/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://oss.sonatype.org/content/repositories/orgspark-project-1089/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: http://download.java.net/maven/2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar
Downloading: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar (177 KB at 34.0 KB/sec)
Downloaded: https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar (344 KB at 22.9 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-core_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-core_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (default) @ spark-core_2.10 ---
[WARNING] Parameter tasks is deprecated, use target instead
[INFO] Executing tasksmain:[unzip] Expanding: /home/jifeng/hadoop/spark-1.2.0/python/lib/py4j-0.8.2.1-src.zip into /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 23 resources
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 402 Scala sources and 33 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes...
[ERROR] while compiling: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/broadcast/TorrentBroadcast.scaladuring phase: typerlibrary version: version 2.10.4compiler version: version 2.10.4reconstructed args: -Xplugin:/home/jifeng/.m2/repository/org/scalamacros/paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar -deprecation -feature -classpath /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes:/home/jifeng/.m2/repository/com/twitter/chill_2.10/0.5.0/chill_2.10-0.5.0.jar:/home/jifeng/.m2/repository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar:/home/jifeng/.m2/repository/com/esotericsoftware/reflectasm/reflectasm/1.07/reflectasm-1.07-shaded.jar:/home/jifeng/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/home/jifeng/.m2/repository/org/objenesis/objenesis/1.2/objenesis-1.2.jar:/home/jifeng/.m2/repository/com/twitter/chill-java/0.5.0/chill-java-0.5.0.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-client/2.4.1/hadoop-client-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-common/2.4.1/hadoop-common-2.4.1.jar:/home/jifeng/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/jifeng/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/jifeng/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/jifeng/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/jifeng/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar:/home/jifeng/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/jifeng/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/jifeng/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/jifeng/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/jifeng/.m2/repository/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/home/jifeng/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.8.8/jackson-core-asl-1.8.8.jar:/home/jifeng/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.8.8/jackson-mapper-asl-1.8.8.jar:/home/jifeng/.m2/repository/org/apache/avro/avro/1.7.6/avro-1.7.6.jar:/home/jifeng/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-auth/2.4.1/hadoop-auth-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar:/home/jifeng/.m2/repository/org/tukaani/xz/1.0/xz-1.0.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.4.1/hadoop-hdfs-2.4.1.jar:/home/jifeng/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.4.1/hadoop-mapreduce-client-app-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.4.1/hadoop-mapreduce-client-common-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.4.1/hadoop-yarn-client-2.4.1.jar:/home/jifeng/.m2/repository/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.4.1/hadoop-yarn-server-common-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.4.1/hadoop-mapreduce-client-shuffle-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.4.1/hadoop-yarn-api-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.4.1/hadoop-mapreduce-client-core-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.4.1/hadoop-yarn-common-2.4.1.jar:/home/jifeng/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/jifeng/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/jifeng/.m2/repository/javax/activation/activation/1.1/activation-1.1.jar:/home/jifeng/.m2/repository/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.4.1/hadoop-mapreduce-client-jobclient-2.4.1.jar:/home/jifeng/.m2/repository/org/apache/hadoop/hadoop-annotations/2.4.1/hadoop-annotations-2.4.1.jar:/home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar:/home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar:/home/jifeng/.m2/repository/net/java/dev/jets3t/jets3t/0.9.0/jets3t-0.9.0.jar:/home/jifeng/.m2/repository/commons-codec/commons-codec/1.5/commons-codec-1.5.jar:/home/jifeng/.m2/repository/org/apache/httpcomponents/httpclient/4.1.2/httpclient-4.1.2.jar:/home/jifeng/.m2/repository/org/apache/httpcomponents/httpcore/4.1.2/httpcore-4.1.2.jar:/home/jifeng/.m2/repository/com/jamesmurty/utils/java-xmlbuilder/0.4/java-xmlbuilder-0.4.jar:/home/jifeng/.m2/repository/org/apache/curator/curator-recipes/2.4.0/curator-recipes-2.4.0.jar:/home/jifeng/.m2/repository/org/apache/curator/curator-framework/2.4.0/curator-framework-2.4.0.jar:/home/jifeng/.m2/repository/org/apache/curator/curator-client/2.4.0/curator-client-2.4.0.jar:/home/jifeng/.m2/repository/org/apache/zookeeper/zookeeper/3.4.5/zookeeper-3.4.5.jar:/home/jifeng/.m2/repository/jline/jline/0.9.94/jline-0.9.94.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-plus/8.1.14.v20131031/jetty-plus-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.transaction/1.1.1.v201105210645/javax.transaction-1.1.1.v201105210645.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-webapp/8.1.14.v20131031/jetty-webapp-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-xml/8.1.14.v20131031/jetty-xml-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-servlet/8.1.14.v20131031/jetty-servlet-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-jndi/8.1.14.v20131031/jetty-jndi-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.mail.glassfish/1.4.1.v201005082020/javax.mail.glassfish-1.4.1.v201005082020.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.activation/1.1.0.v201105071233/javax.activation-1.1.0.v201105071233.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-security/8.1.14.v20131031/jetty-security-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-util/8.1.14.v20131031/jetty-util-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-server/8.1.14.v20131031/jetty-server-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/orbit/javax.servlet/3.0.0.v201112011016/javax.servlet-3.0.0.v201112011016.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-continuation/8.1.14.v20131031/jetty-continuation-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-http/8.1.14.v20131031/jetty-http-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/org/eclipse/jetty/jetty-io/8.1.14.v20131031/jetty-io-8.1.14.v20131031.jar:/home/jifeng/.m2/repository/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/home/jifeng/.m2/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/home/jifeng/.m2/repository/org/apache/commons/commons-math3/3.1.1/commons-math3-3.1.1.jar:/home/jifeng/.m2/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/home/jifeng/.m2/repository/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar:/home/jifeng/.m2/repository/org/slf4j/jul-to-slf4j/1.7.5/jul-to-slf4j-1.7.5.jar:/home/jifeng/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.5/jcl-over-slf4j-1.7.5.jar:/home/jifeng/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/jifeng/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar:/home/jifeng/.m2/repository/com/ning/compress-lzf/1.0.0/compress-lzf-1.0.0.jar:/home/jifeng/.m2/repository/org/xerial/snappy/snappy-java/1.1.1.6/snappy-java-1.1.1.6.jar:/home/jifeng/.m2/repository/net/jpountz/lz4/lz4/1.2.0/lz4-1.2.0.jar:/home/jifeng/.m2/repository/org/roaringbitmap/RoaringBitmap/0.4.5/RoaringBitmap-0.4.5.jar:/home/jifeng/.m2/repository/commons-net/commons-net/2.2/commons-net-2.2.jar:/home/jifeng/.m2/repository/org/spark-project/akka/akka-remote_2.10/2.3.4-spark/akka-remote_2.10-2.3.4-spark.jar:/home/jifeng/.m2/repository/org/spark-project/akka/akka-actor_2.10/2.3.4-spark/akka-actor_2.10-2.3.4-spark.jar:/home/jifeng/.m2/repository/com/typesafe/config/1.2.1/config-1.2.1.jar:/home/jifeng/.m2/repository/io/netty/netty/3.8.0.Final/netty-3.8.0.Final.jar:/home/jifeng/.m2/repository/org/spark-project/protobuf/protobuf-java/2.5.0-spark/protobuf-java-2.5.0-spark.jar:/home/jifeng/.m2/repository/org/uncommons/maths/uncommons-maths/1.2.2a/uncommons-maths-1.2.2a.jar:/home/jifeng/.m2/repository/org/spark-project/akka/akka-slf4j_2.10/2.3.4-spark/akka-slf4j_2.10-2.3.4-spark.jar:/home/jifeng/.m2/repository/org/json4s/json4s-jackson_2.10/3.2.10/json4s-jackson_2.10-3.2.10.jar:/home/jifeng/.m2/repository/org/json4s/json4s-core_2.10/3.2.10/json4s-core_2.10-3.2.10.jar:/home/jifeng/.m2/repository/org/json4s/json4s-ast_2.10/3.2.10/json4s-ast_2.10-3.2.10.jar:/home/jifeng/.m2/repository/com/thoughtworks/paranamer/paranamer/2.6/paranamer-2.6.jar:/home/jifeng/.m2/repository/org/scala-lang/scalap/2.10.4/scalap-2.10.4.jar:/home/jifeng/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar:/home/jifeng/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.3.1/jackson-databind-2.3.1.jar:/home/jifeng/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.3.0/jackson-annotations-2.3.0.jar:/home/jifeng/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.3.1/jackson-core-2.3.1.jar:/home/jifeng/.m2/repository/org/apache/mesos/mesos/0.18.1/mesos-0.18.1-shaded-protobuf.jar:/home/jifeng/.m2/repository/io/netty/netty-all/4.0.23.Final/netty-all-4.0.23.Final.jar:/home/jifeng/.m2/repository/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-core/3.0.0/metrics-core-3.0.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-jvm/3.0.0/metrics-jvm-3.0.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-json/3.0.0/metrics-json-3.0.0.jar:/home/jifeng/.m2/repository/com/codahale/metrics/metrics-graphite/3.0.0/metrics-graphite-3.0.0.jar:/home/jifeng/.m2/repository/org/tachyonproject/tachyon-client/0.5.0/tachyon-client-0.5.0.jar:/home/jifeng/.m2/repository/org/tachyonproject/tachyon/0.5.0/tachyon-0.5.0.jar:/home/jifeng/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar:/home/jifeng/.m2/repository/org/spark-project/pyrolite/2.0.1/pyrolite-2.0.1.jar:/home/jifeng/.m2/repository/net/sf/py4j/py4j/0.8.2.1/py4j-0.8.2.1.jar:/home/jifeng/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/home/jifeng/.m2/repository/org/codehaus/groovy/groovy-all/2.3.7/groovy-all-2.3.7.jar -bootclasspath /home/jifeng/jdk1.7.0_45/jre/lib/resources.jar:/home/jifeng/jdk1.7.0_45/jre/lib/rt.jar:/home/jifeng/jdk1.7.0_45/jre/lib/sunrsasign.jar:/home/jifeng/jdk1.7.0_45/jre/lib/jsse.jar:/home/jifeng/jdk1.7.0_45/jre/lib/jce.jar:/home/jifeng/jdk1.7.0_45/jre/lib/charsets.jar:/home/jifeng/jdk1.7.0_45/jre/lib/jfr.jar:/home/jifeng/jdk1.7.0_45/jre/classes:/home/jifeng/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar -uncheckedlast tree to typer: Ident(Boolean)symbol: <none> (flags: )symbol definition: <none>symbol owners: context owners: value $anonfun -> value is -> method unBlockifyObject -> object TorrentBroadcast -> package broadcast== Enclosing template or block ==Block(// 7 statementsApply("require"// 2 arguments"blocks"."nonEmpty""Cannot unblockify an empty array of blocks")ValDef( // val is: <?>0"is"<tpt>Apply(new SequenceInputStream."<init>"Apply("asJavaEnumeration"Apply("blocks"."iterator"."map"Function( // val $anonfun: <notype>ValDef( // block: java.nio.ByteBuffer<param>"block"<tpt> // tree.tpe=java.nio.ByteBuffer<empty>)Apply(new ByteBufferInputStream."<init>""block"))))))ValDef( // val in: <?>0"in""InputStream"Apply(compressionCodec.map(((c) => c.compressedInputStream(is)))."getOrElse""is"))ValDef( // val ser: <?>0"ser"<tpt>Apply("serializer"."newInstance"Nil))ValDef( // val serIn: <?>0"serIn"<tpt>Apply("ser"."deserializeStream""in"))ValDef( // val obj: <?>0"obj"<tpt>Apply(TypeApply("serIn"."readObject""T")Nil))Apply("serIn"."close"Nil)"obj"
)uncaught exception during compilation: java.lang.OutOfMemoryError
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [ 9.006 s]
[INFO] Spark Project Networking .......................... SUCCESS [ 11.639 s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [ 8.465 s]
[INFO] Spark Project Core ................................ SKIPPED
[INFO] Spark Project Bagel ............................... SKIPPED
[INFO] Spark Project GraphX .............................. SKIPPED
[INFO] Spark Project Streaming ........................... SKIPPED
[INFO] Spark Project Catalyst ............................ SKIPPED
[INFO] Spark Project SQL ................................. SKIPPED
[INFO] Spark Project ML Library .......................... SKIPPED
[INFO] Spark Project Tools ............................... SKIPPED
[INFO] Spark Project Hive ................................ SKIPPED
[INFO] Spark Project REPL ................................ SKIPPED
[INFO] Spark Project YARN Parent POM ..................... SKIPPED
[INFO] Spark Project YARN Stable API ..................... SKIPPED
[INFO] Spark Project Assembly ............................ SKIPPED
[INFO] Spark Project External Twitter .................... SKIPPED
[INFO] Spark Project External Flume Sink ................. SKIPPED
[INFO] Spark Project External Flume ...................... SKIPPED
[INFO] Spark Project External MQTT ....................... SKIPPED
[INFO] Spark Project External ZeroMQ ..................... SKIPPED
[INFO] Spark Project External Kafka ...................... SKIPPED
[INFO] Spark Project Examples ............................ SKIPPED
[INFO] Spark Project YARN Shuffle Service ................ SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:00 min
[INFO] Finished at: 2015-02-10T11:05:46+08:00
[INFO] Final Memory: 51M/384M
[INFO] ------------------------------------------------------------------------
[ERROR] PermGen space -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError用这个./make-distribution.sh --tgz -Phadoop-2.4 -Pyarn -DskipTests -Dhadoop.version=2.4.1 -Phive
OK!
[jifeng@feng02 spark-1.2.0]$ ./make-distribution.sh --tgz -Phadoop-2.4 -Pyarn -DskipTests -Dhadoop.version=2.4.1 -Phive
***NOTE***: JAVA_HOME is not set to a JDK 6 installation. The resultingdistribution may not work well with PySpark and will not runwith Java 6 (See SPARK-1703 and SPARK-1911).This test can be disabled by adding --skip-java-test.
Output from 'java -version' was:
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
Would you like to continue anyways? [y,n]: y
Spark version is 1.2.0
Making spark-1.2.0-bin-2.4.1.tgz
Tachyon DisabledBuilding with...
$ mvn clean package -DskipTests -Phadoop-2.4 -Pyarn -DskipTests -Dhadoop.version=2.4.1 -Phive[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Spark Project Parent POM
[INFO] Spark Project Networking
[INFO] Spark Project Shuffle Streaming Service
[INFO] Spark Project Core
[INFO] Spark Project Bagel
[INFO] Spark Project GraphX
[INFO] Spark Project Streaming
[INFO] Spark Project Catalyst
[INFO] Spark Project SQL
[INFO] Spark Project ML Library
[INFO] Spark Project Tools
[INFO] Spark Project Hive
[INFO] Spark Project REPL
[INFO] Spark Project YARN Parent POM
[INFO] Spark Project YARN Stable API
[INFO] Spark Project Assembly
[INFO] Spark Project External Twitter
[INFO] Spark Project External Flume Sink
[INFO] Spark Project External Flume
[INFO] Spark Project External MQTT
[INFO] Spark Project External ZeroMQ
[INFO] Spark Project External Kafka
[INFO] Spark Project Examples
[INFO] Spark Project YARN Shuffle Service
[INFO]
[INFO] Using the builder org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder with a thread count of 1
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Parent POM 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-parent ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-parent ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-parent ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-parent ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-parent ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-parent ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-parent ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-parent ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-parent ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-parent ---
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-parent ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-parent ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 34 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Networking 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-common_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/common/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-common_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 42 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 42 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-common_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-common_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/common/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-common_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 7 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-common_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 7 source files to /home/jifeng/hadoop/spark-1.2.0/network/common/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-common_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (test-jar-on-test-compile) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-common_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-common_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-common_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-common_2.10 ---
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/common/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-common_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/common/target/spark-network-common_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-common_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/common/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/common/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1 ms
[INFO]
[INFO] --- maven-jar-plugin:2.2:test-jar (default) @ spark-network-common_2.10 ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Shuffle Streaming Service 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-shuffle_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-shuffle_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 20 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 20 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-shuffle_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-shuffle_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-shuffle_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 11 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-shuffle_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 11 source files to /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-shuffle_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-shuffle_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-shuffle_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-shuffle_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-shuffle_2.10 ---
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-shuffle_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/shuffle/target/spark-network-shuffle_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-shuffle_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/shuffle/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Core 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-core_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/core/target
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF/NOTICE
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF/DEPENDENCIES
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF/LICENSE
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/META-INF
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/finalizer.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/java_collections.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/version.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/compat.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/java_gateway.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j/protocol.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/py4j
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/spark-logo-77x50px-hd.png
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/additional-metrics.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/bootstrap-tooltip.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/jquery-1.11.1.min.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/spark_logo.png
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/initialize-tooltips.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/sorttable.js
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/bootstrap.min.css
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/webui.css
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static/table.js
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui/static
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/ui
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark/log4j-defaults.properties
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache/spark
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org/apache
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/org
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/tests.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/shell.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/traceback_utils.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/storagelevel.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/serializers.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/broadcast.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/java_gateway.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/daemon.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/accumulators.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/sql.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/resultiterable.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/rddsampler.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/statcounter.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/worker.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/cloudpickle.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/shuffle.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/files.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/rdd.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/conf.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/context.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/heapq3.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark/join.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes/pyspark
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/antrun/build-main.xml
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/antrun
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF/NOTICE
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF/DEPENDENCIES
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF/LICENSE
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources/META-INF
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target/maven-shared-archive-resources
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/core/target/.plxarc
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/core/target
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/core/../python/build (includes = [], excludes = [])
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/finalizer.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/java_collections.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/version.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/compat.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/java_gateway.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_callback_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/py4j_callback_example.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_list_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_gateway_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/multithreadtest.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/__init__.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/byte_string_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_map_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/py4j_example.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/py4j_callback_example2.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_array_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/java_set_test.py
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests/finalizer_test.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/tests
[INFO] Deleting file /home/jifeng/hadoop/spark-1.2.0/python/build/py4j/protocol.py
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/python/build/py4j
[INFO] Deleting directory /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-core_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-core_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-antrun-plugin:1.7:run (default) @ spark-core_2.10 ---
[WARNING] Parameter tasks is deprecated, use target instead
[INFO] Executing tasksmain:[unzip] Expanding: /home/jifeng/hadoop/spark-1.2.0/python/lib/py4j-0.8.2.1-src.zip into /home/jifeng/hadoop/spark-1.2.0/python/build
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 23 resources
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 402 Scala sources and 33 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/scheduler/TaskResultGetter.scala:50: inferred existential type (org.apache.spark.scheduler.DirectTaskResult[_$1], Int) forSome { type _$1 }, which cannot be expressed by wildcards, should be enabled
by making the implicit value scala.language.existentials visible.
This can be achieved by adding the import clause 'import scala.language.existentials'
or by setting the compiler option -language:existentials.
See the Scala docs for value scala.language.existentials for a discussion
why the feature should be explicitly enabled.
[WARNING] val (result, size) = serializer.get().deserialize[TaskResult[_]](serializedData) match {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkContext.scala:573: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewHadoopJob(hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkContext.scala:618: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewHadoopJob(hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkContext.scala:773: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewHadoopJob(conf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala:168: constructor TaskID in class TaskID is deprecated: see corresponding Javadoc for more information.
[WARNING] new TaskAttemptID(new TaskID(jID.value, true, splitID), attemptID))
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala:189: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] outputPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala:103: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (!fs.getFileStatus(path).isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala:157: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] val logDirs = if (logStatus != null) logStatus.filter(_.isDir).toSeq else Seq[FileStatus]()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/input/PortableDataStream.scala:48: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (file.isDir) 0L else file.getLen
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/input/WholeTextFileInputFormat.scala:63: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (file.isDir) 0L else file.getLen
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/mapred/SparkHadoopMapRedUtil.scala:56: constructor TaskAttemptID in class TaskAttemptID is deprecated: see corresponding Javadoc for more information.
[WARNING] new TaskAttemptID(jtIdentifier, jobId, isMap, taskId, attemptId)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/CheckpointRDD.scala:110: method getDefaultReplication in class FileSystem is deprecated: see corresponding Javadoc for more information.
[WARNING] fs.create(tempOutputPath, false, bufferSize, fs.getDefaultReplication, blockSize)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/HadoopRDD.scala:349: constructor TaskID in class TaskID is deprecated: see corresponding Javadoc for more information.
[WARNING] val taId = new TaskAttemptID(new TaskID(jobID, true, splitId), attemptId)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala:884: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewAPIHadoopJob(hadoopConf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala:952: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new NewAPIHadoopJob(hadoopConf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala:202: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] fileStatuses.filter(!_.isDir).map(_.getPath).toSeq
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/main/scala/org/apache/spark/scheduler/InputFormatInfo.scala:106: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(conf)
[WARNING] ^
[WARNING] 17 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-core_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 33 source files to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-core_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-core_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 4 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-core_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 123 Scala sources and 4 Java sources to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/FileSuite.scala:497: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sc.hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/metrics/InputOutputMetricsSuite.scala:34: trait ShouldMatchers in package matchers is deprecated: Please use org.scalatest.Matchers instead.
[WARNING] class InputOutputMetricsSuite extends FunSuite with SharedSparkContext with ShouldMatchers {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/scheduler/EventLoggingListenerSuite.scala:177: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] assert(logDir.isDir)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/scheduler/ReplayListenerSuite.scala:124: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] assert(eventLogDir.isDir)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/core/src/test/scala/org/apache/spark/util/FileLoggerSuite.scala:106: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] assert(fileSystem.getFileStatus(logDirPath).isDir)
[WARNING] ^
[WARNING] 5 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/core/src/test/java/org/apache/spark/JavaAPISuite.java使用或覆盖了已过时的 API。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/core/src/test/java/org/apache/spark/JavaAPISuite.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-core_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 4 source files to /home/jifeng/hadoop/spark-1.2.0/core/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-core_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/core/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-core_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-core_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-core_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-core_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-dependency-plugin:2.9:copy-dependencies (copy-dependencies) @ spark-core_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-core_2.10 ---
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Including com.google.guava:guava:jar:14.0.1 in the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.spark-project.spark:unused:jar:1.0.0 from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/core/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/core/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-core_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/core/target/spark-core_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-core_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/core/scalastyle-output.xml
Processed 401 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 11690 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Bagel 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-bagel_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/bagel/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-bagel_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-bagel_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/bagel/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-bagel_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-bagel_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/bagel/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-bagel_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/bagel/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-bagel_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/bagel/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-bagel_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/bagel/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-bagel_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-bagel_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source to /home/jifeng/hadoop/spark-1.2.0/bagel/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-bagel_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-bagel_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-bagel_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-bagel_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-bagel_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-bagel_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-bagel_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-bagel_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/bagel/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/bagel/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-bagel_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/bagel/target/spark-bagel_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-bagel_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/bagel/scalastyle-output.xml
Processed 2 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 421 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project GraphX 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-graphx_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/graphx/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-graphx_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-graphx_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-graphx_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-graphx_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-graphx_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 38 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/graphx/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala:124: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] var messages = g.mapReduceTriplets(sendMsg, mergeMsg)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/main/scala/org/apache/spark/graphx/Pregel.scala:141: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] messages = g.mapReduceTriplets(sendMsg, mergeMsg, Some((newVerts, activeDirection))).cache()
[WARNING] ^
[WARNING] two warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-graphx_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/graphx/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-graphx_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-graphx_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-graphx_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 17 Scala sources to /home/jifeng/hadoop/spark-1.2.0/graphx/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:223: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val result = graph.mapReduceTriplets[Int](et => Iterator((et.dstId, et.srcAttr)), _ + _)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:287: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val neighborDegreeSums = starDeg.mapReduceTriplets(
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:297: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val numEvenNeighbors = vids.mapReduceTriplets(et => {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:311: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val numOddNeighbors = changedGraph.mapReduceTriplets(et => {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/graphx/src/test/scala/org/apache/spark/graphx/GraphSuite.scala:345: method mapReduceTriplets in class Graph is deprecated: use aggregateMessages
[WARNING] val neighborDegreeSums = reverseStarDegrees.mapReduceTriplets(
[WARNING] ^
[WARNING] 5 warnings found
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-graphx_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-graphx_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-graphx_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-graphx_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-graphx_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-graphx_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-graphx_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-graphx_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.jblas:jblas:jar:1.2.3 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/graphx/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/graphx/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-graphx_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/graphx/target/spark-graphx_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-graphx_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/graphx/scalastyle-output.xml
Processed 38 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 819 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Streaming 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/streaming/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/streaming/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/streaming/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 80 Scala sources and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/streaming/src/main/scala/org/apache/spark/streaming/util/WriteAheadLogManager.scala:184: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (fileSystem.exists(logDirectoryPath) && fileSystem.getFileStatus(logDirectoryPath).isDir) {
[WARNING] ^
[WARNING] one warning found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/streaming/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 19 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/streaming/src/test/scala/org/apache/spark/streaming/util/WriteAheadLogSuite.scala:343: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (fileSystem.exists(logDirectoryPath) && fileSystem.getFileStatus(logDirectoryPath).isDir) {
[WARNING] ^
[WARNING] one warning found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java使用或覆盖了已过时的 API。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/streaming/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (test-jar-on-test-compile) @ spark-streaming_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/streaming/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/streaming/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/streaming/target/spark-streaming_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/streaming/scalastyle-output.xml
Processed 80 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 670 ms
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ spark-streaming_2.10 ---
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Catalyst 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-catalyst_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-catalyst_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-catalyst_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-catalyst_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-catalyst_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-catalyst_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 67 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-catalyst_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-catalyst_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-catalyst_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-catalyst_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 22 Scala sources to /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-catalyst_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-catalyst_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (test-jar-on-test-compile) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-tests.jar
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-catalyst_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-catalyst_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-catalyst_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-catalyst_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-catalyst_2.10 ---
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-catalyst_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/sql/catalyst/scalastyle-output.xml
Processed 67 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1836 ms
[INFO]
[INFO] --- maven-jar-plugin:2.4:test-jar (default) @ spark-catalyst_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/catalyst/target/spark-catalyst_2.10-1.2.0-tests.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project SQL 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-sql_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/sql/core/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-sql_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-sql_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-sql_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-sql_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-sql_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 66 Scala sources and 44 Java sources to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetRelation.scala:182: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:83: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sc.hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:222: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sqlContext.sparkContext.hadoopConfiguration)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:275: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(conf)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:614: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTableOperations.scala:615: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (!fs.exists(path) || !fs.getFileStatus(path).isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTestData.scala:220: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:368: method fromCaseClassString in object DataType is deprecated: Use DataType.fromJson instead
[WARNING] Try(DataType.fromJson(string)).getOrElse(DataType.fromCaseClassString(string)) match {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:387: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:388: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] if (fs.exists(path) && !fs.getFileStatus(path).isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:432: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:438: method makeQualified in class Path is deprecated: see corresponding Javadoc for more information.
[WARNING] val path = origPath.makeQualified(fs)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/ParquetTypes.scala:457: method readFooter in object ParquetFileReader is deprecated: see corresponding Javadoc for more information.
[WARNING] .map(ParquetFileReader.readFooter(conf, _))
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala:103: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] val childDirs = childrenOfPath.filter(s => s.isDir)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/scala/org/apache/spark/sql/parquet/newParquet.scala:156: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job(sparkContext.hadoopConfiguration)
[WARNING] ^
[WARNING] 15 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/main/java/org/apache/spark/sql/api/java/UserDefinedType.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-sql_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 44 source files to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-sql_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-sql_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-sql_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 38 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/test-classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:288: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
This can be achieved by adding the import clause 'import scala.language.postfixOps'
or by setting the compiler option -language:postfixOps.
See the Scala docs for value scala.language.postfixOps for a discussion
why the feature should be explicitly enabled.
[WARNING] testData.select(sqrt('key)).orderBy('key asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:293: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] testData.select(sqrt('value), 'key).orderBy('key asc, 'value asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:293: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] testData.select(sqrt('value), 'key).orderBy('key asc, 'value asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:305: postfix operator asc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] testData.select(abs('key)).orderBy('key asc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/DslQuerySuite.scala:310: postfix operator desc should be enabled
by making the implicit value scala.language.postfixOps visible.
[WARNING] negativeData.select(abs('key)).orderBy('key desc),
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala:457: abstract type T is unchecked since it is eliminated by erasure
[WARNING] assert(filter.get.isInstanceOf[T])
[WARNING] ^
[WARNING] abstract type T is unchecked since it is eliminated by erasure
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/scala/org/apache/spark/sql/parquet/ParquetQuerySuite.scala:336: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] 8 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/sql/core/src/test/java/org/apache/spark/sql/api/java/JavaRowSuite.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-sql_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/sql/core/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-sql_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-sql_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-sql_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-sql_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-sql_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-sql_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-sql_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-catalyst_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-column:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-common:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-encoding:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-generator:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-format:jar:2.2.0-rc1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-jackson:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.11 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/core/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/core/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-sql_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/core/target/spark-sql_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-sql_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/sql/core/scalastyle-output.xml
Processed 66 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1153 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project ML Library 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-mllib_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/mllib/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-mllib_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/mllib/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-mllib_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 13 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-mllib_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 121 Scala sources and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-mllib_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-mllib_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/mllib/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-mllib_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-mllib_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 58 Scala sources and 16 Java sources to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/mllib/src/test/java/org/apache/spark/mllib/feature/JavaTfIdfSuite.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-mllib_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 16 source files to /home/jifeng/hadoop/spark-1.2.0/mllib/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-mllib_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-mllib_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-mllib_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-mllib_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-mllib_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-mllib_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-mllib_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-sql_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-catalyst_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-column:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-common:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-encoding:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-generator:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-format:jar:2.2.0-rc1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-jackson:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.11 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.jblas:jblas:jar:1.2.3 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze_2.10:jar:0.10 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze-macros_2.10:jar:0.3.1 from the shaded jar.
[INFO] Excluding com.github.fommil.netlib:core:jar:1.1.2 from the shaded jar.
[INFO] Excluding net.sourceforge.f2j:arpack_combined_all:jar:0.1 from the shaded jar.
[INFO] Excluding net.sf.opencsv:opencsv:jar:2.3 from the shaded jar.
[INFO] Excluding com.github.rwl:jtransforms:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.spire-math:spire_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.spire-math:spire-macros_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/mllib/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/mllib/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-mllib_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/mllib/target/spark-mllib_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-mllib_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/mllib/scalastyle-output.xml
Processed 121 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 1190 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Tools 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-tools_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/tools/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-tools_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-tools_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/tools/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-tools_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-tools_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/tools/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-tools_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources to /home/jifeng/hadoop/spark-1.2.0/tools/target/scala-2.10/classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-tools_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-tools_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/tools/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-tools_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/tools/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-tools_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-tools_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-tools_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/tools/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-tools_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-tools_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-tools_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-tools_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-tools_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-tools_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/tools/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-tools_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/tools/target/spark-tools_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-tools_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/tools/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 46 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Hive 1.2.0
[INFO] ------------------------------------------------------------------------
Downloading: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.5/avro-mapred-1.7.5.jar
Downloading: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.6/avro-mapred-1.7.6-hadoop2.jar
Downloaded: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.6/avro-mapred-1.7.6-hadoop2.jar (169 KB at 40.2 KB/sec)
Downloaded: https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.7.5/avro-mapred-1.7.5.jar (167 KB at 34.6 KB/sec)
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-hive_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/sql/hive/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-hive_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-hive_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala added.
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-default-sources) @ spark-hive_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/v0.13.1/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-hive_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-hive_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-hive_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 21 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/classes...
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/parquet/FakeParquetSerDe.scala:34: @deprecated now takes two arguments; see the scaladoc.
[WARNING] @deprecated("No code should depend on FakeParquetHiveSerDe as it is only intended as a " +
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala:141: method isDir in class FileStatus is deprecated: see corresponding Javadoc for more information.
[WARNING] val size = if (fileStatus.isDir) {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala:494: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] Utils.getContextOrSparkClassLoader).asInstanceOf[Class[Deserializer]],
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:73: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] relation.tableDesc.getDeserializerClass.asInstanceOf[Class[Deserializer]],
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:87: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] deserializerClass: Class[_ <: Deserializer],
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:121: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] (part, part.getDeserializer.getClass.asInstanceOf[Class[Deserializer]])).toMap
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:136: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] partitionToDeserializer: Map[HivePartition,
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/TableReader.scala:266: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] deserializer: Deserializer,
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala:63: trait Serializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] private def newSerializer(tableDesc: TableDesc): Serializer = {
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/InsertIntoHiveTable.scala:64: trait Serializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] val serializer = tableDesc.getDeserializerClass.newInstance().asInstanceOf[Serializer]
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala:218: class UDAF in package exec is deprecated: see corresponding Javadoc for more information.
[WARNING] type UDFType = UDAF
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala:267: method initialize in class GenericUDTF is deprecated: see corresponding Javadoc for more information.
[WARNING] protected lazy val outputInspector = function.initialize(inputInspectors.toArray)
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveUdfs.scala:333: class UDAF in package exec is deprecated: see corresponding Javadoc for more information.
[WARNING] new GenericUDAFBridge(funcWrapper.createFunction[UDAF]())
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveWriterContainers.scala:142: constructor TaskID in class TaskID is deprecated: see corresponding Javadoc for more information.
[WARNING] new TaskAttemptID(new TaskID(jID.value, true, splitID), attemptID))
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/sql/hive/v0.13.1/src/main/scala/org/apache/spark/sql/hive/Shim13.scala:159: trait Deserializer in package serde2 is deprecated: see corresponding Javadoc for more information.
[WARNING] serdeClass: Class[_ <: Deserializer],
[WARNING] ^
[WARNING] 15 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-hive_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-hive_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/sql/hive/compatibility/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-hive_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9636 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-hive_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 24 Scala sources and 5 Java sources to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: /home/jifeng/hadoop/spark-1.2.0/sql/hive/src/test/java/org/apache/spark/sql/hive/execution/UDFListListInt.java使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-hive_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 5 source files to /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.4:build-classpath (default) @ spark-hive_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-hive_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-hive_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-hive_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-hive_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-hive_2.10 ---
[INFO]
[INFO] --- maven-dependency-plugin:2.4:copy-dependencies (copy-dependencies) @ spark-hive_2.10 ---
[INFO] datanucleus-core-3.2.10.jar already exists in destination.
[INFO] datanucleus-rdbms-3.2.9.jar already exists in destination.
[INFO] datanucleus-api-jdo-3.2.6.jar already exists in destination.
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-hive_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-sql_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-catalyst_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-column:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-common:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-encoding:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-generator:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.twitter:parquet-format:jar:2.2.0-rc1 from the shaded jar.
[INFO] Excluding com.twitter:parquet-jackson:jar:1.6.0rc3 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-metastore:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-shims:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-common:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-0.20:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-common-secure:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-0.20S:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive.shims:hive-shims-0.23:jar:0.13.1a from the shaded jar.
[INFO] Excluding com.jolbox:bonecp:jar:0.8.0.RELEASE from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.4 from the shaded jar.
[INFO] Excluding commons-logging:commons-logging:jar:1.1.3 from the shaded jar.
[INFO] Excluding org.apache.derby:derby:jar:10.10.1.1 from the shaded jar.
[INFO] Excluding org.datanucleus:datanucleus-api-jdo:jar:3.2.6 from the shaded jar.
[INFO] Excluding org.datanucleus:datanucleus-core:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.datanucleus:datanucleus-rdbms:jar:3.2.9 from the shaded jar.
[INFO] Excluding javax.jdo:jdo-api:jar:3.0.1 from the shaded jar.
[INFO] Excluding javax.transaction:jta:jar:1.1 from the shaded jar.
[INFO] Excluding org.antlr:antlr-runtime:jar:3.4 from the shaded jar.
[INFO] Excluding org.antlr:stringtemplate:jar:3.2.1 from the shaded jar.
[INFO] Excluding antlr:antlr:jar:2.7.7 from the shaded jar.
[INFO] Excluding org.apache.thrift:libfb303:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.thrift:libthrift:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-exec:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-ant:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.apache.velocity:velocity:jar:1.5 from the shaded jar.
[INFO] Excluding oro:oro:jar:2.0.8 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-common:jar:0.13.1a from the shaded jar.
[INFO] Excluding com.twitter:parquet-hadoop-bundle:jar:1.3.2 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding javolution:javolution:jar:5.5.1 from the shaded jar.
[INFO] Excluding org.antlr:ST4:jar:4.0.4 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-mapred:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.apache.ant:ant:jar:1.9.1 from the shaded jar.
[INFO] Excluding org.apache.ant:ant-launcher:jar:1.9.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.2 from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding com.googlecode.javaewah:JavaEWAH:jar:0.3.2 from the shaded jar.
[INFO] Excluding org.iq80.snappy:snappy:jar:0.2 from the shaded jar.
[INFO] Excluding org.json:json:jar:20090211 from the shaded jar.
[INFO] Excluding stax:stax-api:jar:1.0.1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.spark-project.hive:hive-serde:jar:0.13.1a from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-mapred:jar:hadoop2:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:tests:1.7.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/hive/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/hive/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/sql/hive/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-hive_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/sql/hive/target/spark-hive_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-hive_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/sql/hive/scalastyle-output.xml
Processed 20 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 759 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project REPL 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-repl_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/repl/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-repl_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-repl_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/scala-2.10/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-repl_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-repl_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/repl/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-repl_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 13 Scala sources to /home/jifeng/hadoop/spark-1.2.0/repl/target/scala-2.10/classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-repl_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-repl_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/repl/scala-2.10/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-repl_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-repl_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Scala sources to /home/jifeng/hadoop/spark-1.2.0/repl/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-repl_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-repl_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/repl/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-repl_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-repl_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-repl_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-repl_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-repl_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-repl_2.10 ---
[INFO] Excluding org.scala-lang:jline:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.fusesource.jansi:jansi:jar:1.4 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-bagel_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-mllib_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.jblas:jblas:jar:1.2.3 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze_2.10:jar:0.10 from the shaded jar.
[INFO] Excluding org.scalanlp:breeze-macros_2.10:jar:0.3.1 from the shaded jar.
[INFO] Excluding com.github.fommil.netlib:core:jar:1.1.2 from the shaded jar.
[INFO] Excluding net.sourceforge.f2j:arpack_combined_all:jar:0.1 from the shaded jar.
[INFO] Excluding net.sf.opencsv:opencsv:jar:2.3 from the shaded jar.
[INFO] Excluding com.github.rwl:jtransforms:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.spire-math:spire_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.spire-math:spire-macros_2.10:jar:0.7.4 from the shaded jar.
[INFO] Excluding org.scalamacros:quasiquotes_2.10:jar:2.0.1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.11 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/repl/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/repl/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-repl_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/repl/target/spark-repl_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-repl_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/repl/scalastyle-output.xml
Processed 1 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 49 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project YARN Parent POM 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ yarn-parent_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/yarn/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ yarn-parent_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ yarn-parent_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ yarn-parent_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/common/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ yarn-parent_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ yarn-parent_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/yarn/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ yarn-parent_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ yarn-parent_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ yarn-parent_2.10 ---
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding com.google.inject.extensions:guice-servlet:jar:3.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding com.google.inject:guice:jar:3.0 from the shaded jar.
[INFO] Excluding javax.inject:javax.inject:jar:1 from the shaded jar.
[INFO] Excluding aopalliance:aopalliance:jar:1.0 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-server:jar:1.9 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-json:jar:1.9 from the shaded jar.
[INFO] Excluding org.codehaus.jettison:jettison:jar:1.1 from the shaded jar.
[INFO] Excluding com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-jaxrs:jar:1.8.3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-xc:jar:1.8.3 from the shaded jar.
[INFO] Excluding com.sun.jersey.contribs:jersey-guice:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ yarn-parent_2.10 ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ yarn-parent_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/yarn/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/yarn/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 11 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project YARN Stable API 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-yarn_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-yarn_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-yarn_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/common/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-yarn_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/yarn/common/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-yarn_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 17 Scala sources to /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/scala-2.10/classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-yarn_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-yarn_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/src/test/scala added.
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/yarn/common/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-yarn_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 5 Scala sources to /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-yarn_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-yarn_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-yarn_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-yarn_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-yarn_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-yarn_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-yarn_2.10 ---
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding jline:jline:jar:0.9.94 from the shaded jar.
[INFO] Excluding org.codehaus.jettison:jettison:jar:1.1 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-core_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.twitter:chill_2.10:jar:0.5.0 from the shaded jar.
[INFO] Excluding com.esotericsoftware.kryo:kryo:jar:2.21 from the shaded jar.
[INFO] Excluding com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 from the shaded jar.
[INFO] Excluding com.esotericsoftware.minlog:minlog:jar:1.2 from the shaded jar.
[INFO] Excluding org.objenesis:objenesis:jar:1.2 from the shaded jar.
[INFO] Excluding com.twitter:chill-java:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-common_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.9.0 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpclient:jar:4.1.2 from the shaded jar.
[INFO] Excluding org.apache.httpcomponents:httpcore:jar:4.1.2 from the shaded jar.
[INFO] Excluding com.jamesmurty.utils:java-xmlbuilder:jar:0.4 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-lang3:jar:3.3.2 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-math3:jar:3.1.1 from the shaded jar.
[INFO] Excluding com.google.code.findbugs:jsr305:jar:1.3.9 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jul-to-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.slf4j:jcl-over-slf4j:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding com.ning:compress-lzf:jar:1.0.0 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.roaringbitmap:RoaringBitmap:jar:0.4.5 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding io.netty:netty:jar:3.8.0.Final from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.uncommons.maths:uncommons-maths:jar:1.2.2a from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.json4s:json4s-jackson_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-core_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding org.json4s:json4s-ast_2.10:jar:3.2.10 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scalap:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-databind:jar:2.3.1 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 from the shaded jar.
[INFO] Excluding com.fasterxml.jackson.core:jackson-core:jar:2.3.1 from the shaded jar.
[INFO] Excluding org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 from the shaded jar.
[INFO] Excluding io.netty:netty-all:jar:4.0.23.Final from the shaded jar.
[INFO] Excluding com.clearspring.analytics:stream:jar:2.7.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-core:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-jvm:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-json:jar:3.0.0 from the shaded jar.
[INFO] Excluding com.codahale.metrics:metrics-graphite:jar:3.0.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon-client:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.tachyonproject:tachyon:jar:0.5.0 from the shaded jar.
[INFO] Excluding org.spark-project:pyrolite:jar:2.0.1 from the shaded jar.
[INFO] Excluding net.sf.py4j:py4j:jar:0.8.2.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.6 from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java:jar:2.5.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding javax.xml.bind:jaxb-api:jar:2.2.2 from the shaded jar.
[INFO] Excluding javax.xml.stream:stax-api:jar:1.0-2 from the shaded jar.
[INFO] Excluding javax.activation:activation:jar:1.1 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-core:jar:1.9 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding com.google.inject.extensions:guice-servlet:jar:3.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.4 from the shaded jar.
[INFO] Excluding com.google.inject:guice:jar:3.0 from the shaded jar.
[INFO] Excluding javax.inject:javax.inject:jar:1 from the shaded jar.
[INFO] Excluding aopalliance:aopalliance:jar:1.0 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-server:jar:1.9 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-json:jar:1.9 from the shaded jar.
[INFO] Excluding com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-jaxrs:jar:1.8.3 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-xc:jar:1.8.3 from the shaded jar.
[INFO] Excluding com.sun.jersey.contribs:jersey-guice:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:2.4.1 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.sun.jersey:jersey-client:jar:1.9 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-client:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding xmlenc:xmlenc:jar:0.52 from the shaded jar.
[INFO] Excluding commons-collections:commons-collections:jar:3.2.1 from the shaded jar.
[INFO] Excluding commons-configuration:commons-configuration:jar:1.6 from the shaded jar.
[INFO] Excluding commons-digester:commons-digester:jar:1.8 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils:jar:1.7.0 from the shaded jar.
[INFO] Excluding commons-beanutils:commons-beanutils-core:jar:1.8.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-auth:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/yarn/stable/target/spark-yarn_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-yarn_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/yarn/stable/scalastyle-output.xml
Processed 4 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 37 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Assembly 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-assembly_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/assembly/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-assembly_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/assembly/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-assembly_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-assembly_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/assembly/src/test/scala added.
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-assembly_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-assembly_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/assembly/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-assembly_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-assembly_2.10 ---
[INFO] Including com.google.guava:guava:jar:14.0.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-core_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including com.twitter:chill_2.10:jar:0.5.0 in the shaded jar.
[INFO] Including com.esotericsoftware.kryo:kryo:jar:2.21 in the shaded jar.
[INFO] Including com.esotericsoftware.reflectasm:reflectasm:jar:shaded:1.07 in the shaded jar.
[INFO] Including com.esotericsoftware.minlog:minlog:jar:1.2 in the shaded jar.
[INFO] Including org.objenesis:objenesis:jar:1.2 in the shaded jar.
[INFO] Including com.twitter:chill-java:jar:0.5.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-client:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-common:jar:2.4.1 in the shaded jar.
[INFO] Including xmlenc:xmlenc:jar:0.52 in the shaded jar.
[INFO] Including commons-collections:commons-collections:jar:3.2.1 in the shaded jar.
[INFO] Including commons-configuration:commons-configuration:jar:1.6 in the shaded jar.
[INFO] Including commons-digester:commons-digester:jar:1.8 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils:jar:1.7.0 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils-core:jar:1.8.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-auth:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-hdfs:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-annotations:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-network-common_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including net.java.dev.jets3t:jets3t:jar:0.9.0 in the shaded jar.
[INFO] Including commons-codec:commons-codec:jar:1.5 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpcore:jar:4.1.2 in the shaded jar.
[INFO] Including com.jamesmurty.utils:java-xmlbuilder:jar:0.4 in the shaded jar.
[INFO] Including org.apache.curator:curator-recipes:jar:2.4.0 in the shaded jar.
[INFO] Including org.apache.curator:curator-framework:jar:2.4.0 in the shaded jar.
[INFO] Including org.apache.curator:curator-client:jar:2.4.0 in the shaded jar.
[INFO] Including org.apache.zookeeper:zookeeper:jar:3.4.5 in the shaded jar.
[INFO] Including jline:jline:jar:0.9.94 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-plus:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.transaction:jar:1.1.1.v201105210645 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-webapp:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-xml:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-servlet:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-jndi:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.mail.glassfish:jar:1.4.1.v201005082020 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.activation:jar:1.1.0.v201105071233 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-security:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.apache.commons:commons-lang3:jar:3.3.2 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar.
[INFO] Including com.google.code.findbugs:jsr305:jar:1.3.9 in the shaded jar.
[INFO] Including org.slf4j:slf4j-api:jar:1.7.5 in the shaded jar.
[INFO] Including org.slf4j:jul-to-slf4j:jar:1.7.5 in the shaded jar.
[INFO] Including org.slf4j:jcl-over-slf4j:jar:1.7.5 in the shaded jar.
[INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar.
[INFO] Including org.slf4j:slf4j-log4j12:jar:1.7.5 in the shaded jar.
[INFO] Including com.ning:compress-lzf:jar:1.0.0 in the shaded jar.
[INFO] Including org.xerial.snappy:snappy-java:jar:1.1.1.6 in the shaded jar.
[INFO] Including net.jpountz.lz4:lz4:jar:1.2.0 in the shaded jar.
[INFO] Including org.roaringbitmap:RoaringBitmap:jar:0.4.5 in the shaded jar.
[INFO] Including commons-net:commons-net:jar:2.2 in the shaded jar.
[INFO] Including org.spark-project.akka:akka-remote_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including com.typesafe:config:jar:1.2.1 in the shaded jar.
[INFO] Including io.netty:netty:jar:3.8.0.Final in the shaded jar.
[INFO] Including org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark in the shaded jar.
[INFO] Including org.uncommons.maths:uncommons-maths:jar:1.2.2a in the shaded jar.
[INFO] Including org.spark-project.akka:akka-slf4j_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including org.scala-lang:scala-library:jar:2.10.4 in the shaded jar.
[INFO] Including org.json4s:json4s-jackson_2.10:jar:3.2.10 in the shaded jar.
[INFO] Including org.json4s:json4s-core_2.10:jar:3.2.10 in the shaded jar.
[INFO] Including org.json4s:json4s-ast_2.10:jar:3.2.10 in the shaded jar.
[INFO] Including org.scala-lang:scalap:jar:2.10.4 in the shaded jar.
[INFO] Including org.apache.mesos:mesos:jar:shaded-protobuf:0.18.1 in the shaded jar.
[INFO] Including io.netty:netty-all:jar:4.0.23.Final in the shaded jar.
[INFO] Including com.clearspring.analytics:stream:jar:2.7.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-core:jar:3.0.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-jvm:jar:3.0.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-json:jar:3.0.0 in the shaded jar.
[INFO] Including com.codahale.metrics:metrics-graphite:jar:3.0.0 in the shaded jar.
[INFO] Including org.tachyonproject:tachyon-client:jar:0.5.0 in the shaded jar.
[INFO] Including org.tachyonproject:tachyon:jar:0.5.0 in the shaded jar.
[INFO] Including org.spark-project:pyrolite:jar:2.0.1 in the shaded jar.
[INFO] Including net.sf.py4j:py4j:jar:0.8.2.1 in the shaded jar.
[INFO] Including org.apache.spark:spark-bagel_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-mllib_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.jblas:jblas:jar:1.2.3 in the shaded jar.
[INFO] Including org.scalanlp:breeze_2.10:jar:0.10 in the shaded jar.
[INFO] Including org.scalanlp:breeze-macros_2.10:jar:0.3.1 in the shaded jar.
[INFO] Including com.github.fommil.netlib:core:jar:1.1.2 in the shaded jar.
[INFO] Including net.sourceforge.f2j:arpack_combined_all:jar:0.1 in the shaded jar.
[INFO] Including net.sf.opencsv:opencsv:jar:2.3 in the shaded jar.
[INFO] Including com.github.rwl:jtransforms:jar:2.4.0 in the shaded jar.
[INFO] Including org.spire-math:spire_2.10:jar:0.7.4 in the shaded jar.
[INFO] Including org.spire-math:spire-macros_2.10:jar:0.7.4 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-graphx_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-sql_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-catalyst_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.scalamacros:quasiquotes_2.10:jar:2.0.1 in the shaded jar.
[INFO] Including com.twitter:parquet-column:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-common:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-encoding:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-generator:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-hadoop:jar:1.6.0rc3 in the shaded jar.
[INFO] Including com.twitter:parquet-format:jar:2.2.0-rc1 in the shaded jar.
[INFO] Including com.twitter:parquet-jackson:jar:1.6.0rc3 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.11 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-databind:jar:2.3.0 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-annotations:jar:2.3.0 in the shaded jar.
[INFO] Including com.fasterxml.jackson.core:jackson-core:jar:2.3.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-repl_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.scala-lang:jline:jar:2.10.4 in the shaded jar.
[INFO] Including org.fusesource.jansi:jansi:jar:1.4 in the shaded jar.
[INFO] Including org.scala-lang:scala-compiler:jar:2.10.4 in the shaded jar.
[INFO] Including org.scala-lang:scala-reflect:jar:2.10.4 in the shaded jar.
[INFO] Including org.apache.spark:spark-yarn_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-api:jar:2.4.1 in the shaded jar.
[INFO] Including commons-lang:commons-lang:jar:2.6 in the shaded jar.
[INFO] Including com.google.protobuf:protobuf-java:jar:2.5.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-common:jar:2.4.1 in the shaded jar.
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar.
[INFO] Including javax.xml.stream:stax-api:jar:1.0-2 in the shaded jar.
[INFO] Including javax.activation:activation:jar:1.1 in the shaded jar.
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar.
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-core:jar:1.9 in the shaded jar.
[INFO] Including commons-cli:commons-cli:jar:1.2 in the shaded jar.
[INFO] Including com.google.inject.extensions:guice-servlet:jar:3.0 in the shaded jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including com.google.inject:guice:jar:3.0 in the shaded jar.
[INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar.
[INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-server:jar:1.9 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-json:jar:1.9 in the shaded jar.
[INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar.
[INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-jaxrs:jar:1.8.3 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-xc:jar:1.8.3 in the shaded jar.
[INFO] Including com.sun.jersey.contribs:jersey-guice:jar:1.9 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-server-web-proxy:jar:2.4.1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-server-common:jar:2.4.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty:jar:6.1.26 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-client:jar:2.4.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-util:jar:6.1.26 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-client:jar:1.9 in the shaded jar.
[INFO] Including org.apache.spark:spark-hive_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-metastore:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive:hive-shims:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-common:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-0.20:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-common-secure:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-0.20S:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive.shims:hive-shims-0.23:jar:0.13.1a in the shaded jar.
[INFO] Including com.jolbox:bonecp:jar:0.8.0.RELEASE in the shaded jar.
[INFO] Including commons-logging:commons-logging:jar:1.1.3 in the shaded jar.
[INFO] Including org.apache.derby:derby:jar:10.10.1.1 in the shaded jar.
[INFO] Including org.datanucleus:datanucleus-api-jdo:jar:3.2.6 in the shaded jar.
[INFO] Including org.datanucleus:datanucleus-core:jar:3.2.10 in the shaded jar.
[INFO] Including org.datanucleus:datanucleus-rdbms:jar:3.2.9 in the shaded jar.
[INFO] Including javax.jdo:jdo-api:jar:3.0.1 in the shaded jar.
[INFO] Including javax.transaction:jta:jar:1.1 in the shaded jar.
[INFO] Including org.antlr:antlr-runtime:jar:3.4 in the shaded jar.
[INFO] Including org.antlr:stringtemplate:jar:3.2.1 in the shaded jar.
[INFO] Including antlr:antlr:jar:2.7.7 in the shaded jar.
[INFO] Including org.apache.thrift:libfb303:jar:0.9.0 in the shaded jar.
[INFO] Including org.apache.thrift:libthrift:jar:0.9.0 in the shaded jar.
[INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-exec:jar:0.13.1a in the shaded jar.
[INFO] Including org.spark-project.hive:hive-ant:jar:0.13.1a in the shaded jar.
[INFO] Including org.apache.velocity:velocity:jar:1.5 in the shaded jar.
[INFO] Including oro:oro:jar:2.0.8 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-common:jar:0.13.1a in the shaded jar.
[INFO] Including com.twitter:parquet-hadoop-bundle:jar:1.3.2 in the shaded jar.
[INFO] Including javolution:javolution:jar:5.5.1 in the shaded jar.
[INFO] Including org.antlr:ST4:jar:4.0.4 in the shaded jar.
[INFO] Including org.apache.avro:avro-mapred:jar:1.7.5 in the shaded jar.
[INFO] Including org.apache.ant:ant:jar:1.9.1 in the shaded jar.
[INFO] Including org.apache.ant:ant-launcher:jar:1.9.1 in the shaded jar.
[INFO] Including com.googlecode.javaewah:JavaEWAH:jar:0.3.2 in the shaded jar.
[INFO] Including org.iq80.snappy:snappy:jar:0.2 in the shaded jar.
[INFO] Including org.json:json:jar:20090211 in the shaded jar.
[INFO] Including stax:stax-api:jar:1.0.1 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the shaded jar.
[INFO] Including org.spark-project.hive:hive-serde:jar:0.13.1a in the shaded jar.
[INFO] Including org.apache.avro:avro:jar:1.7.6 in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.3 in the shaded jar.
[INFO] Including org.apache.avro:avro-mapred:jar:hadoop2:1.7.6 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:1.7.6 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:tests:1.7.6 in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] commons-logging-1.1.3.jar, jcl-over-slf4j-1.7.5.jar define 6 overlappping classes:
[WARNING] - org.apache.commons.logging.impl.NoOpLog
[WARNING] - org.apache.commons.logging.impl.SimpleLog
[WARNING] - org.apache.commons.logging.LogFactory
[WARNING] - org.apache.commons.logging.LogConfigurationException
[WARNING] - org.apache.commons.logging.impl.SimpleLog$1
[WARNING] - org.apache.commons.logging.Log
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-column-1.6.0rc3.jar define 543 overlappping classes:
[WARNING] - parquet.io.PrimitiveColumnIO
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.Long2IntSortedMap
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.LongIterators$IntIteratorWrapper
[WARNING] - parquet.column.values.ValuesReader
[WARNING] - parquet.column.impl.ColumnReaderImpl$1
[WARNING] - parquet.column.ParquetProperties$WriterVersion
[WARNING] - parquet.schema.PrimitiveType$PrimitiveTypeName
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.LongIterators$UnmodifiableListIterator
[WARNING] - parquet.it.unimi.dsi.fastutil.longs.LongIterator
[WARNING] - parquet.it.unimi.dsi.fastutil.doubles.AbstractDoubleList
[WARNING] - 533 more...
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-common-1.6.0rc3.jar define 7 overlappping classes:
[WARNING] - parquet.Ints
[WARNING] - parquet.ParquetRuntimeException
[WARNING] - parquet.Log$1
[WARNING] - parquet.Log
[WARNING] - parquet.bytes.BytesUtils
[WARNING] - parquet.Version
[WARNING] - parquet.Preconditions
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar, commons-collections-3.2.1.jar define 10 overlappping classes:
[WARNING] - org.apache.commons.collections.FastHashMap$EntrySet
[WARNING] - org.apache.commons.collections.ArrayStack
[WARNING] - org.apache.commons.collections.FastHashMap$1
[WARNING] - org.apache.commons.collections.FastHashMap$KeySet
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView
[WARNING] - org.apache.commons.collections.BufferUnderflowException
[WARNING] - org.apache.commons.collections.Buffer
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator
[WARNING] - org.apache.commons.collections.FastHashMap$Values
[WARNING] - org.apache.commons.collections.FastHashMap
[WARNING] kryo-2.21.jar, reflectasm-1.07-shaded.jar define 23 overlappping classes:
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Opcodes
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Frame
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Label
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.FieldWriter
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.AnnotationVisitor
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.FieldVisitor
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Item
[WARNING] - com.esotericsoftware.reflectasm.AccessClassLoader
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.Edge
[WARNING] - com.esotericsoftware.reflectasm.shaded.org.objectweb.asm.ClassVisitor
[WARNING] - 13 more...
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar define 82 overlappping classes:
[WARNING] - org.apache.commons.beanutils.WrapDynaBean
[WARNING] - org.apache.commons.beanutils.Converter
[WARNING] - org.apache.commons.beanutils.converters.IntegerConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleBeanUtilsBean
[WARNING] - org.apache.commons.beanutils.locale.converters.DecimalLocaleConverter
[WARNING] - org.apache.commons.beanutils.locale.converters.DoubleLocaleConverter
[WARNING] - org.apache.commons.beanutils.converters.ShortConverter
[WARNING] - org.apache.commons.beanutils.converters.StringArrayConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleConvertUtilsBean
[WARNING] - org.apache.commons.beanutils.LazyDynaClass
[WARNING] - 72 more...
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-jackson-1.6.0rc3.jar define 623 overlappping classes:
[WARNING] - parquet.org.codehaus.jackson.map.deser.impl.PropertyValue$Map
[WARNING] - parquet.org.codehaus.jackson.map.BeanPropertyDefinition
[WARNING] - parquet.org.codehaus.jackson.util.DefaultPrettyPrinter$Lf2SpacesIndenter
[WARNING] - parquet.org.codehaus.jackson.map.jsontype.impl.StdSubtypeResolver
[WARNING] - parquet.org.codehaus.jackson.map.ser.FilteredBeanPropertyWriter$MultiView
[WARNING] - parquet.org.codehaus.jackson.map.deser.std.PrimitiveArrayDeserializers$Base
[WARNING] - parquet.org.codehaus.jackson.map.ser.std.StdContainerSerializers
[WARNING] - parquet.org.codehaus.jackson.map.SerializationConfig$Feature
[WARNING] - parquet.org.codehaus.jackson.map.deser.impl.ValueInjector
[WARNING] - parquet.org.codehaus.jackson.map.deser.std.ThrowableDeserializer
[WARNING] - 613 more...
[WARNING] avro-mapred-1.7.6-hadoop2.jar, avro-mapred-1.7.5.jar define 121 overlappping classes:
[WARNING] - org.apache.avro.mapreduce.AvroKeyRecordReader
[WARNING] - org.apache.avro.mapred.AvroJob
[WARNING] - org.apache.avro.mapred.SequenceFileReader$5
[WARNING] - org.apache.avro.hadoop.io.AvroKeyValue$Iterator
[WARNING] - org.apache.avro.mapred.tether.TaskType
[WARNING] - org.apache.avro.hadoop.io.AvroSequenceFile
[WARNING] - org.apache.avro.mapreduce.AvroKeyValueInputFormat
[WARNING] - org.apache.avro.mapred.tether.TetherData
[WARNING] - org.apache.avro.mapred.tether.TetherInputFormat
[WARNING] - org.apache.avro.hadoop.util.AvroCharSequenceComparator
[WARNING] - 111 more...
[WARNING] javax.activation-1.1.0.v201105071233.jar, activation-1.1.jar define 17 overlappping classes:
[WARNING] - javax.activation.MimeType
[WARNING] - javax.activation.FileTypeMap
[WARNING] - javax.activation.FileDataSource
[WARNING] - javax.activation.DataContentHandler
[WARNING] - javax.activation.CommandObject
[WARNING] - javax.activation.MimetypesFileTypeMap
[WARNING] - javax.activation.CommandMap
[WARNING] - javax.activation.DataSource
[WARNING] - javax.activation.DataHandler
[WARNING] - javax.activation.MimeTypeParameterList
[WARNING] - 7 more...
[WARNING] stax-api-1.0-2.jar, stax-api-1.0.1.jar define 37 overlappping classes:
[WARNING] - javax.xml.stream.XMLOutputFactory
[WARNING] - javax.xml.stream.events.StartElement
[WARNING] - javax.xml.stream.events.Namespace
[WARNING] - javax.xml.stream.util.EventReaderDelegate
[WARNING] - javax.xml.stream.XMLInputFactory
[WARNING] - javax.xml.stream.events.Characters
[WARNING] - javax.xml.stream.XMLStreamReader
[WARNING] - javax.xml.stream.events.EntityReference
[WARNING] - javax.xml.stream.events.NotationDeclaration
[WARNING] - javax.xml.stream.XMLStreamWriter
[WARNING] - 27 more...
[WARNING] hadoop-yarn-api-2.4.1.jar, hadoop-yarn-common-2.4.1.jar define 3 overlappping classes:
[WARNING] - org.apache.hadoop.yarn.factories.package-info
[WARNING] - org.apache.hadoop.yarn.util.package-info
[WARNING] - org.apache.hadoop.yarn.factory.providers.package-info
[WARNING] parquet-format-2.2.0-rc1.jar, parquet-hadoop-bundle-1.3.2.jar define 197 overlappping classes:
[WARNING] - parquet.org.apache.thrift.protocol.TCompactProtocol$Types
[WARNING] - parquet.format.Encoding
[WARNING] - parquet.org.apache.thrift.TSerializer
[WARNING] - parquet.org.apache.thrift.protocol.TJSONProtocol
[WARNING] - parquet.format.ColumnChunk$_Fields
[WARNING] - parquet.format.ColumnMetaData$1
[WARNING] - parquet.org.apache.thrift.transport.TSeekableFile
[WARNING] - parquet.org.apache.thrift.TServiceClientFactory
[WARNING] - parquet.org.apache.thrift.transport.THttpClient
[WARNING] - parquet.org.apache.thrift.protocol.TProtocolUtil
[WARNING] - 187 more...
[WARNING] parquet-encoding-1.6.0rc3.jar, parquet-hadoop-bundle-1.3.2.jar define 183 overlappping classes:
[WARNING] - parquet.column.values.bitpacking.ByteBitPackingBE$Packer21
[WARNING] - parquet.column.values.bitpacking.OneBitPackingReader
[WARNING] - parquet.column.values.bitpacking.ByteBitPackingLE$Packer16
[WARNING] - parquet.column.values.bitpacking.OneBitPackingWriter
[WARNING] - parquet.column.values.bitpacking.ByteBitPackingLE$Packer29
[WARNING] - parquet.column.values.bitpacking.LemireBitPackingLE$Packer15
[WARNING] - parquet.column.values.bitpacking.BitPacking
[WARNING] - parquet.column.values.bitpacking.Packer
[WARNING] - parquet.column.values.bitpacking.LemireBitPackingLE$Packer23
[WARNING] - parquet.column.values.bitpacking.LemireBitPackingLE$Packer3
[WARNING] - 173 more...
[WARNING] jansi-1.4.jar, jline-2.10.4.jar define 23 overlappping classes:
[WARNING] - org.fusesource.jansi.Ansi$Erase
[WARNING] - org.fusesource.jansi.Ansi
[WARNING] - org.fusesource.jansi.AnsiOutputStream
[WARNING] - org.fusesource.jansi.internal.CLibrary
[WARNING] - org.fusesource.jansi.Ansi$2
[WARNING] - org.fusesource.jansi.WindowsAnsiOutputStream
[WARNING] - org.fusesource.jansi.AnsiRenderer$Code
[WARNING] - org.fusesource.jansi.AnsiConsole
[WARNING] - org.fusesource.jansi.Ansi$Attribute
[WARNING] - org.fusesource.jansi.Ansi$Color
[WARNING] - 13 more...
[WARNING] minlog-1.2.jar, kryo-2.21.jar define 2 overlappping classes:
[WARNING] - com.esotericsoftware.minlog.Log$Logger
[WARNING] - com.esotericsoftware.minlog.Log
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-hadoop-1.6.0rc3.jar define 90 overlappping classes:
[WARNING] - parquet.hadoop.codec.CodecConfig
[WARNING] - parquet.hadoop.util.counters.mapred.MapRedCounterAdapter
[WARNING] - parquet.hadoop.example.GroupReadSupport
[WARNING] - parquet.hadoop.codec.CompressionCodecNotSupportedException
[WARNING] - parquet.hadoop.InternalParquetRecordWriter
[WARNING] - parquet.hadoop.metadata.FileMetaData
[WARNING] - parquet.hadoop.ParquetFileReader$Chunk
[WARNING] - parquet.hadoop.example.ExampleOutputFormat
[WARNING] - parquet.hadoop.ParquetInputFormat$1
[WARNING] - parquet.hadoop.ParquetFileWriter$STATE$2
[WARNING] - 80 more...
[WARNING] kryo-2.21.jar, objenesis-1.2.jar define 32 overlappping classes:
[WARNING] - org.objenesis.Objenesis
[WARNING] - org.objenesis.strategy.StdInstantiatorStrategy
[WARNING] - org.objenesis.instantiator.basic.ObjectStreamClassInstantiator
[WARNING] - org.objenesis.instantiator.sun.SunReflectionFactorySerializationInstantiator
[WARNING] - org.objenesis.instantiator.perc.PercSerializationInstantiator
[WARNING] - org.objenesis.instantiator.NullInstantiator
[WARNING] - org.objenesis.instantiator.jrockit.JRockitLegacyInstantiator
[WARNING] - org.objenesis.instantiator.gcj.GCJInstantiatorBase
[WARNING] - org.objenesis.ObjenesisException
[WARNING] - org.objenesis.instantiator.basic.ObjectInputStreamInstantiator$MockStream
[WARNING] - 22 more...
[WARNING] guava-14.0.1.jar, spark-core_2.10-1.2.0.jar define 5 overlappping classes:
[WARNING] - com.google.common.base.Optional$1$1
[WARNING] - com.google.common.base.Optional
[WARNING] - com.google.common.base.Optional$1
[WARNING] - com.google.common.base.Absent
[WARNING] - com.google.common.base.Present
[WARNING] jta-1.1.jar, javax.transaction-1.1.1.v201105210645.jar define 18 overlappping classes:
[WARNING] - javax.transaction.RollbackException
[WARNING] - javax.transaction.HeuristicMixedException
[WARNING] - javax.transaction.InvalidTransactionException
[WARNING] - javax.transaction.Synchronization
[WARNING] - javax.transaction.xa.XAException
[WARNING] - javax.transaction.HeuristicRollbackException
[WARNING] - javax.transaction.HeuristicCommitException
[WARNING] - javax.transaction.xa.XAResource
[WARNING] - javax.transaction.TransactionSynchronizationRegistry
[WARNING] - javax.transaction.TransactionRolledbackException
[WARNING] - 8 more...
[WARNING] spark-streaming_2.10-1.2.0.jar, spark-yarn_2.10-1.2.0.jar, spark-network-shuffle_2.10-1.2.0.jar, spark-graphx_2.10-1.2.0.jar, spark-mllib_2.10-1.2.0.jar, spark-hive_2.10-1.2.0.jar, unused-1.0.0.jar, spark-catalyst_2.10-1.2.0.jar, spark-sql_2.10-1.2.0.jar, spark-network-common_2.10-1.2.0.jar, spark-bagel_2.10-1.2.0.jar, spark-repl_2.10-1.2.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] parquet-hadoop-bundle-1.3.2.jar, parquet-generator-1.6.0rc3.jar define 3 overlappping classes:
[WARNING] - parquet.encoding.bitpacking.ByteBasedBitPackingGenerator
[WARNING] - parquet.encoding.Generator
[WARNING] - parquet.encoding.bitpacking.IntBasedBitPackingGenerator
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-assembly_2.10 ---
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-assembly_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/assembly/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/assembly/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 8 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Twitter 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-twitter_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/twitter/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-twitter_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-twitter_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/twitter/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-twitter_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-twitter_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/twitter/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-twitter_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-twitter_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-twitter_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/twitter/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-twitter_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-twitter_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-twitter_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-twitter_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-twitter_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-twitter_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-twitter_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-twitter_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-twitter_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-twitter_2.10 ---
[INFO] Excluding org.twitter4j:twitter4j-stream:jar:3.0.3 from the shaded jar.
[INFO] Excluding org.twitter4j:twitter4j-core:jar:3.0.3 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/twitter/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-twitter_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/twitter/target/spark-streaming-twitter_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-twitter_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/twitter/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 51 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Flume Sink 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-flume-sink_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/src/main/scala added.
[INFO]
[INFO] --- avro-maven-plugin:1.7.6:idl-protocol (default) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-flume-sink_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 5 Scala sources and 3 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/scala-2.10/classes...
[WARNING] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.ChannelPipelineFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.handler.execution.ExecutionHandler not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.ChannelFactory not found - continuing with a stub.
[WARNING] Class org.jboss.netty.handler.execution.ExecutionHandler not found - continuing with a stub.
[WARNING] Class org.jboss.netty.channel.group.ChannelGroup not found - continuing with a stub.
[WARNING] 7 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: 某些输入文件使用了未经检查或不安全的操作。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:unchecked 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-flume-sink_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 3 source files to /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-flume-sink_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-flume-sink_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source to /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/scala-2.10/test-classes...
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-flume-sink_2.10 ---
[INFO] Nothing to compile - all classes are up to date
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-flume-sink_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-flume-sink_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-flume-sink_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-flume-sink_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-flume-sink_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-flume-sink_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-flume-sink_2.10 ---
[INFO] Excluding org.apache.flume:flume-ng-sdk:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-core:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-configuration:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.5 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20110124 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.2.2 from the shaded jar.
[INFO] Excluding org.apache.mina:mina-core:jar:2.0.4 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-flume-sink_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume-sink/target/spark-streaming-flume-sink_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-flume-sink_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/flume-sink/scalastyle-output.xml
Processed 5 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 73 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Flume 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-flume_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/flume/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-flume_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-flume_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-flume_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-flume_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/flume/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-flume_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 6 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-flume_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-flume_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/flume/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-flume_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-flume_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 3 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-flume_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 3 source files to /home/jifeng/hadoop/spark-1.2.0/external/flume/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-flume_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-flume_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-flume_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-flume_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-flume_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-flume_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-flume_2.10 ---
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.spark:spark-streaming-flume-sink_2.10:jar:1.2.0 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-core:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-configuration:jar:1.4.0 from the shaded jar.
[INFO] Excluding commons-io:commons-io:jar:2.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.5 from the shaded jar.
[INFO] Excluding commons-cli:commons-cli:jar:1.2 from the shaded jar.
[INFO] Excluding commons-lang:commons-lang:jar:2.5 from the shaded jar.
[INFO] Excluding joda-time:joda-time:jar:2.1 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:servlet-api:jar:2.5-20110124 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty:jar:6.1.26 from the shaded jar.
[INFO] Excluding com.google.code.gson:gson:jar:2.2.2 from the shaded jar.
[INFO] Excluding org.apache.mina:mina-core:jar:2.0.4 from the shaded jar.
[INFO] Excluding org.apache.flume:flume-ng-sdk:jar:1.4.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro:jar:1.7.6 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-core-asl:jar:1.9.13 from the shaded jar.
[INFO] Excluding org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.3 from the shaded jar.
[INFO] Excluding org.apache.commons:commons-compress:jar:1.4.1 from the shaded jar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.avro:avro-ipc:jar:1.7.6 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/flume/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-flume_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/flume/target/spark-streaming-flume_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-flume_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/flume/scalastyle-output.xml
Processed 6 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 75 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External MQTT 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-mqtt_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-mqtt_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-mqtt_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-mqtt_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-mqtt_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/mqtt/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-mqtt_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-mqtt_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-mqtt_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-mqtt_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-mqtt_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-mqtt_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-mqtt_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-mqtt_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-mqtt_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-mqtt_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-mqtt_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-mqtt_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-mqtt_2.10 ---
[INFO] Excluding org.eclipse.paho:mqtt-client:jar:0.4.0 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-mqtt_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/mqtt/target/spark-streaming-mqtt_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-mqtt_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/mqtt/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 36 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External ZeroMQ 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-zeromq_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-zeromq_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-zeromq_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-zeromq_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-zeromq_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/zeromq/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-zeromq_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 3 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-zeromq_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-zeromq_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-zeromq_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-zeromq_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 1 Scala source and 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-zeromq_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-zeromq_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-zeromq_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-zeromq_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-zeromq_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-zeromq_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-zeromq_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-zeromq_2.10 ---
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-zeromq_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark from the shaded jar.
[INFO] Excluding com.typesafe:config:jar:1.2.1 from the shaded jar.
[INFO] Excluding org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark from the shaded jar.
[INFO] Excluding org.spark-project.zeromq:zeromq-scala-binding_2.10:jar:0.0.7-spark from the shaded jar.
[INFO] Excluding net.java.dev.jna:jna:jar:3.0.9 from the shaded jar.
[INFO] Excluding com.github.jnr:jnr-constants:jar:0.8.2 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-zeromq_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/zeromq/target/spark-streaming-zeromq_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-zeromq_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/zeromq/scalastyle-output.xml
Processed 3 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 17 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project External Kafka 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-streaming-kafka_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/external/kafka/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-streaming-kafka_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-streaming-kafka_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/external/kafka/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming-kafka_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-streaming-kafka_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/external/kafka/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-streaming-kafka_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 4 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-streaming-kafka_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-streaming-kafka_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/external/kafka/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-streaming-kafka_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 1 resource
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-streaming-kafka_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Scala sources and 1 Java source to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/test-classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-streaming-kafka_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/scala-2.10/test-classes
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-streaming-kafka_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-streaming-kafka_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-streaming-kafka_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-kafka_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-streaming-kafka_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-streaming-kafka_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-streaming-kafka_2.10 ---
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.5 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-library:jar:2.10.4 from the shaded jar.
[INFO] Excluding org.apache.kafka:kafka_2.10:jar:0.8.0 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-compiler:jar:2.10.4 from the shaded jar.
[INFO] Excluding com.101tec:zkclient:jar:0.3 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.1.6 from the shaded jar.
[INFO] Excluding com.yammer.metrics:metrics-core:jar:2.2.0 from the shaded jar.
[INFO] Excluding com.yammer.metrics:metrics-annotation:jar:2.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang:scala-reflect:jar:2.10.4 from the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0.jar with /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0-shaded.jar
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/kafka/dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: /home/jifeng/hadoop/spark-1.2.0/external/kafka/dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-streaming-kafka_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/external/kafka/target/spark-streaming-kafka_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-streaming-kafka_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/external/kafka/scalastyle-output.xml
Processed 4 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 36 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project Examples 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-examples_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/examples/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-examples_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-examples_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/scala-2.10/src/main/scala added.
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/scala-2.10/src/main/java added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-examples_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-examples_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 7 resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-examples_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 77 Scala sources and 23 Java sources to /home/jifeng/hadoop/spark-1.2.0/examples/target/scala-2.10/classes...
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceAudience not found - continuing with a stub.
[WARNING] Class org.apache.hadoop.hbase.classification.InterfaceStability not found - continuing with a stub.
[WARNING] /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala/org/apache/spark/examples/CassandraCQLTest.scala:85: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala/org/apache/spark/examples/CassandraTest.scala:62: constructor Job in class Job is deprecated: see corresponding Javadoc for more information.
[WARNING] val job = new Job()
[WARNING] ^
[WARNING] /home/jifeng/hadoop/spark-1.2.0/examples/src/main/scala/org/apache/spark/examples/HBaseTest.scala:39: constructor HTableDescriptor in class HTableDescriptor is deprecated: see corresponding Javadoc for more information.
[WARNING] val tableDesc = new HTableDescriptor(args(0))
[WARNING] ^
[WARNING] 66 warnings found
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 注: 某些输入文件使用或覆盖了已过时的 API。
[WARNING] 注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-examples_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 23 source files to /home/jifeng/hadoop/spark-1.2.0/examples/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-examples_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/examples/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-examples_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/examples/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-examples_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-examples_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-examples_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/examples/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-examples_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-examples_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-examples_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/examples/target/spark-examples_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-examples_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-examples_2.10 ---
[INFO] Including com.google.guava:guava:jar:14.0.1 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpclient:jar:4.1.2 in the shaded jar.
[INFO] Including org.apache.httpcomponents:httpcore:jar:4.1.2 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-util:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.slf4j:slf4j-api:jar:1.7.5 in the shaded jar.
[INFO] Including log4j:log4j:jar:1.2.17 in the shaded jar.
[INFO] Including org.slf4j:slf4j-log4j12:jar:1.7.5 in the shaded jar.
[INFO] Including org.xerial.snappy:snappy-java:jar:1.1.1.6 in the shaded jar.
[INFO] Including net.jpountz.lz4:lz4:jar:1.2.0 in the shaded jar.
[INFO] Including commons-net:commons-net:jar:2.2 in the shaded jar.
[INFO] Including org.spark-project.akka:akka-actor_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including com.typesafe:config:jar:1.2.1 in the shaded jar.
[INFO] Including org.spark-project.protobuf:protobuf-java:jar:2.5.0-spark in the shaded jar.
[INFO] Including org.scala-lang:scala-library:jar:2.10.4 in the shaded jar.
[INFO] Including org.antlr:antlr-runtime:jar:3.4 in the shaded jar.
[INFO] Including org.antlr:stringtemplate:jar:3.2.1 in the shaded jar.
[INFO] Including antlr:antlr:jar:2.7.7 in the shaded jar.
[INFO] Including commons-httpclient:commons-httpclient:jar:3.1 in the shaded jar.
[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar.
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.8.8 in the shaded jar.
[INFO] Including org.apache.avro:avro:jar:1.7.6 in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.3 in the shaded jar.
[INFO] Including org.apache.avro:avro-ipc:jar:1.7.6 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-twitter_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.twitter4j:twitter4j-stream:jar:3.0.3 in the shaded jar.
[INFO] Including org.twitter4j:twitter4j-core:jar:3.0.3 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-flume_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-flume-sink_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.flume:flume-ng-core:jar:1.4.0 in the shaded jar.
[INFO] Including org.apache.flume:flume-ng-configuration:jar:1.4.0 in the shaded jar.
[INFO] Including joda-time:joda-time:jar:2.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:servlet-api:jar:2.5-20110124 in the shaded jar.
[INFO] Including com.google.code.gson:gson:jar:2.2.2 in the shaded jar.
[INFO] Including org.apache.flume:flume-ng-sdk:jar:1.4.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-mqtt_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.eclipse.paho:mqtt-client:jar:0.4.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-zeromq_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.spark-project.akka:akka-zeromq_2.10:jar:2.3.4-spark in the shaded jar.
[INFO] Including org.spark-project.zeromq:zeromq-scala-binding_2.10:jar:0.0.7-spark in the shaded jar.
[INFO] Including net.java.dev.jna:jna:jar:3.0.9 in the shaded jar.
[INFO] Including com.github.jnr:jnr-constants:jar:0.8.2 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-server:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty.orbit:javax.servlet:jar:3.0.0.v201112011016 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-continuation:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-http:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.eclipse.jetty:jetty-io:jar:8.1.14.v20131031 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-testing-util:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-common:test-jar:tests:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-server:test-jar:tests:0.98.7-hadoop1 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-core:jar:1.8 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-json:jar:1.8 in the shaded jar.
[INFO] Including org.codehaus.jettison:jettison:jar:1.1 in the shaded jar.
[INFO] Including com.sun.xml.bind:jaxb-impl:jar:2.2.3-1 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-xc:jar:1.7.1 in the shaded jar.
[INFO] Including com.sun.jersey:jersey-server:jar:1.8 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-hadoop1-compat:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-hadoop1-compat:test-jar:tests:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-core:jar:1.2.1 in the shaded jar.
[INFO] Including xmlenc:xmlenc:jar:0.52 in the shaded jar.
[INFO] Including commons-configuration:commons-configuration:jar:1.6 in the shaded jar.
[INFO] Including commons-digester:commons-digester:jar:1.8 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils:jar:1.7.0 in the shaded jar.
[INFO] Including commons-beanutils:commons-beanutils-core:jar:1.8.0 in the shaded jar.
[INFO] Including commons-el:commons-el:jar:1.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-test:jar:1.2.1 in the shaded jar.
[INFO] Including org.apache.ftpserver:ftplet-api:jar:1.0.0 in the shaded jar.
[INFO] Including org.apache.mina:mina-core:jar:2.0.0-M5 in the shaded jar.
[INFO] Including org.apache.ftpserver:ftpserver-core:jar:1.0.0 in the shaded jar.
[INFO] Including org.apache.ftpserver:ftpserver-deprecated:jar:1.0.0-M2 in the shaded jar.
[INFO] Including com.github.stephenc.findbugs:findbugs-annotations:jar:1.3.9-1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-protocol:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including com.google.protobuf:protobuf-java:jar:2.5.0 in the shaded jar.
[INFO] Including commons-logging:commons-logging:jar:1.1.1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-common:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including commons-codec:commons-codec:jar:1.5 in the shaded jar.
[INFO] Including commons-lang:commons-lang:jar:2.6 in the shaded jar.
[INFO] Including commons-collections:commons-collections:jar:3.2.1 in the shaded jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-client:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.zookeeper:zookeeper:jar:3.4.6 in the shaded jar.
[INFO] Including org.cloudera.htrace:htrace-core:jar:2.04 in the shaded jar.
[INFO] Including org.jruby.joni:joni:jar:2.1.2 in the shaded jar.
[INFO] Including org.jruby.jcodings:jcodings:jar:1.0.8 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-server:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-prefix-tree:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-core:jar:2.2.0 in the shaded jar.
[INFO] Including commons-cli:commons-cli:jar:1.2 in the shaded jar.
[INFO] Including com.github.stephenc.high-scale-lib:high-scale-lib:jar:1.1.1 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty:jar:6.1.26 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-util:jar:6.1.26 in the shaded jar.
[INFO] Including org.mortbay.jetty:jetty-sslengine:jar:6.1.26 in the shaded jar.
[INFO] Including org.mortbay.jetty:jsp-2.1:jar:6.1.14 in the shaded jar.
[INFO] Including org.mortbay.jetty:jsp-api-2.1:jar:6.1.14 in the shaded jar.
[INFO] Including org.mortbay.jetty:servlet-api-2.5:jar:6.1.14 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.8.8 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-jaxrs:jar:1.8.8 in the shaded jar.
[INFO] Including tomcat:jasper-compiler:jar:5.5.23 in the shaded jar.
[INFO] Including tomcat:jasper-runtime:jar:5.5.23 in the shaded jar.
[INFO] Including org.jamon:jamon-runtime:jar:2.3.1 in the shaded jar.
[INFO] Including javax.xml.bind:jaxb-api:jar:2.2.2 in the shaded jar.
[INFO] Including javax.activation:activation:jar:1.1 in the shaded jar.
[INFO] Including org.apache.hbase:hbase-hadoop-compat:jar:0.98.7-hadoop1 in the shaded jar.
[INFO] Including org.apache.commons:commons-math:jar:2.1 in the shaded jar.
[INFO] Including org.apache.commons:commons-math3:jar:3.1.1 in the shaded jar.
[INFO] Including com.twitter:algebird-core_2.10:jar:0.8.1 in the shaded jar.
[INFO] Including com.googlecode.javaewah:JavaEWAH:jar:0.6.6 in the shaded jar.
[INFO] Including org.scala-lang:scala-reflect:jar:2.10.4 in the shaded jar.
[INFO] Including org.apache.cassandra:cassandra-all:jar:1.2.6 in the shaded jar.
[INFO] Including org.antlr:antlr:jar:3.2 in the shaded jar.
[INFO] Including com.googlecode.json-simple:json-simple:jar:1.1 in the shaded jar.
[INFO] Including org.yaml:snakeyaml:jar:1.6 in the shaded jar.
[INFO] Including edu.stanford.ppl:snaptree:jar:0.1 in the shaded jar.
[INFO] Including org.mindrot:jbcrypt:jar:0.3m in the shaded jar.
[INFO] Including org.apache.thrift:libthrift:jar:0.7.0 in the shaded jar.
[INFO] Including javax.servlet:servlet-api:jar:2.5 in the shaded jar.
[INFO] Including org.apache.cassandra:cassandra-thrift:jar:1.2.6 in the shaded jar.
[INFO] Including com.github.stephenc:jamm:jar:0.2.5 in the shaded jar.
[INFO] Including com.github.scopt:scopt_2.10:jar:3.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-streaming-kafka_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.kafka:kafka_2.10:jar:0.8.0 in the shaded jar.
[INFO] Including org.scala-lang:scala-compiler:jar:2.10.4 in the shaded jar.
[INFO] Including com.101tec:zkclient:jar:0.3 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-annotation:jar:2.2.0 in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] spark-streaming-flume_2.10-1.2.0.jar, spark-streaming-flume-sink_2.10-1.2.0.jar, spark-streaming-zeromq_2.10-1.2.0.jar, spark-streaming-kafka_2.10-1.2.0.jar, spark-streaming-twitter_2.10-1.2.0.jar, unused-1.0.0.jar, spark-streaming-mqtt_2.10-1.2.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar, commons-collections-3.2.1.jar define 10 overlappping classes:
[WARNING] - org.apache.commons.collections.FastHashMap$EntrySet
[WARNING] - org.apache.commons.collections.ArrayStack
[WARNING] - org.apache.commons.collections.FastHashMap$1
[WARNING] - org.apache.commons.collections.FastHashMap$KeySet
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView
[WARNING] - org.apache.commons.collections.BufferUnderflowException
[WARNING] - org.apache.commons.collections.Buffer
[WARNING] - org.apache.commons.collections.FastHashMap$CollectionView$CollectionViewIterator
[WARNING] - org.apache.commons.collections.FastHashMap$Values
[WARNING] - org.apache.commons.collections.FastHashMap
[WARNING] commons-beanutils-core-1.8.0.jar, commons-beanutils-1.7.0.jar define 82 overlappping classes:
[WARNING] - org.apache.commons.beanutils.Converter
[WARNING] - org.apache.commons.beanutils.WrapDynaBean
[WARNING] - org.apache.commons.beanutils.converters.IntegerConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleBeanUtilsBean
[WARNING] - org.apache.commons.beanutils.locale.converters.DoubleLocaleConverter
[WARNING] - org.apache.commons.beanutils.locale.converters.DecimalLocaleConverter
[WARNING] - org.apache.commons.beanutils.converters.ShortConverter
[WARNING] - org.apache.commons.beanutils.converters.StringArrayConverter
[WARNING] - org.apache.commons.beanutils.locale.LocaleConvertUtilsBean
[WARNING] - org.apache.commons.beanutils.LazyDynaClass
[WARNING] - 72 more...
[WARNING] jasper-compiler-5.5.23.jar, jasper-runtime-5.5.23.jar, jsp-2.1-6.1.14.jar define 1 overlappping classes:
[WARNING] - org.apache.jasper.compiler.Localizer
[WARNING] jasper-compiler-5.5.23.jar, jsp-2.1-6.1.14.jar define 143 overlappping classes:
[WARNING] - org.apache.jasper.compiler.TagLibraryInfoImpl
[WARNING] - org.apache.jasper.xmlparser.SymbolTable
[WARNING] - org.apache.jasper.compiler.Generator$FragmentHelperClass$Fragment
[WARNING] - org.apache.jasper.compiler.Generator$1TagHandlerPoolVisitor
[WARNING] - org.apache.jasper.compiler.ScriptingVariabler
[WARNING] - org.apache.jasper.compiler.SmapStratum$LineInfo
[WARNING] - org.apache.jasper.compiler.Node$AttributeGenerator
[WARNING] - org.apache.jasper.compiler.Node
[WARNING] - org.apache.jasper.compiler.Node$JspAttribute
[WARNING] - org.apache.jasper.compiler.tagplugin.TagPlugin
[WARNING] - 133 more...
[WARNING] cassandra-all-1.2.6.jar, cassandra-thrift-1.2.6.jar define 2 overlappping classes:
[WARNING] - org.apache.cassandra.thrift.ITransportFactory
[WARNING] - org.apache.cassandra.thrift.TFramedTransportFactory
[WARNING] jasper-runtime-5.5.23.jar, jsp-2.1-6.1.14.jar define 43 overlappping classes:
[WARNING] - org.apache.jasper.runtime.ProtectedFunctionMapper$2
[WARNING] - org.apache.jasper.runtime.PageContextImpl$3
[WARNING] - org.apache.jasper.runtime.JspFactoryImpl$PrivilegedGetPageContext
[WARNING] - org.apache.jasper.runtime.PageContextImpl$4
[WARNING] - org.apache.jasper.runtime.JspFactoryImpl
[WARNING] - org.apache.jasper.runtime.ProtectedFunctionMapper$1
[WARNING] - org.apache.jasper.JasperException
[WARNING] - org.apache.jasper.runtime.PerThreadTagHandlerPool$PerThreadData
[WARNING] - org.apache.jasper.util.FastDateFormat
[WARNING] - org.apache.jasper.runtime.PageContextImpl$8
[WARNING] - 33 more...
[WARNING] servlet-api-2.5-20110124.jar, servlet-api-2.5.jar, javax.servlet-3.0.0.v201112011016.jar, servlet-api-2.5-6.1.14.jar define 42 overlappping classes:
[WARNING] - javax.servlet.ServletRequestWrapper
[WARNING] - javax.servlet.FilterChain
[WARNING] - javax.servlet.SingleThreadModel
[WARNING] - javax.servlet.http.HttpServletResponse
[WARNING] - javax.servlet.http.HttpUtils
[WARNING] - javax.servlet.ServletContextAttributeEvent
[WARNING] - javax.servlet.ServletContextAttributeListener
[WARNING] - javax.servlet.http.HttpServlet
[WARNING] - javax.servlet.http.HttpSessionAttributeListener
[WARNING] - javax.servlet.http.HttpServletRequest
[WARNING] - 32 more...
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-examples_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/examples/target/spark-examples_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-examples_2.10 ---
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/examples/scalastyle-output.xml
Processed 76 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 470 ms
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Project YARN Shuffle Service 1.2.0
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ spark-network-yarn_2.10 ---
[INFO] Deleting /home/jifeng/hadoop/spark-1.2.0/network/yarn/target
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-versions) @ spark-network-yarn_2.10 ---
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-source (add-scala-sources) @ spark-network-yarn_2.10 ---
[INFO] Source directory: /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/main/scala added.
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-network-yarn_2.10 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-network-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/main/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @ spark-network-yarn_2.10 ---
[WARNING] Zinc server is not available at port 3030 - reverting to normal incremental compile
[INFO] Using incremental compilation
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
[INFO] Compiling 2 Java sources to /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/scala-2.10/classes...
[WARNING] 警告: [options] 未与 -source 1.6 一起设置引导类路径
[WARNING] 1 个警告
[INFO]
[INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ spark-network-yarn_2.10 ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 2 source files to /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/scala-2.10/classes
[INFO]
[INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-scala-test-sources) @ spark-network-yarn_2.10 ---
[INFO] Test Source directory: /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/test/scala added.
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ spark-network-yarn_2.10 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /home/jifeng/hadoop/spark-1.2.0/network/yarn/src/test/resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.0:testCompile (scala-test-compile-first) @ spark-network-yarn_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ spark-network-yarn_2.10 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.9:build-classpath (default) @ spark-network-yarn_2.10 ---
[INFO] Wrote classpath file '/home/jifeng/hadoop/spark-1.2.0/network/yarn/target/spark-test-classpath.txt'.
[INFO]
[INFO] --- gmavenplus-plugin:1.2:execute (default) @ spark-network-yarn_2.10 ---
[INFO] Using Groovy 2.3.7 to perform execute.
[INFO]
[INFO] --- maven-surefire-plugin:2.17:test (default-test) @ spark-network-yarn_2.10 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.4:jar (default-jar) @ spark-network-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/spark-network-yarn_2.10-1.2.0.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-network-yarn_2.10 ---
[INFO]
[INFO] --- maven-shade-plugin:2.2:shade (default) @ spark-network-yarn_2.10 ---
[INFO] Including org.apache.spark:spark-network-shuffle_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-network-common_2.10:jar:1.2.0 in the shaded jar.
[INFO] Including io.netty:netty-all:jar:4.0.23.Final in the shaded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] unused-1.0.0.jar, spark-network-common_2.10-1.2.0.jar, spark-network-shuffle_2.10-1.2.0.jar define 1 overlappping classes:
[WARNING] - org.apache.spark.unused.UnusedStubClass
[WARNING] maven-shade-plugin has detected that some .class files
[WARNING] are present in two or more JARs. When this happens, only
[WARNING] one single version of the class is copied in the uberjar.
[WARNING] Usually this is not harmful and you can skeep these
[WARNING] warnings, otherwise try to manually exclude artifacts
[WARNING] based on mvn dependency:tree -Ddetail=true and the above
[WARNING] output
[WARNING] See http://docs.codehaus.org/display/MAVENUSER/Shade+Plugin
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (create-source-jar) @ spark-network-yarn_2.10 ---
[INFO] Building jar: /home/jifeng/hadoop/spark-1.2.0/network/yarn/target/spark-network-yarn_2.10-1.2.0-sources.jar
[INFO]
[INFO] --- scalastyle-maven-plugin:0.4.0:check (default) @ spark-network-yarn_2.10 ---
[WARNING] sourceDirectory is not specified or does not exist value=/home/jifeng/hadoop/spark-1.2.0/network/yarn/src/main/scala
Saving to outputFile=/home/jifeng/hadoop/spark-1.2.0/network/yarn/scalastyle-output.xml
Processed 0 file(s)
Found 0 errors
Found 0 warnings
Found 0 infos
Finished in 9 ms
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM .......................... SUCCESS [ 9.124 s]
[INFO] Spark Project Networking .......................... SUCCESS [ 11.218 s]
[INFO] Spark Project Shuffle Streaming Service ........... SUCCESS [ 8.029 s]
[INFO] Spark Project Core ................................ SUCCESS [05:54 min]
[INFO] Spark Project Bagel ............................... SUCCESS [ 39.515 s]
[INFO] Spark Project GraphX .............................. SUCCESS [01:56 min]
[INFO] Spark Project Streaming ........................... SUCCESS [02:36 min]
[INFO] Spark Project Catalyst ............................ SUCCESS [02:46 min]
[INFO] Spark Project SQL ................................. SUCCESS [03:01 min]
[INFO] Spark Project ML Library .......................... SUCCESS [03:18 min]
[INFO] Spark Project Tools ............................... SUCCESS [ 22.244 s]
[INFO] Spark Project Hive ................................ SUCCESS [02:30 min]
[INFO] Spark Project REPL ................................ SUCCESS [01:12 min]
[INFO] Spark Project YARN Parent POM ..................... SUCCESS [ 2.751 s]
[INFO] Spark Project YARN Stable API ..................... SUCCESS [01:14 min]
[INFO] Spark Project Assembly ............................ SUCCESS [ 57.801 s]
[INFO] Spark Project External Twitter .................... SUCCESS [ 25.289 s]
[INFO] Spark Project External Flume Sink ................. SUCCESS [ 32.711 s]
[INFO] Spark Project External Flume ...................... SUCCESS [ 47.628 s]
[INFO] Spark Project External MQTT ....................... SUCCESS [ 24.121 s]
[INFO] Spark Project External ZeroMQ ..................... SUCCESS [ 28.154 s]
[INFO] Spark Project External Kafka ...................... SUCCESS [ 43.508 s]
[INFO] Spark Project Examples ............................ SUCCESS [01:49 min]
[INFO] Spark Project YARN Shuffle Service ................ SUCCESS [ 4.315 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 32:19 min
[INFO] Finished at: 2015-02-10T11:49:07+08:00
[INFO] Final Memory: 92M/591M
[INFO] ------------------------------------------------------------------------
生成的文件：spark-1.2.0-bin-2.4.1.tgz
[jifeng@feng02 spark-1.2.0]$ ls
assembly data examples make-distribution.sh python scalastyle-output.xml tox.ini
bagel dev external mllib README.md spark-1.2.0-bin-2.4.1.tgz yarn
bin dist extras network repl sql
conf docker graphx NOTICE sbin streaming
CONTRIBUTING.md docs lib_managed pom.xml sbt target
core ec2 LICENSE project scalastyle-config.xml toolsSpark 1.2 编译相关推荐
- Spark笔记整理（一）：spark单机安装部署、分布式集群与HA安装部署+spark源码编译...
[TOC] spark单机安装部署 1.安装scala 解压:tar -zxvf soft/scala-2.10.5.tgz -C app/ 重命名:mv scala-2.10.5/ scala 配置 ...
- spark源码编译记录
spark在项目中已经用了一段时间了,趁现在空闲,下个源码编译在IDEA里面阅读下,特此记录过程. 前提已经安装maven和git 1.上官网下载源码的包: 2.然后解压到一个文件夹 3.编译,编译的 ...
- spark 1.4 编译
在官网直接下载最新的1.4代码 http://d3kbcqa49mib13.cloudfront.net/spark-1.4.0.tgz 解压后执行编译,但是需要配置下环境 JDK Scala Mav ...
- Spark源码编译（windows）
1. 下载源码 其他版本下载(当前页面拉到底部看到下图信息): 选择需要下载的版本: 选择版本进入文件夹,比如:下载2.3.1版本源码: 2. 环境配置 需要配置环境变量的程序: JDK1.8(注意J ...
- Spark源码的编译过程详细解读(各版本)（博主推荐）
本文转自大数据躺过的坑博客园博客,原文链接:xxxxx,如需转载请自行联系原作者说在前面的话 重新试多几次.编译过程中会出现下载某个包的时间太久,这是由于连接网站的过程中会出现假死,按ctrl+c,重 ...
- Spark入门实战系列--2.Spark编译与部署（下）--Spark编译安装
[注]该系列文章以及使用到安装包/测试数据 可以在<倾情大奉送--Spark入门实战系列>获取 1.编译Spark Spark可以通过SBT和Maven两种方式进行编译,再通过make-d ...
- Spark源码打包编译的过程
前言 上篇文章介绍了下 安装sbt环境 启动scala项目 安装SBT环境运行Scala项目 为什么要弄这个 因为我本来是想对spark源码编译部署 spark是用scala语言编译的 spark源码 ...
- Spark入门实战系列--6.SparkSQL（中）--深入了解SparkSQL运行计划及调优
[注]该系列文章以及使用到安装包/测试数据 可以在<倾情大奉送--Spark入门实战系列>获取 1.1 运行环境说明 1.1.1 硬软件环境 l 主机操作系统:Windows 64位, ...
- 新闻网大数据实时分析可视化系统项目——14、Spark2.X环境准备、编译部署及运行...
1.Spark概述 Spark 是一个用来实现快速而通用的集群计算的平台. 在速度方面, Spark 扩展了广泛使用的 MapReduce 计算模型,而且高效地支持更多计算模式,包括交互式查询和流处理 ...
最新文章
- 现在参加软件测试培训就业难度大不大?
- Cognizant：走向2028年将诞生的21个新工作
- 安装Subversion1.82（SVN）
- linux 终端 画圆,16个圆桌面Linux用户必须要知道的Shell命令
- html修改图片宽度高度,HTML基础 img width height 设置显示图片的高度和宽度
- ExtJs 备忘录（2）—— Form表单（二） [ 控件封装 ]
- u-boot移植随笔：u-boot技巧二则
- （HDU）1157 -- Who's in the Middle（哪个居中）
- 2022新版完整版青龙面板对接机器人,傻妞对接onebot(oicq)协议实现机器人功能
- 在‘句子迷’爬取网友总结的方文山歌词并作词频统计
- LeetCode 刷题： Fizz Buzz
- DNS到底是干什么用的
- 模拟人生畅玩版无线连接服务器超时,打开模拟人生™：畅玩版提示网络异常或者连接不上...
- PCB后续以及泪滴、敷铜和标识
- 戴尔要求DEC雇员扔掉Mac
- [案例4-8]模拟物流快递系统程序设计
- 程序员年薪20万、30万、40万都是什么样的体验？
- 怎样在一张图片上叠加另一张图片
- 家居家纺行业的进销存软件怎么选择，门店管理系统选择
- 音乐信号处理权威会议
热门文章
- python章节总结_《Python深度学习》第一章总结
- python调用cplex_python - 如何使用docplex（python）在优化问题中建模约束？ - SO中文参考 - www.soinside.com...
- jieba分词错误_如何掌握分词技术，你需要学会这些
- java核心api_Java核心API之字符流使用介绍
- 服务器升级内存跟cpu之后性能更差,云服务器cpu重要还是内存重要
- excel判断字符串包含另一个字符串_【前端冷知识】如何正确判断一个字符串是数值？...
- 七十一、Vue项目城市选择页搜索逻辑实现，边输入边搜索功能的解决办法：节流函数
- 五十七、教用Python中的turtle海龟画图（下篇）
- 虚拟机中Ubuntu不能联网----
- 直播 | NeurIPS 2021：基于投影变换建模传递关系的知识图谱表示学习