更多代码请见：https://github.com/xubo245/SparkLearning
Spark中组件Ml的学习

1.解释

(1)基本配置：
scala-2.11.8
java1.7
maven3.3.9

(2) 下载：github

(3) 设定jvm参数：

export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"

(4)编译：mvn clean package -DskipTests

2.代码：

mvn clean package -DskipTests

在window下使用build/mvn -DskipTests clean package，git下使用这个也不能成功，会导致各种问题，bash起了好多线程，最后老报内存不足

3.结果：

编译成功

[INFO]
[INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-strea
ming-kafka-0-10-assembly_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10-assembly\target\spa
rk-streaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT-sources.jar
[INFO]
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-
streaming-kafka-0-10-assembly_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10-assembly\target\spa
rk-streaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT-test-sources.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [  4.060 s]
[INFO] Spark Project Tags ................................. SUCCESS [  6.272 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 12.164 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 11.965 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  8.533 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 15.566 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 11.382 s]
[INFO] Spark Project Core ................................. SUCCESS [04:00 min]
[INFO] Spark Project GraphX ............................... SUCCESS [ 46.278 s]
[INFO] Spark Project Streaming ............................ SUCCESS [01:30 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [03:04 min]
[INFO] Spark Project SQL .................................. SUCCESS [03:45 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 32.449 s]
[INFO] Spark Project ML Library ........................... SUCCESS [02:56 min]
[INFO] Spark Project Tools ................................ SUCCESS [  6.504 s]
[INFO] Spark Project Hive ................................. SUCCESS [03:00 min]
[INFO] Spark Project REPL ................................. SUCCESS [ 19.472 s]
[INFO] Spark Project Assembly ............................. SUCCESS [  4.420 s]
[INFO] Spark Project External Flume Sink .................. SUCCESS [ 17.863 s]
[INFO] Spark Project External Flume ....................... SUCCESS [ 26.544 s]
[INFO] Spark Project External Flume Assembly .............. SUCCESS [  3.423 s]
[INFO] Spark Integration for Kafka 0.8 .................... SUCCESS [ 32.688 s]
[INFO] Spark Project Examples ............................. SUCCESS [ 48.515 s]
[INFO] Spark Project External Kafka Assembly .............. SUCCESS [  5.093 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [ 30.390 s]
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  4.189 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 24:07 min
[INFO] Finished at: 2016-07-30T16:49:32+08:00
[INFO] Final Memory: 95M/994M
[INFO] ------------------------------------------------------------------------

为什么没有看到完整的jar包？？

参考
【1】http://spark.apache.org/docs/2.0.0/
【2】https://github.com/apache/spark
【3】https://github.com/xubo245/SparkLearning

部分记录

ar.
[INFO] Excluding org.tukaani:xz:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-hdfs:jar:2.2.0 from the shaded jar.
[INFO] Excluding org.mortbay.jetty:jetty-util:jar:6.1.26 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-app:jar:2.2.0 from th
e shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-common:jar:2.2.0 fromthe shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-client:jar:2.2.0 from the shaded
jar.
[INFO] Excluding com.google.inject:guice:jar:3.0 from the shaded jar.
[INFO] Excluding javax.inject:javax.inject:jar:1 from the shaded jar.
[INFO] Excluding aopalliance:aopalliance:jar:1.0 from the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-server-common:jar:2.2.0 from the
shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-shuffle:jar:2.2.0 fro
m the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-api:jar:2.2.0 from the shaded jar
.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-core:jar:2.2.0 from t
he shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-yarn-common:jar:2.2.0 from the shaded
jar.
[INFO] Excluding org.apache.hadoop:hadoop-mapreduce-client-jobclient:jar:2.2.0 f
rom the shaded jar.
[INFO] Excluding org.apache.hadoop:hadoop-annotations:jar:2.2.0 from the shaded
jar.
[INFO] Excluding net.java.dev.jets3t:jets3t:jar:0.7.1 from the shaded jar.
[INFO] Excluding commons-codec:commons-codec:jar:1.10 from the shaded jar.
[INFO] Excluding commons-httpclient:commons-httpclient:jar:3.1 from the shaded j
ar.
[INFO] Excluding org.apache.curator:curator-recipes:jar:2.4.0 from the shaded ja
r.
[INFO] Excluding org.apache.curator:curator-framework:jar:2.4.0 from the shaded
jar.
[INFO] Excluding org.apache.curator:curator-client:jar:2.4.0 from the shaded jar
.
[INFO] Excluding org.apache.zookeeper:zookeeper:jar:3.4.5 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-api:jar:1.7.16 from the shaded jar.
[INFO] Excluding log4j:log4j:jar:1.2.17 from the shaded jar.
[INFO] Excluding org.slf4j:slf4j-log4j12:jar:1.7.16 from the shaded jar.
[INFO] Excluding org.xerial.snappy:snappy-java:jar:1.1.2.4 from the shaded jar.
[INFO] Excluding net.jpountz.lz4:lz4:jar:1.3.0 from the shaded jar.
[INFO] Excluding commons-net:commons-net:jar:2.2 from the shaded jar.
[INFO] Excluding com.thoughtworks.paranamer:paranamer:jar:2.6 from the shaded ja
r.
[INFO] Excluding org.apache.kafka:kafka_2.11:jar:0.10.0.0 from the shaded jar.
[INFO] Excluding com.101tec:zkclient:jar:0.8 from the shaded jar.
[INFO] Excluding com.yammer.metrics:metrics-core:jar:2.2.0 from the shaded jar.
[INFO] Excluding org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.4
from the shaded jar.
[INFO] Excluding org.apache.kafka:kafka-clients:jar:0.10.0.0 from the shaded jar
.
[INFO] Excluding org.apache.spark:spark-tags_2.11:jar:2.1.0-SNAPSHOT from the sh
aded jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing C:\soft\spark\spark\external\kafka-0-10\target\spark-streaming-
kafka-0-10_2.11-2.1.0-SNAPSHOT.jar with C:\soft\spark\spark\external\kafka-0-10\
target\spark-streaming-kafka-0-10_2.11-2.1.0-SNAPSHOT-shaded.jar
[INFO] Dependency-reduced POM written at: C:\soft\spark\spark\external\kafka-0-1
0\dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: C:\soft\spark\spark\external\kafka-0-1
0\dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: C:\soft\spark\spark\external\kafka-0-1
0\dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-strea
ming-kafka-0-10_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10\target\spark-stream
ing-kafka-0-10_2.11-2.1.0-SNAPSHOT-sources.jar
[INFO]
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-
streaming-kafka-0-10_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10\target\spark-stream
ing-kafka-0-10_2.11-2.1.0-SNAPSHOT-test-sources.jar
[INFO]
[INFO] ------------------------------------------------------------------------
[INFO] Building Spark Integration for Kafka 0.10 Assembly 2.1.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:3.0.0:clean (default-clean) @ spark-streaming-kafk
a-0-10-assembly_2.11 ---
[INFO]
[INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-versions) @ spark-stream
ing-kafka-0-10-assembly_2.11 ---
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:add-source (eclipse-add-source) @ spark-stre
aming-kafka-0-10-assembly_2.11 ---
[INFO] Add Source directory: C:\soft\spark\spark\external\kafka-0-10-assembly\sr
c\main\scala
[INFO] Add Test Source directory: C:\soft\spark\spark\external\kafka-0-10-assemb
ly\src\test\scala
[INFO]
[INFO] --- maven-dependency-plugin:2.10:build-classpath (default-cli) @ spark-st
reaming-kafka-0-10-assembly_2.11 ---
[INFO] Dependencies classpath:
C:\Users\xingyun.xb\.m2\repository\org\apache\avro\avro\1.7.7\avro-1.7.7.jar;C:\
Users\xingyun.xb\.m2\repository\com\101tec\zkclient\0.8\zkclient-0.8.jar;C:\User
s\xingyun.xb\.m2\repository\javax\inject\javax.inject\1\javax.inject-1.jar;C:\so
ft\spark\spark\external\kafka-0-10\target\spark-streaming-kafka-0-10_2.11-2.1.0-
SNAPSHOT.jar;C:\Users\xingyun.xb\.m2\repository\org\codehaus\jackson\jackson-cor
e-asl\1.9.13\jackson-core-asl-1.9.13.jar;C:\Users\xingyun.xb\.m2\repository\com\
thoughtworks\paranamer\paranamer\2.3\paranamer-2.3.jar;C:\Users\xingyun.xb\.m2\r
epository\com\google\inject\guice\3.0\guice-3.0.jar;C:\Users\xingyun.xb\.m2\repo
sitory\commons-io\commons-io\2.4\commons-io-2.4.jar;C:\Users\xingyun.xb\.m2\repo
sitory\org\scala-lang\modules\scala-parser-combinators_2.11\1.0.4\scala-parser-c
ombinators_2.11-1.0.4.jar;C:\Users\xingyun.xb\.m2\repository\org\apache\kafka\ka
fka-clients\0.10.0.0\kafka-clients-0.10.0.0.jar;C:\Users\xingyun.xb\.m2\reposito
ry\org\apache\hadoop\hadoop-yarn-api\2.2.0\hadoop-yarn-api-2.2.0.jar;C:\Users\xi
ngyun.xb\.m2\repository\org\tukaani\xz\1.0\xz-1.0.jar;C:\Users\xingyun.xb\.m2\re
pository\org\apache\avro\avro-ipc\1.7.7\avro-ipc-1.7.7.jar;C:\Users\xingyun.xb\.
m2\repository\org\apache\commons\commons-compress\1.4.1\commons-compress-1.4.1.j
ar;C:\Users\xingyun.xb\.m2\repository\org\apache\hadoop\hadoop-yarn-client\2.2.0
\hadoop-yarn-client-2.2.0.jar;C:\Users\xingyun.xb\.m2\repository\org\apache\hado
op\hadoop-yarn-common\2.2.0\hadoop-yarn-common-2.2.0.jar;C:\Users\xingyun.xb\.m2
\repository\org\apache\kafka\kafka_2.11\0.10.0.0\kafka_2.11-0.10.0.0.jar;C:\User
s\xingyun.xb\.m2\repository\aopalliance\aopalliance\1.0\aopalliance-1.0.jar;C:\U
sers\xingyun.xb\.m2\repository\com\yammer\metrics\metrics-core\2.2.0\metrics-cor
e-2.2.0.jar;C:\Users\xingyun.xb\.m2\repository\org\codehaus\jackson\jackson-mapp
er-asl\1.9.13\jackson-mapper-asl-1.9.13.jar;C:\soft\spark\spark\common\tags\targ
et\spark-tags_2.11-2.1.0-SNAPSHOT.jar;C:\Users\xingyun.xb\.m2\repository\org\spa
rk-project\spark\unused\1.0.0\unused-1.0.0.jar
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ spark-streaming
-kafka-0-10-assembly_2.11 ---
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ spark-stre
aming-kafka-0-10-assembly_2.11 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory C:\soft\spark\spark\external\kafka-0-
10-assembly\src\main\resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-stream
ing-kafka-0-10-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.5.1:compile (default-compile) @ spark-streami
ng-kafka-0-10-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-antrun-plugin:1.8:run (create-tmp-dir) @ spark-streaming-kafka-
0-10-assembly_2.11 ---
[INFO] Executing tasksmain:[mkdir] Created dir: C:\soft\spark\spark\external\kafka-0-10-assembly\target
\tmp
[INFO] Executed tasks
[INFO]
[INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ sp
ark-streaming-kafka-0-10-assembly_2.11 ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory C:\soft\spark\spark\external\kafka-0-
10-assembly\src\test\resources
[INFO] Copying 3 resources
[INFO]
[INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ spa
rk-streaming-kafka-0-10-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-compiler-plugin:3.5.1:testCompile (default-testCompile) @ spark
-streaming-kafka-0-10-assembly_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-dependency-plugin:2.10:build-classpath (generate-test-classpath
) @ spark-streaming-kafka-0-10-assembly_2.11 ---
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ spark-streaming-ka
fka-0-10-assembly_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-streaming-kafka-0-10
-assembly_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-streaming-kafka-0-10-a
ssembly_2.11 ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- maven-jar-plugin:2.6:test-jar (prepare-test-jar) @ spark-streaming-ka
fka-0-10-assembly_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10-assembly\target\spa
rk-streaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT-tests.jar
[INFO]
[INFO] --- maven-jar-plugin:2.6:jar (default-jar) @ spark-streaming-kafka-0-10-a
ssembly_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10-assembly\target\spa
rk-streaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT.jar
[INFO]
[INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ spark-s
treaming-kafka-0-10-assembly_2.11 ---
[INFO]
[INFO] --- maven-shade-plugin:2.4.3:shade (default) @ spark-streaming-kafka-0-10
-assembly_2.11 ---
[INFO] Including org.apache.spark:spark-streaming-kafka-0-10_2.11:jar:2.1.0-SNAP
SHOT in the shaded jar.
[INFO] Including org.apache.kafka:kafka_2.11:jar:0.10.0.0 in the shaded jar.
[INFO] Including com.101tec:zkclient:jar:0.8 in the shaded jar.
[INFO] Including com.yammer.metrics:metrics-core:jar:2.2.0 in the shaded jar.
[INFO] Including org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.4
in the shaded jar.
[INFO] Including org.apache.kafka:kafka-clients:jar:0.10.0.0 in the shaded jar.
[INFO] Including org.apache.spark:spark-tags_2.11:jar:2.1.0-SNAPSHOT in the shad
ed jar.
[INFO] Including commons-io:commons-io:jar:2.4 in the shaded jar.
[INFO] Including org.apache.avro:avro:jar:1.7.7 in the shaded jar.
[INFO] Including com.thoughtworks.paranamer:paranamer:jar:2.3 in the shaded jar.[INFO] Including org.apache.commons:commons-compress:jar:1.4.1 in the shaded jar
.
[INFO] Including org.tukaani:xz:jar:1.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-client:jar:2.2.0 in the shaded ja
r.
[INFO] Including com.google.inject:guice:jar:3.0 in the shaded jar.
[INFO] Including javax.inject:javax.inject:jar:1 in the shaded jar.
[INFO] Including aopalliance:aopalliance:jar:1.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-api:jar:2.2.0 in the shaded jar.
[INFO] Including org.apache.hadoop:hadoop-yarn-common:jar:2.2.0 in the shaded ja
r.
[INFO] Including org.apache.avro:avro-ipc:jar:1.7.7 in the shaded jar.
[INFO] Including org.codehaus.jackson:jackson-core-asl:jar:1.9.13 in the shaded
jar.
[INFO] Including org.codehaus.jackson:jackson-mapper-asl:jar:1.9.13 in the shade
d jar.
[INFO] Including org.spark-project.spark:unused:jar:1.0.0 in the shaded jar.
[WARNING] spark-tags_2.11-2.1.0-SNAPSHOT.jar, spark-streaming-kafka-0-10_2.11-2.
1.0-SNAPSHOT.jar, unused-1.0.0.jar define 1 overlapping classes:
[WARNING]   - org.apache.spark.unused.UnusedStubClass
[WARNING] hadoop-yarn-common-2.2.0.jar, hadoop-yarn-api-2.2.0.jar define 3 overl
apping classes:
[WARNING]   - org.apache.hadoop.yarn.factories.package-info
[WARNING]   - org.apache.hadoop.yarn.util.package-info
[WARNING]   - org.apache.hadoop.yarn.factory.providers.package-info
[WARNING] maven-shade-plugin has detected that some class files are
[WARNING] present in two or more JARs. When this happens, only one
[WARNING] single version of the class is copied to the uber jar.
[WARNING] Usually this is not harmful and you can skip these warnings,
[WARNING] otherwise try to manually exclude artifacts based on
[WARNING] mvn dependency:tree -Ddetail=true and the above output.
[WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing C:\soft\spark\spark\external\kafka-0-10-assembly\target\spark-s
treaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT.jar with C:\soft\spark\spark\ex
ternal\kafka-0-10-assembly\target\spark-streaming-kafka-0-10-assembly_2.11-2.1.0
-SNAPSHOT-shaded.jar
[INFO] Dependency-reduced POM written at: C:\soft\spark\spark\external\kafka-0-1
0-assembly\dependency-reduced-pom.xml
[INFO] Dependency-reduced POM written at: C:\soft\spark\spark\external\kafka-0-1
0-assembly\dependency-reduced-pom.xml
[INFO]
[INFO] --- maven-source-plugin:2.4:jar-no-fork (create-source-jar) @ spark-strea
ming-kafka-0-10-assembly_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10-assembly\target\spa
rk-streaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT-sources.jar
[INFO]
[INFO] --- maven-source-plugin:2.4:test-jar-no-fork (create-source-jar) @ spark-
streaming-kafka-0-10-assembly_2.11 ---
[INFO] Building jar: C:\soft\spark\spark\external\kafka-0-10-assembly\target\spa
rk-streaming-kafka-0-10-assembly_2.11-2.1.0-SNAPSHOT-test-sources.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [  4.060 s]
[INFO] Spark Project Tags ................................. SUCCESS [  6.272 s]
[INFO] Spark Project Sketch ............................... SUCCESS [ 12.164 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 11.965 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [  8.533 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 15.566 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 11.382 s]
[INFO] Spark Project Core ................................. SUCCESS [04:00 min]
[INFO] Spark Project GraphX ............................... SUCCESS [ 46.278 s]
[INFO] Spark Project Streaming ............................ SUCCESS [01:30 min]
[INFO] Spark Project Catalyst ............................. SUCCESS [03:04 min]
[INFO] Spark Project SQL .................................. SUCCESS [03:45 min]
[INFO] Spark Project ML Local Library ..................... SUCCESS [ 32.449 s]
[INFO] Spark Project ML Library ........................... SUCCESS [02:56 min]
[INFO] Spark Project Tools ................................ SUCCESS [  6.504 s]
[INFO] Spark Project Hive ................................. SUCCESS [03:00 min]
[INFO] Spark Project REPL ................................. SUCCESS [ 19.472 s]
[INFO] Spark Project Assembly ............................. SUCCESS [  4.420 s]
[INFO] Spark Project External Flume Sink .................. SUCCESS [ 17.863 s]
[INFO] Spark Project External Flume ....................... SUCCESS [ 26.544 s]
[INFO] Spark Project External Flume Assembly .............. SUCCESS [  3.423 s]
[INFO] Spark Integration for Kafka 0.8 .................... SUCCESS [ 32.688 s]
[INFO] Spark Project Examples ............................. SUCCESS [ 48.515 s]
[INFO] Spark Project External Kafka Assembly .............. SUCCESS [  5.093 s]
[INFO] Spark Integration for Kafka 0.10 ................... SUCCESS [ 30.390 s]
[INFO] Spark Integration for Kafka 0.10 Assembly .......... SUCCESS [  4.189 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 24:07 min
[INFO] Finished at: 2016-07-30T16:49:32+08:00
[INFO] Final Memory: 95M/994M
[INFO] ------------------------------------------------------------------------C:\soft\spark\spark>

Spark2学习2之window下编译spark-2.0.0相关推荐

  1. lapack 在window下编译

    lapack 在window下编译 今天进行了Lapack3.8.0在windows下编译 1. 首先使用CMake进行vs2015下的工程生成,碰到了一个变量没有设置的问题: string(TOUP ...

  2. centos 6 mysql 5.7.13 编译安装_Centos 6.5系统下编译安装PHP 7.0.13的方法

    PHP7.0正式版也出来了,今天编译安装了一下,写下安装步骤,我是在centos6.6 环境中编译的,下面是详细的安装步骤 环境依赖 yum install gcc gcc-c++ libxml2 l ...

  3. 在Window下编译OpenH323

    前言:         本文只提供VC6.0的编译说明,如果想知道VC.Net下的编译过程请参看原文. 原文 :          http://www.voxgratia.org/docs/pwli ...

  4. Window下编译 64位ffmpeg 引入libx264及libmp3lame编码库

    好记性不如烂笔头,每次编译总要有些时间折腾,记录下编译过程,方便后来者. 本文 介绍windows下编译64位Ffmpeg库 (版本V4.02)如何引入libx264及libmp3lame(编码mp3 ...

  5. Firefly-RK3288学习笔记2-Ubuntu16.04下编译Ubuntu16.04固件

    转载:https://blog.csdn.net/kenjianqi1647/article/details/88726391 官方教程:http://wiki.t-firefly.com/zh_CN ...

  6. TCP/IP协议学习笔记(三)Window下socket编程(一)TCP

    DLL的加载 使用#pragma命令,在编译时加载: #pragma comment (lib, "ws2_32.lib") //加载 ws2_32.dll 使用DLL之前,还需要 ...

  7. 64位centos 下编译 hadoop 2.6.0 源码

    64位os下为啥要编译hadoop就不解释了,百度一下就能知道原因,下面是步骤: 前提:编译源码所在的机器,必须能上网,否则建议不要尝试了 一. 下载必要的组件 a) 下载hadoop源码 (当前最新 ...

  8. 【甘道夫】Win7x64环境下编译Apache Hadoop2.2.0的Eclipse插件

    目标: 编译Apache Hadoop2.2.0在win7x64环境下的Eclipse插件 环境: win7x64家庭普通版 eclipse-jee-kepler-SR1-win32-x86_64.z ...

  9. 【甘道夫】Win7x64环境下编译Apache Hadoop2.2.0的Eclipse小工具

    目标: 编译Apache Hadoop2.2.0在win7x64环境下的Eclipse插件 环境: win7x64家庭普通版 eclipse-jee-kepler-SR1-win32-x86_64.z ...

最新文章

  1. python实现AES算法
  2. VTK：可视化之ComplexV
  3. hbase启动的时候报错java.lang.ClassNotFoundException: org.slf4j.LoggerFactory
  4. 手把手maven的功能/安装/使用/idea集成
  5. opencv论坛_Opencv批量添加logo的解决方案
  6. 递增子序列 Increasing Subsequences
  7. python 运算符与流程控制
  8. JSONHelper JSON帮助类
  9. css3制作的载入动画效果，效果很震撼！
  10. 马尔可夫过程及其例题分析
  11. jq 获取引入页面url_jQuery获取当前页面的URL信息
  12. 什么是MAC多播地址
  13. java 微信隐藏右上角_不懂这11个隐藏技巧，别说你会用微信
  14. 用 screen 做串口终端
  15. Excel-用OFFSET和COUNTA实现动态增加下拉列表
  16. VSCODE+EIDE开发STM32
  17. javaScript-工具库
  18. 他趣产品总监张俊杰：从“爹爹框架”看内容平台运营的 4 大关键点
  19. 3.2 Python 实例3-天天向上的力量
  20. Java架构师，大数据架构师，高并发设计模式，机器学习知识点分享

热门文章

  1. 【Web3】Web3连接到以太坊网络（测试网、主网）
  2. windows_用命令行/终端打开网页(url)(launch a webpage by winodws CLI)
  3. 享用一生100种最实用生活小窍门
  4. 软件测试BATJ大厂1000小时面试经验分享【建议收藏】
  5. VCS2018在Ubuntu20 18安装步骤
  6. 视频教程-CCNP 思科认证网络工程师（美女讲师版）-思科认证
  7. 论文修改---参考文献修改
  8. 《羊卓的杨的算法笔记》_Quentin
  9. 移动终端开发必备知识
  10. android apn流程,Android APN加载流程