从底层代码实现来讲，makeRDD 方法其实就是 parallelize 方法:

def makeRDD[T: ClassTag](seq: Seq[T],numSlices: Int = defaultParallelism): RDD[T] = withScope {parallelize(seq, numSlices)
}

代码示例：

package com.zxl.sparkimport org.apache.spark.{SparkConf, SparkContext}
/*
从集合中创建 RDD，Spark 主要提供了两个方法：parallelize 和 makeRDD
*/
object RDDDemo01 {def main(args: Array[String]): Unit = {val sparkConf = new SparkConf().setMaster("local").setAppName("spark")val sparkContext = new SparkContext(sparkConf)val rdd1 = sparkContext.parallelize(List(1, 2, 3, 4))val rdd2 = sparkContext.makeRDD(List(1, 2, 3, 4))rdd1.collect().foreach(println)rdd2.collect().foreach(println)sparkContext.stop()}}

运行结果：

/home/zxl/develop/jdk1.8.0_271/bin/java -javaagent:/home/zxl/develop/idea-IC-203.5981.155/lib/idea_rt.jar=41839:/home/zxl/develop/idea-IC-203.5981.155/bin -Dfile.encoding=UTF-8 -classpath /home/zxl/develop/jdk1.8.0_271/jre/lib/charsets.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/deploy.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/cldrdata.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/dnsns.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/jaccess.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/jfxrt.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/localedata.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/nashorn.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/sunec.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/sunjce_provider.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/sunpkcs11.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/ext/zipfs.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/javaws.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/jce.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/jfr.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/jfxswt.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/jsse.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/management-agent.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/plugin.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/resources.jar:/home/zxl/develop/jdk1.8.0_271/jre/lib/rt.jar:/home/zxl/IdeaProjects/spark/target/classes:/home/zxl/develop/scala-2.12.12/lib/scala-reflect.jar:/home/zxl/develop/scala-2.12.12/lib/scala-library.jar:/home/zxl/.m2/repository/org/apache/spark/spark-core_2.12/3.0.0/spark-core_2.12-3.0.0.jar:/home/zxl/.m2/repository/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/home/zxl/.m2/repository/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/home/zxl/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/home/zxl/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/home/zxl/.m2/repository/org/apache/commons/commons-compress/1.8.1/commons-compress-1.8.1.jar:/home/zxl/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar:/home/zxl/.m2/repository/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/home/zxl/.m2/repository/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/home/zxl/.m2/repository/commons-codec/commons-codec/1.9/commons-codec-1.9.jar:/home/zxl/.m2/repository/com/twitter/chill_2.12/0.9.5/chill_2.12-0.9.5.jar:/home/zxl/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/home/zxl/.m2/repository/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/home/zxl/.m2/repository/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar:/home/zxl/.m2/repository/com/twitter/chill-java/0.9.5/chill-java-0.9.5.jar:/home/zxl/.m2/repository/org/apache/xbean/xbean-asm7-shaded/4.15/xbean-asm7-shaded-4.15.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-client/2.7.4/hadoop-client-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-common/2.7.4/hadoop-common-2.7.4.jar:/home/zxl/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/home/zxl/.m2/repository/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/home/zxl/.m2/repository/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/home/zxl/.m2/repository/commons-io/commons-io/2.4/commons-io-2.4.jar:/home/zxl/.m2/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/home/zxl/.m2/repository/org/mortbay/jetty/jetty-sslengine/6.1.26/jetty-sslengine-6.1.26.jar:/home/zxl/.m2/repository/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/home/zxl/.m2/repository/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/home/zxl/.m2/repository/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/home/zxl/.m2/repository/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/home/zxl/.m2/repository/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/home/zxl/.m2/repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/home/zxl/.m2/repository/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-auth/2.7.4/hadoop-auth-2.7.4.jar:/home/zxl/.m2/repository/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/home/zxl/.m2/repository/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/home/zxl/.m2/repository/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/home/zxl/.m2/repository/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/home/zxl/.m2/repository/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/home/zxl/.m2/repository/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/home/zxl/.m2/repository/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/home/zxl/.m2/repository/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-hdfs/2.7.4/hadoop-hdfs-2.7.4.jar:/home/zxl/.m2/repository/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/home/zxl/.m2/repository/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/home/zxl/.m2/repository/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.4/hadoop-mapreduce-client-app-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.4/hadoop-mapreduce-client-common-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-yarn-client/2.7.4/hadoop-yarn-client-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-yarn-server-common/2.7.4/hadoop-yarn-server-common-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.4/hadoop-mapreduce-client-shuffle-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-yarn-api/2.7.4/hadoop-yarn-api-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.4/hadoop-mapreduce-client-core-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-yarn-common/2.7.4/hadoop-yarn-common-2.7.4.jar:/home/zxl/.m2/repository/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/home/zxl/.m2/repository/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/home/zxl/.m2/repository/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/home/zxl/.m2/repository/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.4/hadoop-mapreduce-client-jobclient-2.7.4.jar:/home/zxl/.m2/repository/org/apache/hadoop/hadoop-annotations/2.7.4/hadoop-annotations-2.7.4.jar:/home/zxl/.m2/repository/org/apache/spark/spark-launcher_2.12/3.0.0/spark-launcher_2.12-3.0.0.jar:/home/zxl/.m2/repository/org/apache/spark/spark-kvstore_2.12/3.0.0/spark-kvstore_2.12-3.0.0.jar:/home/zxl/.m2/repository/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/home/zxl/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.10.0/jackson-core-2.10.0.jar:/home/zxl/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.10.0/jackson-annotations-2.10.0.jar:/home/zxl/.m2/repository/org/apache/spark/spark-network-common_2.12/3.0.0/spark-network-common_2.12-3.0.0.jar:/home/zxl/.m2/repository/org/apache/spark/spark-network-shuffle_2.12/3.0.0/spark-network-shuffle_2.12-3.0.0.jar:/home/zxl/.m2/repository/org/apache/spark/spark-unsafe_2.12/3.0.0/spark-unsafe_2.12-3.0.0.jar:/home/zxl/.m2/repository/javax/activation/activation/1.1.1/activation-1.1.1.jar:/home/zxl/.m2/repository/org/apache/curator/curator-recipes/2.7.1/curator-recipes-2.7.1.jar:/home/zxl/.m2/repository/org/apache/curator/curator-framework/2.7.1/curator-framework-2.7.1.jar:/home/zxl/.m2/repository/com/google/guava/guava/16.0.1/guava-16.0.1.jar:/home/zxl/.m2/repository/org/apache/zookeeper/zookeeper/3.4.14/zookeeper-3.4.14.jar:/home/zxl/.m2/repository/org/apache/yetus/audience-annotations/0.5.0/audience-annotations-0.5.0.jar:/home/zxl/.m2/repository/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/home/zxl/.m2/repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar:/home/zxl/.m2/repository/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/home/zxl/.m2/repository/org/apache/commons/commons-text/1.6/commons-text-1.6.jar:/home/zxl/.m2/repository/com/google/code/findbugs/jsr305/3.0.0/jsr305-3.0.0.jar:/home/zxl/.m2/repository/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.jar:/home/zxl/.m2/repository/org/slf4j/jul-to-slf4j/1.7.30/jul-to-slf4j-1.7.30.jar:/home/zxl/.m2/repository/org/slf4j/jcl-over-slf4j/1.7.30/jcl-over-slf4j-1.7.30.jar:/home/zxl/.m2/repository/log4j/log4j/1.2.17/log4j-1.2.17.jar:/home/zxl/.m2/repository/org/slf4j/slf4j-log4j12/1.7.30/slf4j-log4j12-1.7.30.jar:/home/zxl/.m2/repository/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/home/zxl/.m2/repository/org/xerial/snappy/snappy-java/1.1.7.5/snappy-java-1.1.7.5.jar:/home/zxl/.m2/repository/org/lz4/lz4-java/1.7.1/lz4-java-1.7.1.jar:/home/zxl/.m2/repository/com/github/luben/zstd-jni/1.4.4-3/zstd-jni-1.4.4-3.jar:/home/zxl/.m2/repository/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/home/zxl/.m2/repository/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/home/zxl/.m2/repository/commons-net/commons-net/3.1/commons-net-3.1.jar:/home/zxl/.m2/repository/org/scala-lang/modules/scala-xml_2.12/1.2.0/scala-xml_2.12-1.2.0.jar:/home/zxl/.m2/repository/org/scala-lang/scala-library/2.12.10/scala-library-2.12.10.jar:/home/zxl/.m2/repository/org/scala-lang/scala-reflect/2.12.10/scala-reflect-2.12.10.jar:/home/zxl/.m2/repository/org/json4s/json4s-jackson_2.12/3.6.6/json4s-jackson_2.12-3.6.6.jar:/home/zxl/.m2/repository/org/json4s/json4s-core_2.12/3.6.6/json4s-core_2.12-3.6.6.jar:/home/zxl/.m2/repository/org/json4s/json4s-ast_2.12/3.6.6/json4s-ast_2.12-3.6.6.jar:/home/zxl/.m2/repository/org/json4s/json4s-scalap_2.12/3.6.6/json4s-scalap_2.12-3.6.6.jar:/home/zxl/.m2/repository/org/glassfish/jersey/core/jersey-client/2.30/jersey-client-2.30.jar:/home/zxl/.m2/repository/jakarta/ws/rs/jakarta.ws.rs-api/2.1.6/jakarta.ws.rs-api-2.1.6.jar:/home/zxl/.m2/repository/org/glassfish/hk2/external/jakarta.inject/2.6.1/jakarta.inject-2.6.1.jar:/home/zxl/.m2/repository/org/glassfish/jersey/core/jersey-common/2.30/jersey-common-2.30.jar:/home/zxl/.m2/repository/jakarta/annotation/jakarta.annotation-api/1.3.5/jakarta.annotation-api-1.3.5.jar:/home/zxl/.m2/repository/org/glassfish/hk2/osgi-resource-locator/1.0.3/osgi-resource-locator-1.0.3.jar:/home/zxl/.m2/repository/org/glassfish/jersey/core/jersey-server/2.30/jersey-server-2.30.jar:/home/zxl/.m2/repository/org/glassfish/jersey/media/jersey-media-jaxb/2.30/jersey-media-jaxb-2.30.jar:/home/zxl/.m2/repository/jakarta/validation/jakarta.validation-api/2.0.2/jakarta.validation-api-2.0.2.jar:/home/zxl/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet/2.30/jersey-container-servlet-2.30.jar:/home/zxl/.m2/repository/org/glassfish/jersey/containers/jersey-container-servlet-core/2.30/jersey-container-servlet-core-2.30.jar:/home/zxl/.m2/repository/org/glassfish/jersey/inject/jersey-hk2/2.30/jersey-hk2-2.30.jar:/home/zxl/.m2/repository/org/glassfish/hk2/hk2-locator/2.6.1/hk2-locator-2.6.1.jar:/home/zxl/.m2/repository/org/glassfish/hk2/external/aopalliance-repackaged/2.6.1/aopalliance-repackaged-2.6.1.jar:/home/zxl/.m2/repository/org/glassfish/hk2/hk2-api/2.6.1/hk2-api-2.6.1.jar:/home/zxl/.m2/repository/org/glassfish/hk2/hk2-utils/2.6.1/hk2-utils-2.6.1.jar:/home/zxl/.m2/repository/org/javassist/javassist/3.25.0-GA/javassist-3.25.0-GA.jar:/home/zxl/.m2/repository/io/netty/netty-all/4.1.47.Final/netty-all-4.1.47.Final.jar:/home/zxl/.m2/repository/com/clearspring/analytics/stream/2.9.6/stream-2.9.6.jar:/home/zxl/.m2/repository/io/dropwizard/metrics/metrics-core/4.1.1/metrics-core-4.1.1.jar:/home/zxl/.m2/repository/io/dropwizard/metrics/metrics-jvm/4.1.1/metrics-jvm-4.1.1.jar:/home/zxl/.m2/repository/io/dropwizard/metrics/metrics-json/4.1.1/metrics-json-4.1.1.jar:/home/zxl/.m2/repository/io/dropwizard/metrics/metrics-graphite/4.1.1/metrics-graphite-4.1.1.jar:/home/zxl/.m2/repository/io/dropwizard/metrics/metrics-jmx/4.1.1/metrics-jmx-4.1.1.jar:/home/zxl/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.10.0/jackson-databind-2.10.0.jar:/home/zxl/.m2/repository/com/fasterxml/jackson/module/jackson-module-scala_2.12/2.10.0/jackson-module-scala_2.12-2.10.0.jar:/home/zxl/.m2/repository/com/fasterxml/jackson/module/jackson-module-paranamer/2.10.0/jackson-module-paranamer-2.10.0.jar:/home/zxl/.m2/repository/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/home/zxl/.m2/repository/oro/oro/2.0.8/oro-2.0.8.jar:/home/zxl/.m2/repository/net/razorvine/pyrolite/4.30/pyrolite-4.30.jar:/home/zxl/.m2/repository/net/sf/py4j/py4j/0.10.9/py4j-0.10.9.jar:/home/zxl/.m2/repository/org/apache/spark/spark-tags_2.12/3.0.0/spark-tags_2.12-3.0.0.jar:/home/zxl/.m2/repository/org/apache/commons/commons-crypto/1.0.0/commons-crypto-1.0.0.jar:/home/zxl/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar com.zxl.spark.RDDDemo01
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
20/12/28 09:57:11 WARN Utils: Your hostname, debian resolves to a loopback address: 127.0.0.1; using 192.168.116.152 instead (on interface enp3s0)
20/12/28 09:57:11 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
20/12/28 09:57:11 INFO SparkContext: Running Spark version 3.0.0
20/12/28 09:57:12 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
20/12/28 09:57:12 INFO ResourceUtils: ==============================================================
20/12/28 09:57:12 INFO ResourceUtils: Resources for spark.driver:20/12/28 09:57:12 INFO ResourceUtils: ==============================================================
20/12/28 09:57:12 INFO SparkContext: Submitted application: spark
20/12/28 09:57:13 INFO SecurityManager: Changing view acls to: zxl
20/12/28 09:57:13 INFO SecurityManager: Changing modify acls to: zxl
20/12/28 09:57:13 INFO SecurityManager: Changing view acls groups to:
20/12/28 09:57:13 INFO SecurityManager: Changing modify acls groups to:
20/12/28 09:57:13 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(zxl); groups with view permissions: Set(); users  with modify permissions: Set(zxl); groups with modify permissions: Set()
20/12/28 09:57:14 INFO Utils: Successfully started service 'sparkDriver' on port 34393.
20/12/28 09:57:14 INFO SparkEnv: Registering MapOutputTracker
20/12/28 09:57:14 INFO SparkEnv: Registering BlockManagerMaster
20/12/28 09:57:14 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
20/12/28 09:57:14 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
20/12/28 09:57:14 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
20/12/28 09:57:14 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-fcbf5879-1705-41c7-9db0-72a664f2075d
20/12/28 09:57:14 INFO MemoryStore: MemoryStore started with capacity 366.1 MiB
20/12/28 09:57:14 INFO SparkEnv: Registering OutputCommitCoordinator
20/12/28 09:57:15 INFO Utils: Successfully started service 'SparkUI' on port 4040.
20/12/28 09:57:15 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.116.152:4040
20/12/28 09:57:15 INFO Executor: Starting executor ID driver on host 192.168.116.152
20/12/28 09:57:15 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 43457.
20/12/28 09:57:15 INFO NettyBlockTransferService: Server created on 192.168.116.152:43457
20/12/28 09:57:15 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
20/12/28 09:57:15 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.116.152, 43457, None)
20/12/28 09:57:15 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.116.152:43457 with 366.1 MiB RAM, BlockManagerId(driver, 192.168.116.152, 43457, None)
20/12/28 09:57:15 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.116.152, 43457, None)
20/12/28 09:57:15 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.116.152, 43457, None)
20/12/28 09:57:17 INFO SparkContext: Starting job: collect at RDDDemo01.scala:11
20/12/28 09:57:17 INFO DAGScheduler: Got job 0 (collect at RDDDemo01.scala:11) with 1 output partitions
20/12/28 09:57:17 INFO DAGScheduler: Final stage: ResultStage 0 (collect at RDDDemo01.scala:11)
20/12/28 09:57:17 INFO DAGScheduler: Parents of final stage: List()
20/12/28 09:57:17 INFO DAGScheduler: Missing parents: List()
20/12/28 09:57:17 INFO DAGScheduler: Submitting ResultStage 0 (ParallelCollectionRDD[0] at parallelize at RDDDemo01.scala:9), which has no missing parents
20/12/28 09:57:17 WARN SizeEstimator: Failed to check whether UseCompressedOops is set; assuming yes
20/12/28 09:57:17 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.0 KiB, free 366.1 MiB)
20/12/28 09:57:18 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1279.0 B, free 366.1 MiB)
20/12/28 09:57:18 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 192.168.116.152:43457 (size: 1279.0 B, free: 366.1 MiB)
20/12/28 09:57:18 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1200
20/12/28 09:57:18 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 0 (ParallelCollectionRDD[0] at parallelize at RDDDemo01.scala:9) (first 15 tasks are for partitions Vector(0))
20/12/28 09:57:18 INFO TaskSchedulerImpl: Adding task set 0.0 with 1 tasks
20/12/28 09:57:18 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, 192.168.116.152, executor driver, partition 0, PROCESS_LOCAL, 7290 bytes)
20/12/28 09:57:18 INFO Executor: Running task 0.0 in stage 0.0 (TID 0)
20/12/28 09:57:18 INFO Executor: Finished task 0.0 in stage 0.0 (TID 0). 836 bytes result sent to driver
20/12/28 09:57:18 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 720 ms on 192.168.116.152 (executor driver) (1/1)
20/12/28 09:57:18 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
20/12/28 09:57:18 INFO DAGScheduler: ResultStage 0 (collect at RDDDemo01.scala:11) finished in 1.159 s
20/12/28 09:57:18 INFO DAGScheduler: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job
20/12/28 09:57:18 INFO TaskSchedulerImpl: Killing all running tasks in stage 0: Stage finished
20/12/28 09:57:19 INFO DAGScheduler: Job 0 finished: collect at RDDDemo01.scala:11, took 1.296072 s
1
2
3
4
20/12/28 09:57:19 INFO SparkContext: Starting job: collect at RDDDemo01.scala:12
20/12/28 09:57:19 INFO DAGScheduler: Got job 1 (collect at RDDDemo01.scala:12) with 1 output partitions
20/12/28 09:57:19 INFO DAGScheduler: Final stage: ResultStage 1 (collect at RDDDemo01.scala:12)
20/12/28 09:57:19 INFO DAGScheduler: Parents of final stage: List()
20/12/28 09:57:19 INFO DAGScheduler: Missing parents: List()
20/12/28 09:57:19 INFO DAGScheduler: Submitting ResultStage 1 (ParallelCollectionRDD[1] at makeRDD at RDDDemo01.scala:10), which has no missing parents
20/12/28 09:57:19 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 2.0 KiB, free 366.1 MiB)
20/12/28 09:57:19 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 1279.0 B, free 366.1 MiB)
20/12/28 09:57:19 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on 192.168.116.152:43457 (size: 1279.0 B, free: 366.1 MiB)
20/12/28 09:57:19 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1200
20/12/28 09:57:19 INFO DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (ParallelCollectionRDD[1] at makeRDD at RDDDemo01.scala:10) (first 15 tasks are for partitions Vector(0))
20/12/28 09:57:19 INFO TaskSchedulerImpl: Adding task set 1.0 with 1 tasks
20/12/28 09:57:19 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 1, 192.168.116.152, executor driver, partition 0, PROCESS_LOCAL, 7290 bytes)
20/12/28 09:57:19 INFO Executor: Running task 0.0 in stage 1.0 (TID 1)
20/12/28 09:57:19 INFO Executor: Finished task 0.0 in stage 1.0 (TID 1). 836 bytes result sent to driver
20/12/28 09:57:19 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 1) in 25 ms on 192.168.116.152 (executor driver) (1/1)
20/12/28 09:57:19 INFO DAGScheduler: ResultStage 1 (collect at RDDDemo01.scala:12) finished in 0.056 s
20/12/28 09:57:19 INFO TaskSchedulerImpl: Removed TaskSet 1.0, whose tasks have all completed, from pool
20/12/28 09:57:19 INFO DAGScheduler: Job 1 is finished. Cancelling potential speculative or zombie tasks for this job
20/12/28 09:57:19 INFO TaskSchedulerImpl: Killing all running tasks in stage 1: Stage finished
20/12/28 09:57:19 INFO DAGScheduler: Job 1 finished: collect at RDDDemo01.scala:12, took 0.067567 s
20/12/28 09:57:19 INFO SparkUI: Stopped Spark web UI at http://192.168.116.152:4040
1
2
3
4
20/12/28 09:57:19 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
20/12/28 09:57:19 INFO MemoryStore: MemoryStore cleared
20/12/28 09:57:19 INFO BlockManager: BlockManager stopped
20/12/28 09:57:19 INFO BlockManagerMaster: BlockManagerMaster stopped
20/12/28 09:57:19 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
20/12/28 09:57:19 INFO SparkContext: Successfully stopped SparkContext
20/12/28 09:57:19 INFO ShutdownHookManager: Shutdown hook called
20/12/28 09:57:19 INFO ShutdownHookManager: Deleting directory /tmp/spark-397bb91b-1c27-4121-87b1-fb335c857e80Process finished with exit code 0

Spark创建RDD的四种方式（一）：从集合（内存）中创建 RDD代码示例相关推荐

1. java并发编程基础系列（五）： 创建线程的四种方式

   线程的创建一共有四种方式: 继承于Thread类,重写run()方法: 实现Runable接口,实现里面的run()方法: 使用 FutureTask 实现有返回结果的线程 使用ExecutorSer ...

2. Python创建进程的四种方式

   Python创建进程的四种方式 百度百科 进程(Process)是计算机中的程序关于某数据集合上的一次运行活动,是系统进行资源分配和调度的基本单位,是操作系统结构的基础.在早期面向进程设计的计算机结构 ...

3. 创建现成的四种方式 多线程与并发的基本概念：

   多线程与并发的基本概念: 多线程 一:什么是线程? 进程:进行中应用程序 线程:是进程组成者,一个进程中可能包含多个线程 cpu执行程序的最小单位是线程,cpu在同一时间内只能执行一个线程,在多个线程 ...

4. Java 创建类的四种方式

   Java 创建类的四种方式 对于上学期已经学习过c++的同学,是不是对另一大编程语言产生了浓厚的兴趣,对于c++的面向对象编程,又和java的面向变量有何区别,下面我们从java四种创建对象来说起. ...

5. 创建线程的四种方式（Thread、Runnable、线程池、Callable）

   目录 一.直接继承Thread类,然后重写run方法 二.实现Runnable接口 三.线程池创建 四.实现Callable接口 创建线程有四种方式:1.继承Thread类   2.实现Runnabl ...

6. java创建多线程的四种方式

   java多线程的创建方式是面试经常会被问到的一个问题,因此在这里我对java创建多线程的四种方式做一个简单的归纳与总结,便于复习. 一.继承Thread类创建多线程 ① 创建一个继承于Thread类的 ...

7. 创建多线程的四种方式

   创建多线程的四种方式 方式一:继承于Thread类 创建一个继承于Thread类的子类 重写Thread类的run()->将此线程执行的操作声明在run()中 创建Thread类的子类的对象 通 ...

8. Java File.createNewFile 创建文件的四种方式小笔记

   本文为joshua317原创文章,转载请注明:转载自joshua317博客 Java File.createNewFile 创建文件的四种方式小笔记 - joshua317的博客 1.File(Str ...

9. Java 并发 多线程：创建线程的四种方式

   Java 并发 多线程: 创建线程的四种方式 继承 Thread 类并重写 run 方法 实现 Runnable 接口 实现 Callable 接口 使用线程池的方式创建 1. 通过继承 Thread ...

10. 【并发编程】创建线程的四种方式

    上一篇我们初步认识了线程,现在我们来讲一下,创建线程的三种方式 1.继承Thread 类通过继承thread类,然后重写run方法(run方法中是线程真正执行的代码,runable也是如此)即可.当子 ...

最新文章

1. 2021年大数据Flink（三十）：Flink ​​​​​​​Table API  SQL 介绍
2. 【开源】QuickPager ASP.NET2.0分页控件V2.0.0.3 【增加了使用说明】
3. c语言存储多个数据,C语言中如何求数组真实存有数据的元素个数
4. 视图、触发器、事务、存储过程、函数
5. 【Mood-9】搬家至博客园喽～～～
6. 为何要把你的SAP运行在Oracle数据库上？
7. java grizzly_Grizzly简介
8. java 字符串 数组互转
9. BUG! exception in phase semantic analysis in source unit
10. java包命名规则名词_java中命名规范
11. git push ! [remote rejected] master -＞ master (pre-receive hook declined)
12. [导入]如何在标题栏上增加按钮
13. Android预定义样式?android:attr/attribute、?attr/attribute和?attribute
14. 20191112每日一句
15. [SoapUI]怎样保存response到本地文件夹
16. 【单片机学习笔记】上传一整年的自学电子笔记，互相交流，共同进步。
17. DSA数字签名原理及python实现
18. html中创建圆点列表符号,圆点项目符号
19. 响铃：含着金钥匙的HomeKit如何才能大器晚成？
20. Spring 事件发布机制@EventListener源码深度解析

热门文章

1. 【NLP】GloVe的Python实现
2. 【Python】聊聊Pandas的前世今生
3. 【Python基础】Python 炫技操作：五种 Python 转义表示法
4. 顶会快讯|5篇AAAI2020相关论文抢先看（附GitHub代码地址）
5. 推荐几款不错的写作利器
6. 深度学习笔记 第五门课 序列模型 第三周 序列模型和注意力机制
7. 圆形的CNN卷积核？华中科大清华黄高团队康奈尔提出圆形卷积，进一步提升卷积结构性能！
8. 微信视频号推荐算法上分技巧
9. 我害怕接入IM云的开发者
10. 《Spring 3.0就这么简单》——1.6 展现层