运行wordcount的时候显示INFO mapreduce.Job: map 0% reduce 0%

错误提示：

[xiaoqiu@s150 /home/xiaoqiu]$ hadoop jar wordcounter.jar com.cr.wordcount.WordcountApp hdfs://s150/user/xiaoqiu/data/wc.txt hdfs://s150/user/xiaoqiu/data/out
18/01/05 09:12:52 INFO client.RMProxy: Connecting to ResourceManager at s150/192.168.109.150:8032
18/01/05 09:12:55 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
18/01/05 09:13:13 INFO input.FileInputFormat: Total input paths to process : 1
18/01/05 09:13:18 INFO mapreduce.JobSubmitter: number of splits:1
18/01/05 09:13:21 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1515157734609_0002
18/01/05 09:14:14 INFO impl.YarnClientImpl: Submitted application application_1515157734609_0002
18/01/05 09:14:16 INFO mapreduce.Job: The url to track the job: http://s150:8088/proxy/application_1515157734609_0002/
18/01/05 09:14:16 INFO mapreduce.Job: Running job: job_1515157734609_0002
18/01/05 09:20:09 INFO mapreduce.Job: Job job_1515157734609_0002 running in uber mode : false
18/01/05 09:20:16 INFO mapreduce.Job:  map 0% reduce 0%

解决：

修改了虚拟机的内存大小，我之前是每个虚拟机配置的512M，后来改成了1个G，解决了问题

运行wordcount的时候显示INFO mapreduce.Job: map 0% reduce 0%相关推荐

使用sqoop将数据从hdfs中导入mysql时，卡在INFO mapreduce.Job: map 100% reduce 0%的解决办法
最近在将hdfs中已经处理好的数据导入到mysql的时候遇到这么一个现象,当任务执行到 INFO mapreduce.Job: map 100% reduce 0% mapreduce任务卡在map1 ...
Hive mapreduce的map与reduce个数由什么决定？
文章目录 1.MapTask的数量决定 2.如何来调整MapTask的数量 2.1 增加map的数量 : 调小maxsize (要小于blockSize才有效,比如100byte) 2.2 减少map ...
map-reduce 、map、reduce
2019独角兽企业重金招聘Python工程师标准>>> map-reduce 过程中间绿线区域就是shuffle("洗牌")过程:map之后,reduce之前的 ...
hadoop运行wordcount实例，hdfs简单操作
1.查看hadoop版本 [hadoop@ltt1 sbin]$ hadoop version Hadoop 2.6.0-cdh5.12.0 Subversion http://github.com/ ...
运行wordcount时显示Could not obtain block
该文章接上面hadoop运行wordcount时卡住不动,接着下面 hadoop@ubuntu118:~/hadoop-1.0.2$ bin/hadoop dfsadmin -safemode lea ...
mac 10.9.5 安装hadoop 1.2.1 运行wordcount
1 在终端上输入 ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/homebrew/go/install) ...
ubuntu下hadoop运行wordcount程序
本机环境 ubuntu 12 hadoop 1.1.2 首先保证hadoop配置成功 1.在Hadoop的解压目录的如下位置可以找到WordCount.java的源文件 src/examples/or ...
wordcount.java_一步一步编译运行wordcount.java
WordCount是学习Hadoop的经典入门范例.下面通过一步步的操作,来编译.打包.运行WordCount程序. 1.在Hadoop 1.0.4的解压目录的如下位置可以找到WordCount.ja ...
Spark在Yarn上运行Wordcount程序
过往记忆专注于Hadoop.Spark.Hive.Flume.Hbase,QQ交流群:138615359 首页 Hadoop Spark Hive Hbase Flume 面试题面试题数据结构算 ...

运行wordcount的时候显示INFO mapreduce.Job: map 0% reduce 0%

运行wordcount的时候显示INFO mapreduce.Job: map 0% reduce 0%相关推荐

最新文章

热门文章