hadoop Safe mode is ON 的解决办法

搭了一个hadoop集群环境，近期总是出现读写文件错误的情况，查看name node的日志显示（ Safe mode is ON）

Safe mode is ON. The ratio of reported blocks 0.2000 has not reached the threshold 0.9990. Safe mode will be turned off automatically.

再往上翻

org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot delete /home/hadoop/tmp/mapred/system. Name node is in safe mode.

google 解决方案有三种

1）执行命令：bin/hadoop dfsadmin -safemode leave

dfsadmin -safemode value 参数value的说明如下：

enter - 进入安全模式

leave - 强制NameNode离开安全模式

get - 返回安全模式是否开启的信息

wait - 等待安全模式结束。

2）重新格式化文件系统 =。=

3）bin/hadoop fsck /

第一种方法，需要每次都执行一遍，很纠结~

第二种方法，format的意思你懂得。。。。

第三种方法，如果数据多，那执行起来会很慢，没办法，慢慢等吧。

hadoop@mhadoop:~/hadoop-1.0.0$ bin/hadoop fsck /
FSCK started by hadoop from /192.168.1.110 for path / at Wed Mar 07 17:57:43 CST 2012
.
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0001/job.jar: CORRUPT block blk_-8710406465335110666
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0001/job.jar: MISSING 1 blocks of total size 142465 B..
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0002/job.jar: CORRUPT block blk_8343735010139595189
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0002/job.jar: MISSING 1 blocks of total size 142465 B..
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0004/job.jar: CORRUPT block blk_4796918520991551976
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0004/job.jar: MISSING 1 blocks of total size 142465 B..
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0005/job.jar: CORRUPT block blk_8732649167016211914
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0005/job.jar: MISSING 1 blocks of total size 142465 B..
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0006/job.jar: CORRUPT block blk_2190395249671123528
/tmp/hadoop/tmp/mapred/staging/hadoop/.staging/job_201202290728_0006/job.jar: MISSING 1 blocks of total size 142465 B..
/tmp/hadoop/tmp/mapred/system/jobtracker.info: Under replicated blk_3010497672022840180_1511. Target Replicas is 2 but found 1 replica(s).
.
/user/hadoop/input/README.txt: Under replicated blk_1278803782511847062_1510. Target Replicas is 2 but found 1 replica(s).
..
/user/hadoop/output/_logs/history/job_201202290728_0007_1330473591943_hadoop_word+count: CORRUPT block blk_-165491155081655193
/user/hadoop/output/_logs/history/job_201202290728_0007_1330473591943_hadoop_word+count: MISSING 1 blocks of total size 13581 B..
/user/hadoop/output/_logs/history/job_201202290728_0007_conf.xml: CORRUPT block blk_359906738089887519
/user/hadoop/output/_logs/history/job_201202290728_0007_conf.xml: MISSING 1 blocks of total size 20344 B..
/user/hadoop/output/part-r-00000: CORRUPT block blk_-3883649133311907523
/user/hadoop/output/part-r-00000: MISSING 1 blocks of total size 158081 B.Status: CORRUPT
Total size: 905701 B
Total dirs: 20
Total files: 11
Total blocks (validated): 10 (avg. block size 90570 B)
********************************
CORRUPT FILES: 8
MISSING BLOCKS: 8
MISSING SIZE: 904331 B
CORRUPT BLOCKS: 8
********************************
Minimally replicated blocks: 2 (20.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 2 (20.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 2
Average block replication: 0.2
Corrupt blocks: 8
Missing replicas: 2 (100.0 %)
Number of data-nodes: 1
Number of racks: 1
FSCK ended at Wed Mar 07 17:57:43 CST 2012 in 11 milliseconds
The filesystem under path '/' is CORRUPT

hadoop Safe mode is ON 的解决办法相关推荐

Hive安装报错：Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient的解决办法
最近练习Hive,安装时爆出如下错误:Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClie ...
hadoop启动命令 start-all.sh失效解决办法
很多人在配置好了hadoop集群后,输入启动命令 start-all.sh 时,报错:This script is Deprecated. Instead use start-dfs.sh and s ...
hadoop磁盘空间不均衡的解决办法
hadoop集群在运行一段时间后,总是会出现某台机器的磁盘使用率特别高,有的使用率特别低,针对这种情况,hadoop提供了balancer工具调整磁盘负载使用命令:start-balancer.sh ...
Hadoop完全分子式环境搭建—问题及解决办法
Hadoop完全分布式环境搭建 ps:本人是按照尚硅谷的教程搭建的,版本hadoop2.7,centos版本6,一台主机,两台从机. 一．版本问题 1.尽量使用hadoop版本2,尽量不要使用最新版本 ...
maven引入hadoop_Maven引入hadoop依赖包出错解决办法
错误: ArtifactTransferException: Failure to transfer org.apache.hadoop:hadoop-hdfs:jar:2.6.0 from http ...
Hadoop搭建集群中输入hdfs namenode -format格式化节点时，提示：hdfs: command not found 解决办法
分析原因: hadoop的安装路径没有加入到当前路径中解决办法: 方法1: 进入hadoop的安装目录,在执行hadoop命令时在前面加上:./bin ./sbin 方法2: 进入/etc/prof ...
hadoop不生成tmp解决办法
解决办法: 代码里加入: conf.set("hadoop.tmp.dir","自己的路径名") 如:conf.set("hadoop.tmp.dir ...
新手安装hadoop教程和个人遇到的错误及解决办法（错误：./hadoop-daemon.sh start journalnode用不了和WARNING: HADOOP_SECURE_DN_USER）
首先Hadoop的安装分为三大步(视频教程移步https://www.bilibili.com/video/BV1mL4y1T7em?spm_id_from=333.337.search-card.a ...
Hadoop 运行wordcount任务卡在job running的一种解决办法
Hadoop 运行wordcount任务卡在runnning job的一种解决办法在使用Mac系统构建本地伪分布式hadoop系统,遇到如下问题网上有较多的解决办法,但是均不能解决我的问题,后来经 ...
【原创】-eclipse下连Hadoop报java.lang.OutOfMemoryError: Java heap space的解决办法
eclipse下java.lang.OutOfMemoryError: Java heap space的解决办法: 一.在eclipse下远程连接Hadoop出现如下问题: 14/03/28 22:3 ...

hadoop Safe mode is ON 的解决办法

hadoop Safe mode is ON 的解决办法相关推荐

最新文章

热门文章