The procedure WAL relies on the ability to hsync for proper operation during component failures

################################################第1种办法##############################################################

[1]的解決方案是:

更換hadoop版本，讓hadoop與hbase更加兼容

################################################第2种办法##############################################################

[2]的解決方案是：

hbase-site.xml增加配置
<property><name>hbase.unsafe.stream.capability.enforce</name><value>false</value>
</property>

注意这种设置有丢数据的风险

##########################################第3种办法#############################################################################

[3]的方案是

(Python3.6) appleyuchi@Desktop:~/bigdata/hbase-2.2.6/lib$ ls |grep hadoop
hadoop-annotations-2.8.5.jar
hadoop-auth-2.8.5.jar
hadoop-client-2.8.5.jar
hadoop-common-2.8.5.jar
hadoop-distcp-2.8.5.jar
hadoop-hdfs-2.8.5.jar
hadoop-hdfs-2.8.5-tests.jar
hadoop-hdfs-client-2.8.5.jar
hadoop-mapreduce-client-app-2.8.5.jar
hadoop-mapreduce-client-common-2.8.5.jar
hadoop-mapreduce-client-core-2.8.5.jar
hadoop-mapreduce-client-hs-2.8.5.jar
hadoop-mapreduce-client-jobclient-2.8.5.jar
hadoop-mapreduce-client-shuffle-2.8.5.jar
hadoop-minicluster-2.8.5.jar
hadoop-yarn-api-2.8.5.jar
hadoop-yarn-client-2.8.5.jar
hadoop-yarn-common-2.8.5.jar
hadoop-yarn-server-applicationhistoryservice-2.8.5.jar
hadoop-yarn-server-common-2.8.5.jar
hadoop-yarn-server-nodemanager-2.8.5.jar
hadoop-yarn-server-resourcemanager-2.8.5.jar
hadoop-yarn-server-tests-2.8.5-tests.jar
hadoop-yarn-server-web-proxy-2.8.5.jar
hbase-hadoop2-compat-2.2.6.jar
hbase-hadoop2-compat-2.2.6-tests.jar
hbase-hadoop-compat-2.2.6.jar
hbase-hadoop-compat-2.2.6-tests.jar

液就是说$HBASE_HOME/lib下面的2.8.5的相关的jar全部要替换掉

替换脚本auto.sh：

#!/bin/sh
cp $HADOOP_HOME/share/hadoop/hdfs/lib/hadoop-annotations-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/hdfs/lib/hadoop-auth-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/common/hadoop-common-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/tools/lib/hadoop-distcp-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-app-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-common-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-core-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-api-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-client-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-common-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-common-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-nodemanager-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-3.1.2.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/test/hadoop-yarn-server-tests-3.1.2-tests.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/yarn/hadoop-yarn-server-web-proxy-3.1.2.jar $HBASE_HOME/lib#启动所需的依赖
cp $HADOOP_HOME/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/common/lib/stax2-api-3.1.4.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/common/lib/commons-beanutils-1.9.3.jar $HBASE_HOME/lib
cp $HADOOP_HOME/share/hadoop/common/lib/commons-configuration2-2.1.1.jar $HBASE_HOME/lib
#下面是额外的依赖
cp $HADOOP_HOME/share/hadoop/common/lib/protobuf-java-2.5.0.jar $HBASE_HOME/lib/rm $HBASE_HOME/lib/hadoop-annotations-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-auth-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-common-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-distcp-2.8.5.jar
#下面的三个经过测试不要删除
#rm $HBASE_HOME/lib/hadoop-hdfs-2.8.5.jar
#rm $HBASE_HOME/lib/hadoop-hdfs-2.8.5-tests.jar
#rm $HBASE_HOME/lib/hadoop-hdfs-client-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-mapreduce-client-app-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-mapreduce-client-common-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-mapreduce-client-core-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-mapreduce-client-hs-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-mapreduce-client-jobclient-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-mapreduce-client-shuffle-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-api-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-client-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-common-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-server-applicationhistoryservice-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-server-common-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-server-nodemanager-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-server-resourcemanager-2.8.5.jar
rm $HBASE_HOME/lib/hadoop-yarn-server-tests-2.8.5-tests.jar
rm $HBASE_HOME/lib/hadoop-yarn-server-web-proxy-2.8.5.jar
wget -P $HBASE_HOME  https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-minicluster/3.1.2/hadoop-minicluster-3.1.2.jar
wget -P $HBASE_HOME  https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-client/3.1.2/hadoop-client-3.1.2.jar

chmod u+x auto.sh

./auto.sh

然后上述jar同步到集群其他各个节点

并且hbase-site.xml中需要添加

<property>
<name>hbase.wal.provider</name>
<value>filesystem</value>
</property>

Reference:

[1]HBASE中Hmaster启动后自动挂掉的问题

[2]The procedure WAL relies on the ability to hsync for proper operation during component failures,...

[3]

The procedure WAL relies on the ability to hsync for proper operation during component failures相关推荐

解决Hbase报错java.lang.IllegalStateException: The procedure WAL relies on the ability to hsync for....
完整报错为: java.lang.IllegalStateException: The procedure WAL relies on the ability to hsync for proper ...
hadoop+hive+flink+hbase交互的版本兼容性
与Hive兼容的Hadoop版本[3] Flink支持的Hive[1] 1.x.y, 2.x.y 1.0.0 1.0.1 1.x.y, 2.x.y 1.1.0 1.1.1 1.x.y, 2.x.y 1 ...
大数据组件需要额外添加的依赖包汇总(持续更新中)
现在FLINK已经被阿里收购了,所以会有blink的jar包大数据组件依赖包来源具体的依赖包 Hadoop3.1.2 用户添加 javax.ws.rs-api-2.0-m11.jar jerse ...
hbase官方网站声称的兼容是否是100%兼容？
根据[1]中的兼容矩阵,如下: 我们采用 hadoop3.1.2 hbase2.2.4 进行测试 $HBASE_HOME/logs/hbase-appleyuchi-master-Desktop.lo ...
编译hbase2.2.4+hadoop3.1.2
环境: ubuntu19.10 hadoop3.1.2 hbase2.2.4 完整报错如下: java.lang.IllegalStateException: The procedure WAL re ...
Hbase安装~Hbase安装过程中常见的问题
HBase的运行依赖于Zookeeper,Hadoop HBase安装 1.解压文件 tar -zxvf hbase-1.3.1-bin.tar.gz 2.配置文件 1)hbase-env.sh 修改 ...
Hbase集群搭建超详细教程
Hbase集群搭建前言详细步骤 1.下载安装包 2.解压 3.修改配置文件 3.1 修改hbase-env.sh文件 3.2 修改hbase-site.xml 3.3 修改regionserver ...
ERROR [master/jinghang01:16000:becomeActiveMaster] master.HMaster: Failed to become active master
配置好 hbase-site.xml ,启动hbase,查看日志出现问题. 2020-10-12 17:01:36,126 INFO [master/jinghang01:16000:becomeA ...
HBase2.2.2安装和编程
文章目录一.HBase简介二.HBase安装和配置 1.安装 2.配置 2.1单机模式配置 2.2伪分布式模式配置三.编程实践 3.1HBase常用shell命令 3.1.1HBase中创建表 ...

The procedure WAL relies on the ability to hsync for proper operation during component failures

The procedure WAL relies on the ability to hsync for proper operation during component failures相关推荐

最新文章

热门文章