hbase遇到元数据缺失，hbase:namespace加载错误，hbase启动不了

####背景####
hbase-2.0.0-alpha4
jdk1.8.0_151
zookeeper-3.4.9

####问题描述####
因为某种原因，已经部署好的环境，突然报错

2017-12-06 17:12:22,399 WARN  [RSProcedureDispatcher-pool3-t2] procedure.RSProcedureDispatcher: Failed dispatch to server=centos7-node3.zxp.com,16020,1512551537684 try=0
java.io.IOException: java.io.IOException: Missing table descriptor for b49b8576cb6dbfb0bae2cbf650bb7c02at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1959)at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3470)at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:26878)at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406)at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:134)at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325)at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305)at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)at java.lang.reflect.Constructor.newInstance(Constructor.java:423)at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:93)at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:83)at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:368)at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:345)at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.sendRequest(RSProcedureDispatcher.java:298)at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.call(RSProcedureDispatcher.java:268)at org.apache.hadoop.hbase.master.procedure.RSProcedureDispatcher$ExecuteProceduresRemoteCall.call(RSProcedureDispatcher.java:246)at java.util.concurrent.FutureTask.run(FutureTask.java:266)at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(java.io.IOException): java.io.IOException: Missing table descriptor for b49b8576cb6dbfb0bae2cbf650bb7c02at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1959)at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3470)at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:26878)at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406)at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:134)at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325)at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305)at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:387)at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:95)at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:410)at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:406)at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103)at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118)at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:161)at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:191)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)at org.apache.hadoop.hbase.shaded.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310)at org.apache.hadoop.hbase.shaded.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:284)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)at org.apache.hadoop.hbase.shaded.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)at org.apache.hadoop.hbase.shaded.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1334)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)at org.apache.hadoop.hbase.shaded.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)at org.apache.hadoop.hbase.shaded.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:926)at org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:979)at org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:401)at org.apache.hadoop.hbase.shaded.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:306)at org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)at org.apache.hadoop.hbase.shaded.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)... 1 more
2017-12-06 17:12:22,401 WARN  [RSProcedureDispatcher-pool3-t2] assignment.RegionTransitionProcedure: Remote call failed pid=4, ppid=3, state=RUNNABLE:REGION_TRANSITION_DISPATCH; AssignProcedure table=hbase:namespace, region=b49b8576cb6dbfb0bae2cbf650bb7c02; rit=OPENING, location=centos7-node3.zxp.com,16020,1512551537684; exception=java.io.IOException: Missing table descriptor for b49b8576cb6dbfb0bae2cbf650bb7c02at org.apache.hadoop.hbase.regionserver.RSRpcServices.openRegion(RSRpcServices.java:1959)at org.apache.hadoop.hbase.regionserver.RSRpcServices.executeProcedures(RSRpcServices.java:3470)at org.apache.hadoop.hbase.shaded.protobuf.generated.AdminProtos$AdminService$2.callBlockingMethod(AdminProtos.java:26878)at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:406)at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:134)at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:325)at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:305)

2017-12-06 17:13:14,626 WARN  [centos7-node1.zxp.com,16000,1512551524749_Chore_1] cleaner.CleanerChore: Found a wrongly formatted file: file:/home/root/hbase-2.0.0-alpha4/data/oldWALs/pv2-00000000000000000001.log - will delete it.
2017-12-06 17:13:26,551 WARN  [ProcExecTimeout] assignment.AssignmentManager: TODO Handle stuck in transition: rit=OPENING, location=centos7-node3.zxp.com,16020,1512551537684, table=hbase:namespace, region=b49b8576cb6dbfb0bae2cbf650bb7c02
2017-12-06 17:13:31,569 WARN  [ProcExecTimeout] assignment.AssignmentManager: TODO Handle stuck in transition: rit=OPENING, location=centos7-node3.zxp.com,16020,1512551537684, table=hbase:namespace, region=b49b8576cb6dbfb0bae2cbf650bb7c02

配置如下：

<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>file:///home/root/hbase-2.0.0-alpha4/data</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>centos7-node1.zxp.com,centos7-node2.zxp.com,centos7-node3.zxp.com</value>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/home/root/zookeeper-3.4.9/data</value>
</property><property><name>zookeeper.znode.parent</name><value>/hbase-test2</value></property>
</configuration>

接下来直接把各个节点的hbase.rootdir目录和zookeeper对应的znode.parent全部铲除，理论上这是一个重新初始化的动作

####解决

原因：这是local模式下特殊的配置导致，

etc:rm -rf /tmp/hbase-root/

解决方法：清除该目录，问题得到解决。

hbase遇到元数据缺失，hbase:namespace加载错误，hbase启动不了相关推荐

海康摄像头SDK二次开发错误问题解决方案(三）：3. 错误：提示如“HCNetSDK.dll”组件缺失，无法加载问题
错误: 提示如"HCNetSDK.dll"组件缺失,无法加载问题分析: MFC平台可能有bug,有时不能读取出"HCNetSDK.dll"文件: 解决: 可将 ...
加载服务器版本信息,传奇服务器端启动加载错误的解决方法
1.启动服务端M2报错的类型 2.错误分类,思路理清 3.文字总结以下常见现象传奇服务器端启动加载错误解决方法 Exception] 物品数据库加载错误! [Exception] 魔法数据库加载错误 ...
不需要任何依赖的图片加载错误处理的工具类load-image.js
需求的诞生: 先简单介绍一下业务场景,我们的项目是一个微博舆情分析系统,可以根据用户设置的关键字监测相关微博舆情,并进行实时推送.监测范围涵盖境内和境外微博平台(境内:新浪.腾讯,境外:twitter ...
android 获取位置数据库,尝试从webview获取位置时，Android“SQLite数据库无法从/CachedGeoposition.db加载”错误...
我正在创建一个使用webkit和chrome客户端的android应用程序.我希望能够在网页请求时获取当前位置.我设置的网页适用于普通浏览器就好了.然而,当我尝试访问该网页WebKit中,我不断收到此 ...
制作镜像包时遇到的模块加载错误的问题
最近遇到一个问题,定制的一个镜像包,在启动后,发现有些内核模块加载是错误的,有些是正确的.使用modinfo去查询,可以看到加载的为内核版本中的模块(非自己定制的模块),而有些自己新增的模块没有加载成 ...
chrome浏览器无法加载百度网页启动组件怎么办
chrome浏览器无法加载百度网页启动组件怎么办 chrome浏览器无法加载百度网页启动组件怎么办?chrome浏览器百度打不开提示无法加载百度网页启动组件怎么办?使用chrome浏览器打开百度的时候 ...
oracle ocx加载错误,flash9.ocx 加载错误解决方法
用IE浏览网页时,经常会遇到flash9插件加载错误. 如果选择继续,则CPU被占用90%以上,几秒后,网页自动关闭.如果把flash9.ocx关掉,不加载的话,flash又看不成. 如何解决? 方法 ...
max2104打开时提醒注册插件出错_启动3dmax时出现插件程序集加载错误怎么办？
原因: 3ds Max 安装已损坏或者与安装的 .NET Framework 或 Windows 程序防火墙和权限冲突. 解决方案: 发生此一般性错误的原因可能有多种:Windows 更新或升级,甚至 ...
Vue图片加载错误、图片加载失败的处理
加载一个图片pic,会在代码里做一个检验图片是否存在,通常会像下面这样写 <img :src="pic?pic:'../assets/img/load.png'" alt=& ...

hbase遇到元数据缺失，hbase:namespace加载错误，hbase启动不了

hbase遇到元数据缺失，hbase:namespace加载错误，hbase启动不了相关推荐

最新文章

热门文章