hiveserver2查询操作报错Error while compiling statement等

1 问题产生背景

更换hive客户端还使用原先的关系型数据库（我用的是mysql）的metastore。

2 报错信息

Error: Error while compiling statement: FAILED: SemanticException Unable to fetch table emp.
Exception thrown when executing query :
SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS
`NUCLEUS_TYPE`,`A0`.`CREATE_TIME`,`A0`.`LAST_ACCESS_TIME`,`A0`.`OWNER`,`A0`.`RETENTION`,
`A0`.`IS_REWRITE_ENABLED`,`A0`.`TBL_NAME`,`A0`.`TBL_TYPE`,`A0`.`TBL_ID`
FROM `TBLS` `A0` LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID`
WHERE `A0`.`TBL_NAME` = ? AND `B0`.`NAME` = ? (state=42000,code=40000)

3 分析问题

网上能查到类似的问题很少，只好自己想办法了。
乍一看报错信息中最后是一个关系型数据库的查询语句，就把它复制出来到mysql的元数据库下执行，问号？改成具体的表名和字段名（到元数据库的TBLS表和DBS查看），比如我的：

SELECT
DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable'
AS `NUCLEUS_TYPE`,
`A0`.`CREATE_TIME`,
`A0`.`LAST_ACCESS_TIME`,
`A0`.`OWNER`,
`A0`.`RETENTION`,
`A0`.`IS_REWRITE_ENABLED`,
`A0`.`TBL_NAME`,
`A0`.`TBL_TYPE`,
`A0`.`TBL_ID`
FROM `TBLS` `A0`
LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID`
WHERE `A0`.`TBL_NAME` = 'student' AND `B0`.`NAME` = 'default'

执行有报错：

org.jkiss.dbeaver.model.sql.DBSQLException: SQL 错误 [1054] [42S22]: Unknown column 'A0.IS_REWRITE_ENABLED' in 'field list'at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:133)at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeStatement(SQLQueryJob.java:509)at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.lambda$0(SQLQueryJob.java:440)at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:168)at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.executeSingleQuery(SQLQueryJob.java:427)at org.jkiss.dbeaver.ui.editors.sql.execute.SQLQueryJob.extractData(SQLQueryJob.java:812)at org.jkiss.dbeaver.ui.editors.sql.SQLEditor$QueryResultsContainer.readData(SQLEditor.java:3226)at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.lambda$0(ResultSetJobDataRead.java:118)at org.jkiss.dbeaver.model.exec.DBExecUtils.tryExecuteRecover(DBExecUtils.java:168)at org.jkiss.dbeaver.ui.controls.resultset.ResultSetJobDataRead.run(ResultSetJobDataRead.java:116)at org.jkiss.dbeaver.ui.controls.resultset.ResultSetViewer$ResultSetDataPumpJob.run(ResultSetViewer.java:4516)at org.jkiss.dbeaver.model.runtime.AbstractJob.run(AbstractJob.java:105)at org.eclipse.core.internal.jobs.Worker.run(Worker.java:63)
Caused by: java.sql.SQLSyntaxErrorException: Unknown column 'A0.IS_REWRITE_ENABLED' in 'field list'at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:120)at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)at com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:764)at com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:648)at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.execute(JDBCStatementImpl.java:327)at org.jkiss.dbeaver.model.impl.jdbc.exec.JDBCStatementImpl.executeStatement(JDBCStatementImpl.java:130)... 12 more

报错信息大概意思是说这个表TBLS的IS_REWRITE_ENABLED列不存在，把这个字段注释掉就能正常运行了。但是这个问题没法解决呀，因为hive元数据库里的表都是hive自动生成的，最好别改。

4 解决问题

既然更换hive客户端那就重新建一个元数据库吧，名字可以自己起，那就叫metastore2吧，在hive解压后的conf文件夹下的hive-site.xml中修改javax.jdo.option.ConnectionURL、hive.metastore.warehouse.dir即可。下面是我的配置信息仅供参考：

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration><property><name>javax.jdo.option.ConnectionURL</name><value>jdbc:mysql://cts111:3306/metastore2?createDatabaseIfNotExist=true&amp;useSSL=false</value><description>JDBC connect string for a JDBC metastore</description></property><property><name>javax.jdo.option.ConnectionDriverName</name><value>com.mysql.jdbc.Driver</value><description>Driver class name for a JDBC metastore</description></property><property><name>javax.jdo.option.ConnectionUserName</name><value>root</value><description>username to use against metastore database</description></property><property><name>javax.jdo.option.ConnectionPassword</name><value>mysql123</value><description>password to use against metastore database</description></property><!-- hue配置 --><property><name>hive.server2.thrift.port</name><value>10000</value><description>TCP 的监听端口</description></property><property><name>hive.server2.thrift.bind.host</name><value>192.168.1.111</value><description>TCP绑定的主机</description></property><property><name>hive.server2.long.polling.timeout</name><value>5000</value><description>HiveServer2在响应使用长轮询的异步调用之前等待的时间（毫秒）</description></property><!-- 如果使用了下面这个配置得先启动metastore，否则hiveserver2会报错跑不起来 --><property><name>hive.metastore.uris</name><value>thrift://192.168.1.111:9083</value><description>指向的是运行metastore服务的主机</description></property><property><name>hive.metastore.warehouse.dir</name><value>/user/hive/warehouse2</value></property><property><name>hive.cli.print.current.db</name><value>true</value><description>Whether to include the    current database in the Hive prompt.</description></property><property><name>hive.cli.print.header</name><value>true</value><description>Whether to print the names of the columns in query output.</description></property><!-- 关闭元数据检查 --><property><name>hive.metastore.schema.verification</name><value>false</value></property><!-- tez --><property><name>hive.execution.engine</name><value>tez</value></property><!-- 解决hive配置tez后查询一直pending的问题 默认是-1 --><property><name>hive.tez.cpu.vcores</name><value>1</value><description>https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties</description></property><!-- 为了tez稳定运行的可选设置 --><property><name>hive.tez.container.size</name><value>1024</value></property><property><name>hive.prewarm.enabled</name><value>true</value></property><!--配置hive默认的提交队列,在capacity-scheduler.xml中设置了--><property><name>mapreduce.job.queuename</name><value>hive</value></property><!--配置tez默认的提交队列,在capacity-scheduler.xml中设置了--><property><name>tez.queue.name</name><value>hive</value></property></configuration>

hive-site.xml的配置文件一定要根据自己的实际情况做剪裁，自己的环境跟别人的可能不一样，如果是刚安装hive测试运行只要配置前四个基本的四大件就好。

5 参考文章

1）hive 问题总结