记录搭建分布式项目环境-MySQL集群
2024-05-23 15:44:56
下了好多版本，都没有默认的my.cnf文件，发现5.7.17有，但其实my.cnf可以直接复制一份到etc下面就可以了，然后将basedir和datadir记得改好
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-common-5.7.28-1.el7.x86_64.rpm [sudo] hadoop 的密码：
Verifying... ################################# [100%]
准备中... ################################# [100%]
正在升级/安装...1:mysql-community-common-5.7.28-1.e################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-5.7.28-1.el7.x86_64.rpm
Verifying... ################################# [100%]
准备中... ################################# [100%]
正在升级/安装...1:mysql-community-libs-5.7.28-1.el7################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm
错误：依赖检测失败：libcrypto.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要libcrypto.so.10(libcrypto.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要libssl.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要libssl.so.10(libssl.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
[hadoop@localhost mysqlBundle]$ yum install -y libaio
错误：运行此命令需要管理员特权（多数系统下是root用户）。
[hadoop@localhost mysqlBundle]$ sudo yum install -y libaio
上次元数据过期检查：2:58:31 前，执行于 2021年10月19日 星期二 13时49分15秒。
软件包 libaio-0.3.112-1.el8.x86_64 已安装。
依赖关系解决。
无需任何处理。
完毕！
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm
错误：依赖检测失败：libcrypto.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要libcrypto.so.10(libcrypto.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要libssl.so.10()(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要libssl.so.10(libssl.so.10)(64bit) 被 mysql-community-libs-compat-5.7.28-1.el7.x86_64 需要
[hadoop@localhost mysqlBundle]$ yum install -y libssl
错误：运行此命令需要管理员特权（多数系统下是root用户）。
[hadoop@localhost mysqlBundle]$ sudo yum install -y libssl
上次元数据过期检查：2:59:20 前，执行于 2021年10月19日 星期二 13时49分15秒。
未找到匹配的参数: libssl
错误：没有任何匹配: libssl
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-libs-compat-5.7.28-1.el7.x86_64.rpm --nodeps --force
Verifying... ################################# [100%]
准备中... ################################# [100%]
正在升级/安装...1:mysql-community-libs-compat-5.7.2################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-client-5.7.28-1.el7.x86_64.rpm Verifying... ################################# [100%]
准备中... ################################# [100%]
正在升级/安装...1:mysql-community-client-5.7.28-1.e################################# [100%]
[hadoop@localhost mysqlBundle]$ sudo rpm -ivh mysql-community-server-5.7.28-1.el7.x86_64.rpm Verifying... ################################# [100%]
准备中... ################################# [100%]
正在升级/安装...1:mysql-community-server-5.7.28-1.e################################# [100%]
[/usr/lib/tmpfiles.d/mysql.conf:23] Line references path below legacy directory /var/run/, updating /var/run/mysqld → /run/mysqld; please update the tmpfiles.d/ drop-in file accordingly.
[/usr/lib/tmpfiles.d/pesign.conf:1] Line references path below legacy directory /var/run/, updating /var/run/pesign → /run/pesign; please update the tmpfiles.d/ drop-in file accordingly.
[hadoop@localhost mysqlBundle]$ vim /usr/lib/
alsa/ firmware/ kdump/ ostree/ tmpfiles.d/
binfmt.d/ fontconfig/ kernel/ polkit-1/ tuned/
.build-id/ games/ locale/ python3.6/ udev/
cpp gcc/ mdadm/ realmd/ vmware-caf/
cups/ grub/ modprobe.d/ rpm/ vmware-tools/
debug/ java/ modules/ sse2/ vmware-vgauth/
dracut/ jvm/ modules-load.d/ sysctl.d/
eclipse/ jvm-commmon/ mozilla/ sysimage/
environment.d/ jvm-private/ NetworkManager/ systemd/
firewalld/ kbd/ os-release sysusers.d/
[hadoop@localhost mysqlBundle]$ vim /usr/lib/tmpfiles.d/mysql.conf
[hadoop@localhost mysqlBundle]$ sudo vim /usr/lib/tmpfiles.d/mysql.conf
[sudo] hadoop 的密码：
[hadoop@localhost mysqlBundle]$ cd /usr/lib/tmpfiles.d/
[hadoop@localhost tmpfiles.d]$ ls
cockpit-tempfiles.conf home.conf mdadm.conf rpcbind.conf systemd-nspawn.conf
colord.conf httpd.conf mod_fcgid.conf rpm.conf tmp.conf
criu.conf iscsi.conf mysql.conf samba.conf tuned.conf
cryptsetup.conf journal-nocow.conf openssh.conf selinux-policy.conf udisks2.conf
cups.conf legacy.conf ostree-tmpfiles.conf setroubleshoot.conf var.conf
cups-lp.conf libselinux.conf pam.conf spice-vdagentd.conf x11.conf
dbus.conf libstoragemgmt.conf pesign.conf subscription-manager.conf
dnf.conf lockdev.conf podman.conf sudo.conf
etc.conf lvm2.conf portables.conf systemd.conf
gvfsd-fuse-tmpfiles.conf man-db.conf radvd.conf systemd-nologin.conf
[hadoop@localhost tmpfiles.d]$ vim pesign.conf
[hadoop@localhost tmpfiles.d]$ sudo vim pesign.conf rpm安装的时候出现的问题
[/usr/lib/tmpfiles.d/mysql.conf:23] Line references path below legacy directory /var/run/, updating /var/run/mysqld → /run/mysqld; please update the tmpfiles.d/ drop-in file accordingly.
[/usr/lib/tmpfiles.d/pesign.conf:1] Line references path below legacy directory /var/run/, updating /var/run/pesign → /run/pesign; please update the tmpfiles.d/ drop-in file accordingly.
[hadoop@localhost mysql]$ mysql -uroot -p
Enter password:
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)
Can’t connect to local MySQL server through socket ‘/var/lib/mysql/mysql.sock’ (2)
这个错误如果你当前使用的不是root用户应当尝试一下
sudo chmod -R 777 /var/lib/mysql/
这个stackoverflow里面很多办法
hive
[hadoop@localhost conf]$ schematool -initSchema -dbType mysql -verbose
Exception in thread "main" java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)Vat org.apache.hadoop.conf.Configuration.set(Configuration.java:1357)at org.apache.hadoop.conf.Configuration.set(Configuration.java:1338)at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:536)at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:554)at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:448)at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5141)at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5104)at org.apache.hive.beeline.HiveSchemaTool.<init>(HiveSchemaTool.java:96)at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1473)at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)at java.lang.reflect.Method.invoke(Method.java:498)at org.apache.hadoop.util.RunJar.run(RunJar.java:323)at org.apache.hadoop.util.RunJar.main(RunJar.java:236)hive里面的guava和hadoop里面的版本不一样，hadoop版本的更高
删掉
rm -rf guava-19.0.jar
将Hadoop更高版本的复制过来
cp guava-27.0-jre.jar /opt/hive3/lib/
然后初始化
[hadoop@localhost lib]$ schematool -initSchema -dbType mysql -verbose
Metastore connection URL: jdbc:mysql://hadoop102:3306/metastore?useSSL=false
Metastore Connection Driver : com.mysql.jdbc.Driver
Metastore connection User: root
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.mysql.sql
Connecting to jdbc:mysql://hadoop102:3306/metastore?useSSL=false
Connected to: MySQL (version 5.7.28)
Driver: MySQL Connector Java (version mysql-connector-java-5.1.27 ( Revision: alexander.soklakov@oracle.com-20131021093118-gtm1bh1vb450xipt ))
Transaction isolation: TRANSACTION_READ_COMMITTED
0: jdbc:mysql://hadoop102:3306/metastore> !autocommit on
Autocommit status: true
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_CHARACTER_SET_RESULTS=@@CHARACTER_SET_RESULTS */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_COLLATION_CONNECTION=@@COLLATION_CONNECTION */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET NAMES utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40103 SET @OLD_TIME_ZONE=@@TIME_ZONE */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40103 SET TIME_ZONE='+00:00' */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET @OLD_UNIQUE_CHECKS=@@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET @OLD_FOREIGN_KEY_CHECKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @OLD_SQL_MODE=@@SQL_MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40111 SET @OLD_SQL_NOTES=@@SQL_NOTES, SQL_NOTES=0 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `BUCKETING_COLS` ( `SD_ID` bigint(20) NOT NULL, `BUCKET_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `BUCKETING_COLS_N49` (`SD_ID`), CONSTRAINT `BUCKETING_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.017 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `CDS` ( `CD_ID` bigint(20) NOT NULL, PRIMARY KEY (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.018 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `COLUMNS_V2` ( `CD_ID` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE_NAME` MEDIUMTEXT DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`CD_ID`,`COLUMN_NAME`), KEY `COLUMNS_V2_N49` (`CD_ID`), CONSTRAINT `COLUMNS_V2_FK1` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DATABASE_PARAMS` ( `DB_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(180) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`,`PARAM_KEY`), KEY `DATABASE_PARAMS_N49` (`DB_ID`), CONSTRAINT `DATABASE_PARAMS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE `CTLGS` ( `CTLG_ID` BIGINT PRIMARY KEY, `NAME` VARCHAR(256), `DESC` VARCHAR(4000), `LOCATION_URI` VARCHAR(4000) NOT NULL, UNIQUE KEY `UNIQUE_CATALOG` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO `CTLGS` VALUES (1, 'hive', 'Default catalog for Hive', 'TBD')
1 row affected (0.02 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DBS` ( `DB_ID` bigint(20) NOT NULL, `DESC` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_LOCATION_URI` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CTLG_NAME` varchar(256) NOT NULL DEFAULT 'hive', PRIMARY KEY (`DB_ID`), UNIQUE KEY `UNIQUE_DATABASE` (`NAME`, `CTLG_NAME`), CONSTRAINT `CTLG_FK1` FOREIGN KEY (`CTLG_NAME`) REFERENCES `CTLGS` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.014 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DB_PRIVS` ( `DB_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_GRANT_ID`), UNIQUE KEY `DBPRIVILEGEINDEX` (`AUTHORIZER`,`DB_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`DB_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `DB_PRIVS_N49` (`DB_ID`), CONSTRAINT `DB_PRIVS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `GLOBAL_PRIVS` ( `USER_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `USER_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`USER_GRANT_ID`), UNIQUE KEY `GLOBALPRIVILEGEINDEX` (`AUTHORIZER`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`USER_PRIV`,`GRANTOR`,`GRANTOR_TYPE`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `IDXS` ( `INDEX_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DEFERRED_REBUILD` bit(1) NOT NULL, `INDEX_HANDLER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INDEX_TBL_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `ORIG_TBL_ID` bigint(20) DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`INDEX_ID`), UNIQUE KEY `UNIQUEINDEX` (`INDEX_NAME`,`ORIG_TBL_ID`), KEY `IDXS_N51` (`SD_ID`), KEY `IDXS_N50` (`INDEX_TBL_ID`), KEY `IDXS_N49` (`ORIG_TBL_ID`), CONSTRAINT `IDXS_FK1` FOREIGN KEY (`ORIG_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `IDXS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `IDXS_FK3` FOREIGN KEY (`INDEX_TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.016 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `INDEX_PARAMS` ( `INDEX_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`INDEX_ID`,`PARAM_KEY`), KEY `INDEX_PARAMS_N49` (`INDEX_ID`), CONSTRAINT `INDEX_PARAMS_FK1` FOREIGN KEY (`INDEX_ID`) REFERENCES `IDXS` (`INDEX_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.014 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `NUCLEUS_TABLES` ( `CLASS_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TYPE` varchar(4) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `OWNER` varchar(2) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `VERSION` varchar(20) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTERFACE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`CLASS_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITIONS` ( `PART_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `PART_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`PART_ID`), UNIQUE KEY `UNIQUEPARTITION` (`PART_NAME`,`TBL_ID`), KEY `PARTITIONS_N49` (`TBL_ID`), KEY `PARTITIONS_N50` (`SD_ID`), CONSTRAINT `PARTITIONS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `PARTITIONS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.02 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.006 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_EVENTS` ( `PART_NAME_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `EVENT_TIME` bigint(20) NOT NULL, `EVENT_TYPE` int(11) NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_NAME_ID`), KEY `PARTITIONEVENTINDEX` (`PARTITION_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_KEYS` ( `TBL_ID` bigint(20) NOT NULL, `PKEY_COMMENT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PKEY_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PKEY_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TBL_ID`,`PKEY_NAME`), KEY `PARTITION_KEYS_N49` (`TBL_ID`), CONSTRAINT `PARTITION_KEYS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_KEY_VALS` ( `PART_ID` bigint(20) NOT NULL, `PART_KEY_VAL` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`PART_ID`,`INTEGER_IDX`), KEY `PARTITION_KEY_VALS_N49` (`PART_ID`), CONSTRAINT `PARTITION_KEY_VALS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PARTITION_PARAMS` ( `PART_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_ID`,`PARAM_KEY`), KEY `PARTITION_PARAMS_N49` (`PART_ID`), CONSTRAINT `PARTITION_PARAMS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PART_COL_PRIVS` ( `PART_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_COLUMN_GRANT_ID`), KEY `PART_COL_PRIVS_N49` (`PART_ID`), KEY `PARTITIONCOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `PART_COL_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PART_PRIVS` ( `PART_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_GRANT_ID`), KEY `PARTPRIVILEGEINDEX` (`AUTHORIZER`,`PART_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`PART_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `PART_PRIVS_N49` (`PART_ID`), CONSTRAINT `PART_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `ROLES` ( `ROLE_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`ROLE_ID`), UNIQUE KEY `ROLEENTITYINDEX` (`ROLE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `ROLE_MAP` ( `ROLE_GRANT_ID` bigint(20) NOT NULL, `ADD_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`ROLE_GRANT_ID`), UNIQUE KEY `USERROLEMAPINDEX` (`PRINCIPAL_NAME`,`ROLE_ID`,`GRANTOR`,`GRANTOR_TYPE`), KEY `ROLE_MAP_N49` (`ROLE_ID`), CONSTRAINT `ROLE_MAP_FK1` FOREIGN KEY (`ROLE_ID`) REFERENCES `ROLES` (`ROLE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SDS` ( `SD_ID` bigint(20) NOT NULL, `CD_ID` bigint(20) DEFAULT NULL, `INPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `IS_COMPRESSED` bit(1) NOT NULL, `IS_STOREDASSUBDIRECTORIES` bit(1) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `NUM_BUCKETS` int(11) NOT NULL, `OUTPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`SD_ID`), KEY `SDS_N49` (`SERDE_ID`), KEY `SDS_N50` (`CD_ID`), CONSTRAINT `SDS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), CONSTRAINT `SDS_FK2` FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SD_PARAMS` ( `SD_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`PARAM_KEY`), KEY `SD_PARAMS_N49` (`SD_ID`), CONSTRAINT `SD_PARAMS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SEQUENCE_TABLE` ( `SEQUENCE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `NEXT_VAL` bigint(20) NOT NULL, PRIMARY KEY (`SEQUENCE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO `SEQUENCE_TABLE` (`SEQUENCE_NAME`, `NEXT_VAL`) VALUES ('org.apache.hadoop.hive.metastore.model.MNotificationLog', 1)
1 row affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SERDES` ( `SERDE_ID` bigint(20) NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SLIB` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESCRIPTION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DESERIALIZER_CLASS` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `SERDE_TYPE` integer, PRIMARY KEY (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SERDE_PARAMS` ( `SERDE_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`,`PARAM_KEY`), KEY `SERDE_PARAMS_N49` (`SERDE_ID`), CONSTRAINT `SERDE_PARAMS_FK1` FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_COL_NAMES` ( `SD_ID` bigint(20) NOT NULL, `SKEWED_COL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SKEWED_COL_NAMES_N49` (`SD_ID`), CONSTRAINT `SKEWED_COL_NAMES_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_COL_VALUE_LOC_MAP` ( `SD_ID` bigint(20) NOT NULL, `STRING_LIST_ID_KID` bigint(20) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N49` (`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N50` (`SD_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK2` FOREIGN KEY (`STRING_LIST_ID_KID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST` ( `STRING_LIST_ID` bigint(20) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_STRING_LIST_VALUES` ( `STRING_LIST_ID` bigint(20) NOT NULL, `STRING_LIST_VALUE` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`,`INTEGER_IDX`), KEY `SKEWED_STRING_LIST_V决绝ALUES_N49` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_STRING_LIST_VALUES_FK1` FOREIGN KEY (`STRING_LIST_ID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SKEWED_VALUES` ( `SD_ID_OID` bigint(20) NOT NULL, `STRING_LIST_ID_EID` bigint(20) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID_OID`,`INTEGER_IDX`), KEY `SKEWED_VALUES_N50` (`SD_ID_OID`), KEY `SKEWED_VALUES_N49` (`STRING_LIST_ID_EID`), CONSTRAINT `SKEWED_VALUES_FK2` FOREIGN KEY (`STRING_LIST_ID_EID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_VALUES_FK1` FOREIGN KEY (`SD_ID_OID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.015 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `SORT_COLS` ( `SD_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ORDER` int(11) NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SORT_COLS_N49` (`SD_ID`), CONSTRAINT `SORT_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TABLE_PARAMS` ( `TBL_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` MEDIUMTEXT CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_ID`,`PARAM_KEY`), KEY `TABLE_PARAMS_N49` (`TBL_ID`), CONSTRAINT `TABLE_PARAMS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `MV_CREATION_METADATA` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TXN_LIST` TEXT DEFAULT NULL, `MATERIALIZATION_TIME` bigint(20) NOT NULL, PRIMARY KEY (`MV_CREATION_METADATA_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX MV_UNIQUE_TABLE ON MV_CREATION_METADATA (TBL_NAME, DB_NAME) USING BTREE
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TBLS` ( `TBL_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `OWNER` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `RETENTION` int(11) NOT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `VIEW_EXPANDED_TEXT` mediumtext, `VIEW_ORIGINAL_TEXT` mediumtext, `IS_REWRITE_ENABLED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TBL_ID`), UNIQUE KEY `UNIQUETABLE` (`TBL_NAME`,`DB_ID`), KEY `TBLS_N50` (`SD_ID`), KEY `TBLS_N49` (`DB_ID`), CONSTRAINT `TBLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `TBLS_FK2` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `MV_TABLES_USED` ( `MV_CREATION_METADATA_ID` bigint(20) NOT NULL, `TBL_ID` bigint(20) NOT NULL, CONSTRAINT `MV_TABLES_USED_FK1` FOREIGN KEY (`MV_CREATION_METADATA_ID`) REFERENCES `MV_CREATION_METADATA` (`MV_CREATION_METADATA_ID`), CONSTRAINT `MV_TABLES_USED_FK2` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TBL_COL_PRIVS` ( `TBL_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_COLUMN_GRANT_ID`), KEY `TABLECOLUMNPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `TBL_COL_PRIVS_N49` (`TBL_ID`), CONSTRAINT `TBL_COL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TBL_PRIVS` ( `TBL_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, `AUTHORIZER` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_GRANT_ID`), KEY `TBL_PRIVS_N49` (`TBL_ID`), KEY `TABLEPRIVILEGEINDEX` (`AUTHORIZER`,`TBL_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `TBL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.011 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TAB_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TBL_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `TAB_COL_STATS_FK` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.141 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX TAB_COL_STATS_IDX ON TAB_COL_STATS (CAT_NAME, DB_NAME, TABLE_NAME, COLUMN_NAME) USING BTREE
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `PART_COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `CAT_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `DB_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `PART_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20), `BIT_VECTOR` blob, `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID`), CONSTRAINT `PART_COL_STATS_FK` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX PCS_STATS_IDX ON PART_COL_STATS (CAT_NAME, DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TYPES` ( `TYPES_ID` bigint(20) NOT NULL, `TYPE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE1` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TYPE2` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TYPES_ID`), UNIQUE KEY `UNIQUE_TYPE` (`TYPE_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET @saved_cs_client = @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `TYPE_FIELDS` ( `TYPE_NAME` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `FIELD_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `FIELD_TYPE` varchar(767) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`TYPE_NAME`,`FIELD_NAME`), KEY `TYPE_FIELDS_N49` (`TYPE_NAME`), CONSTRAINT `TYPE_FIELDS_FK1` FOREIGN KEY (`TYPE_NAME`) REFERENCES `TYPES` (`TYPES_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `MASTER_KEYS` ( `KEY_ID` INTEGER NOT NULL AUTO_INCREMENT, `MASTER_KEY` VARCHAR(767) BINARY NULL, PRIMARY KEY (`KEY_ID`) ) ENGINE=INNODB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `DELEGATION_TOKENS` ( `TOKEN_IDENT` VARCHAR(767) BINARY NOT NULL, `TOKEN` VARCHAR(767) BINARY NULL, PRIMARY KEY (`TOKEN_IDENT`) ) ENGINE=INNODB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `VERSION` ( `VER_ID` BIGINT NOT NULL, `SCHEMA_VERSION` VARCHAR(127) NOT NULL, `VERSION_COMMENT` VARCHAR(255), PRIMARY KEY (`VER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `FUNCS` ( `FUNC_ID` BIGINT(20) NOT NULL, `CLASS_NAME` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `CREATE_TIME` INT(11) NOT NULL, `DB_ID` BIGINT(20), `FUNC_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `FUNC_TYPE` INT(11) NOT NULL, `OWNER_NAME` VARCHAR(128) CHARACTER SET latin1 COLLATE latin1_bin, `OWNER_TYPE` VARCHAR(10) CHARACTER SET latin1 COLLATE latin1_bin, PRIMARY KEY (`FUNC_ID`), UNIQUE KEY `UNIQUEFUNCTION` (`FUNC_NAME`, `DB_ID`), KEY `FUNCS_N49` (`DB_ID`), CONSTRAINT `FUNCS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `FUNC_RU` ( `FUNC_ID` BIGINT(20) NOT NULL, `RESOURCE_TYPE` INT(11) NOT NULL, `RESOURCE_URI` VARCHAR(4000) CHARACTER SET latin1 COLLATE latin1_bin, `INTEGER_IDX` INT(11) NOT NULL, PRIMARY KEY (`FUNC_ID`, `INTEGER_IDX`), CONSTRAINT `FUNC_RU_FK1` FOREIGN KEY (`FUNC_ID`) REFERENCES `FUNCS` (`FUNC_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `NOTIFICATION_LOG` ( `NL_ID` BIGINT(20) NOT NULL, `EVENT_ID` BIGINT(20) NOT NULL, `EVENT_TIME` INT(11) NOT NULL, `EVENT_TYPE` varchar(32) NOT NULL, `CAT_NAME` varchar(256), `DB_NAME` varchar(128), `TBL_NAME` varchar(256), `MESSAGE` longtext, `MESSAGE_FORMAT` varchar(16), PRIMARY KEY (`NL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `NOTIFICATION_SEQUENCE` ( `NNI_ID` BIGINT(20) NOT NULL, `NEXT_EVENT_ID` BIGINT(20) NOT NULL, PRIMARY KEY (`NNI_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO `NOTIFICATION_SEQUENCE` (`NNI_ID`, `NEXT_EVENT_ID`) SELECT * from (select 1 as `NNI_ID`, 1 as `NOTIFICATION_SEQUENCE`) a WHERE (SELECT COUNT(*) FROM `NOTIFICATION_SEQUENCE`) = 0
1 row affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `KEY_CONSTRAINTS` ( `CHILD_CD_ID` BIGINT, `CHILD_INTEGER_IDX` INT(11), `CHILD_TBL_ID` BIGINT, `PARENT_CD_ID` BIGINT, `PARENT_INTEGER_IDX` INT(11) NOT NULL, `PARENT_TBL_ID` BIGINT NOT NULL, `POSITION` BIGINT NOT NULL, `CONSTRAINT_NAME` VARCHAR(400) NOT NULL, `CONSTRAINT_TYPE` SMALLINT(6) NOT NULL, `UPDATE_RULE` SMALLINT(6), `DELETE_RULE` SMALLINT(6), `ENABLE_VALIDATE_RELY` SMALLINT(6) NOT NULL, `DEFAULT_VALUE` VARCHAR(400), PRIMARY KEY (`CONSTRAINT_NAME`, `POSITION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX `CONSTRAINTS_PARENT_TABLE_ID_INDEX` ON KEY_CONSTRAINTS (`PARENT_TBL_ID`) USING BTREE
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX `CONSTRAINTS_CONSTRAINT_TYPE_INDEX` ON KEY_CONSTRAINTS (`CONSTRAINT_TYPE`) USING BTREE
No rows affected (0.006 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS `METASTORE_DB_PROPERTIES` ( `PROPERTY_KEY` varchar(255) NOT NULL, `PROPERTY_VALUE` varchar(1000) NOT NULL, `DESCRIPTION` varchar(1000), PRIMARY KEY(`PROPERTY_KEY`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_RESOURCEPLAN ( `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `QUERY_PARALLELISM` int(11), `STATUS` varchar(20) NOT NULL, `DEFAULT_POOL_ID` bigint(20), PRIMARY KEY (`RP_ID`), UNIQUE KEY `UNIQUE_WM_RESOURCEPLAN` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_POOL ( `POOL_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `PATH` varchar(767) NOT NULL, `ALLOC_FRACTION` DOUBLE, `QUERY_PARALLELISM` int(11), `SCHEDULING_POLICY` varchar(767), PRIMARY KEY (`POOL_ID`), UNIQUE KEY `UNIQUE_WM_POOL` (`RP_ID`, `PATH`), CONSTRAINT `WM_POOL_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> ALTER TABLE `WM_RESOURCEPLAN` ADD CONSTRAINT `WM_RESOURCEPLAN_FK1` FOREIGN KEY (`DEFAULT_POOL_ID`) REFERENCES `WM_POOL`(`POOL_ID`)
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_TRIGGER ( `TRIGGER_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `NAME` varchar(128) NOT NULL, `TRIGGER_EXPRESSION` varchar(1024), `ACTION_EXPRESSION` varchar(1024), `IS_IN_UNMANAGED` bit(1) NOT NULL DEFAULT 0, PRIMARY KEY (`TRIGGER_ID`), UNIQUE KEY `UNIQUE_WM_TRIGGER` (`RP_ID`, `NAME`), CONSTRAINT `WM_TRIGGER_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_POOL_TO_TRIGGER ( `POOL_ID` bigint(20) NOT NULL, `TRIGGER_ID` bigint(20) NOT NULL, PRIMARY KEY (`POOL_ID`, `TRIGGER_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK1` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`), CONSTRAINT `WM_POOL_TO_TRIGGER_FK2` FOREIGN KEY (`TRIGGER_ID`) REFERENCES `WM_TRIGGER` (`TRIGGER_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE IF NOT EXISTS WM_MAPPING ( `MAPPING_ID` bigint(20) NOT NULL, `RP_ID` bigint(20) NOT NULL, `ENTITY_TYPE` varchar(128) NOT NULL, `ENTITY_NAME` varchar(128) NOT NULL, `POOL_ID` bigint(20), `ORDERING` int, PRIMARY KEY (`MAPPING_ID`), UNIQUE KEY `UNIQUE_WM_MAPPING` (`RP_ID`, `ENTITY_TYPE`, `ENTITY_NAME`), CONSTRAINT `WM_MAPPING_FK1` FOREIGN KEY (`RP_ID`) REFERENCES `WM_RESOURCEPLAN` (`RP_ID`), CONSTRAINT `WM_MAPPING_FK2` FOREIGN KEY (`POOL_ID`) REFERENCES `WM_POOL` (`POOL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE TXNS ( TXN_ID bigint PRIMARY KEY, TXN_STATE char(1) NOT NULL, TXN_STARTED bigint NOT NULL, TXN_LAST_HEARTBEAT bigint NOT NULL, TXN_USER varchar(128) NOT NULL, TXN_HOST varchar(128) NOT NULL, TXN_AGENT_INFO varchar(128), TXN_META_INFO varchar(128), TXN_HEARTBEAT_COUNT int, TXN_TYPE int ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE TXN_COMPONENTS ( TC_TXNID bigint NOT NULL, TC_DATABASE varchar(128) NOT NULL, TC_TABLE varchar(128), TC_PARTITION varchar(767), TC_OPERATION_TYPE char(1) NOT NULL, TC_WRITEID bigint, FOREIGN KEY (TC_TXNID) REFERENCES TXNS (TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX TC_TXNID_INDEX ON TXN_COMPONENTS (TC_TXNID)
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE COMPLETED_TXN_COMPONENTS ( CTC_TXNID bigint NOT NULL, CTC_DATABASE varchar(128) NOT NULL, CTC_TABLE varchar(256), CTC_PARTITION varchar(767), CTC_TIMESTAMP timestamp DEFAULT CURRENT_TIMESTAMP NOT NULL, CTC_WRITEID bigint, CTC_UPDATE_DELETE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX COMPLETED_TXN_COMPONENTS_IDX ON COMPLETED_TXN_COMPONENTS (CTC_DATABASE, CTC_TABLE, CTC_PARTITION) USING BTREE
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_TXN_ID ( NTXN_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO NEXT_TXN_ID VALUES(1)
1 row affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE HIVE_LOCKS ( HL_LOCK_EXT_ID bigint NOT NULL, HL_LOCK_INT_ID bigint NOT NULL, HL_TXNID bigint NOT NULL, HL_DB varchar(128) NOT NULL, HL_TABLE varchar(128), HL_PARTITION varchar(767), HL_LOCK_STATE char(1) not null, HL_LOCK_TYPE char(1) not null, HL_LAST_HEARTBEAT bigint NOT NULL, HL_ACQUIRED_AT bigint, HL_USER varchar(128) NOT NULL, HL_HOST varchar(128) NOT NULL, HL_HEARTBEAT_COUNT int, HL_AGENT_INFO varchar(128), HL_BLOCKEDBY_EXT_ID bigint, HL_BLOCKEDBY_INT_ID bigint, PRIMARY KEY(HL_LOCK_EXT_ID, HL_LOCK_INT_ID), KEY HIVE_LOCK_TXNID_INDEX (HL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.009 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX HL_TXNID_IDX ON HIVE_LOCKS (HL_TXNID)
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_LOCK_ID ( NL_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.006 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO NEXT_LOCK_ID VALUES(1)
1 row affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE COMPACTION_QUEUE ( CQ_ID bigint PRIMARY KEY, CQ_DATABASE varchar(128) NOT NULL, CQ_TABLE varchar(128) NOT NULL, CQ_PARTITION varchar(767), CQ_STATE char(1) NOT NULL, CQ_TYPE char(1) NOT NULL, CQ_TBLPROPERTIES varchar(2048), CQ_WORKER_ID varchar(128), CQ_START bigint, CQ_RUN_AS varchar(128), CQ_HIGHEST_WRITE_ID bigint, CQ_META_INFO varbinary(2048), CQ_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE COMPLETED_COMPACTIONS ( CC_ID bigint PRIMARY KEY, CC_DATABASE varchar(128) NOT NULL, CC_TABLE varchar(128) NOT NULL, CC_PARTITION varchar(767), CC_STATE char(1) NOT NULL, CC_TYPE char(1) NOT NULL, CC_TBLPROPERTIES varchar(2048), CC_WORKER_ID varchar(128), CC_START bigint, CC_END bigint, CC_RUN_AS varchar(128), CC_HIGHEST_WRITE_ID bigint, CC_META_INFO varbinary(2048), CC_HADOOP_JOB_ID varchar(32) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_COMPACTION_QUEUE_ID ( NCQ_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO NEXT_COMPACTION_QUEUE_ID VALUES(1)
1 row affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE AUX_TABLE ( MT_KEY1 varchar(128) NOT NULL, MT_KEY2 bigint NOT NULL, MT_COMMENT varchar(255), PRIMARY KEY(MT_KEY1, MT_KEY2) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE WRITE_SET ( WS_DATABASE varchar(128) NOT NULL, WS_TABLE varchar(128) NOT NULL, WS_PARTITION varchar(767), WS_TXNID bigint NOT NULL, WS_COMMIT_ID bigint NOT NULL, WS_OPERATION_TYPE char(1) NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE TXN_TO_WRITE_ID ( T2W_TXNID bigint NOT NULL, T2W_DATABASE varchar(128) NOT NULL, T2W_TABLE varchar(256) NOT NULL, T2W_WRITEID bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE UNIQUE INDEX TBL_TO_TXN_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_TXNID)
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE UNIQUE INDEX TBL_TO_WRITE_ID_IDX ON TXN_TO_WRITE_ID (T2W_DATABASE, T2W_TABLE, T2W_WRITEID)
No rows affected (0.005 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE NEXT_WRITE_ID ( NWI_DATABASE varchar(128) NOT NULL, NWI_TABLE varchar(256) NOT NULL, NWI_NEXT bigint NOT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE UNIQUE INDEX NEXT_WRITE_ID_IDX ON NEXT_WRITE_ID (NWI_DATABASE, NWI_TABLE)
No rows affected (0.013 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE MIN_HISTORY_LEVEL ( MHL_TXNID bigint NOT NULL, MHL_MIN_OPEN_TXNID bigint NOT NULL, PRIMARY KEY(MHL_TXNID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX MIN_HISTORY_LEVEL_IDX ON MIN_HISTORY_LEVEL (MHL_MIN_OPEN_TXNID)
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE MATERIALIZATION_REBUILD_LOCKS ( MRL_TXN_ID bigint NOT NULL, MRL_DB_NAME VARCHAR(128) NOT NULL, MRL_TBL_NAME VARCHAR(256) NOT NULL, MRL_LAST_HEARTBEAT bigint NOT NULL, PRIMARY KEY(MRL_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE `I_SCHEMA` ( `SCHEMA_ID` BIGINT PRIMARY KEY, `SCHEMA_TYPE` INTEGER NOT NULL, `NAME` VARCHAR(256), `DB_ID` BIGINT, `COMPATIBILITY` INTEGER NOT NULL, `VALIDATION_LEVEL` INTEGER NOT NULL, `CAN_EVOLVE` bit(1) NOT NULL, `SCHEMA_GROUP` VARCHAR(256), `DESCRIPTION` VARCHAR(4000), FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`), KEY `UNIQUE_NAME` (`NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE `SCHEMA_VERSION` ( `SCHEMA_VERSION_ID` bigint primary key, `SCHEMA_ID` BIGINT, `VERSION` INTEGER NOT NULL, `CREATED_AT` BIGINT NOT NULL, `CD_ID` BIGINT, `STATE` INTEGER NOT NULL, `DESCRIPTION` VARCHAR(4000), `SCHEMA_TEXT` mediumtext, `FINGERPRINT` VARCHAR(256), `SCHEMA_VERSION_NAME` VARCHAR(256), `SERDE_ID` bigint, FOREIGN KEY (`SCHEMA_ID`) REFERENCES `I_SCHEMA` (`SCHEMA_ID`), FOREIGN KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`), FOREIGN KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), KEY `UNIQUE_VERSION` (`SCHEMA_ID`, `VERSION`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.012 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE REPL_TXN_MAP ( RTM_REPL_POLICY varchar(256) NOT NULL, RTM_SRC_TXN_ID bigint NOT NULL, RTM_TARGET_TXN_ID bigint NOT NULL, PRIMARY KEY (RTM_REPL_POLICY, RTM_SRC_TXN_ID) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE TABLE RUNTIME_STATS ( RS_ID bigint primary key, CREATE_TIME bigint NOT NULL, WEIGHT bigint NOT NULL, PAYLOAD blob ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> CREATE INDEX IDX_RUNTIME_STATS_CREATE_TIME ON RUNTIME_STATS(CREATE_TIME)
No rows affected (0.007 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> INSERT INTO VERSION (VER_ID, SCHEMA_VERSION, VERSION_COMMENT) VALUES (1, '3.1.0', 'Hive release version 3.1.0')
1 row affected (0.003 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET character_set_client = @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40103 SET TIME_ZONE=@OLD_TIME_ZONE */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET SQL_MODE=@OLD_SQL_MODE */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET FOREIGN_KEY_CHECKS=@OLD_FOREIGN_KEY_CHECKS */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40014 SET UNIQUE_CHECKS=@OLD_UNIQUE_CHECKS */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET CHARACTER_SET_CLIENT=@OLD_CHARACTER_SET_CLIENT */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET CHARACTER_SET_RESULTS=@OLD_CHARACTER_SET_RESULTS */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40101 SET COLLATION_CONNECTION=@OLD_COLLATION_CONNECTION */
No rows affected (0.002 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> /*!40111 SET SQL_NOTES=@OLD_SQL_NOTES */
No rows affected (0.001 seconds)
0: jdbc:mysql://hadoop102:3306/metastore> !closeall
Closing: 0: jdbc:mysql://hadoop102:3306/metastore?useSSL=false
beeline>
beeline> Initialization script completed
schemaTool completed解决报错：
[hadoop@localhost lib]$ hive
2021-10-19 17:40:29,235 INFO [main] conf.HiveConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
Hive Session ID = 09fe8720-09f8-4bcc-a722-e33fbefa073b
2021-10-19 17:40:31,367 INFO [main] SessionState: Hive Session ID = 09fe8720-09f8-4bcc-a722-e33fbefa073bLogging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:40:31,432 INFO [main] SessionState:
Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
Exception in thread "main" java.lang.RuntimeException: java.net.ConnectException: Call From hadoop102/192.168.206.128 to hadoop102:8020 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused这个是因为没启动hadoop
[hadoop@localhost lib]$ hive
2021-10-19 17:42:27,409 INFO [main] conf.HiveConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
Hive Session ID = 36761330-b5c1-44fb-ba2d-80ca8383f370
2021-10-19 17:42:29,805 INFO [main] SessionState: Hive Session ID = 36761330-b5c1-44fb-ba2d-80ca8383f370Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:42:29,886 INFO [main] SessionState:
Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
Exception in thread "main" java.lang.RuntimeException: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot create directory /tmp/hive. Name node is in safe mode.
The reported blocks 48 has reached the threshold 0.9990 of total blocks 48. The minimum number of live datanodes is not required. In safe mode extension. Safe mode will be turned off automatically in 1 seconds. NamenodeHostName:hadoop102at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1508)at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1495)at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3251)at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:1158)at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:723)at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1086)SafeModeException：hadoop刚启动，所以还在安全模式，需要等一会再启动hive
启动成功
[hadoop@localhost lib]$ hive
2021-10-19 17:43:25,417 INFO [main] conf.HiveConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
Hive Session ID = 82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:27,614 INFO [main] SessionState: Hive Session ID = 82ce7380-4aec-45ef-9e24-9822c2cfbe1fLogging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:43:27,693 INFO [main] SessionState:
Logging initialized using configuration in jar:file:/opt/hive3/lib/hive-common-3.1.2.jar!/hive-log4j2.properties Async: true
2021-10-19 17:43:29,131 INFO [main] session.SessionState: Created HDFS directory: /tmp/hive/hadoop
2021-10-19 17:43:29,143 INFO [main] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:29,180 INFO [main] session.SessionState: Created local directory: /tmp/hadoop/82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:29,189 INFO [main] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/82ce7380-4aec-45ef-9e24-9822c2cfbe1f/_tmp_space.db
2021-10-19 17:43:29,207 INFO [main] conf.HiveConf: Using the default value passed in for log id: 82ce7380-4aec-45ef-9e24-9822c2cfbe1f
2021-10-19 17:43:29,208 INFO [main] session.SessionState: Updating thread name to 82ce7380-4aec-45ef-9e24-9822c2cfbe1f main
2021-10-19 17:43:30,287 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-19 17:43:30,349 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-19 17:43:30,360 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-19 17:43:30,362 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Found configuration file file:/opt/hive3/conf/hive-site.xml
2021-10-19 17:43:30,364 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Unable to find config file hivemetastore-site.xml
2021-10-19 17:43:30,364 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Found configuration file null
2021-10-19 17:43:30,366 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Unable to find config file metastore-site.xml
2021-10-19 17:43:30,366 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] conf.MetastoreConf: Found configuration file null
2021-10-19 17:43:30,675 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
2021-10-19 17:43:30,971 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-1 - Starting...
2021-10-19 17:43:31,338 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-1 - Start completed.
2021-10-19 17:43:31,505 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-2 - Starting...
2021-10-19 17:43:31,545 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] hikari.HikariDataSource: HikariPool-2 - Start completed.
2021-10-19 17:43:31,626 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
2021-10-19 17:43:31,802 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-19 17:43:31,805 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: Initialized ObjectStore
2021-10-19 17:43:32,095 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,095 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,096 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,097 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,097 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:32,098 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,606 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,606 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,606 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,607 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,607 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:33,607 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] DataNucleus.MetaData: Metadata has jdbc-type of null yet this is not valid. Ignored
2021-10-19 17:43:35,532 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: Setting location of default catalog, as it hasn't been done after upgrade
2021-10-19 17:43:35,568 WARN [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.ObjectStore: Failed to get database hive.default, returning NoSuchObjectException
2021-10-19 17:43:35,651 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: Added admin role in metastore
2021-10-19 17:43:35,660 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: Added public role in metastore
2021-10-19 17:43:35,709 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: No user is added in admin role, since config is empty
2021-10-19 17:43:35,922 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-19 17:43:35,958 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] metastore.HiveMetaStore: 0: get_all_functions
2021-10-19 17:43:35,961 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_all_functions
Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
2021-10-19 17:43:35,991 INFO [82ce7380-4aec-45ef-9e24-9822c2cfbe1f main] CliDriver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Hive Session ID = 4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:35,992 INFO [pool-10-thread-1] SessionState: Hive Session ID = 4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:36,018 INFO [pool-10-thread-1] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:36,024 INFO [pool-10-thread-1] session.SessionState: Created local directory: /tmp/hadoop/4a304c40-5ff9-4489-b42c-943f78629388
2021-10-19 17:43:36,036 INFO [pool-10-thread-1] session.SessionState: Created HDFS directory: /tmp/hive/hadoop/4a304c40-5ff9-4489-b42c-943f78629388/_tmp_space.db
2021-10-19 17:43:36,041 INFO [pool-10-thread-1] metastore.HiveMetaStore: 1: get_databases: @hive#
2021-10-19 17:43:36,042 INFO [pool-10-thread-1] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_databases: @hive#
2021-10-19 17:43:36,047 INFO [pool-10-thread-1] metastore.HiveMetaStore: 1: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-19 17:43:36,049 INFO [pool-10-thread-1] metastore.ObjectStore: ObjectStore, initialize called
2021-10-19 17:43:36,095 INFO [pool-10-thread-1] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-19 17:43:36,097 INFO [pool-10-thread-1] metastore.ObjectStore: Initialized ObjectStore
2021-10-19 17:43:36,119 INFO [pool-10-thread-1] metastore.HiveMetaStore: 1: get_tables_by_type: db=@hive#default pat=.*,type=MATERIALIZED_VIEW
2021-10-19 17:43:36,119 INFO [pool-10-thread-1] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_tables_by_type: db=@hive#default pat=.*,type=MATERIALIZED_VIEW
2021-10-19 17:43:36,141 INFO [pool-10-thread-1] metastore.HiveMetaStore: 1: get_multi_table : db=default tbls=
2021-10-19 17:43:36,141 INFO [pool-10-thread-1] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_multi_table : db=default tbls=
2021-10-19 17:43:36,182 INFO [pool-10-thread-1] metadata.HiveMaterializedViewsRegistry: Materialized views registry has been initialized
hive> 下面开始shell编写hql语句
CREATE TABLE pokes (foo INT, bar STRING);
create table pokes(foo int,bar string);
2021-10-21 20:20:52,248 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] conf.HiveConf: Using the default value passed in for log id: 011bf2aa-1ba6-4dc6-a523-c2c937456640
2021-10-21 20:20:52,337 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Compiling command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb): create table pokes(foo int,bar string)
2021-10-21 20:20:52,808 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 20:20:52,811 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-21 20:20:52,831 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=011bf2aa-1ba6-4dc6-a523-c2c937456640, clientType=HIVECLI]
2021-10-21 20:20:52,832 WARN [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
2021-10-21 20:20:52,833 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-21 20:20:52,834 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 20:20:52,835 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-21 20:20:52,835 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 20:20:52,835 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-21 20:20:52,838 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 20:20:52,838 WARN [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 20:20:52,838 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 20:20:52,853 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 20:20:52,853 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 20:20:52,854 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 20:20:52,863 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] parse.CalcitePlanner: Creating table default.pokes position=13
2021-10-21 20:20:52,884 WARN [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 20:20:52,884 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 20:20:52,894 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 20:20:52,894 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 20:20:52,894 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 20:20:52,895 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-21 20:20:52,895 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-21 20:20:52,925 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-21 20:20:52,939 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-21 20:20:52,944 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Completed compiling command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb); Time taken: 0.641 seconds
2021-10-21 20:20:52,945 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] reexec.ReExecDriver: Execution #1 of query
2021-10-21 20:20:52,945 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 20:20:52,946 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Executing command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb): create table pokes(foo int,bar string)
2021-10-21 20:20:52,961 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Starting task [Stage-0:DDL] in serial mode
2021-10-21 20:20:52,961 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook to org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl
2021-10-21 20:20:52,962 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 20:20:52,962 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-21 20:20:52,962 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 20:20:52,962 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-21 20:20:53,262 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 20:20:53,262 WARN [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 20:20:53,262 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 20:20:53,273 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 20:20:53,273 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 20:20:53,273 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 20:20:53,274 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] metastore.HiveMetaStore: bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[], parameters:{totalSize=0, numRows=0, rawDataSize=0, COLUMN_STATS_ACCURATE={"BASIC_STATS":"true","COLUMN_STATS":{"bar":"true","foo":"true"}}, numFiles=0, bucketing_version=2}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE, privileges:PrincipalPrivilegeSet(userPrivileges:{hadoop=[PrivilegeGrantInfo(privilege:INSERT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:SELECT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:UPDATE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:DELETE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true)]}, groupPrivileges:null, rolePrivileges:null), temporary:false, catName:hive, ownerType:USER)
2021-10-21 20:20:53,274 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] HiveMetaStore.audit: bucketCols:[], sortCols:[], parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], skewedColValueLocationMaps:{}), storedAsSubDirectories:false), partitionKeys:[], parameters:{totalSize=0, numRows=0, rawDataSize=0, COLUMN_STATS_ACCURATE={"BASIC_STATS":"true","COLUMN_STATS":{"bar":"true","foo":"true"}}, numFiles=0, bucketing_version=2}, viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE, privileges:PrincipalPrivilegeSet(userPrivileges:{hadoop=[PrivilegeGrantInfo(privilege:INSERT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:SELECT, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:UPDATE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true), PrivilegeGrantInfo(privilege:DELETE, createTime:-1, grantor:hadoop, grantorType:USER, grantOption:true)]}, groupPrivileges:null, rolePrivileges:null), temporary:false, catName:hive, ownerType:USER)
2021-10-21 20:20:53,327 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] utils.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-21 20:20:53,476 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Completed executing command(queryId=hadoop_20211021202052_9e16384b-e567-43dd-bc46-291a1bb651cb); Time taken: 0.531 seconds
OK
2021-10-21 20:20:53,476 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: OK
2021-10-21 20:20:53,476 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 1.174 seconds
2021-10-21 20:20:53,477 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] CliDriver: Time taken: 1.174 seconds
2021-10-21 20:20:53,477 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] conf.HiveConf: Using the default value passed in for log id: 011bf2aa-1ba6-4dc6-a523-c2c937456640
2021-10-21 20:20:53,477 INFO [011bf2aa-1ba6-4dc6-a523-c2c937456640 main] session.SessionState: Resetting thread name to main可以看出创建成功，但是日志太多了，我们来更改下日志级别
CREATE TABLE invites (foo INT, bar STRING) PARTITIONED BY (ds STRING);
hive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes;
2021-10-21 22:45:33,338 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] conf.HiveConf: Using the default value passed in for log id: c8421de0-5d74-4add-948b-61ff8d1a68cb
2021-10-21 22:45:33,408 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Compiling command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-21 22:45:33,820 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 22:45:33,826 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:33,826 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,131 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-21 22:45:34,133 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-21 22:45:34,139 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Completed compiling command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba); Time taken: 0.758 seconds
2021-10-21 22:45:34,139 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] reexec.ReExecDriver: Execution #1 of query
2021-10-21 22:45:34,140 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-21 22:45:34,140 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Executing command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-21 22:45:34,158 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-21 22:45:34,160 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 22:45:34,161 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-21 22:45:34,161 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 22:45:34,161 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
Loading data to table default.pokes
2021-10-21 22:45:34,161 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] exec.Task: Loading data to table default.pokes from file:/opt/hive3/examples/files/kv1.txt
2021-10-21 22:45:34,163 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 22:45:34,163 WARN [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 22:45:34,164 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 22:45:34,178 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 22:45:34,178 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 22:45:34,178 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 22:45:34,178 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,178 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,209 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,209 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-21 22:45:34,238 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-21 22:45:34,238 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-21 22:45:34,269 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-21 22:45:34,712 INFO [Thread-10] hdfs.DataStreamer: Exception in createBlockOutputStream blk_1073741962_1138
java.io.IOException: Got error, status=ERROR, status message , ack with firstBadLink as 192.168.206.130:9866at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:134)at org.apache.hadoop.hdfs.protocol.datatransfer.DataTransferProtoUtil.checkBlockOpStatus(DataTransferProtoUtil.java:110)at org.apache.hadoop.hdfs.DataStreamer.createBlockOutputStream(DataStreamer.java:1779)at org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1680)at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:715)
2021-10-21 22:45:34,714 WARN [Thread-10] hdfs.DataStreamer: Abandoning BP-483593717-192.168.206.128-1634263371490:blk_1073741962_1138
2021-10-21 22:45:34,723 WARN [Thread-10] hdfs.DataStreamer: Excluding datanode DatanodeInfoWithStorage[192.168.206.130:9866,DS-8d36418c-fefe-4d2f-ae05-86485c844169,DISK]
2021-10-21 22:45:35,186 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-21 22:45:35,187 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=alter_table: hive.default.pokes newtbl=pokes
2021-10-21 22:45:35,295 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-21 22:45:35,295 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-21 22:45:35,295 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-21 22:45:35,295 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-21 22:45:35,295 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-21 22:45:35,295 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] stats.BasicStatsTask: Executing stats task
2021-10-21 22:45:35,297 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-21 22:45:35,297 WARN [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-21 22:45:35,297 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-21 22:45:35,308 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-21 22:45:35,308 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.ObjectStore: Initialized ObjectStore
2021-10-21 22:45:35,308 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-21 22:45:35,309 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-21 22:45:35,309 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-21 22:45:35,596 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-21 22:45:35,596 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=alter_table: hive.default.pokes newtbl=pokes
2021-10-21 22:45:35,644 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] stats.BasicStatsTask: Table default.pokes stats: [numFiles=1, numRows=0, totalSize=5812, rawDataSize=0]
2021-10-21 22:45:35,645 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Completed executing command(queryId=hadoop_20211021224533_39bde44f-0525-4cde-babf-0dca3732b6ba); Time taken: 1.504 seconds
OK
2021-10-21 22:45:35,645 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: OK
2021-10-21 22:45:35,645 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 2.266 seconds
2021-10-21 22:45:35,646 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] CliDriver: Time taken: 2.266 seconds
2021-10-21 22:45:35,646 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] conf.HiveConf: Using the default value passed in for log id: c8421de0-5d74-4add-948b-61ff8d1a68cb
2021-10-21 22:45:35,646 INFO [c8421de0-5d74-4add-948b-61ff8d1a68cb main] session.SessionState: Resetting thread name to main很明显就是9866端口未开放，开放下端口就可以了
sudo firewall-cmd --zone=public --add-port=9866/tcp --permanent
sudo firewall-cmd --reload
hive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes;
2021-10-22 08:37:05,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:37:05,736 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-22 08:37:06,150 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:37:06,156 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,156 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,409 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:37:06,411 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-22 08:37:06,418 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff); Time taken: 0.702 seconds
2021-10-22 08:37:06,419 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:37:06,419 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:37:06,419 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes
2021-10-22 08:37:06,437 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 08:37:06,438 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:37:06,438 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:37:06,439 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:37:06,439 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
Loading data to table default.pokes
2021-10-22 08:37:06,440 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Loading data to table default.pokes from file:/opt/hive3/examples/files/kv1.txt
2021-10-22 08:37:06,442 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:37:06,442 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:37:06,442 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:37:06,454 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:37:06,454 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:37:06,455 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:37:06,455 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,455 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,488 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,488 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-22 08:37:06,517 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 08:37:06,517 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 08:37:06,582 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-22 08:37:06,925 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-22 08:37:06,925 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=alter_table: hive.default.pokes newtbl=pokes
2021-10-22 08:37:07,024 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-22 08:37:07,024 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:37:07,024 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:37:07,025 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:37:07,025 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:37:07,025 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Executing stats task
2021-10-22 08:37:07,026 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:37:07,026 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:37:07,027 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:37:07,039 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:37:07,039 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:37:07,039 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:37:07,040 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 08:37:07,040 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-22 08:37:07,301 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_table: hive.default.pokes newtbl=pokes
2021-10-22 08:37:07,301 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=alter_table: hive.default.pokes newtbl=pokes
2021-10-22 08:37:07,350 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Table default.pokes stats: [numFiles=1, numRows=0, totalSize=5812, rawDataSize=0]
2021-10-22 08:37:07,350 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022083705_2bf1cb2e-0d1d-46a7-a31b-eca9196896ff); Time taken: 0.931 seconds
OK
2021-10-22 08:37:07,350 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:37:07,351 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 1.637 seconds
2021-10-22 08:37:07,352 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 1.637 seconds
2021-10-22 08:37:07,352 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:37:07,352 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to mainhive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv2.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-15');
2021-10-22 08:39:48,122 INFO [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:39:48,123 INFO [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:39:48,124 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv2.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-15')
2021-10-22 08:39:48,147 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:39:48,147 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,147 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:39:48,198 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=ce39fa7f-65fa-46a8-8069-3af52af74324, clientType=HIVECLI]
2021-10-22 08:39:48,199 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
2021-10-22 08:39:48,199 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,200 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,201 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,202 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:39:48,202 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:39:48,202 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:39:48,213 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:39:48,213 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:39:48,214 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:39:48,220 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,220 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,275 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,275 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,306 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:39:48,306 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-22 08:39:48,306 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76); Time taken: 0.182 seconds
2021-10-22 08:39:48,306 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:39:48,306 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:39:48,306 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv2.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-15')
2021-10-22 08:39:48,324 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 08:39:48,324 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:39:48,324 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:39:48,324 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,324 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,325 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,325 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,325 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,325 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
Loading data to table default.invites partition (ds=2008-08-15)
2021-10-22 08:39:48,325 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Loading data to table default.invites partition (ds=2008-08-15) from file:/opt/hive3/examples/files/kv2.txt
2021-10-22 08:39:48,327 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:39:48,327 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:39:48,327 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:39:48,338 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:39:48,338 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:39:48,339 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:39:48,339 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,339 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:39:48,364 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,364 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,396 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.MoveTask: Partition is: {ds=2008-08-15}
2021-10-22 08:39:48,397 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: partition_name_has_valid_characters
2021-10-22 08:39:48,397 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=partition_name_has_valid_characters
2021-10-22 08:39:48,397 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,397 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:39:48,420 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,421 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,453 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 08:39:48,453 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 08:39:48,459 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 08:39:48,525 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: add_partition : tbl=hive.default.invites
2021-10-22 08:39:48,525 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=add_partition : tbl=hive.default.invites
2021-10-22 08:39:48,619 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,619 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-22 08:39:48,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:39:48,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:39:48,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,665 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,666 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,666 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:39:48,666 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:39:48,666 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Executing stats task
2021-10-22 08:39:48,668 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:39:48,668 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:39:48,668 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:39:48,679 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:39:48,679 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:39:48,680 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:39:48,680 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:39:48,680 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:39:48,704 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,704 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-15]
2021-10-22 08:39:48,753 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Partition {ds=2008-08-15} stats: [numFiles=1, numRows=0, totalSize=5791, rawDataSize=0]
2021-10-22 08:39:48,754 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_partitions : tbl=hive.default.invites
2021-10-22 08:39:48,754 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=alter_partitions : tbl=hive.default.invites
2021-10-22 08:39:48,754 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: New partition values:[2008-08-15]
2021-10-22 08:39:48,821 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022083948_9d089e89-e0b7-4e11-91cd-6035d0f73f76); Time taken: 0.515 seconds
OK
2021-10-22 08:39:48,821 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:39:48,821 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 0.697 seconds
2021-10-22 08:39:48,821 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 0.697 seconds
2021-10-22 08:39:48,821 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:39:48,821 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to mainhive> LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv3.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-08');
2021-10-22 08:41:01,811 INFO [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:01,811 INFO [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:41:01,813 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv3.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-08')
2021-10-22 08:41:01,835 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 08:41:01,835 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,836 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:01,837 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:01,838 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:41:01,838 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:41:01,838 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:41:01,849 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:41:01,849 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:41:01,849 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:41:01,849 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:01,849 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:41:01,869 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,869 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,897 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,897 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,922 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:41:01,922 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:null, properties:null)
2021-10-22 08:41:01,923 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca); Time taken: 0.109 seconds
2021-10-22 08:41:01,923 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:41:01,923 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:01,923 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca): LOAD DATA LOCAL INPATH '/opt/hive3/examples/files/kv3.txt' OVERWRITE INTO TABLE invites PARTITION (ds='2008-08-08')
2021-10-22 08:41:01,930 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 08:41:01,931 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:41:01,931 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:41:01,931 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,931 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:01,932 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,932 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:01,933 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:01,933 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
Loading data to table default.invites partition (ds=2008-08-08)
2021-10-22 08:41:01,933 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Loading data to table default.invites partition (ds=2008-08-08) from file:/opt/hive3/examples/files/kv3.txt
2021-10-22 08:41:01,936 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:41:01,937 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:41:01,937 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:41:01,950 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:41:01,950 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:41:01,950 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:41:01,951 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:01,951 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:41:01,970 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,970 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:01,999 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.MoveTask: Partition is: {ds=2008-08-08}
2021-10-22 08:41:01,999 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: partition_name_has_valid_characters
2021-10-22 08:41:01,999 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=partition_name_has_valid_characters
2021-10-22 08:41:02,000 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:02,000 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:41:02,020 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,020 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,046 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 08:41:02,047 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 08:41:02,052 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-08
2021-10-22 08:41:02,120 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: add_partition : tbl=hive.default.invites
2021-10-22 08:41:02,120 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=add_partition : tbl=hive.default.invites
2021-10-22 08:41:02,162 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,162 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,208 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:STATS] in serial mode
2021-10-22 08:41:02,208 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 08:41:02,208 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 08:41:02,209 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Executing stats task
2021-10-22 08:41:02,211 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 08:41:02,211 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 08:41:02,211 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 08:41:02,220 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 08:41:02,220 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 08:41:02,220 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 08:41:02,221 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:02,221 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:41:02,241 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,241 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partition_with_auth : tbl=hive.default.invites[2008-08-08]
2021-10-22 08:41:02,286 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] stats.BasicStatsTask: Partition {ds=2008-08-08} stats: [numFiles=1, numRows=0, totalSize=216, rawDataSize=0]
2021-10-22 08:41:02,287 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: alter_partitions : tbl=hive.default.invites
2021-10-22 08:41:02,287 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=alter_partitions : tbl=hive.default.invites
2021-10-22 08:41:02,287 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: New partition values:[2008-08-08]
2021-10-22 08:41:02,342 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022084101_b16e38be-7dc3-4c7e-826a-93743b26bbca); Time taken: 0.419 seconds
OK
2021-10-22 08:41:02,342 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:41:02,342 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 0.529 seconds
2021-10-22 08:41:02,342 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 0.529 seconds
2021-10-22 08:41:02,342 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:02,342 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to main查询
hive> SELECT a.foo FROM invites a WHERE a.ds='2008-08-15';
2021-10-22 08:41:38,476 INFO [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:38,476 INFO [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:41:38,478 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153): SELECT a.foo FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:41:38,502 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:38,506 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 08:41:38,510 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 08:41:38,510 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:41:38,510 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:38,510 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:41:38,531 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:41:38,542 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:41:38,590 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-41-38_491_9014122941911866299-1
2021-10-22 08:41:38,592 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 08:41:38,605 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] results.QueryResultsCache: Initializing query results cache at /tmp/hive/_resultscache_
2021-10-22 08:41:38,617 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] results.QueryResultsCache: Query results cache: cacheDirectory /tmp/hive/_resultscache_/results-68bf50f9-4555-423a-9026-4bef405d0d8a, maxCacheSize 2147483648, maxEntrySize 10485760, maxEntryLifetime 3600000
2021-10-22 08:41:39,292 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 08:41:39,292 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.invites
2021-10-22 08:41:39,301 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:41:39,301 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 08:41:39,310 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:41:39,310 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 08:41:39,315 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 08:41:39,316 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.invites
2021-10-22 08:41:39,323 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 08:41:39,323 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 08:41:40,088 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 08:41:40,088 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 08:41:40,166 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 08:41:40,167 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_databases: @hive#
2021-10-22 08:41:40,174 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 08:41:40,174 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 08:41:40,219 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:41:40,219 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:41:40,219 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:41:40,245 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:41:40,245 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:41:40,250 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-41-38_491_9014122941911866299-1
2021-10-22 08:41:40,291 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-41-38_491_9014122941911866299-1/-mr-10001/.hive-staging_hive_2021-10-22_08-41-38_491_9014122941911866299-1
2021-10-22 08:41:40,302 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 08:41:40,331 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FS(3)
2021-10-22 08:41:40,331 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 08:41:40,331 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 08:41:40,335 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 08:41:40,408 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 08:41:40,408 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Not eligible for results caching - no mr/tez/spark jobs
2021-10-22 08:41:40,408 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:41:40,408 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null)], properties:null)
2021-10-22 08:41:40,424 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.TableScanOperator: Initializing operator TS[0]
2021-10-22 08:41:40,424 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SelectOperator: Initializing operator SEL[2]
2021-10-22 08:41:40,425 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SelectOperator: SELECT struct<foo:int,bar:string,ds:string>
2021-10-22 08:41:40,425 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.ListSinkOperator: Initializing operator LIST_SINK[5]
2021-10-22 08:41:40,433 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153); Time taken: 1.955 seconds
2021-10-22 08:41:40,433 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:41:40,433 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:40,433 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153): SELECT a.foo FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:41:40,440 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022084138_d46f1de4-4f8c-4f3f-bd40-6b0d9decf153); Time taken: 0.007 seconds
OK
2021-10-22 08:41:40,440 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: OK
2021-10-22 08:41:40,440 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:41:40,449 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2021-10-22 08:41:40,478 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapred.FileInputFormat: Total input files to process : 1
474
281
179
291
62
271
217
135
167
468
423
413
245
455
425
241
177
272
231
448
287
246
440
31
373
447
443
175
278
296
147
428
126
249
21
273
441
106
371
153
356
217
490
33
35
421
243
402
128
10
226
133
333
15
110
391
343
275
0
485
293
240
241
286
85
408
477
455
99
335
476
482
367
59
48
424
226
494
488
94
485
393
349
11
161
123
409
50
265
402
128
468
314
497
224
63
344
4
277
135
3
206
101
331
114
209
281
56
239
389
114
254
235
390
165
304
264
196
238
20
11
492
129
257
71
289
453
421
82
58
5
86
249
438
360
323
222
42
467
411
175
429
338
281
68
185
16
147
119
492
473
376
347
120
213
306
393
427
291
426
132
446
386
65
121
388
184
375
284
191
129
246
197
491
369
262
122
438
351
390
352
23
226
328
382
342
349
480
102
497
487
480
331
409
475
463
183
177
399
15
318
149
392
77
275
476
258
174
252
114
87
161
75
264
48
336
340
390
443
484
407
189
305
367
6
260
2
349
170
51
355
363
164
118
310
104
19
80
117
326
47
121
241
450
140
212
308
30
405
239
119
358
11
49
143
153
341
21
105
157
416
199
375
42
89
363
395
347
386
77
454
293
364
20
89
461
52
40
8
168
384
313
324
310
206
381
404
206
385
259
226
262
69
303
245
260
328
322
122
241
469
404
384
76
116
42
104
481
303
93
277
406
451
53
32
132
192
58
351
70
443
356
399
205
352
52
21
317
330
209
138
429
160
267
454
257
76
174
412
16
375
489
295
105
204
126
274
439
374
494
216
457
93
470
196
302
119
375
391
287
450
375
437
12
398
35
334
384
435
60
29
442
151
52
404
446
300
0
268
491
392
21
295
93
104
436
61
407
439
156
341
118
335
172
244
6
284
164
136
349
371
462
123
432
496
355
144
87
408
152
382
348
122
427
292
182
474
353
310
52
486
152
378
414
261
65
371
256
292
412
97
495
385
40
49
389
259
97
478
125
243
151
178
100
415
401
156
228
363
117
22
248
459
402
62
137
162
244
276
46
341
78
379
215
134
196
410
157
431
82
440
100
407
371
308
430
309
135
161
468
152
138
76
161
300
337
91
478
118
1
89
178
457
29
242
285
35
227
395
244
2021-10-22 08:41:40,566 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:500,
2021-10-22 08:41:40,566 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_2:500, RECORDS_OUT_INTERMEDIATE:0,
2021-10-22 08:41:40,566 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.ListSinkOperator: RECORDS_OUT_OPERATOR_LIST_SINK_5:500, RECORDS_OUT_INTERMEDIATE:0,
Time taken: 1.962 seconds, Fetched: 500 row(s)
2021-10-22 08:41:40,574 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] CliDriver: Time taken: 1.962 seconds, Fetched: 500 row(s)
2021-10-22 08:41:40,574 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:41:40,574 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to main
hive> INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15';
2021-10-22 08:44:30,993 INFO [main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:44:30,993 INFO [main] session.SessionState: Updating thread name to ce39fa7f-65fa-46a8-8069-3af52af74324 main
2021-10-22 08:44:30,994 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Compiling command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:44:31,008 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:44:31,008 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 08:44:31,009 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 08:44:31,009 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:44:31,009 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:44:31,009 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:44:31,030 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:44:31,030 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:44:31,030 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 08:44:31,036 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 08:44:31,036 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.invites
2021-10-22 08:44:31,041 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:44:31,041 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 08:44:31,046 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 08:44:31,047 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 08:44:31,050 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 08:44:31,050 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.invites
2021-10-22 08:44:31,055 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 08:44:31,055 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 08:44:31,089 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 08:44:31,089 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 08:44:31,135 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 08:44:31,135 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_databases: @hive#
2021-10-22 08:44:31,140 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 08:44:31,140 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 08:44:31,150 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 08:44:31,151 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 08:44:31,151 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 08:44:31,170 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 08:44:31,170 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 08:44:31,172 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,186 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,191 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 08:44:31,191 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FS(3)
2021-10-22 08:44:31,191 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 08:44:31,191 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 08:44:31,192 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 08:44:31,232 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] optimizer.GenMRFileSink1: using CombineHiveInputformat for the merge job
2021-10-22 08:44:31,300 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 08:44:31,305 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 08:44:31,305 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 08:44:31,333 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 08:44:31,333 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map vectorized: true
2021-10-22 08:44:31,333 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 08:44:31,333 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 08:44:31,333 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 08:44:31,334 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 08:44:31,334 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] parse.CalcitePlanner: Not eligible for results caching - no fetch task
2021-10-22 08:44:31,335 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 08:44:31,335 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null), FieldSchema(name:a.bar, type:string, comment:null), FieldSchema(name:a.ds, type:string, comment:null)], properties:null)
2021-10-22 08:44:31,335 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a); Time taken: 0.341 seconds
2021-10-22 08:44:31,335 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 08:44:31,335 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:44:31,336 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Executing command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 08:44:31,377 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a
2021-10-22 08:44:31,377 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Query ID = hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a
Total jobs = 3
2021-10-22 08:44:31,377 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Total jobs = 3
Launching Job 1 out of 3
2021-10-22 08:44:31,390 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Launching Job 1 out of 3
2021-10-22 08:44:31,403 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 08:44:31,403 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 08:44:31,410 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,422 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2021-10-22 08:44:31,426 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: Processing alias a
2021-10-22 08:44:31,426 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: Adding 1 inputs; the first input is hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 08:44:31,430 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1
2021-10-22 08:44:31,440 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.SerializationUtilities: Serializing MapWork using kryo
2021-10-22 08:44:31,494 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] Configuration.deprecation: mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2021-10-22 08:44:31,508 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: Serialized plan (via FILE) - name: null size: 4.77KB
2021-10-22 08:44:31,604 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.206.129:8032
2021-10-22 08:44:31,883 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] client.RMProxy: Connecting to ResourceManager at hadoop103/192.168.206.129:8032
2021-10-22 08:44:31,890 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: PLAN PATH = hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1/-mr-10004/5fe16d2f-6fa8-4156-a701-440522c7bc21/map.xml
2021-10-22 08:44:32,108 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-10-22 08:44:32,128 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hadoop/.staging/job_1634862971391_0001
2021-10-22 08:44:32,860 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Utilities: PLAN PATH = hdfs://hadoop102:8020/tmp/hive/hadoop/ce39fa7f-65fa-46a8-8069-3af52af74324/hive_2021-10-22_08-44-31_006_6583511319793128565-1/-mr-10004/5fe16d2f-6fa8-4156-a701-440522c7bc21/map.xml
2021-10-22 08:44:32,860 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones.
2021-10-22 08:44:32,872 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15; using filter path hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 08:44:32,879 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] input.FileInputFormat: Total input files to process : 1
2021-10-22 08:44:32,885 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: number of splits 1
2021-10-22 08:44:32,886 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] io.CombineHiveInputFormat: Number of all splits 1
2021-10-22 08:44:32,968 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobSubmitter: number of splits:1
2021-10-22 08:44:32,981 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled
2021-10-22 08:44:33,027 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobSubmitter: Submitting tokens for job: job_1634862971391_0001
2021-10-22 08:44:33,027 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.JobSubmitter: Executing with tokens: []
2021-10-22 08:44:33,213 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.Configuration: resource-types.xml not found
2021-10-22 08:44:33,214 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-10-22 08:44:33,454 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] impl.YarnClientImpl: Submitted application application_1634862971391_0001
2021-10-22 08:44:33,499 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Job: The url to track the job: http://hadoop103:8088/proxy/application_1634862971391_0001/
Starting Job = job_1634862971391_0001, Tracking URL = http://hadoop103:8088/proxy/application_1634862971391_0001/
2021-10-22 08:44:33,501 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Starting Job = job_1634862971391_0001, Tracking URL = http://hadoop103:8088/proxy/application_1634862971391_0001/
Kill Command = /usr/local/hadoop3/bin/mapred job -kill job_1634862971391_0001
2021-10-22 08:44:33,501 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Kill Command = /usr/local/hadoop3/bin/mapred job -kill job_1634862971391_0001
Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
2021-10-22 08:44:38,579 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
2021-10-22 08:44:38,642 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2021-10-22 08:44:38,635 Stage-1 map = 0%, reduce = 0%
2021-10-22 08:44:38,644 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: 2021-10-22 08:44:38,635 Stage-1 map = 0%, reduce = 0%
2021-10-22 08:44:38,651 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
Ended Job = job_1634862971391_0001 with errors
2021-10-22 08:44:38,670 ERROR [ce39fa7f-65fa-46a8-8069-3af52af74324 main] exec.Task: Ended Job = job_1634862971391_0001 with errors
Error during job, obtaining debugging information...
2021-10-22 08:44:38,672 ERROR [Thread-42] exec.Task: Error during job, obtaining debugging information...
2021-10-22 08:44:38,672 INFO [Thread-42] Configuration.deprecation: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2021-10-22 08:44:38,704 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] impl.YarnClientImpl: Killed application application_1634862971391_0001
2021-10-22 08:44:38,725 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
2021-10-22 08:44:38,725 ERROR [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
2021-10-22 08:44:38,746 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: MapReduce Jobs Launched:
2021-10-22 08:44:38,757 WARN [ce39fa7f-65fa-46a8-8069-3af52af74324 main] mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL
2021-10-22 08:44:38,760 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Stage-Stage-1: HDFS Read: 0 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 0 msec
2021-10-22 08:44:38,761 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec
2021-10-22 08:44:38,761 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Completed executing command(queryId=hadoop_20211022084430_21a5d01e-369f-4a81-a649-2add9fac3c1a); Time taken: 7.411 seconds
2021-10-22 08:44:38,761 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 08:44:38,779 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] conf.HiveConf: Using the default value passed in for log id: ce39fa7f-65fa-46a8-8069-3af52af74324
2021-10-22 08:44:38,779 INFO [ce39fa7f-65fa-46a8-8069-3af52af74324 main] session.SessionState: Resetting thread name to main设置一下这个
set hive.exec.mode.local.auto=true;(默认为false)
就可以了
hive> INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15';
2021-10-22 09:13:30,273 INFO [main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:13:30,273 INFO [main] session.SessionState: Updating thread name to 51408bd7-50c8-4a43-954e-a1517b55ac60 main
2021-10-22 09:13:30,320 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Compiling command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 09:13:30,746 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:13:30,749 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 09:13:30,775 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] sqlstd.SQLStdHiveAccessController: Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=51408bd7-50c8-4a43-954e-a1517b55ac60, clientType=HIVECLI]
2021-10-22 09:13:30,778 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] session.SessionState: METASTORE_FILTER_HOOK will be ignored, since hive.security.authorization.manager is set to instance of HiveAuthorizerFactory.
2021-10-22 09:13:30,778 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 09:13:30,781 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:13:30,781 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 09:13:30,781 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:13:30,782 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 09:13:30,783 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:13:30,784 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:13:30,784 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:13:30,795 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:13:30,795 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:13:30,796 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:13:30,805 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 09:13:30,805 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:13:30,806 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:13:30,807 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:13:30,817 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:13:30,817 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:13:30,818 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:13:30,821 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:13:30,821 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 09:13:30,934 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:13:30,940 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:13:30,942 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 09:13:30,951 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] results.QueryResultsCache: Initializing query results cache at /tmp/hive/_resultscache_
2021-10-22 09:13:30,975 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] results.QueryResultsCache: Query results cache: cacheDirectory /tmp/hive/_resultscache_/results-80ac00fc-8385-47c1-9ee3-cbf30eed39bb, maxCacheSize 2147483648, maxEntrySize 10485760, maxEntryLifetime 3600000
2021-10-22 09:13:31,542 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 09:13:31,542 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.invites
2021-10-22 09:13:31,550 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:13:31,550 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 09:13:31,562 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:13:31,562 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 09:13:31,570 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 09:13:31,570 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.invites
2021-10-22 09:13:31,578 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 09:13:31,578 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 09:13:32,374 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 09:13:32,374 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partitions_by_expr : tbl=hive.default.invites
2021-10-22 09:13:32,476 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 09:13:32,477 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_databases: @hive#
2021-10-22 09:13:32,483 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 09:13:32,483 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 09:13:32,526 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:13:32,526 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:13:32,526 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 09:13:32,560 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:13:32,560 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:13:32,598 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1
2021-10-22 09:13:32,612 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1
2021-10-22 09:13:32,617 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 09:13:32,648 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FS(3)
2021-10-22 09:13:32,648 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 09:13:32,648 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 09:13:32,652 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 09:13:32,744 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] optimizer.GenMRFileSink1: using CombineHiveInputformat for the merge job
2021-10-22 09:13:32,814 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 09:13:32,817 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:13:32,817 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 09:13:32,844 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 09:13:32,845 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorized: true
2021-10-22 09:13:32,845 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 09:13:32,845 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 09:13:32,845 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:13:32,883 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15 length: 5791 file count: 1 directory count: 1
2021-10-22 09:13:32,893 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cannot get size of hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10002. Safely ignored.
2021-10-22 09:13:32,896 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cannot get size of hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10002. Safely ignored.
Automatically selecting local only mode for query
2021-10-22 09:13:32,897 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Automatically selecting local only mode for query
2021-10-22 09:13:32,901 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 09:13:32,901 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Not eligible for results caching - no fetch task
2021-10-22 09:13:32,902 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 09:13:32,905 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null), FieldSchema(name:a.bar, type:string, comment:null), FieldSchema(name:a.ds, type:string, comment:null)], properties:null)
2021-10-22 09:13:32,911 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b); Time taken: 2.615 seconds
2021-10-22 09:13:32,911 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 09:13:32,912 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:13:32,912 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Executing command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b): INSERT OVERWRITE DIRECTORY '/tmp/hdfs_out' SELECT a.* FROM invites a WHERE a.ds='2008-08-15'
2021-10-22 09:13:32,920 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b
2021-10-22 09:13:32,920 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Query ID = hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b
Total jobs = 3
2021-10-22 09:13:32,920 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total jobs = 3
Launching Job 1 out of 3
2021-10-22 09:13:32,941 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Launching Job 1 out of 3
2021-10-22 09:13:32,956 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:13:32,956 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:13:32,971 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2021-10-22 09:13:32,975 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Processing alias a
2021-10-22 09:13:32,976 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Adding 1 inputs; the first input is hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 09:13:32,989 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.SerializationUtilities: Serializing MapWork using kryo
2021-10-22 09:13:33,002 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Serialized plan (via FILE) - name: null size: 4.77KB
2021-10-22 09:13:33,132 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2021-10-22 09:13:33,141 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,279 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-10-22 09:13:33,422 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,422 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones.
2021-10-22 09:13:33,433 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15; using filter path hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15
2021-10-22 09:13:33,525 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] input.FileInputFormat: Total input files to process : 1
2021-10-22 09:13:33,533 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: number of splits 1
2021-10-22 09:13:33,534 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Number of all splits 1
2021-10-22 09:13:33,548 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: number of splits:1
2021-10-22 09:13:33,607 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1064075207_0001
2021-10-22 09:13:33,607 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Executing with tokens: []
2021-10-22 09:13:33,734 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.Job: The url to track the job: http://localhost:8080/
2021-10-22 09:13:33,737 INFO [Thread-11] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
Job running in-process (local Hadoop)
2021-10-22 09:13:33,737 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Job running in-process (local Hadoop)
2021-10-22 09:13:33,739 INFO [Thread-11] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2021-10-22 09:13:33,755 INFO [Thread-11] mapred.LocalJobRunner: Waiting for map tasks
2021-10-22 09:13:33,760 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1064075207_0001_m_000000_0
2021-10-22 09:13:33,814 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ]
2021-10-22 09:13:33,823 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: Paths:/user/hive/warehouse/invites/ds=2008-08-15/kv2.txt:0+5791InputFormatClass: org.apache.hadoop.mapred.TextInputFormat2021-10-22 09:13:33,834 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,835 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo
2021-10-22 09:13:33,874 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 4.77KB
2021-10-22 09:13:33,879 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,903 INFO [LocalJobRunner Map Task Executor #0] Configuration.deprecation: map.input.file is deprecated. Instead, use mapreduce.map.input.file
2021-10-22 09:13:33,903 INFO [LocalJobRunner Map Task Executor #0] Configuration.deprecation: map.input.start is deprecated. Instead, use mapreduce.map.input.start
2021-10-22 09:13:33,903 INFO [LocalJobRunner Map Task Executor #0] Configuration.deprecation: map.input.length is deprecated. Instead, use mapreduce.map.input.length
2021-10-22 09:13:33,903 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0
2021-10-22 09:13:33,926 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/hadoop-annotations-3.2.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar, file:/opt/hive3/lib/json-1.8.jar, file:/opt/hive3/lib/hive-jdbc-handler-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar, file:/opt/hive3/lib/validation-api-1.1.0.Final.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/opt/hive3/lib/zookeeper-3.4.6.jar, file:/opt/hive3/lib/jackson-core-2.9.5.jar, file:/usr/local/hbase/conf/, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar]
2021-10-22 09:13:33,927 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/sha
2021-10-22 09:13:33,927 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:33,931 INFO [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: Initializing operator MAP[0]
2021-10-22 09:13:33,958 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper:
<MAP>Id =0<Children>null<\Children><Parent><\Parent>
<\MAP>
2021-10-22 09:13:33,960 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing operator TS[0]
2021-10-22 09:13:33,960 INFO [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: Initializing operator SEL[7]
2021-10-22 09:13:33,964 INFO [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: Initializing operator FS[8]
2021-10-22 09:13:33,965 INFO [LocalJobRunner Map Task Executor #0] Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id
2021-10-22 09:13:33,966 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe[[[B@6b876068]:[_col0, _col1, _col2]:[int, string, string]] and formatter : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat@2159a3c2
2021-10-22 09:13:33,966 INFO [LocalJobRunner Map Task Executor #0] Configuration.deprecation: mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2021-10-22 09:13:33,974 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-13-30_337_8151184031692863975-1/-mr-10004/b7614eb8-7440-41db-acc1-15c04e143a00/map.xml
2021-10-22 09:13:34,091 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/_tmp.-ext-10002/000000_0
2021-10-22 09:13:34,091 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/_task_tmp.-ext-10002/_tmp.000000_0
2021-10-22 09:13:34,091 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/_tmp.-ext-10002/000000_0
2021-10-22 09:13:34,135 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 1
2021-10-22 09:13:34,136 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 10
2021-10-22 09:13:34,137 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 100
2021-10-22 09:13:34,146 INFO [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:500, RECORDS_OUT_OPERATOR_MAP_0:0,
2021-10-22 09:13:34,146 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:500,
2021-10-22 09:13:34,146 INFO [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: RECORDS_OUT_OPERATOR_SEL_7:500, RECORDS_OUT_INTERMEDIATE:0,
2021-10-22 09:13:34,146 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[8]: records written - 500
2021-10-22 09:13:34,230 INFO [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_1:500, RECORDS_OUT_OPERATOR_FS_8:500,
2021-10-22 09:13:34,233 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner:
2021-10-22 09:13:34,247 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1064075207_0001_m_000000_0 is done. And is in the process of committing
2021-10-22 09:13:34,250 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15/kv2.txt:0+5791
2021-10-22 09:13:34,250 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1064075207_0001_m_000000_0' done.
2021-10-22 09:13:34,255 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: m CountersFILE: Number of bytes read=40629062FILE: Number of bytes written=41865245FILE: Number of read operations=0FILE: Number of large read operations=0FILE: Number of write operations=0HDFS: Number of bytes read=5791HDFS: Number of bytes written=11291HDFS: Number of read operations=26HDFS: Number of large read operations=0HDFS: Number of write operations=10HDFS: Number of bytes read erasure-coded=0Map-Reduce FrameworkMap input records=500Map output records=0Input split bytes=225Spilled Records=0Failed Shuffles=0Merged Map outputs=0GC time elapsed (ms)=10Total committed heap usage (bytes)=163270656HIVECREATED_FILES=1DESERIALIZE_ERRORS=0RECORDS_IN=500RECORDS_OUT_1=500RECORDS_OUT_INTERMEDIATE=0RECORDS_OUT_OPERATOR_FS_8=500RECORDS_OUT_OPERATOR_MAP_0=0RECORDS_OUT_OPERATOR_SEL_7=500RECORDS_OUT_OPERATOR_TS_0=500File Input Format Counters Bytes Read=0File Output Format Counters Bytes Written=0
2021-10-22 09:13:34,255 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1064075207_0001_m_000000_0
2021-10-22 09:13:34,257 INFO [Thread-11] mapred.LocalJobRunner: map task executor complete.
2021-10-22 09:13:34,753 Stage-1 map = 100%, reduce = 0%
2021-10-22 09:13:34,753 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: 2021-10-22 09:13:34,753 Stage-1 map = 100%, reduce = 0%
Ended Job = job_local1064075207_0001
2021-10-22 09:13:34,762 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Ended Job = job_local1064075207_0001
2021-10-22 09:13:34,794 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-6:CONDITIONAL] in serial mode
Stage-3 is selected by condition resolver.
2021-10-22 09:13:34,799 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Stage-3 is selected by condition resolver.
Stage-2 is filtered out by condition resolver.
2021-10-22 09:13:34,799 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Stage-2 is filtered out by condition resolver.
Stage-4 is filtered out by condition resolver.
2021-10-22 09:13:34,800 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Stage-4 is filtered out by condition resolver.
2021-10-22 09:13:34,800 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-3:MOVE] in serial mode
2021-10-22 09:13:34,801 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:13:34,801 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 09:13:34,801 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:13:34,801 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
Moving data to directory hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10000
2021-10-22 09:13:34,801 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Moving data to directory hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10000 from hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10002
2021-10-22 09:13:34,829 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
Moving data to directory /tmp/hdfs_out
2021-10-22 09:13:34,829 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Moving data to directory /tmp/hdfs_out from hdfs://hadoop102:8020/tmp/hdfs_out/.hive-staging_hive_2021-10-22_09-13-30_337_8151184031692863975-1/-ext-10000
MapReduce Jobs Launched:
2021-10-22 09:13:34,852 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: MapReduce Jobs Launched:
Stage-Stage-1: HDFS Read: 5791 HDFS Write: 11291 SUCCESS
2021-10-22 09:13:34,852 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Stage-Stage-1: HDFS Read: 5791 HDFS Write: 11291 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:13:34,852 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:13:34,852 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed executing command(queryId=hadoop_20211022091330_ca9ae4c8-68f2-4670-9c12-10bbdd097f3b); Time taken: 1.94 seconds
OK
2021-10-22 09:13:34,852 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: OK
2021-10-22 09:13:34,853 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 4.558 seconds
2021-10-22 09:13:34,858 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] CliDriver: Time taken: 4.558 seconds
2021-10-22 09:13:34,858 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:13:34,858 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] session.SessionState: Resetting thread name to mainhive> INSERT OVERWRITE LOCAL DIRECTORY '/tmp/local_out' SELECT a.* FROM pokes a;
2021-10-22 09:20:36,949 INFO [main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:20:36,949 INFO [main] session.SessionState: Updating thread name to 51408bd7-50c8-4a43-954e-a1517b55ac60 main
2021-10-22 09:20:36,951 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Compiling command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797): INSERT OVERWRITE LOCAL DIRECTORY '/tmp/local_out' SELECT a.* FROM pokes a
2021-10-22 09:20:36,966 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:20:36,966 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:20:36,966 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:20:36,977 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:20:36,977 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:20:36,978 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:20:36,978 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStoreClient: Mestastore configuration metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook
2021-10-22 09:20:36,978 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 09:20:36,979 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:20:36,981 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:20:36,981 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:20:36,981 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:20:36,992 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:20:36,992 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:20:36,992 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:20:36,992 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 09:20:36,992 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-22 09:20:37,022 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:20:37,022 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:20:37,022 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 09:20:37,027 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.pokes
2021-10-22 09:20:37,027 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.pokes
2021-10-22 09:20:37,031 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.pokes
2021-10-22 09:20:37,031 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.pokes
2021-10-22 09:20:37,036 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.pokes
2021-10-22 09:20:37,036 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.pokes
2021-10-22 09:20:37,040 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.pokes
2021-10-22 09:20:37,040 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.pokes
2021-10-22 09:20:37,043 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=pokes
2021-10-22 09:20:37,043 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=pokes
2021-10-22 09:20:37,081 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_databases: @hive#
2021-10-22 09:20:37,081 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_databases: @hive#
2021-10-22 09:20:37,085 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 09:20:37,085 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_materialized_views_for_rewriting: db=@hive#default
2021-10-22 09:20:37,093 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:20:37,093 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.pokes
2021-10-22 09:20:37,093 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.pokes
2021-10-22 09:20:37,120 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:20:37,120 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:20:37,129 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Context: New scratch dir is hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1
2021-10-22 09:20:37,130 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/tmp/local_out/.hive-staging_hive_2021-10-22_09-20-36_964_3191088301170901390-1
2021-10-22 09:20:37,137 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 09:20:37,137 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FS(2)
2021-10-22 09:20:37,137 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(1)
2021-10-22 09:20:37,137 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 09:20:37,158 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 09:20:37,159 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:20:37,159 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 09:20:37,159 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 09:20:37,159 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorized: true
2021-10-22 09:20:37,160 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 09:20:37,160 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 09:20:37,160 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:20:37,163 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/pokes length: 5812 file count: 1 directory count: 1
Automatically selecting local only mode for query
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Automatically selecting local only mode for query
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Not eligible for results caching - no fetch task
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.foo, type:int, comment:null), FieldSchema(name:a.bar, type:string, comment:null)], properties:null)
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797); Time taken: 0.213 seconds
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:20:37,164 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Executing command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797): INSERT OVERWRITE LOCAL DIRECTORY '/tmp/local_out' SELECT a.* FROM pokes a
2021-10-22 09:20:37,171 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases.
Query ID = hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797
2021-10-22 09:20:37,171 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Query ID = hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797
Total jobs = 1
2021-10-22 09:20:37,171 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total jobs = 1
Launching Job 1 out of 1
2021-10-22 09:20:37,172 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Launching Job 1 out of 1
2021-10-22 09:20:37,176 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-1:MAPRED] in serial mode
Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:20:37,177 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Number of reduce tasks is set to 0 since there's no reduce operator
2021-10-22 09:20:37,178 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mr.ExecDriver: Using org.apache.hadoop.hive.ql.io.CombineHiveInputFormat
2021-10-22 09:20:37,178 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Processing alias a
2021-10-22 09:20:37,178 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Adding 1 inputs; the first input is hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-22 09:20:37,181 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.SerializationUtilities: Serializing MapWork using kryo
2021-10-22 09:20:37,193 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Serialized plan (via FILE) - name: null size: 4.35KB
2021-10-22 09:20:37,194 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2021-10-22 09:20:37,206 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] impl.MetricsSystemImpl: JobTracker metrics system already initialized!
2021-10-22 09:20:37,208 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,216 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-10-22 09:20:37,299 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,299 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Total number of paths: 1, launching 1 threads to check non-combinable ones.
2021-10-22 09:20:37,300 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: CombineHiveInputSplit creating pool for hdfs://hadoop102:8020/user/hive/warehouse/pokes; using filter path hdfs://hadoop102:8020/user/hive/warehouse/pokes
2021-10-22 09:20:37,305 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] input.FileInputFormat: Total input files to process : 1
2021-10-22 09:20:37,306 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: number of splits 1
2021-10-22 09:20:37,306 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] io.CombineHiveInputFormat: Number of all splits 1
2021-10-22 09:20:37,308 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: number of splits:1
2021-10-22 09:20:37,338 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Submitting tokens for job: job_local1497044033_0002
2021-10-22 09:20:37,339 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.JobSubmitter: Executing with tokens: []
2021-10-22 09:20:37,435 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] mapreduce.Job: The url to track the job: http://localhost:8080/
Job running in-process (local Hadoop)
2021-10-22 09:20:37,435 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Job running in-process (local Hadoop)
2021-10-22 09:20:37,435 INFO [Thread-23] mapred.LocalJobRunner: OutputCommitter set in config org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2021-10-22 09:20:37,436 INFO [Thread-23] mapred.LocalJobRunner: OutputCommitter is org.apache.hadoop.hive.ql.io.HiveFileFormatUtils$NullOutputCommitter
2021-10-22 09:20:37,438 INFO [Thread-23] mapred.LocalJobRunner: Waiting for map tasks
2021-10-22 09:20:37,438 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Starting task: attempt_local1497044033_0002_m_000000_0
2021-10-22 09:20:37,440 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Using ResourceCalculatorProcessTree : [ ]
2021-10-22 09:20:37,442 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: Processing split: Paths:/user/hive/warehouse/pokes/kv1.txt:0+5812InputFormatClass: org.apache.hadoop.mapred.TextInputFormat2021-10-22 09:20:37,442 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,443 INFO [LocalJobRunner Map Task Executor #0] exec.SerializationUtilities: Deserializing MapWork using kryo
2021-10-22 09:20:37,457 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: Deserialized plan (via FILE) - name: null size: 4.35KB
2021-10-22 09:20:37,458 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,464 INFO [LocalJobRunner Map Task Executor #0] mapred.MapTask: numReduceTasks: 0
2021-10-22 09:20:37,465 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/hadoop-annotations-3.2.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar, file:/opt/hive3/lib/json-1.8.jar, file:/opt/hive3/lib/hive-jdbc-handler-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar, file:/opt/hive3/lib/validation-api-1.1.0.Final.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/opt/hive3/lib/zookeeper-3.4.6.jar, file:/opt/hive3/lib/jackson-core-2.9.5.jar, file:/usr/local/hbase/conf/, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar]
2021-10-22 09:20:37,467 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper: 5.0-b32.jar, file:/opt/hive3/lib/hbase-procedure-2.0.0-alpha4.jar, file:/opt/hive3/lib/jetty-jaas-9.3.20.v20170531.jar, file:/usr/local/hadoop3/share/hadoop/yarn/lib/jackson-jaxrs-json-provider-2.9.10.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/audience-annotations-0.5.0.jar, file:/opt/hive3/lib/log4j-api-2.10.0.jar, file:/opt/hive3/lib/hive-llap-ext-client-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/hadoop-annotations-3.2.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/kerby-xdr-1.0.1.jar, file:/opt/hive3/lib/json-1.8.jar, file:/opt/hive3/lib/hive-jdbc-handler-3.1.2.jar, file:/usr/local/hadoop3/share/hadoop/common/lib/jetty-xml-9.4.20.v20190813.jar, file:/opt/hive3/lib/validation-api-1.1.0.Final.jar, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/commons-daemon-1.0.13.jar, file:/opt/hive3/lib/zookeeper-3.4.6.jar, file:/opt/hive3/lib/jackson-core-2.9.5.jar, file:/usr/local/hbase/conf/, file:/usr/local/hadoop3/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar]
2021-10-22 09:20:37,467 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,467 INFO [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: Initializing operator MAP[0]
2021-10-22 09:20:37,468 INFO [LocalJobRunner Map Task Executor #0] mr.ExecMapper:
<MAP>Id =0<Children>null<\Children><Parent><\Parent>
<\MAP>
2021-10-22 09:20:37,469 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: Initializing operator TS[0]
2021-10-22 09:20:37,469 INFO [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: Initializing operator SEL[3]
2021-10-22 09:20:37,469 INFO [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: Initializing operator FS[4]
2021-10-22 09:20:37,470 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Using serializer : class org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe[[[B@39f46052]:[_col0, _col1]:[int, string]] and formatter : org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat@555ce525
2021-10-22 09:20:37,472 INFO [LocalJobRunner Map Task Executor #0] exec.Utilities: PLAN PATH = file:/tmp/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10003/5085a53b-0047-4049-aee5-d3d824ab6a95/map.xml
2021-10-22 09:20:37,480 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Final Path: FS hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/_tmp.-mr-10000/000000_0
2021-10-22 09:20:37,480 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: Writing to temp file: FS hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/_task_tmp.-mr-10000/_tmp.000000_0
2021-10-22 09:20:37,480 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: New Final Path: FS hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/_tmp.-mr-10000/000000_0
2021-10-22 09:20:37,489 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 1
2021-10-22 09:20:37,490 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 10
2021-10-22 09:20:37,490 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 100
2021-10-22 09:20:37,492 INFO [LocalJobRunner Map Task Executor #0] vector.VectorMapOperator: DESERIALIZE_ERRORS:0, RECORDS_OUT_INTERMEDIATE:0, RECORDS_IN:500, RECORDS_OUT_OPERATOR_MAP_0:0,
2021-10-22 09:20:37,492 INFO [LocalJobRunner Map Task Executor #0] exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_TS_0:500,
2021-10-22 09:20:37,492 INFO [LocalJobRunner Map Task Executor #0] vector.VectorSelectOperator: RECORDS_OUT_OPERATOR_SEL_3:500, RECORDS_OUT_INTERMEDIATE:0,
2021-10-22 09:20:37,492 INFO [LocalJobRunner Map Task Executor #0] exec.FileSinkOperator: FS[4]: records written - 500
2021-10-22 09:20:37,531 INFO [LocalJobRunner Map Task Executor #0] vector.VectorFileSinkOperator: RECORDS_OUT_OPERATOR_FS_4:500, RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_1:500,
2021-10-22 09:20:37,532 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner:
2021-10-22 09:20:37,535 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task:attempt_local1497044033_0002_m_000000_0 is done. And is in the process of committing
2021-10-22 09:20:37,536 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: hdfs://hadoop102:8020/user/hive/warehouse/pokes/kv1.txt:0+5812
2021-10-22 09:20:37,536 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Task 'attempt_local1497044033_0002_m_000000_0' done.
2021-10-22 09:20:37,536 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: m CountersFILE: Number of bytes read=81257687FILE: Number of bytes written=83729159FILE: Number of read operations=0FILE: Number of large read operations=0FILE: Number of write operations=0HDFS: Number of bytes read=11603HDFS: Number of bytes written=17103HDFS: Number of read operations=54HDFS: Number of large read operations=0HDFS: Number of write operations=22HDFS: Number of bytes read erasure-coded=0Map-Reduce FrameworkMap input records=500Map output records=0Input split bytes=209Spilled Records=0Failed Shuffles=0Merged Map outputs=0GC time elapsed (ms)=0Total committed heap usage (bytes)=163270656HIVECREATED_FILES=1DESERIALIZE_ERRORS=0RECORDS_IN=500RECORDS_OUT_1=500RECORDS_OUT_INTERMEDIATE=0RECORDS_OUT_OPERATOR_FS_4=500RECORDS_OUT_OPERATOR_MAP_0=0RECORDS_OUT_OPERATOR_SEL_3=500RECORDS_OUT_OPERATOR_TS_0=500File Input Format Counters Bytes Read=0File Output Format Counters Bytes Written=0
2021-10-22 09:20:37,536 INFO [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner: Finishing task: attempt_local1497044033_0002_m_000000_0
2021-10-22 09:20:37,536 INFO [Thread-23] mapred.LocalJobRunner: map task executor complete.
2021-10-22 09:20:38,439 Stage-1 map = 100%, reduce = 0%
2021-10-22 09:20:38,439 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: 2021-10-22 09:20:38,439 Stage-1 map = 100%, reduce = 0%
Ended Job = job_local1497044033_0002
2021-10-22 09:20:38,441 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Ended Job = job_local1497044033_0002
2021-10-22 09:20:38,459 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Starting task [Stage-0:MOVE] in serial mode
2021-10-22 09:20:38,459 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Cleaning up thread local RawStore...
2021-10-22 09:20:38,459 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Cleaning up thread local RawStore...
2021-10-22 09:20:38,460 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Done cleaning up thread local RawStore
2021-10-22 09:20:38,460 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=Done cleaning up thread local RawStore
Moving data to local directory /tmp/local_out
2021-10-22 09:20:38,460 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Task: Moving data to local directory /tmp/local_out from hdfs://hadoop102:8020/tmp/hive/hadoop/51408bd7-50c8-4a43-954e-a1517b55ac60/hive_2021-10-22_09-20-36_964_3191088301170901390-1/-mr-10000
2021-10-22 09:20:38,460 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: /tmp/local_out
MapReduce Jobs Launched:
2021-10-22 09:20:38,472 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: MapReduce Jobs Launched:
Stage-Stage-1: HDFS Read: 11603 HDFS Write: 17103 SUCCESS
2021-10-22 09:20:38,472 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Stage-Stage-1: HDFS Read: 11603 HDFS Write: 17103 SUCCESS
Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:20:38,472 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Total MapReduce CPU Time Spent: 0 msec
2021-10-22 09:20:38,472 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed executing command(queryId=hadoop_20211022092036_e9ef4a3f-84da-4fd6-b2fa-1b43104c6797); Time taken: 1.308 seconds
OK
2021-10-22 09:20:38,472 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: OK
2021-10-22 09:20:38,472 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
Time taken: 1.521 seconds
2021-10-22 09:20:38,477 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] CliDriver: Time taken: 1.521 seconds
2021-10-22 09:20:38,477 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:20:38,477 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] session.SessionState: Resetting thread name to mainhive> create table events as SELECT a.bar, count(*) FROM invites a WHERE a.foo > 0 GROUP BY a.bar;
2021-10-22 09:25:40,003 INFO [main] conf.HiveConf: Using the default value passed in for log id: 51408bd7-50c8-4a43-954e-a1517b55ac60
2021-10-22 09:25:40,003 INFO [main] session.SessionState: Updating thread name to 51408bd7-50c8-4a43-954e-a1517b55ac60 main
2021-10-22 09:25:40,004 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Compiling command(queryId=hadoop_20211022092540_2175849b-d1d7-41de-beb8-59afdc172bc6): create table events as SELECT a.bar, count(*) FROM invites a WHERE a.foo > 0 GROUP BY a.bar
2021-10-22 09:25:40,020 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: Opening raw store with implementation class:org.apache.hadoop.hive.metastore.ObjectStore
2021-10-22 09:25:40,020 WARN [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: datanucleus.autoStartMechanismMode is set to unsupported value null . Setting it to value: ignored
2021-10-22 09:25:40,020 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: ObjectStore, initialize called
2021-10-22 09:25:40,031 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.MetaStoreDirectSql: Using direct SQL, underlying DB is MYSQL
2021-10-22 09:25:40,032 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.ObjectStore: Initialized ObjectStore
2021-10-22 09:25:40,032 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.RetryingMetaStoreClient: RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient ugi=hadoop (auth:SIMPLE) retries=1 delay=1 lifetime=0
2021-10-22 09:25:40,032 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-10-22 09:25:40,032 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Starting Semantic Analysis
2021-10-22 09:25:40,033 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Creating table default.events position=13
2021-10-22 09:25:40,034 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.events
2021-10-22 09:25:40,034 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.events
2021-10-22 09:25:40,041 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,041 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,047 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed phase 1 of Semantic Analysis
2021-10-22 09:25:40,047 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:25:40,048 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:25:40,048 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 09:25:40,072 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:25:40,072 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:25:40,072 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,073 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,079 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] common.FileUtils: Creating directory if it doesn't exist: hdfs://hadoop102:8020/user/hive/warehouse/.hive-staging_hive_2021-10-22_09-25-40_016_3824792441440869218-1
2021-10-22 09:25:40,090 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed getting MetaData in Semantic Analysis
2021-10-22 09:25:40,094 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_not_null_constraints : tbl=hive.default.invites
2021-10-22 09:25:40,094 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_not_null_constraints : tbl=hive.default.invites
2021-10-22 09:25:40,099 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:25:40,099 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 09:25:40,104 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_primary_keys : tbl=hive.default.invites
2021-10-22 09:25:40,104 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_primary_keys : tbl=hive.default.invites
2021-10-22 09:25:40,108 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_unique_constraints : tbl=hive.default.invites
2021-10-22 09:25:40,109 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_unique_constraints : tbl=hive.default.invites
2021-10-22 09:25:40,113 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 09:25:40,113 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_foreign_keys : parentdb=null parenttbl=null foreigndb=default foreigntbl=invites
2021-10-22 09:25:40,185 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_partitions : tbl=hive.default.invites
2021-10-22 09:25:40,185 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_partitions : tbl=hive.default.invites
2021-10-22 09:25:40,232 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Creating table default.events position=13
2021-10-22 09:25:40,232 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.events
2021-10-22 09:25:40,232 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.events
2021-10-22 09:25:40,236 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,237 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,242 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for source tables
2021-10-22 09:25:40,242 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_table : tbl=hive.default.invites
2021-10-22 09:25:40,242 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_table : tbl=hive.default.invites
2021-10-22 09:25:40,268 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for subqueries
2021-10-22 09:25:40,268 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Get metadata for destination tables
2021-10-22 09:25:40,269 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,269 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,283 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,283 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,289 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: CBO Succeeded; optimized logical plan.
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FS(7)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(6)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for GBY(5)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for RS(4)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for GBY(3)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for SEL(2)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for FIL(1)
2021-10-22 09:25:40,290 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ppd.OpProcFactory: Processing for TS(0)
2021-10-22 09:25:40,293 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] optimizer.ColumnPrunerProcFactory: RS 4 oldColExprMap: {KEY._col0=Column[_col0], VALUE._col0=Column[_col1]}
2021-10-22 09:25:40,293 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] optimizer.ColumnPrunerProcFactory: RS 4 newColExprMap: {KEY._col0=Column[_col0], VALUE._col0=Column[_col1]}
2021-10-22 09:25:40,295 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,295 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,301 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] metastore.HiveMetaStore: 0: get_database: @hive#default
2021-10-22 09:25:40,302 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] HiveMetaStore.audit: ugi=hadoop ip=unknown-ip-addr cmd=get_database: @hive#default
2021-10-22 09:25:40,329 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Examining input format to see if vectorization is enabled.
2021-10-22 09:25:40,329 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vectorization is enabled for input format(s) [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:25:40,329 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Validating and vectorizing MapWork... (vectorizedVertexNum 0)
2021-10-22 09:25:40,337 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Vector GROUP BY operator will use processing mode HASH
2021-10-22 09:25:40,347 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorization enabled: true
2021-10-22 09:25:40,347 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorized: true
2021-10-22 09:25:40,347 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map vectorizedVertexNum: 0
2021-10-22 09:25:40,347 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map enabledConditionsMet: [hive.vectorized.use.vector.serde.deserialize IS true]
2021-10-22 09:25:40,347 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Map inputFileFormatClassNameSet: [org.apache.hadoop.mapred.TextInputFormat]
2021-10-22 09:25:40,348 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reduce vectorization enabled: false
2021-10-22 09:25:40,348 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reduce vectorized: false
2021-10-22 09:25:40,348 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reduce vectorizedVertexNum: 1
2021-10-22 09:25:40,348 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reducer hive.vectorized.execution.reduce.enabled: true
2021-10-22 09:25:40,348 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] physical.Vectorizer: Reducer engine: mr
2021-10-22 09:25:40,353 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-15 length: 5791 file count: 1 directory count: 1
2021-10-22 09:25:40,353 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] exec.Utilities: Cache Content Summary for hdfs://hadoop102:8020/user/hive/warehouse/invites/ds=2008-08-08 length: 216 file count: 1 directory count: 1
Automatically selecting local only mode for query
2021-10-22 09:25:40,353 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Automatically selecting local only mode for query
2021-10-22 09:25:40,355 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] parse.CalcitePlanner: Completed plan generation
2021-10-22 09:25:40,355 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Semantic Analysis Completed (retrial = false)
2021-10-22 09:25:40,355 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:a.bar, type:string, comment:null), FieldSchema(name:_c1, type:bigint, comment:null)], properties:null)
2021-10-22 09:25:40,355 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] ql.Driver: Completed compiling command(queryId=hadoop_20211022092540_2175849b-d1d7-41de-beb8-59afdc172bc6); Time taken: 0.351 seconds
2021-10-22 09:25:40,356 INFO [51408bd7-50c8-4a43-954e-a1517b55ac60 main] reexec.ReExecDriver: Execution #1 of query
2021-10-22 09:25:40,356 INFO [51408bd7-50c8-
 续前节 windows平台使用Docker搭建分布式hadoop集群 安装分布式Spark篇 1. 运行wi ...
- 如何使用Docker安装Mycat中间件 | 实现主从的读写分离，搭建属于你的Mysql 集群 | 来看看这篇吧
上一篇写了如何使用Docker搭建Mysql的主从复制,这篇文章是在已经搭建好Mysql的主从复制的基础上实现读写分离的. 直接CV也能搭建起来,莫慌. 我们一起加油!!! 只要有docker的环境就 ...
- ubuntu mysql集群搭建_ubuntu server部署mysql集群
简介 [说明本次部署的内容,目的等等] 本部署文档的目的是如何在ubuntu server上进行mysql的群集部署. 前期准备 在进行本文档操作前,需要完成如下前期步骤: 1.安装3台ubuntu ...
- mysql mmm搭建_搭建mysql-mmm高可用MySQL集群
实验需求:配置mysql-mmm,实现mysql的高可用 MySQL-MMM实现MySQL高可用 http://www.linuxidc.com/Linux/2014-02/96994.htm MyS ...
- windows+mysql集群搭建-三分钟搞定集群
一.集群了解 计算机一级考试系统要用集群,目标是把集群搭建起来,保证一个库dang了,不会影响程序的运行.首先看了一些关于集群的资料,然后根据步骤一步步的整,遇到了一些问题,在这里把我遇到的问题以及解 ...
- 二进制安装mysql集群_实战mysql集群搭建（一）--centos7下二进制安装mysql-5.6
在超哥的帮助下,完成了基于InnoDb数据引擎的mysql数据库集群搭建,实现了主从复制的功能,本篇博文介绍如何使用二进制安装mysql的方法,具体实现步骤如下: 软件使用说明: Liunx系统:ce ...
- 数据库应用——MyCat代理MySQL集群
MyCat代理MySQL集群 一.MyCat代理MySQL集群 1.1 MyCat概述 1.2 MyCat功能 1.3 MyCat图示 二.Mycat实战详解 2.1 MyCat实战案例 2.1.1 ...
- mysql集群安装(centos)
永不放弃,一切皆有可能!!! 只为成功找方法,不为失败找借口! mysql集群安装(centos) mysql cluster : 1. 基于NDB Cluster 的分布式数据库系统 2. mysq ...
- mysql集群多管理节点_项目进阶 之 集群环境搭建（三）多管理节点MySQL集群
多管理节点MySQL的配置很easy,仅须要改动之前的博文中提高的三种节点的三个地方. 1)改动管理节点配置 打开管理节点C:\mysql\bin下的config.ini文件,将当中ndb_mgmd的 ...
最新文章
- bash: 无法为立即文档创建临时文件: 权限不够_世界顶级Linux大牛耗时三年总结出3000页Linux文档...
- 视频图像处理基础知识4（视频分辨率参考 行频 隔行扫描 逐行扫描）【转】
- 通俗大白话来理解TCP协议的三次握手和四次分手
- CF--思维练习--CodeForces - 219C Color Stripe （思维）
- 收入和贷款有什么关系？
- Cannot find or open the PDB file
- virtualbox ubuntu 18.04网络设置
- 孪生网络Dataset
- centos7环境下mysql5.7的安装与配置
- html计算选定的金额,计算总金额
- 通过汉诺塔深入理解递归流程。
- 期末复习概率论与数理统计时遇到的那些证明题
- html 设置表格打印宽度设置,html表格怎么设置宽度
- Postgresql模糊查询插件pg_bigm安装
- wps公式如何加序号_WPS表格技巧—筛选后也会自动连续的序号
- 用python画小仓鼠教程_看看萌萌哒的仓鼠是怎么画出来的，最详细的图文教程，别错过！...
- 租用国外服务器推荐哪一个？
- 《SQL基础》06. 函数
- HDCTF-2nd复盘
- MySQL批量修改库、表、列的排序规则