Kylin下构建Cube第一步出错：shell-init: error retrieving current directory

问题背景：
生产环境部署的Kylin-2.1，官方发布的最新安装包并不支持更改hbase存储的namespace，修改源码后重新打包部署过程中，build cube第一步出错

大概错误信息是：

OS command error exit with 5 – hive -e "USE default;
DROP TABLE IF EXISTS kylin_intermediate_kylin_sales_cube_desc_20120101000000_20160502000000;
CREATE EXTERNAL TABLE IF NOT EXISTS kylin_intermediate_kylin_sales_cube_desc_20120101000000_20160502000000
(
DEFAULT_KYLIN_SALES_PART_DT date
,DEFAULT_KYLIN_SALES_LEAF_CATEG_ID bigint
,DEFAULT_KYLIN_SALES_LSTG_SITE_ID int
,DEFAULT_KYLIN_CATEGORY_GROUPINGS_META_CATEG_NAME string
,DEFAULT_KYLIN_CATEGORY_GROUPINGS_CATEG_LVL2_NAME string
,DEFAULT_KYLIN_CATEGORY_GROUPINGS_CATEG_LVL3_NAME string
,DEFAULT_KYLIN_SALES_LSTG_FORMAT_NAME string
,DEFAULT_KYLIN_SALES_PRICE decimal(19,4)
,DEFAULT_KYLIN_SALES_SELLER_ID bigint
)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\177'
STORED AS SEQUENCEFILE
LOCATION '/kylin/kylin_metadata/kylin-5020d91f-3114-421b-929b-f733d438411a/kylin_intermediate_kylin_sales_cube_desc_20120101000000_20160502000000';
SET dfs.replication=2;
SET dfs.block.size=33554432;
SET hive.exec.compress.output=true;
SET hive.auto.convert.join.noconditionaltask=true;
SET hive.auto.convert.join.noconditionaltask.size=300000000;
SET mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec;
SET mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.SnappyCodec;
SET hive.merge.mapfiles=true;
SET hive.merge.mapredfiles=true;
SET mapred.output.compression.type=BLOCK;
SET hive.merge.size.per.task=256000000;
SET hive.support.concurrency=false;
SET mapreduce.job.split.metainfo.maxsize=-1;
INSERT OVERWRITE TABLE kylin_intermediate_kylin_sales_cube_desc_20120101000000_20160502000000 SELECT
KYLIN_SALES.PART_DT
,KYLIN_SALES.LEAF_CATEG_ID
,KYLIN_SALES.LSTG_SITE_ID
,KYLIN_CATEGORY_GROUPINGS.META_CATEG_NAME
,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME
,KYLIN_CATEGORY_GROUPINGS.CATEG_LVL3_NAME
,KYLIN_SALES.LSTG_FORMAT_NAME
,KYLIN_SALES.PRICE
,KYLIN_SALES.SELLER_ID
FROM DEFAULT.KYLIN_SALES as KYLIN_SALES
INNER JOIN DEFAULT.KYLIN_CAL_DT as KYLIN_CAL_DT
ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
INNER JOIN DEFAULT.KYLIN_CATEGORY_GROUPINGS as KYLIN_CATEGORY_GROUPINGS
ON KYLIN_SALES.LEAF_CATEG_ID = KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID AND KYLIN_SALES.LSTG_SITE_ID = KYLIN_CATEGORY_GROUPINGS.SITE_ID
WHERE (KYLIN_SALES.PART_DT >= '2012-01-01' AND KYLIN_SALES.PART_DT < '2016-05-02')
;
"
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
Unable to determine Hadoop version information.
'hadoop version' returned:
shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
chdir: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
Error occurred during initialization of VM java.lang.Error: Properties init: Could not determine current working directory. at java.lang.System.initProperties(Native Method) at java.lang.System.initializeSystemClass(System.java:1119)

Kylin之前是没有问题的，构建了很多cube都没有问题，即便是出错按理讲也不会出现在第一步，第一步的动作是创建一个宽表，放到hive作为临时表。
解决思路：
第一感觉是权限问题，修改了sh脚本的执行权限，修改了hdfs上 kylin 工作目录的权限后，问题仍然存在。
重新找原因，其中有报工作目录的问题，看上去是本地目录并不是Hdfs上的目录，这才想起可能是上次重新部署Kylin的时候把旧版本的直接删除，但并没有停掉进程。

ps aux | grep kylin

查看进程查然有两个Kylin进程在跑，于是Kill掉旧的进程

突然想起之前有人误删了kylin的文件夹，所以去查看了一下，果然某一台机器下面存在两个kylin进程。kill 后重启就好了。

猜测的原因是原进程的安装目录已经不存在了，并行着两个Kylin
进程产生冲突。

Kylin下构建Cube第一步出错：shell-init: error retrieving current directory相关推荐

shell 报错 shell-init: error retrieving current directory: getcwd: cannot access parent directories
[root@web-server php]# /etc/init.d/httpd restart shell-init: error retrieving current directory: get ...
matlab帮助安装,HELP HELP 挂载到/media/matlab下后安装第一步的错误代码如下 - MATLAB Answers - MATLAB Central...
cp: 读取'/media/matlab/help/includes/shared/equationrenderer/release/equationrenderer/nls/browsercheck ...
Github注册第一步出错，最新解决方法
今天想注册一个github账号,于是乎搜到了官网.速度太慢好不容易打开填写好了,却弹出了这样的提示: Uable to verify your captcha response. Please vis ...
5.Apache Kylin 构建第一步报错 Container complete event for unknown container
版本: Apache Kylin 3.0.0 一.问题 build cube第一步(#1 Step Name: Create Intermediate Flat Hive)报错 Container c ...
7.Apache Kylin 创建cube 第一阶段报错Create Intermediate Flat Hive 报错 MapredLocalTask
文章目录一.问题二.解决一.问题版本: cdh6.2.0 kylin3.0.0 构建cube第一阶段Create Intermediate Flat Hive,报错 FAILED: Execu ...
ASO第一步-什么是ASO，与SEO的区别？
应用商店优化ASO(App Store Optimization)是提高应用商店内应用程序可视性和提高应用程序转化率的过程.主要的应用商店是iOS的应用商店和Android的Google Play.除 ...
扫雷第一步，先戳哪里最高效？
扫雷第一步,先戳哪里最高效? 解名缰 2012-06-12 16:54:49 因为第一步绝对安全,一个普通玩家就会想点哪里点哪里.其实技巧的高下之分,从第一步就已开始.点角点边还是点中间?死理性派告 ...
Kylin高级主题-Cube构建算法介绍（逐层算法和快速算法）
Apache Kylin是一个开源的分布式分析引擎,提供Hadoop之上的SQL查询接口及多维分析(OLAP)能力以支持超大规模数据.它能在亚秒内查询巨大的Hive表.本文将详细介绍Apache Ky ...
kylin如何支持flink_大数据集群运维（28） Kylin 配置使用 flink 构建 Cube
用 Flink 构建 Cube Kylin v3.1 引入了 Flink cube engine,在 build cube 步骤中使用 Apache Flink 代替 MapReduce:您可以查看 ...

Kylin下构建Cube第一步出错：shell-init: error retrieving current directory

Kylin下构建Cube第一步出错：shell-init: error retrieving current directory相关推荐

最新文章

热门文章