尚硅谷大数据superset安装包冲突

一、安装Miniconda

下载Miniconda（Python3版本）

下载地址：https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh
执行以下命令进行安装，并按照提示操作，直到安装完成。
```
bash Miniconda3-latest-Linux-x86_64.sh
```
在安装过程中，出现以下提示时，可以指定安装路径

加载环境变量配置文件，使之生效
```
source ~/.bashrc
```

取消激活base环境

conda config --set auto_activate_base false

二、创建Python3.7环境

配置conda国内镜像

conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/free
conda config --add channels https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
conda config --set show_channel_urls yes

创建Python3.9环境

conda create --name superset python=3.9

激活superset环境
```
conda activate superset
```

三、Superset部署

安装Superset之前，需安装以下所需依赖

sudo yum install -y gcc gcc-c++ libffi-devel python-devel python-pip python-wheel python-setuptools openssl-devel cyrus-sasl-devel openldap-devel

安装superset

安装（更新）setuptools和pip

pip install --upgrade setuptools pip -i https://pypi.douban.com/simple/

安装superset

pip install apache-superset -i https://pypi.douban.com/simple/

初始化supetset数据库superset db upgrade出现如下错误

Failed to create app
Traceback (most recent call last):File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/app.py", line 37, in create_appapp_initializer.init_app()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 460, in init_appself.init_app_in_ctx()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 409, in init_app_in_ctxself.configure_url_map_converters()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 508, in configure_url_map_convertersfrom superset.utils.url_map_converters import (File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/utils/url_map_converters.py", line 21, in <module>from superset.models.tags import ObjectTypesFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/models/__init__.py", line 17, in <module>from . import core, datasource_access_request, dynamic_plugins, sql_lab, user_attributesFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/models/core.py", line 63, in <module>from superset.utils import cache as cache_util, core as utilsFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/utils/cache.py", line 28, in <module>from werkzeug.wrappers.etag import ETagResponseMixin
ModuleNotFoundError: No module named 'werkzeug.wrappers.etag'

解决办法：一定要先统一Flask和Werkzeug框架的版本，不然问题还是无法解决

pip uninstall Flask
pip uninstall Werkzeugpip install Flask==2.0.2
pip install Werkzeug==2.0.2

再次进行初始化出现superset db upgrade

出现如下错误：

--------------------------------------------------------------------------------WARNING
--------------------------------------------------------------------------------
A Default SECRET_KEY was detected, please use superset_config.py to override it.
Use a strong complex alphanumeric string and use a tool to help you generate
a sufficiently random sequence, ex: openssl rand -base64 42
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
logging was configured successfully
2022-09-30 15:19:27,622:INFO:superset.utils.logging_configurator:logging was configured successfully
2022-09-30 15:19:27,644:INFO:root:Configured event logger of type <class 'superset.utils.log.DBEventLogger'>
Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `FILTER_STATE_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
2022-09-30 15:19:27,651:WARNING:superset.utils.cache_manager:Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `FILTER_STATE_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `EXPLORE_FORM_DATA_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
2022-09-30 15:19:27,658:WARNING:superset.utils.cache_manager:Falling back to the built-in cache, that stores data in the metadata database, for the following cache: `EXPLORE_FORM_DATA_CACHE_CONFIG`. It is recommended to use `RedisCache`, `MemcachedCache` or another dedicated caching backend for production deployments
No PIL installation found
2022-09-30 15:19:27,987:INFO:superset.utils.screenshots:No PIL installation found
Failed to create app
Traceback (most recent call last):File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/app.py", line 37, in create_appapp_initializer.init_app()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 460, in init_appself.init_app_in_ctx()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 410, in init_app_in_ctxself.configure_data_sources()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 476, in configure_data_sourcesConnectorRegistry.register_sources(module_datasource_map)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/connector_registry.py", line 42, in register_sourcesmodule_obj = __import__(module_name, fromlist=class_names)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/sqla/__init__.py", line 17, in <module>from . import models, viewsFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/sqla/views.py", line 28, in <module>from wtforms.ext.sqlalchemy.fields import QuerySelectField
ModuleNotFoundError: No module named 'wtforms.ext'
2022-09-30 15:19:28,607:ERROR:superset.app:Failed to create app
Traceback (most recent call last):File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/app.py", line 37, in create_appapp_initializer.init_app()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 460, in init_appself.init_app_in_ctx()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 410, in init_app_in_ctxself.configure_data_sources()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 476, in configure_data_sourcesConnectorRegistry.register_sources(module_datasource_map)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/connector_registry.py", line 42, in register_sourcesmodule_obj = __import__(module_name, fromlist=class_names)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/sqla/__init__.py", line 17, in <module>from . import models, viewsFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/sqla/views.py", line 28, in <module>from wtforms.ext.sqlalchemy.fields import QuerySelectField
ModuleNotFoundError: No module named 'wtforms.ext'
Traceback (most recent call last):File "/home/hdfs/miniconda3/envs/superset/bin/superset", line 8, in <module>sys.exit(superset())File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/click/core.py", line 1130, in __call__return self.main(*args, **kwargs)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/flask/cli.py", line 600, in mainreturn super().main(*args, **kwargs)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/click/core.py", line 1055, in mainrv = self.invoke(ctx)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/click/core.py", line 1654, in invokesuper().invoke(ctx)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/click/core.py", line 1404, in invokereturn ctx.invoke(self.callback, **ctx.params)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/click/core.py", line 760, in invokereturn __callback(*args, **kwargs)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/click/decorators.py", line 26, in new_funcreturn f(get_current_context(), *args, **kwargs)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/flask/cli.py", line 443, in decoratorwith __ctx.ensure_object(ScriptInfo).load_app().app_context():File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/flask/cli.py", line 406, in load_appapp = locate_app(self, import_name, name)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/flask/cli.py", line 276, in locate_appreturn find_best_app(script_info, module)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/flask/cli.py", line 68, in find_best_appapp = call_factory(script_info, app_factory)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/flask/cli.py", line 123, in call_factoryreturn app_factory(*args, **kwargs)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/app.py", line 44, in create_appraise exFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/app.py", line 37, in create_appapp_initializer.init_app()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 460, in init_appself.init_app_in_ctx()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 410, in init_app_in_ctxself.configure_data_sources()File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/initialization/__init__.py", line 476, in configure_data_sourcesConnectorRegistry.register_sources(module_datasource_map)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/connector_registry.py", line 42, in register_sourcesmodule_obj = __import__(module_name, fromlist=class_names)File "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/sqla/__init__.py", line 17, in <module>from . import models, viewsFile "/home/hdfs/miniconda3/envs/superset/lib/python3.9/site-packages/superset/connectors/sqla/views.py", line 28, in <module>from wtforms.ext.sqlalchemy.fields import QuerySelectField
ModuleNotFoundError: No module named 'wtforms.ext'

安装如下包即可解决

pip install WTForms==2.3.3

创建管理员用户

export FLASK_APP=superset
superset fab create-admin

superset初始化
```
superset init
```

四、启动Supterset

安装gunicorn

pip install gunicorn -i https://pypi.douban.com/simple/

启动

gunicorn --workers 5 --timeout 120 --bind hadoop:8787  "superset.app:create_app()" --daemon

停止

ps -ef | awk '/superset/ && !/awk/{print $2}' | xargs kill -9

尚硅谷大数据superset安装包冲突相关推荐

尚硅谷大数据项目之电商数仓（4即席查询数据仓库）
尚硅谷大数据项目之电商数仓(即席查询) (作者:尚硅谷大数据研发部) 版本:V4.0 第1章 Presto 1.1 Presto简介 1.1.1 Presto概念 1.1.2 Presto架构 1.1 ...
电商数仓描述_笔记-尚硅谷大数据项目数据仓库-电商数仓V1.2新版
架构项目框架数仓架构存储压缩 Snappy与LZO LZO安装: 读取LZO文件时,需要先创建索引,才可以进行切片. 框架版本选型Apache:运维麻烦,需要自己调研兼容性. CDH:国内使用最 ...
2019尚硅谷大数据Maven篇一 Maven安装和概念
2019尚硅谷大数据Maven篇一安装和概念 tags: golang 2019尚硅谷 categories: java Maven 安装依赖概念文章目录 2019尚硅谷大数据Maven篇一安装 ...
《尚硅谷大数据Hadoop》教程
尚硅谷大数据Hadoop教程概论入门 HDFS MapReduce YARN 由于对这方面的知识只是做一个了解,所以详细的东西并不会做笔记. 概论大数据的特点海量.高速.多样.低价值密度入门 ...
尚硅谷大数据视频_Hive视频教程
这次分享的是尚硅谷大数据教程视频的第五份--Hive Hive是基于Hadoop的一个数据仓库工具,将繁琐的MapReduce程序变成了简单方便的SQL语句实现,深受广大软件开发工程师喜爱.Hive同 ...
尚硅谷大数据Hadoop教程（Hadoop 3.x）P46遇到的问题
尚硅谷大数据Hadoop教程(Hadoop 3.x)P46 遇到的问题零基础跟着课程在学,在这一节的时候直接从搭建的集群到了IDEA,给我整懵了. 下面说一下我的解决方法: 对于我这个没学java的 ...
2019尚硅谷大数据Javaweb篇三 Ajax、JSTL、会话技术、过滤器、监听器、xml、json
2019尚硅谷大数据 Javaweb篇三Ajax.JSTL.会话技术.过滤器.监听器 tags: 大数据 2019尚学堂 categories: Ajax异步请求 JSTL中的if和forEach 会 ...
尚硅谷大数据技术之电商用户行为数据分析
尚硅谷大数据技术之电商用户行为分析第1章项目整体介绍 1.1 电商的用户行为电商平台中的用户行为频繁且较复杂,系统上线运行一段时间后,可以收集到大量的用户行为数据,进而利用大数据技术进行深入挖掘 ...
尚硅谷大数据技术Zookeeper教程-笔记01【Zookeeper(入门、本地安装、集群操作)】
视频地址:[尚硅谷]大数据技术之Zookeeper 3.5.7版本教程_哔哩哔哩_bilibili 尚硅谷大数据技术Zookeeper教程-笔记01[Zookeeper(入门.本地安装.集群操作)] ...

尚硅谷大数据superset安装包冲突

尚硅谷大数据superset安装包冲突

一、安装Miniconda

二、创建Python3.7环境

三、Superset部署

四、启动Supterset

尚硅谷大数据superset安装包冲突相关推荐

最新文章

热门文章