[问题已处理]- kubernetes报错error creating overlay mount to xx merged- no such file or directory

导语：k8s 启动报错，通过describe pod，发现提示

Warning Failed 22s kubelet Error: Error response from daemon: error creating overlay mount to /data1/docker/lib/docker/overlay2/a119f7a409ef07f20a9b7cc912ccacbd3dfeb1bd2399f0eb7fe45f96b7c08179-init/merged: no such file or directory

只是部分容器有问题，mysql容器也需要挂载磁盘的是启动ok的，业务容器后启动就报错

网上搜了几个方法

1.在 daemon.json 中添加 “storage-driver”:“overlay”

这个不考虑，overlay都已经被overlay2替代了,官方说推荐用overlay2 代替 overlay 和devicemapper（18.09 版本中废除）以获得更高的效率和磁盘 inode 的节省。再用旧的不合适

2.在 daemon.json 中添加 “storage-driver”:“devicemapper”

不考虑

3.禁用 selinux

我没有安装selinux

尬住。

自己改了下/etc/docker/daemon.json，参考

加了个"storage-driver": “overlay2”,

        {"default-runtime": "nvidia","runtimes": {"nvidia": {"path": "/usr/bin/nvidia-container-runtime","runtimeArgs": []}},"default-shm-size": "2G","insecure-registries": ["harbor.deepwise.com","10.10.3.5","172.28.3.5"] ,"storage-driver": "overlay2","graph": "/data1/docker/lib/docker"}

修改了docker服务加了Environment=DOCKER_SELINUX=–selinux-enabled=false，也不知道是否有用。哈哈哈

[Service]
Environment=DOCKER_SELINUX=--selinux-enabled=false

我打算删除docker的graph路径或者叫data-root路径，即/data1/docker:

rm -rf /data1/docker
mkdir -p /data1/docker
# 因为上面改了配置 需要reload
systemctl daemon-reload
# 我这里想看一下debug日志
dockerd --debug
#systemctl restart docker

然后运行原来的helm命令启动服务就好了。尬住。只能说解决了问题，但是没有找到原因。记不清出问题前之前干了什么骚操作了。

记录一下比较有借鉴意义的排查过程

docker info

检查下你的 docker 信息是不是与下面的保持一致。我当时检查的时候是extfs 磁盘是ext4

 Storage Driver: overlay2Backing Filesystem: xfsSupports d_type: true

补充一下ext4 也是可以的。

# 查看磁盘位置
blkid
# 格式化磁盘,更改文件系统为xfs
mkfs.xfs /dev/sdc1

后面再出问题就通过debug看报错。

参考

https://docs.docker.com/storage/storagedriver/overlayfs-driver/

https://zhuanlan.zhihu.com/p/107643520

https://developer.aliyun.com/ask/114099

[问题已处理]- kubernetes报错error creating overlay mount to xx merged- no such file or directory相关推荐

Docker物理机重启后，docker报错 error creating overlay mount to /var/lib/docker/overlay2
昨晚公司运维说机房要停电,然后今天上午来公司发现,之前docker起的容器启动不起来了,报错 Error response from daemon: Cannot restart container ...
SpringBoot启动报错Error creating bean with name 'xx': Unsatisfied dependency expressed through field xx
错误如下: 2020-05-11 08:55:21.333 WARN 937516 --- [ main] ConfigServletWebServerApplicationContext : Exc ...
启动springboot报错Error creating bean with name 'dataSource' defined in class path resource
2019独角兽企业重金招聘Python工程师标准>>> 启动springboot报错Error creating bean with name 'dataSource' define ...
nacos的feign报错Error creating bean with name ‘configurationPropertiesBeans‘ defined in class path reso
nacos的feign报错Error creating bean with name 'configurationPropertiesBeans' defined in class path reso ...
已解决mysql报错ERROR 1049 (42000): Unknown database ‘数据库‘
已解决mysql报错ERROR 1049 (42000): Unknown database '数据库' 文章目录报错问题解决方法福利报错问题粉丝群里面的一个小伙伴敲代码时发生了报错(当时他 ...
docker 启动容器报 error creating overlay mount to /var/lib/docker/overlay2
问题: 今天用 docker 启动容器时,出现以下错误 Error response from daemon: error creating overlay mount to /var/lib/doc ...
docker容器启动失败（Error response from daemon: error creating overlay mount to /app/docker/overlay2/）
docker容器启动失败问题描述服务器断电,异常关机,重启后,发现无法正常启动docker容器,提示错误: $ docker start mysql-server Error response f ...
CentOS中输入yum报错：sudo: unable to execute /bin/yum: No such file or directory
今天尝试更新了下虚拟机CentOS中的python版本后. 运行"yum"命令,就报错:"sudo: unable to execute /bin/yum: No suc ...
解决docker启动错误 error creating overlay mount to /var/lib/docker/overlay2
原文最近在centos7.1使用docker运行redis镜像,出现下面的错误: /usr/bin/docker-current: Error response from daemon: error ...
Git报错：fatal: Unable to create ‘xx/.git/index.lock‘: File exis
一报错:fatal: Unable to create 'xx/.git/index.lock': File exis 如下: $ git commit fatal: Unable to creat ...

[问题已处理]- kubernetes报错error creating overlay mount to xx merged- no such file or directory

[问题已处理]- kubernetes报错error creating overlay mount to xx merged- no such file or directory相关推荐

最新文章

热门文章