ES：Too many open files in system

测试环境es有warn:

[o.e.g.DanglingIndicesState] [elk-app10] failed to list dangling indices
java.nio.file.FileSystemException: /data/elasticsearch/data/nodes/0/indices: Too many open files in system
   at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) ~[?:?]
   at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
   at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
   at sun.nio.fs.UnixFileSystemProvider.newDirectoryStream(UnixFileSystemProvider.java:427) ~[?:?]
   at java.nio.file.Files.newDirectoryStream(Files.java:457) ~[?:?]
   at org.elasticsearch.env.NodeEnvironment.availableIndexFoldersForPath(NodeEnvironment.java:901) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.env.NodeEnvironment.availableIndexFolders(NodeEnvironment.java:867) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.gateway.MetaStateService.loadIndicesStates(MetaStateService.java:89) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.gateway.DanglingIndicesState.findNewDanglingIndices(DanglingIndicesState.java:137) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.gateway.DanglingIndicesState.findNewAndAddDanglingIndices(DanglingIndicesState.java:122) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.gateway.DanglingIndicesState.processDanglingIndices(DanglingIndicesState.java:87) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.gateway.DanglingIndicesState.clusterChanged(DanglingIndicesState.java:191) ~[elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.cluster.service.ClusterApplierService.lambda$callClusterStateListeners$7(ClusterApplierService.java:495) ~[elasticsearch-6.7.1.jar:6.7.1]
   at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) [?:?]
   at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) [?:?]
   at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) [?:?]
   at org.elasticsearch.cluster.service.ClusterApplierService.callClusterStateListeners(ClusterApplierService.java:492) [elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:475) [elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:419) [elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:163) [elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:681) [elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-6.7.1.jar:6.7.1]
   at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-6.7.1.jar:6.7.1]
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:?]
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:?]
   at java.lang.Thread.run(Thread.java:745) [?:?]

这是因为系统打开的文件太多了，可以用ulimit -a查看当前系统文件最大打开数

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 191525
max locked memory       (kbytes, -l) unlimited
max memory size         (kbytes, -m) unlimited
open files                      (-n) 512000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 512000
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

栏open files不是默认的1024，没毛病。

lsof |wc -l

可以看已经打开文件数量。8万了。

file-max是设置系统所有进程一共可以打开的文件数量。

再看看：cat /proc/sys/fs/file-max

65536

这个小了。还需要改。

echo 52000 > /proc/sys/fs/file-max

再来看看，cat /proc/sys/fs/file-max
52000

通常线上环境不会出现这种问题，运维都会提前配好了。

ES：Too many open files in system相关推荐

too many open files in system报错处理方案
too many open files in system报错处理方案这样的系统问题可以在终端这样解决: 查看文件限制 // 查看文件限制 launchctl limit maxfiles // m ...
ADDS：启用 Advanced Offline Files
注意,以下内容适用于客户端计算机必须运行 Windows 8 或 Windows Server 2012,或以上操作系统. 1.启用对 Folder Redirection 的优化移动: 1)组策略效 ...
ElasticSearch系列 - SpringBoot整合ES：多个精确值查询 terms
文章目录 01. ElasticSearch terms 查询支持的数据类型 02. ElasticSearch term和 terms 查询的区别 03. ElasticSearch terms 查 ...
virtualbox虚拟机安装Ubuntu异常处理：FATAL: NO bootable medium found! System halted
异常:FATAL: NO bootable medium found! System halted. 问题原因:没有用iso文件来安装系统解决方案: 1.去Ubuntu官网下载Ubuntu镜像ISO ...
错误：没有找到合适的设备：没有找到可用于链接System eth0 的设备
弹出界面eth0: 错误:没有找到合适的设备:没有找到可用于链接'System eth0'的设备今天在使用putty连接linux6.0系统远程的时候,重启网卡的时候发现此报错: 报错截图如下: ...
论文精读：XGBoost: A Scalable Tree Boosting System
论文下载地址:XGBoost: A Scalable Tree Boosting System 一句话讲: 读前先问读论文之前首先要问几个问题: 这篇论文大方向的目标是什么? 机器学习中的有监督学习 ...
OpenSIPS实战（八）：修改sip消息-使用lumps system
本文转载自我的公众号Code2Fun 目录前言 1.lumps system简介 2.lumps system函数接口 2.1 创建指定被操作lumps的函数 2.2 创建用于新插入或替换lumps ...
Dell（戴尔）笔记本加装内存条后出现警告：“Warning Message ： Alter！The amount of system memory has changed”
Dell(戴尔)笔记本加装内存条后出现警告:"Warning Message : Alter!The amount of system memory has changed",点击 ...
报错：Elsevier LaTeX编译：Mismatched LaTeX support files detected
报错在editorialmanager.com提交论文的时候,需要给网站提交latex源文件,然后系统会编译好pdf.但是今天编译的时候遇到了一些问题,导致编译出来的pdf是错误log而不是正确的论 ...

ES：Too many open files in system

ES：Too many open files in system相关推荐

最新文章

热门文章