线上flink任务重启报错(Hadoop问题)java.lang.NumberFormatException: For input string: “30s“
2024-06-10 05:59:31
线上Flink任务重启时，提交任务失败，具体报错如下：
2021-12-31 18:09:19
java.lang.NumberFormatException: For input string: "30s"at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)at java.lang.Long.parseLong(Long.java:589)at java.lang.Long.parseLong(Long.java:631)at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1441)at org.apache.hadoop.hdfs.client.impl.DfsClientConf.<init>(DfsClientConf.java:250)at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:303)at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:287)at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:159)at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3242)at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121)at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3291)at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3259)at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:470)at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)at org.apache.iceberg.hadoop.Util.getFs(Util.java:51)at org.apache.iceberg.hadoop.HadoopOutputFile.fromPath(HadoopOutputFile.java:53)at org.apache.iceberg.hadoop.HadoopFileIO.newOutputFile(HadoopFileIO.java:64)at org.apache.iceberg.io.OutputFileFactory.newOutputFile(OutputFileFactory.java:120)at org.apache.iceberg.io.BaseTaskWriter$BaseRollingWriter.openCurrent(BaseTaskWriter.java:264)at org.apache.iceberg.io.BaseTaskWriter$BaseRollingWriter.<init>(BaseTaskWriter.java:231)at org.apache.iceberg.io.BaseTaskWriter$BaseRollingWriter.<init>(BaseTaskWriter.java:221)at org.apache.iceberg.io.BaseTaskWriter$RollingFileWriter.<init>(BaseTaskWriter.java:303)at org.apache.iceberg.io.UnpartitionedWriter.<init>(UnpartitionedWriter.java:33)at org.apache.iceberg.flink.sink.RowDataTaskWriterFactory.create(RowDataTaskWriterFactory.java:89)at org.apache.iceberg.flink.sink.IcebergStreamWriter.open(IcebergStreamWriter.java:59)at org.apache.flink.streaming.runtime.tasks.OperatorChain.initializeStateAndOpenOperators(OperatorChain.java:433)at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$beforeInvoke$2(StreamTask.java:545)at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)at org.apache.flink.streaming.runtime.tasks.StreamTask.beforeInvoke(StreamTask.java:535)at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:575)at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:758)at org.apache.flink.runtime.taskmanager.Task.run(Task.java:573)at java.lang.Thread.run(Thread.java:748)
解决方案：
在hdfs-site.xml中新增配置后
<property><name>dfs.client.datanode-restart.timeout</name><value>30</value>
</property>
问题解决
线上flink任务重启报错(Hadoop问题)java.lang.NumberFormatException: For input string: “30s“相关推荐
- mybatis 报错：Cause: java.lang.NumberFormatException: For input string: ““
mybatis 报错:Cause: java.lang.NumberFormatException: For input string: "" 问题描述 我使用的mybatis版本 ...
- mybatis 报错：Cause: java.lang.NumberFormatException: For input string
Cause: java.lang.NumberFormatException: For input string 异常提示 异常来源 异常解决 异常提示 Error querying database ...
- 报错解决:Cause: java.lang.NumberFormatException: For input string:
我的问题 mapper 判断类型出了错误 错误 正确
- 访问swagger/Knife4j 接口文档报错：java.lang.NumberFormatException: For input string: ““
目录 问题描述 解决过程 问题描述 报异常如下:java.lang.NumberFormatException: For input string: "" 虽然不影响使用,但是每次 ...
- 关于Swagger报错java.lang.NumberFormatException: For input string: 的总结
关于Swagger报错java.lang.NumberFormatException: For input string: ""的总结 1 为什么会报错? 2 如何排错? 3 哪种 ...
- swagger报错 java.lang.NumberFormatException: For input string: ““
项目中集成Swagger,每次刷新页面,都给我报一个java.lang.NumberFormatException: For input string: ""的错误,真的是犯强迫症 ...
- 关于java.lang.NumberFormatException: For input string:${redis.maxIdle}的报错
项目通用文件配置目录 reids配置文件 <?xml version="1.0" encoding="UTF-8"?> <beans xmln ...
- Mybatis报错: Error querying database. Cause: java.lang.NumberFormatException: For input string: “A“
报错信息:Error querying database. Cause: java.lang.NumberFormatException: For input string: "A" ...
- Maven项目报错:Caused by: java.lang.NoClassDefFoundError: com/fasterxml/classmate/Filter
一.问题描述 项目一运行就报错: Caused by: java.lang.NoClassDefFoundError: com/fasterxml/classmate/Filterat org.hib ...
最新文章
- SecureCRT上传下载文件
- OpenAirInterface，开源的 4G EPS 实现
- browse下载插件DownThemAll!
- javascript中的内存管理
- Vue学习（slot、axios）-学习笔记
- AWS手动创建VPC
- php获取工作日时间,ThinkPHP中获取指定日期后工作日的具体日期方法
- mavenFailed to execute goal org.apache.maven.plugins:maven-surefire-plugin解决方法
- C语言中字符串的处理方式
- [luogu3198] 玩具装箱
- android之Intent的七大属性
- 深度学习花书-2.10 PCA数学推导
- 【算法导论】第15章动态规划
- sort( )函数--R语言
- 光盘文件导入服务器,web服务器 光盘文件
- Java数据类型转换
- 树莓派硬件编程——（一）用RPi.GPIO库输出信号
- WhatsApp创始人：从领救济到身价68亿
- 红米k30pro开发者选项
- 计算机毕业设计ssm龙腾集团员工信息管理系统39r5l系统+程序+源码+lw+远程部署