assertion failed:concurrent update to the log .mutiple streaming jobs delete 4
1. 背景
Spark Structured Streaming 读取kafka，然后进行转换，最后写入到kafka中，中间运行的时候出现这个，但是清除checkpoin目录后，就可以正常使用。
错误代码：
assertion failed:concurrent update to the log .mutiple streaming jobs delete
2. 源码定位
spark 2.3版本
org.apache.spark.sql.execution.streaming.MicroBatchExecution#constructNextBatchupdateStatusMessage("Writing offsets to log")reportTimeTaken("walCommit") {assert(offsetLog.add(currentBatchId,availableOffsets.toOffsetSeq(sources, offsetSeqMetadata)),assertion failed:concurrent update to the log .mutiple streaming jobs delete 4相关推荐
- 启动jenkins解锁后，报错“Failed to update the default Update Site 'default'”
报错信息: // 报错信息 2019-11-05 02:01:43.970+0000 [id=40] INFO hudson.util.Retrier#start: The attempt #1 to ...
- [Bug集合]ASSERTION FAILED Call to publish() on an invalid Publisher
Bug报错内容 [FATAL] [1602947663.246764362]: ASSERTION FAILED file = /opt/ros/kinetic/include/ros/pub ...
- Assertion failed: (KALDI_ISFINITE(sigma) “Tridiagonalizing matrix that is too large or has NaNs.“
kaldi中aishell案例s5,进行tdnn训练时报错: bash: line 1: 9006 Aborted (core dumped) ( nnet3-train --use-gpu=wait ...
- eltwise_layer.cpp:170: error: (-215:Assertion failed) inputs.size() = 2 in function 'cv::dnn::Eltwi
eltwise_layer.cpp:170: error: (-215:Assertion failed) inputs.size() >= 2 in function 'cv::dnn::El ...
- solvepnp.cpp:92: error: (-215:Assertion failed) ( (npoints = 4) || (npoints == 3
执行代码 Calib3d.solvePnP(object_pts, image_pts, cameraMatrix, distCoeffs, rvec, tvec); 时报错: sol ...
- (-215:Assertion failed) dst.data == (uchar*)dst_ptr in function 'cvShowImage'
(-215:Assertion failed) dst.data == (uchar*)dst_ptr in function 'cvShowImage' 原因:图像只支持uint8类型数据,正确代码 ...
- debug assertion failed!报错
debug assertion failed!报错.如下图所示,这类报错的原因有很多,我的代码里面报错为 this->SetWindowText("SN串口下载工具");这句 ...
- 出现opencv error: assertion failed..........错误时， 一步解决
运行时出现错误提示: OpenCV<3.4.2> Error: Assertion failed ((flags & FIXED_TYPE) != 0) in cv::debug_ ...
- 成功解决OpenCV Error: Assertion failed (ssize.width 0 ssize.height 0) in cv::resize, file C:\proj
成功解决OpenCV Error: Assertion failed (ssize.width > 0 && ssize.height > 0) in cv::resize ...
最新文章
- 简述BT下载技术及其公司发展现状
- Spring 注解 @Resource和@Autowired（转）
- java jolt调用tuxedo_Jolt调用Tuxedo服务,该怎么处理
- numpy(3)-numpy.random.random() ,random_sample()连续均匀分布
- opengl加载显示3D模型FBX类型文件)
- 技术MBA高科技企业的“宠儿”
- 3d打印英语文献_【玩手工学英语】形状主题：The 3D Shapes Song
- meta你到底了解多少
- python下载包没用_Python下载各种功能包出问题
- linux系统中看视频,怎么在linux里看视频啊？
- 衡量高分辨率图片生成效果的指标PSNR/SSIM
- SPSS入门教程—日期类型的变量转换
- linux下文件去重
- matlab实现卷积编码与viterbi译码
- java微信企业号接入_java微信企业号接入开发
- 企业如何选择短信平台
- 流星加速器木马分析与处置方案
- NLP最简单中文分词介绍
- php 实现我的足迹,Wordpress 实现“您的足迹”功能
- 怎么恢复苹果内置的计算机,苹果自带软件删了怎么恢复原状