canal 重启后不同步数据

我把canal重启了,然后不同步数据了
service中的logs/resourcesearch/resourcesearch.log文件报错

2021-03-04 09:44:22.399 [main] INFO  c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start CannalInstance for 1-resourcesearch
2021-03-04 09:44:22.410 [main] WARN  c.a.o.canal.parse.inbound.mysql.dbsync.LogEventConvert - --> init table filter : ^zhqc_aj\..*$
2021-03-04 09:44:22.411 [main] WARN  c.a.o.canal.parse.inbound.mysql.dbsync.LogEventConvert - --> init table black filter : ^mysql\.slave_.*$
2021-03-04 09:44:22.567 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] WARN  c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ---> begin to find start position, it will be long time for reset or first position
2021-03-04 09:44:22.603 [main] INFO  c.a.otter.canal.instance.core.AbstractCanalInstance - start successful....
2021-03-04 09:44:22.640 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.canal.parse.inbound.mysql.dbsync.DirectLogFetcher - I/O error while reading from client socket
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index fileat com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.seek(MysqlConnection.java:144) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findAsPerTimestampInSpecificLogFile(MysqlEventParser.java:760) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findPositionWithMasterIdAndTimestamp(MysqlEventParser.java:410) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPositionInternal(MysqlEventParser.java:455) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPosition(MysqlEventParser.java:369) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:194) [canal.parse-1.1.5-SNAPSHOT.jar:na]at java.lang.Thread.run(Thread.java:748) [na:1.8.0_275]
2021-03-04 09:44:22.641 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ERROR ## findAsPerTimestampInSpecificLogFile has an error
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index fileat com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.seek(MysqlConnection.java:144) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findAsPerTimestampInSpecificLogFile(MysqlEventParser.java:760) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findPositionWithMasterIdAndTimestamp(MysqlEventParser.java:410) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPositionInternal(MysqlEventParser.java:455) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPosition(MysqlEventParser.java:369) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:194) [canal.parse-1.1.5-SNAPSHOT.jar:na]at java.lang.Thread.run(Thread.java:748) [na:1.8.0_275]
2021-03-04 09:44:22.644 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - dump address /10.10.77.228:3306 has an error, retrying. caused by
com.alibaba.otter.canal.parse.exception.CanalParseException: [fixed timestamp] can't found begin/commit position before with fixed positionmall-mysql-bin.000001:4
2021-03-04 09:44:22.648 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:resourcesearch[com.alibaba.otter.canal.parse.exception.CanalParseException: [fixed timestamp] can't found begin/commit position before with fixed positionmall-mysql-bin.000001:4
]
2021-03-04 09:44:36.986 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] WARN  c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ---> begin to find start position, it will be long time for reset or first position
2021-03-04 09:44:36.993 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.canal.parse.inbound.mysql.dbsync.DirectLogFetcher - I/O error while reading from client socket
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index fileat com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.seek(MysqlConnection.java:144) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findAsPerTimestampInSpecificLogFile(MysqlEventParser.java:760) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findPositionWithMasterIdAndTimestamp(MysqlEventParser.java:410) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPositionInternal(MysqlEventParser.java:455) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPosition(MysqlEventParser.java:369) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:194) [canal.parse-1.1.5-SNAPSHOT.jar:na]at java.lang.Thread.run(Thread.java:748) [na:1.8.0_275]
2021-03-04 09:44:36.993 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ERROR ## findAsPerTimestampInSpecificLogFile has an error
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index fileat com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.seek(MysqlConnection.java:144) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findAsPerTimestampInSpecificLogFile(MysqlEventParser.java:760) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findPositionWithMasterIdAndTimestamp(MysqlEventParser.java:410) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPositionInternal(MysqlEventParser.java:455) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPosition(MysqlEventParser.java:369) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:194) [canal.parse-1.1.5-SNAPSHOT.jar:na]at java.lang.Thread.run(Thread.java:748) [na:1.8.0_275]
2021-03-04 09:44:36.994 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - dump address /10.10.77.228:3306 has an error, retrying. caused by
com.alibaba.otter.canal.parse.exception.CanalParseException: [fixed timestamp] can't found begin/commit position before with fixed positionmall-mysql-bin.000001:4
2021-03-04 09:44:36.995 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:resourcesearch[com.alibaba.otter.canal.parse.exception.CanalParseException: [fixed timestamp] can't found begin/commit position before with fixed positionmall-mysql-bin.000001:4
]
2021-03-04 09:44:55.618 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] WARN  c.a.o.c.p.inbound.mysql.rds.RdsBinlogEventParserProxy - ---> begin to find start position, it will be long time for reset or first position
2021-03-04 09:44:55.626 [destination = resourcesearch , address = /10.10.77.228:3306 , EventParser] ERROR c.a.o.canal.parse.inbound.mysql.dbsync.DirectLogFetcher - I/O error while reading from client socket
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index fileat com.alibaba.otter.canal.parse.inbound.mysql.dbsync.DirectLogFetcher.fetch(DirectLogFetcher.java:102) ~[canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.seek(MysqlConnection.java:144) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findAsPerTimestampInSpecificLogFile(MysqlEventParser.java:760) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findPositionWithMasterIdAndTimestamp(MysqlEventParser.java:410) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPositionInternal(MysqlEventParser.java:455) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.mysql.MysqlEventParser.findStartPosition(MysqlEventParser.java:369) [canal.parse-1.1.5-SNAPSHOT.jar:na]at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:194) [canal.parse-1.1.5-SNAPSHOT.jar:na]at java.lang.Thread.run(Thread.java:748) [na:1.8.0_275]

重点log
java.io.IOException: Received error packet: errno = 1236, sqlstate = HY000 errmsg = Could not find first log file name in binary log index file

ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:resourcesearch[com.alibaba.otter.canal.parse.exception.CanalParseException: [fixed timestamp] can’t found begin/commit position before with fixed positionmall-mysql-bin.000001:4
]
按照网上的教程 https://blog.csdn.net/jingshenbusi/article/details/79920925

删除 meta.dat 重启无效

网上也没有好的办法,就去查canal的配置文件
就这篇: https://www.cnblogs.com/jager/p/6594941.html

看到配置

# position info，需要改成自己的数据库信息
canal.instance.master.address = 172.16.0.158:3306
canal.instance.master.journal.name =
canal.instance.master.position =
canal.instance.master.timestamp = #canal.instance.standby.address =
#canal.instance.standby.journal.name =
#canal.instance.standby.position =
#canal.instance.standby.timestamp =

发现 canal.instance.master.journal.name 后面是空的
然后自己的配置文件 instance.properties 中是
canal.instance.master.journal.name=mall-mysql-bin.000001
而报错的内容是:can’t found begin/commit position before with fixed positionmall-mysql-bin.000001:4
就把配置文件中
canal.instance.master.journal.name=mall-mysql-bin.000001
修改为 canal.instance.master.journal.name=

重启完事!!!

canal 重启后不同步数据相关推荐

java bootstrapcache_使用ehcache持久化数据到磁盘并且在应用服务器重启后不丢失数据...
标签: 使用ehcache时如何持久化数据到磁盘,并且在应用服务器重启后不丢失数据 1.如何持久化到磁盘使用cache.flush(),每次写入到cache后调用cache.flush() ,这样e ...
（已解决）登录火狐浏览器账号后没有同步数据--博主的奇妙寻号之旅
原因上个月升级了Windows 11 太难用了,今天重装,然后发现卧槽,我火狐登上之后怎么是个新号? 以下是我的解决过程,中间几个步骤希望能帮到大家,想跳过请转最终解决. First 开始我以为是 ...
（已解决）登录火狐浏览器账号后没有同步数据，或火狐浏览器账号不存在
关于登录火狐浏览器账号后数据没有同步的问题解决本经验贴适用于 Firefox重度患者需要在境外使用火狐浏览器中国版的同学在新电脑上装了火狐浏览器,想登陆账号来同步书签,发现登录自己的账号竟然要我 ...
ElasticsearchBboss MySQL 同步数据到Elasticsearch
springboot集成ElasticsearchBboss调用Elasticsearch 一.搭建一个springboot项目 1).使用的是idea工具,所以直接选中File–>New–&g ...
Linux重启后硬盘挂载失效问题解决
参考文章: 怎么初始化你的 Linux 新磁盘? - 知乎 (zhihu.com) linux之fstab文件详解_richerg85的专栏-CSDN博客_fstab文件详解断电或重启后,发现数据不 ...
MySQL从零到一解读增量同步数据到elasticsearch canal adapter方式(binlog)实现
本文是作者在单机上面从零到一实现增量同步MySQL数据到elasticsearch canal adapter方式(binlog)实现. 实现步骤 (1)安装MySQL (2)开启MySQL binl ...
canal mysql多节点_数据同步的终极解决方案，阿里巴巴开源的Canal框架当之无愧！！...
写在前面在当今互联网行业,尤其是现在分布式.微服务开发环境下,为了提高搜索效率,以及搜索的精准度,会大量使用Redis.Memcached等NoSQL数据库,也会使用大量的Solr.Elastics ...
用 canal 监控 binlog 并实现mysql定制同步数据的功能
作者:何白白 cnblogs.com/hebaibai/p/10911899.html 业务背景写任何工具都不能脱离实际业务的背景.开始这个项目的时候是因为现有的项目中数据分布太零碎,零零散散的分布 ...
Mysql同步数据到Elasticsearch(实时Canal)
这里只是作为一个想法,Canal有监听binlog文件的功能.所以简单看了一下Canal的入门使用. 后续Canal实时数据同步的功能希望不会被我阉割......当然有大佬已经实现或者有其他方法实现m ...

canal 重启后不同步数据

canal 重启后不同步数据相关推荐

最新文章

热门文章