Comments (14)
Currently, MongoShake only ignores the known error. If you want to skip all errors, you should modify the error judge code by yourself.
from mongoshake.
And do you know where this kind of error could come ?
from mongoshake.
checkout this question, I think the filed 3 already exists.
from mongoshake.
What is strange is that when I replay that particular entry in the oplog manualy the result is a success. But MongoShake raise an error. I can't explain that, you never have that kind of error ?
from mongoshake.
Do you use upsert
?
from mongoshake.
I'll add skipping all error option in the configuration which will be released in the next two days.
from mongoshake.
My Config is :
replayer.dml_only = true
replayer.executor = 1
replayer.executor.upsert = true
replayer.executor.insert_on_dup_update = false
replayer.conflict_write_to = none
replayer.durable = true
Yes I use upsert, that's why I don't understand why manually it works and thru mongoshake it raise an error ..
from mongoshake.
what's your database version and mongo
shell command version?
from mongoshake.
MongoDB version v3.4.10
MongoDB shell version v3.4.10
from mongoshake.
The source database version is also 3.4? Could you give me the error oplog? And how do you manually insert the oplog?
from mongoshake.
This error has gone, I'm running it for 2 days since error ..
from mongoshake.
I got another question, why sometime it seem to "freeze" with 0 logs_get/sec for several minutes .. and the lsn.time is mote than hour ahead from the lsn_ckpt.time. It's normal to be ahead but more than une hour ? How can I optimize that ?
from mongoshake.
Could you show me the result by curl
shown as following which can debug the timestamp according to the wiki?
curl 127.0.0.1:9200/repl | python -m json.tool
curl 127.0.0.1:9200/worker | python -m json.tool
There're 8 workers by default, the oplogs will be hashed into different workers, so when jumbo collection exist and the hash shard key
is collection
, some workers may be very big and others almost have no data inside. The lsn_ckpt is depended on the oldest checkpoint time.
from mongoshake.
please reopen this issue if your problem still exists.
from mongoshake.
Related Issues (20)
- Using MongoShake with MongoDB ReplicaSet on Kubernetes.
- mongoshake使用all 模式完成全量同步,开始增量同步时报错进程自动退出
- 使用all模式同步时,日志中出现run splitVector failed[cannot Decode to nil value], give up parallel fetching
- 怎么彻底停止monghShake防止hypervisor重启。 HOT 1
- 全量同步完成后,写入一个非法的checkpoint[9223372036854775807[2147483647, 4294967295]] HOT 1
- 能否支持arm架构 HOT 2
- mongoshake同步使用all模式导致目标端主库服务器oom ,mongodb进程被kill
- 是否支持同时从多个源向目标数据库同步? HOT 1
- filter过滤collection不生效 HOT 1
- can i use this tool to sync incr ops from replset mongodb(as src) to standalone mongodb(as dst)?
- 关于权限问题
- mac m1 无法启动 ./collector.linux -conf=collector.conf
- Bad checksum?
- crash
- mongo-shake支持同步kafka显示修改数据的整条数据吗?目前是只同步修改了的字段的前后信息
- mongoshake mongodb版本V5.0 同步到kafka一直提示There has no oplog collection in mongo db server,mogodb已开启oplog HOT 2
- tps加入配置
- 全量之后没有增量同步
- FilterNamespaceBlack db.collection support for transactions HOT 3
- panic: move chunk oplog found, 错误优化
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mongoshake.