Giter VIP home page Giter VIP logo

Comments (14)

vinllen avatar vinllen commented on May 8, 2024

Currently, MongoShake only ignores the known error. If you want to skip all errors, you should modify the error judge code by yourself.

from mongoshake.

kinesra75 avatar kinesra75 commented on May 8, 2024

And do you know where this kind of error could come ?

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

checkout this question, I think the filed 3 already exists.

from mongoshake.

kinesra75 avatar kinesra75 commented on May 8, 2024

What is strange is that when I replay that particular entry in the oplog manualy the result is a success. But MongoShake raise an error. I can't explain that, you never have that kind of error ?

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

Do you use upsert?

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

I'll add skipping all error option in the configuration which will be released in the next two days.

from mongoshake.

kinesra75 avatar kinesra75 commented on May 8, 2024

My Config is :

replayer.dml_only = true
replayer.executor = 1
replayer.executor.upsert = true
replayer.executor.insert_on_dup_update = false
replayer.conflict_write_to = none
replayer.durable = true

Yes I use upsert, that's why I don't understand why manually it works and thru mongoshake it raise an error ..

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

what's your database version and mongo shell command version?

from mongoshake.

kinesra75 avatar kinesra75 commented on May 8, 2024

MongoDB version v3.4.10
MongoDB shell version v3.4.10

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

The source database version is also 3.4? Could you give me the error oplog? And how do you manually insert the oplog?

from mongoshake.

kinesra75 avatar kinesra75 commented on May 8, 2024

This error has gone, I'm running it for 2 days since error ..

from mongoshake.

kinesra75 avatar kinesra75 commented on May 8, 2024

I got another question, why sometime it seem to "freeze" with 0 logs_get/sec for several minutes .. and the lsn.time is mote than hour ahead from the lsn_ckpt.time. It's normal to be ahead but more than une hour ? How can I optimize that ?

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

Could you show me the result by curl shown as following which can debug the timestamp according to the wiki?
curl 127.0.0.1:9200/repl | python -m json.tool
curl 127.0.0.1:9200/worker | python -m json.tool
There're 8 workers by default, the oplogs will be hashed into different workers, so when jumbo collection exist and the hash shard key is collection, some workers may be very big and others almost have no data inside. The lsn_ckpt is depended on the oldest checkpoint time.

from mongoshake.

vinllen avatar vinllen commented on May 8, 2024

please reopen this issue if your problem still exists.

from mongoshake.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.