Giter VIP home page Giter VIP logo

Comments (5)

zuston avatar zuston commented on April 28, 2024

And what's the difference of the config of data-replica and data-replica-writer ?

from firestorm.

frankliee avatar frankliee commented on April 28, 2024

These configs are come from quorum protocol.
rss.data.replica is default replica number of partition.
rss.data.replica.write is the minimum replica that writer should write metadata and data successfully.
rss.data.replica.read is the minimum replica that reader should read metadata successfully (data can read from only one replica).
The recommended values are (1,1,1) and (3,2,2),
This feature has been developed completely, but production environment only applies (1,1,1) to reduce rpc/memory cost.

from firestorm.

zuston avatar zuston commented on April 28, 2024

Thanks for your explanation @frankliee.

So the data replica will be supported through client pushing instead of shuffle server.

from firestorm.

frankliee avatar frankliee commented on April 28, 2024

Thanks for your explanation @frankliee.

So the data replica will be supported through client pushing instead of shuffle server.

Yes, its client-side feature.

from firestorm.

zuston avatar zuston commented on April 28, 2024

Thanks again. @frankliee

Close it.

from firestorm.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.