ricardoarchive / kafka-topic-cloner Goto Github PK
View Code? Open in Web Editor NEWLicense: Apache License 2.0
License: Apache License 2.0
What's the use case, or how will this tool be different from mirror-maker?
To prevent mistakes, cloning into the source topic should be impossible.
A parameter could be passed to force same-topic cloning.
The temporary topic should be automatically created at the beginning of the cloning process
An async producer would provude better performances thanks to batch producing.
Make sure that the messages order stays untouched.
The message consumed
and message produced
are filling stdout very quickly. We could log only one in a hundred or something similar.
a second url could be passed as the destination topic's broker. This would allow cloning from a cluster to another.
Move consuming and producing to the kafka package
A timeout to the consumer, similar to what we do with console consumer (timeout.ms) could let the user know when the cloning is ended by terminating the application
Cloning a topic's content currently overrides the producer timestamp which is contained in the event's metadata with the cloning time.
While this can sometimes be the desired behavior, it is not always the case.
A flag could be added with three different behaviors:
Add a --help command that displays the list of commands / arguments
A print that would tell how many messages were cloned would be useful
Unit and integration testing :)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.