Comments (7)
Okay. I see what you are saying. You are looking at the protocol compatibility. Basically a mapping of the APIs, types, and more described here: https://kafka.apache.org/0100/protocol.html
I will shape an issue for Kafka compatibility. This is something that more people have asked for.
We prioritized building the stateful services capability that enables stream processing and materialization based on the signal from the community which is closed to a major release milestone.
Given that this ask is coming up more often. We will follow up on this soon.
from fluvio.
Thank you very much for fluvio’s support!!!
from fluvio.
Thank you for your reply.
I understand that the kafka connector requires the existence of kafka, that is, it requires two components: kafka+fluvio, but fluvio can already replace the function of kafka, so we want to use only one component of fluvio, which can reduce operation and maintenance and resource costs.
Under this demand, fluvio needs to be compatible with kafka's protocol, so that neither the upstream nor the downstream needs to modify it, such as redpanda
from fluvio.
Great!
Our project is built using rust, so I really hope to have a stream processing platform based on rust (replacing kafka, pulsar, etc.). Thank you for your follow-up and attention. I hope this feature will be released soon.
from fluvio.
It’s awesome to hear that you are using rust. I will look at prioritizing the Kafka protocol compatibility.
We are close to wrapping up our stateful service developer preview(Flink like functionality). A couple more releases to go. Once we get to that milestone we will have a capacity conversation to address this.
In the meantime if you have any specific requirements regarding the Kafka protocol compatibility relevant to your project - please let us know.
from fluvio.
Currently we have Kafka connectors. We focused on the stream processing and materialization functionality. However this question keeps coming up.
Could you please describe how you see this functioning. Are you looking for a Kafka compatible API in the Fluvio client?
How would it work in an implementation?
How are you going to use it?
from fluvio.
Stale issue message
from fluvio.
Related Issues (20)
- mirroring: remote mirrored topic should be read-only for local changes HOT 3
- mirroring: audit log and diagnosis
- [Enahancement]: Add BASE OFFSET to `show partition list` HOT 2
- Detect `Artifacts` Updates in `PackageSet` on `fvm update`
- [feature] add `smdk clean`
- [Bug]: `fluvio cluster resume` stuck in `trying to connect to SC` HOT 12
- [Bug]: Smartmodule consume returns an error HOT 1
- [Release Checklist]: `v0.11.8`
- `fvm self update` should perform update process
- Postpone `group` ownership in SMDK/CDK generation to Publish Time
- revise smartmodule build ci for consistency
- Bug: Connector ignore invalid transformation configuration HOT 1
- Bug: Generated `sink` connector cannot be builded due to missing `Stream::next` impl
- [Release Checklist]: `v0.11.9`
- Create a PR for release
- Capability to update `stable` channel on `fvm update`
- smartengine: missing parameters from smartmodules need to report smartmodule name
- Include README as part of `smdk publish`
- index repair API and tooling
- `cdk generate` params and generated project integrity
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fluvio.