Comments (6)
Hi @dzmitry-horbar,
I will check ASAP !
Thanks for your issue.
Regards,
from kafka-streams-dotnet.
Hi @LGouellec , not sure should I create a new issue or could report it here, but when I tried to update Confluent.Kafka to latest version v1.7.0 and it cause KafkaStreams to fail on start with following exception:
KafkaStreams use Confluent.Kafka 1.6.2, and in 1.7.0 some breaking changes are appeared (like some method change, same issue as above).
In next release, my library will use 1.7.0 but need some changes in my code.
from kafka-streams-dotnet.
Description
Hello, I have created simple console application to test GlobalTable + InMemory state store and everything works fine untill we close application. As recommended I do a call to KafkaStream.Dispose() and it throws an error :
Can you please help me with that ? What could be the cause of this issue ?
How to reproduce
Create .net 5.0 console application with Streamiz.Kafka.Net v1.1.5
I removed reading from state store because it doesn't affect this issue, the minimal code to reproduce it below.Configure and start:
var config = new StreamConfig<StringSerDes, StringSerDes>(); config.ApplicationId = "test-app-123"; config.BootstrapServers = "localhost:9092"; config.AutoOffsetReset = AutoOffsetReset.Earliest; StreamBuilder builder = new StreamBuilder(); builder.GlobalTable("dima-test", InMemory<string, string>.As("dima-test-store")); Topology t = builder.Build(); KafkaStream stream = new KafkaStream(t, config); await stream.StartAsync(); await Task.Delay(2000); stream.Dispose();
Checklist
Please provide the following information:
- A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file.
- A code snippet with your topology builder (ex: builder.Stream<string, string>("topic").to("an-another-topic");)
- Streamiz.Kafka.Net nuget version. - v1.1.5
- Apache Kafka version. - v1.6.2 (which is referenced from Streamiz library)
- Client configuration.
- Operating system. - Windows 10
- Provide logs (with in debug mode (log4net and StreamConfig.Debug) as necessary in configuration).
- Critical issue. - no
I reproduced your fix, and in fact, sometimes an error is logged with ObjectDisposedException raised.
It's not a fatal error because it's catch.
But I fixed this issue in my branch fix/84, will release in next release 1.2.0 in some weeks I hope.
from kafka-streams-dotnet.
1.2.0 released
from kafka-streams-dotnet.
Hi @LGouellec , not sure should I create a new issue or could report it here, but when I tried to update Confluent.Kafka to latest version v1.7.0 and it cause KafkaStreams to fail on start with following exception:
from kafka-streams-dotnet.
Good work, thanks for quick turn a round ! :)
from kafka-streams-dotnet.
Related Issues (20)
- Unable to process messages when using MapValuesAsync HOT 10
- Offer manual control over Grace MS settings
- Can't instantiate a new instance of StreamTableJoinProps<> HOT 2
- Topology involving topics spread accross multiple clusters HOT 2
- Default replication factor HOT 1
- Could not load file or assembly 'RocksDbSharp, Version=7.7.3.33461 HOT 3
- Parallel external stream thread
- Issue with State store / Outer join functionality HOT 1
- Provide a way to specify a custom partitioner
- Never receive messages or finish connecting when using AWS Managed Kafka (MSK) with IAM Credentials. HOT 1
- Unable to process messages when using branching HOT 2
- System.InvalidOperationException when accessing InMemoryWindowed Store HOT 1
- Streamiz library is accessing multiple topics in the Kafka cluster instead of just the intended topic HOT 4
- Record.Create factory function does not initialise Headers - Results in Null reference exception if trying to Access Headers HOT 1
- GlobalKTable should provide consumer lag metrics HOT 5
- librdkafka stream metric: consumer lag returns -1 HOT 1
- Self-Relationship exception HOT 1
- RocksDB.Range() and All(): A concurrent update was performed on this collection and corrupted its state.
- Remote storage
- Error using producer message HOT 10
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-streams-dotnet.