Comments (4)
@hemalatha-amrutha This has been the default behavior in Kafka Streams, however, in 1.0 release of Kafka we have the option of specifying the behavior as described in KIP-161 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-161%3A+streams+deserialization+exception+handlers)
You should be able to set the "default.deserialization.exception.handler" config variable to the name of LogAndContinueExceptionHandler class using the SET statement.
Please let us know if you encounter any issues in using the above configuration with Kafka 1.0.
from ksql.
@hjafarpour : We should evaluate whether, moving forward, we should change the default settings of KSQL in this regard.
from ksql.
Hi @hjafarpour , I am getting similar issues with
ksql> show streams;
Stream Name | Kafka Topic | Format
PAGEVIEWS | pageviews | JSON
ksql> select * from PAGEVIEWS;
Failed to deserialize value for record. topic=pageviews, partition=0, offset=7107
Query terminated
are they related. Sorry new to the community and the guidelines to ask questions.
from ksql.
I believe the new default for KSQL is to log error and continue when deserialization fails. Closing this out.
from ksql.
Related Issues (20)
- ksqlDB Java Client - Propagate Connection Exception HOT 2
- ksqldb not starting
- Ksql queries not recognizing the lower case attributes in proto definition HOT 1
- Can't start ksqldb HOT 2
- Querying column with keyword name HOT 1
- KSQL in place upgrades support for stream table joins and table aggregation.
- KSQL CLI docker image does not show output for ksql-migrations HOT 1
- Maximum number of push queries exceeded
- Latest dependency for Janino
- Recent 7.6.0 master build is failing
- `BoundedMemoryRocksDBConfigSetter` leaks the cache configured by Kafka Streams
- Add a way to ignore missing persistent query when executing TERMINATE
- ksqlDb Java Client fails on listQueries with source table.
- BUG: Why is column of type HEADERS not accessible from ksqldb cli?
- Combination of ksql.queries.file and ksql.streams.rocksdb.config.setter config options results in exception at startup time HOT 1
- HEADERS and HEADER column can't be selected, returns `null` or other column values.
- ksqldb on Confluent Cloud seems to inherit the upstream behavior for TS extraction (even if it should not) resulting in Null Pointer Exception
- Docker standalone ksqldb-server 0.30.0 release HOT 4
- Unable to query existing data in kafka cluster. AVRO deserialization error HOT 1
- ksqldb-api-client describeConnector produces wrong request
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ksql.