Comments (3)
The following stacktrace points out that the JSON content read is corrupted:
Caused by: java.lang.IllegalArgumentException: Invalid JSON bytes for [simple type, class io.trino.plugin.deltalake.statistics.ExtendedStatistics]
at io.airlift.json.JsonCodec.fromJson(JsonCodec.java:196)
at io.trino.plugin.deltalake.statistics.MetaDirStatisticsAccess.readExtendedStatistics(MetaDirStatisticsAccess.java:75)
at io.trino.plugin.deltalake.statistics.MetaDirStatisticsAccess.readExtendedStatistics(MetaDirStatisticsAccess.java:65)
at io.trino.plugin.deltalake.statistics.CachingExtendedStatisticsAccess.lambda$readExtendedStatistics$0(CachingExtendedStatisticsAccess.java:63)
The issue reported there seems to be related with the way that LocalOutputFile
writes content to the persistence:
The overwriting of the content is not done in an atomical manner.
We need to rethink the implementation of createOrOverwrite()
method from LocalOutputFile
used to interact in tests with the local file storage.
cc @electrum
from trino.
https://github.com/trinodb/trino/actions/runs/8995057281/job/24709451666
from trino.
We could change this to write to a temporary file and then rename. We could name the temporary file .tmp.$RANDOM.$ORIGINAL
from trino.
Related Issues (20)
- Refactor `testTimestampCoercion*` in Delta Lake connector HOT 1
- Resource manager with http headers
- OpenApi spec for Trino rest client HOT 1
- Iceberg: varbinary type and bucket partition trnsformation
- Donβt understand the metric unit
- Can't load JDBC Driver trino-jdbc-448.jar whith an URL ClassLoader HOT 8
- package Trino-server-rpm error :ailed to execute goal org.codehaus.gmaven:groovy-maven-plugin:2.1.1:e... HOT 2
- Add new table handle interface to expose common datalake-type info HOT 4
- PreparedStatement dont support java.sql.Statement.NO_GENERATED_KEYS option HOT 1
- Verify checksum when reading deletion vectors in Delta Lake connector
- Add support for creating tables with deletion vector in Delta Lake connector
- Reading Delta Lake tables with icebergCompatV1(2) writer features fails HOT 1
- Subquery cache roadmap HOT 6
- Prune casted partition columns
- Order split scheduling between stages for common subqueries HOT 2
- Implement cache prioritization
- Add ttl for cached data
- Normalize conjunct order in CanonicalSubplanExtractor HOT 2
- Add support for (partial) Limit operator to subquery cache
- Add support for Join operator to subquery cache
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from trino.