Comments (3)
bvallier
commented on June 11, 2024
1
my apologies - looking closer, this is a dagster issue using SnowflakePandasIOManager...
from sling-cli.
bvallier
commented on June 11, 2024
Is this related to full-refresh mode where an existing schema is present and a new one (e.g. an additional column added) is being materialized? @flarco the default behavior seems to fail in this case, which i didn't expect. I thought the table would be wiped and any new columns would be added to new table, but that didn't seem to be happening. Is this expected?
from sling-cli.
flarco
commented on June 11, 2024
hey Brice, if it is full refresh, it should recreate the table with the new column. If incremental, it should add the new column (and not fail). Can you paste your log output with debug mode here?
from sling-cli.
Related Issues (20)
- Default incremental mode prevents using full-refresh on stream level HOT 4
- Add DefaultAzureCredential as an authentication option for Azure HOT 2
- Sling padding varchar columns to max length (SQL Server -> Snowflake)
- Panic while exporting Trino table to local parquet file HOT 3
- Problem connecting to named instance SQL Server HOT 1
- Adding `ignore_existing: true` fails the execution when target doesn't exist HOT 1
- varchar columns are empty when reading from a Trino source
- MSSQL null and UniqueIdentifier issues HOT 5
- Reshift ,
- Redshift -> Postgres sync fail HOT 21
- Sling Incremental query using Timestamp with 3 decimals only breaks incremental HOT 1
- Defaults Object not being applied correctly when Wildcard is used HOT 1
- MSSQL connection uri with instance name HOT 2
- Add support for CrateDB bulk inserts
- Clickhouse Target High Memory Usage HOT 15
- _SLING_LOADED_AT is type NUMBER(38,0) on Snowflake instead of TIMESTAMP HOT 5
- Cannot use wildcard with CSV files in Azure Blob Storage HOT 2
- Schema name missing for parquet file writing HOT 1
- panic: runtime error: invalid memory address or nil pointer dereference HOT 1
- Column type coercion to boolean from tinyint stopped working in 1.2.10 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sling-cli.