Comments (3)
Thanks for the quick reply! This fixed it indeed.
FYI, I replaced dbt-snowflake with dbt-snowflake<1.8.0
from dagster.
Hey @juraurai - Thanks for reaching out. I was able to reproduce using the jaffleshop example, which resulted in the following error trace.
ERROR: launchpadlib 1.10.13 requires testresources, which is not installed.
ERROR: grpcio-health-checking 1.63.0 has requirement protobuf<6.0dev,>=5.26.1, but you'll have protobuf 4.25.3 which is incompatible.
ERROR: dbt-semantic-interfaces 0.4.4 has requirement importlib-metadata~=6.0, but you'll have importlib-metadata 7.1.0 which is incompatible.
ERROR: dbt-core 1.7.14 has requirement urllib3~=1.0, but you'll have urllib3 2.2.1 which is incompatible.
ERROR: dbt-duckdb 1.8.0 has requirement dbt-core>=1.8.0, but you'll have dbt-core 1.7.14 which is incompatible.
I managed to fix this by editing the setup.py
file created by using the Import a dbt project
function import in Dagster+. The setup.py
file is added to the PR created by the process in the GitHub repo.
For the jaffleshop example, forcing dbt-duckdb<1.8
in setup.py
fixed the problem. In your case, doing the same for Snowflake should temporarily fix your problem.
I think the problem comes from the version constraints of dbt-core
which we use for our dagster-dbt
library, see here - this will require a fix on our end.
from dagster.
@juraurai Glad to hear it worked! FYI, PR #21904 fixes the problem and should be used in production soon.
from dagster.
Related Issues (20)
- dbt row count breaks on identifier which need quoting
- mlflow integration causes 429 error responses from Databricks when running multiple parallel jobs/ops HOT 2
- Asset daemon breaks when downgrading to 1.7.7 HOT 2
- dbt Freshness Check Fails w/ KeyError Due to "Missing" Metadata HOT 4
- run_status_sensor suddenly starts failing with `Expected non_None value`, possibly caused by ephemeral asset jobs HOT 2
- Monitoring ephemeral runs
- Race condition DuckDB in Dagster Essentials HOT 3
- Support generic type hints
- Asset Versioning with partitioned assets does not detect out-of-sync assets after incrementing code_version HOT 11
- Regression (v1.7.8) - Increased Time Required to start a dbt Project HOT 8
- Pull dagster-databricks Pipes into it's own library to remove dependency on Spark
- [UI] Comma after surname included in catalog greeting
- Add useful context in tooltip for assets outside of the current selection
- [ui][1.7.11] jobs page misbehaving HOT 1
- Overload of warning logs when using dbt-core 1.8.* HOT 9
- Missing imports in `Refactoring assets to use resources` in Dagster Essentials HOT 1
- k8sRunLauncher.runK8sConfig.containerConfig overridden by dagster-user-deployments.deployments[0].resources HOT 4
- Dagster DBT doesn't load list of tags from dbt into dagster
- dbt custom schema not working in dagster HOT 2
- Unexpected behaviour with PermissiveConfig
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dagster.