Comments (6)
Thanks for this info. Been banging my head against these several issues. Maybe also mention them in dbt Slack...
from dbt-synapse.
👋 @MarvinSchenkel -- appreciate your willingness to help out! there aren't too many dbt-synapse
users, but the community is growing day by day.
As far as your error goes, it's worth noting that the majority of dbt-synapse functionality comes from dbt-sqlserver
.USE
is supported for SQL Server and Azure SQL, but not Synapse. So whenever we see an error that has something to do with USE
, it normally means that somehow dbt-sqlserver
macros are being used in place of dbt-synapse
's. For example just last week we fixed an exact example of this error with our v0.19.0
release with #45.
Can you call dbt --version
to see what version of dbt-synapse you are using? It might also be that the wrong version of dbt-sqlserver
is installed, which you should be able to check by calling pip list | grep "dbt"
The newest release of dbt-synapse is v0.19.0.1
.
Then again, you could have discovered a new bug for us!
from dbt-synapse.
Alrighty, so this configuration is working for me:
dbt 0.18.0
dbt-bigquery 0.18.0
dbt-core 0.18.2
dbt-postgres 0.18.0
dbt-redshift 0.18.0
dbt-snowflake 0.18.0
dbt-sqlserver 0.19.0.1
dbt-synapse 0.18.1
When I try to update dbt-synapse to v0.19.0.1, I get a different error:
Running with dbt=0.19.0
Encountered an error while reading profiles:
ERROR Runtime Error
Credentials in profile "default", target "dev" invalid: Runtime Error
Could not find adapter type sqlserver!
Defined profiles:
- default
For more information on configuring profiles, please consult the dbt docs:
pip list
gives me:
dbt 0.19.0
dbt-bigquery 0.19.0
dbt-core 0.19.0
dbt-postgres 0.19.0
dbt-redshift 0.19.0
dbt-snowflake 0.19.0
dbt-sqlserver 0.19.0.1
dbt-synapse 0.19.0.1
Can you give me any pointers on how to debug these errors? I am happy to help out!
Cheers,
Marvin
EDIT: Downgrading dbt-sqlserver
to 0.19.0 seems to fix the error above, however, the next one I run into is:
('42000', '[42000] [Microsoft][ODBC Driver 17 for SQL Server][SQL Server]An insufficient number of arguments were supplied for the procedure or function sp_rename. (104016) (SQLExecDirectW)')
pip list
:
dbt 0.19.0
dbt-bigquery 0.19.0
dbt-core 0.19.0
dbt-postgres 0.19.0
dbt-redshift 0.19.0
dbt-snowflake 0.19.0
dbt-sqlserver 0.19.0
dbt-synapse 0.19.0.1
Any hints on how to trace the sp_rename
call?
from dbt-synapse.
Thanks for all the info! With dbt-synapse>=0.19.0
, there is a breaking change that requires you to change your profiles.yml
's adapter type from type=sqlserver
to type=synapse
When debugging an issue that seems to change behavior between versions of the package, two good places to look are the:
CHANGELOG.md
,- the GitHub Releases page, and
- any relevant Slack channel. Join #db-synapse in the dbt Slack!
The info about the breaking change is in discussed in all these places.
from dbt-synapse.
Thanks for all the info :). I managed to get it to work by manually installing pip packages with the correct version and changing the adapter type in my profile file.
Might be a good idea to update the README.md as well, since that still mentions dbt 0.18 ;-).
from dbt-synapse.
Might be a good idea to update the README.md
@MarvinSchenkel great point. As maintainers, it's hard for us to empathize with the new user experience, so we'd welcome any changes you might suggest in a PR!
from dbt-synapse.
Related Issues (20)
- Changing the distribution and index types in existing snapshots don't have any effect HOT 1
- upgrade to support dbt-core v1.4.0 HOT 2
- Stand up new CI-testing pool HOT 1
- upgrade to support dbt-core v1.5.0
- This repo is missing important files
- upgrade to support dbt-core v1.6.0
- Incremental table creation has unneccessary indexes, write temp table as a HEAP HOT 1
- Satellite problem when using case sensitive collations HOT 1
- upgrade to support dbt-core v1.7.0
- Unable to authenticate to a synapse intance with a dedicated pool HOT 7
- Version of adapter is not visible for `dbt --version` command HOT 2
- upgrade to support dbt-core v1.8.0
- `get_limit_subquery()` does not work with queries containing CTEs HOT 1
- Synapse sql login not working HOT 3
- Set `database=False` in `SynapseRelation.include_policy` instead of overriding `ref` macro HOT 3
- dbt-synapse `1.8.0rc1` broken by dbt-fabric `1.8.3` HOT 3
- `'tmp_relation' is undefined` when altering a column's datatype on an incremental model HOT 1
- Docker image for dbt-synapse HOT 1
- SQLAuth does not work in 1.8 HOT 1
- dbt-utils generate_surrogate_key macro fails for versions 1.4+ when only one field is supplied
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-synapse.