This dbt package contains Snowflake-specific macros that can be (re)used across dbt projects.
Check dbt Hub for the latest installation instructions, or read the docs for more information on installing packages.
Snowflake Utils is compatible with dbt 0.15.0 and later.
snowflake_utils.warehouse_size() (source)
This macro returns an alternative warehouse if conditions are met. It will, in order, check the following conditions for incremental models:
- The relation doesn't exist (initial run) and a warehouse has been configured
- Full refresh run and a warehouse has been configured
Otherwise, it returns the target warehouse configured in the profile.
Call the macro from the snowflake_warehouse
model configuration:
{{
config(
snowflake_warehouse=snowflake_utils.warehouse_size()
)
}}
Out-of-the-box, the macro will return the target.warehouse
for each condition, unless exceptions are configured using one or more of the following variables:
variable | information | required |
---|---|---|
snowflake_utils:initial_run_warehouse | Alternative warehouse when the relation doesn't exist | No |
snowflake_utils:full_refresh_run_warehouse | Alternative warehouse when doing a --full-refresh |
No |
An example dbt_project.yml
configuration:
# dbt_project.yml
...
models:
my_project:
vars:
'snowflake_utils:initial_run_warehouse': "transforming_xl_wh"
'snowflake_utils:full_refresh_run_warehouse': "transforming_xl_wh"
When a variable is configured for a conditon and that condition is matched when executing a run, a log message will confirm which condition was matched and which warehouse is being used.
12:00:00 | Concurrency: 16 threads (target='dev')
12:00:00 |
12:00:00 | 1 of 1 START incremental model DBT_MGUINDON.fct_orders... [RUN]
12:00:00 + Initial Run - Using warehouse TRANSFORMING_XL_WH
Contributions to this package are very welcome! Please create issues for bugs or feature requests, or open PRs against master
.