All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, adheres to Semantic Versioning, and is generated by Changie.
- Add lookback variable to stg_query_history (#163)
- @smitsrr (Features)
- Add new fields for stg_serverless_task_history (#160)
- @fernandobrito (Features)
- Pull out stg_warehouse_events_history (#159)
- Remove warehouse_cluster_status model (#158)
- Add root_query_id, parent_query_id to stg_access_history (#156)
- @tnightengale (Features)
- Fix incremental filtering (#254)
- Include overage spend on services recently introduced (#154)
- @fernandobrito (Fixes)
- Support more usage types (#152)
- Update to use new service_type values (#151)
- Calculate net cloud services costs for reader accounts (#153)
- @fernandobrito (Features)
- @stumelius (Fixes)
- Support different order json comment (#148)
- Add dbt_snowflake_monitoring_incremental_days to set incremental lookback period (#140)
- @smitsrr (Features)
- Fix handling of service_type (#143)
- Switch stg_metering_history to a table incrementalization to handle natural dupes (#142)
- Add query acceleration costs and update cost per query algorithm to include them (#141)
- Make cost_per_query model incremental (#141)
- Add entity_id to stg_metering_history (#141)
To upgrade from 4.x.x, you'll need to full refresh the stg_metering_history model.
- Support quoting: true (#139)
- @ernestoongaro (Fixes)
- Support quoting: true (#139)
- @sidhreddy (Features)
- @yingyingqiqi (Features)
- @ernestoongaro (Features)
- Remove regex UDF to avoid timeout (#135)
- Fix cluster number (#134)
- Sort remaining balance daily with null contract numbers last (#128)
- Add Snowpipe Streaming (#125)
- Remove unneeded data_transfer_history source and stg model (#124)
- Add Data Transfer costs (#123)
- Set range for dbt_snowflake_query_tags (#121)
- Add hourly_spend model (#116)
- Daily rates improvements (#114)
- Add node_meta to dbt_query model (#109)
- @pratik60 (Features)
- Support dbt 1.5.0 (#106)
- Add currency to all models with spend data (#103)
- @calleo (Features)
- Prevent daily_spend from being held up by missing data (#97)
- Don't let daily_spend be held up by stale rates (#95)
- Rename access_history models (#92)
- Fix dbt_cloud_url var (#90)
- @vinooganesh (Fixes)
After attempting to use only query comments or query tags in versions 1 and 2, we've learned we actually need both. The reasons for that are:
- The
is_incrementalmacro is only available from within the query tag dbt context, and is needed to determine whether a model run is incremental or not. - Query tags have a maximum character limit of 2000, which is easily exceeded by a list of refs containing more than a few models.
To upgrade from 2.x.x, follow the latest instructions in the Quickstart. The package is still able to process query metadata generated by previous versions of the package, so no data will be lost on upgrade.
- Use query comments and query tags to avoid query tag character limit (#87)
- Use the model database and schema for UDF creation (#83)
- Add spend_net_cloud_services (#80)
The most significant change in 2.0.0 is using query tags instead of comments to attach dbt metadata to queries. To upgrade from previous versions:
- Remove the query comment configuration from
dbt_project.yml - Follow the instructions to configure the query tag in the Quickstart.
- Switch to using query tags instead of comments (#78)
- Fixes is_incremental in get_query_comment macro (#77)
- Add query_object_access and query_table_access models (#73)
- Fix query_text_no_comments regex (#72)
- Fix error on initial compile with no models created yet (#70)
- Inner join daily_rates to avoid $0 entries in daily_spend for incomplete days (#66)
- Increase incremental lookback window to account for changing cost data (#64)
- Add remaining balance daily model (#58)
- Improve cost per query freshness by using latest rates (#52)
- Select correct overage vs. regular rate each day (#59)
- Support dbt_utils 1.0.0 (#48)
- @GtheSheep (Features)
- Add dbt_queries model to easily understand dbt model costs with links to dbt Cloud (#47)
- Add serverless tasks history and spend (#37)
- Add
warehouse_cluster_status,warehouse_credits_mapandwarehouses_type2_dimensionmodels (#40)
- @gthesheep (Features)
- @ian-whitestone (Features)
- Show only complete days in daily_spend and materialize as table (#34)
- Fix account_locator var (#33)
- Add get_query_comment macro for model metadata in query history (#29)
- Support overage usage type for PAYG accounts (#24)
- Division by zero in cost_per_query model (#27)
- @aphethean1 (Features, Fixes)
- Add daily_spend model which aligns with monthly bill (#13)