Skip to content

Commit

Permalink
Pagination for Snowflake objects
Browse files Browse the repository at this point in the history
  • Loading branch information
matthewshaver committed Nov 8, 2024
1 parent e9c141e commit d8e0093
Showing 1 changed file with 24 additions and 0 deletions.
24 changes: 24 additions & 0 deletions website/docs/reference/resource-configs/snowflake-configs.md
Original file line number Diff line number Diff line change
Expand Up @@ -678,3 +678,27 @@ Per the [Snowflake documentation](https://docs.snowflake.com/en/sql-reference/in
>- DDL operations.
>- DML operations (for tables only).
>- Background maintenance operations on metadata performed by Snowflake.

<VersionBlock firstVersion="1.9">

## Pagination for object results

By default, when dbt encounters a schema with up to 100k objects, it will paginate the results from `show objects` at 10k per page for up to 10 pages.

Environments that have more than 100k objects in a schema can customize the number of results per page and the page limit with the following flags in the `dbt_project.yml`:

- `list_relations_per_page` &mdash; The number of relations on each page (Max 10k as this is the most Snowflake allows).
- `list_relations_page_limit` &mdash; The maximum number of pages to include in the results.

For example, if you wanted to include 10k objects per page and include up to 100 pages (1M objects), configure the flags as follows:


```yml
flags:
list_relations_per_page: 10000
list_relations_page_limit: 100
```

</VersionBlock>

0 comments on commit d8e0093

Please sign in to comment.