Skip to content

iceberg incremental model throws Parameter validation failed: Invalid bucket name "" #756

Closed Answered by Jingye-openc
Jingye-openc asked this question in Q&A
Discussion options

You must be logged in to vote

I managed to get it working for both full and incremental:
(~/.dbt/profiles.yml)

demo_v2:
  target: v2
  outputs:
    v2:
      type: athena
      s3_staging_dir: s3://my-bucket-athena/dbt/
      s3_data_dir: s3://my-bucket-data-lake/demo_v2/
      s3_tmp_table_dir: s3://my-bucket-data-lake/temp
      s3_data_naming: schema_table
      region_name: eu-west-2
      database:  awsdatacatalog
      schema: demo_v2
      aws_profile_name: playground
      threads: 4
      num_retries: 0

(dbt_project.yml)

name: "demo_v2"
version: "1.0.0"
profile: "demo_v2"

model-paths: ["models"]
seed-paths: ["seeds"]
test-paths: ["tests"]
analysis-paths: ["analysis"]
macro-paths: ["macros"]

target-path: "t…

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by Jingye-openc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant