Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support to upcast numeric types when writing to iceberg tables #6372

Open
malhotrashivam opened this issue Nov 13, 2024 · 0 comments
Open
Assignees
Labels
feature request New feature or request iceberg parquet Related to the Parquet integration
Milestone

Comments

@malhotrashivam
Copy link
Contributor

Extension of #5923 on writing side.

This is needed for handling type promotions while writing deephaven tables to iceberg tables.
For example, if Deephaven table has a column of type int whereas iceberg table has same column of type long, we should be able to append this Deephaven table to the iceberg table.
For that, we need to be able to promote types while writing the parquet files.

@malhotrashivam malhotrashivam added feature request New feature or request parquet Related to the Parquet integration labels Nov 13, 2024
@malhotrashivam malhotrashivam added this to the 0.38.0 milestone Nov 13, 2024
@malhotrashivam malhotrashivam self-assigned this Nov 13, 2024
@malhotrashivam malhotrashivam changed the title Added support to upcast numeric types when writing parquet Added support to upcast numeric types when writing to iceberg tables Nov 13, 2024
@rcaudy rcaudy changed the title Added support to upcast numeric types when writing to iceberg tables Add support to upcast numeric types when writing to iceberg tables Nov 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request iceberg parquet Related to the Parquet integration
Projects
None yet
Development

No branches or pull requests

1 participant