Skip to content

Commit

Permalink
feat: declare the schema of the Parquet file
Browse files Browse the repository at this point in the history 
We used to use duckdb, but there were issues to to incorrect type
guessing by duckdb. By validating and modifying the data before
Parquet generation, we can control completely the schema.
  • Loading branch information
@raphael0202
raphael0202 committed Nov 14, 2024
1 parent c9eb710 commit 4e48873
Show file tree
Hide file tree
Showing 3 changed files with 580 additions and 250 deletions.
Loading

0 comments on commit 4e48873

Please sign in to comment.