Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ingest NetCDF #171

Open
aosterthun opened this issue Jul 3, 2019 · 2 comments
Open

Ingest NetCDF #171

aosterthun opened this issue Jul 3, 2019 · 2 comments
Labels
enhancement

Comments

@aosterthun
Copy link

It would be nice to be able to ingest netCDF files into tileDB as Sparse or Dense Arrays. GDAL claims to be able to translate netCDF to DenseArrays with gdal_translate. I used the tool and got an array with quite a bit bigger dimensions then in the source data, so I do not really trust the tool. Also it loses the dimensionnames.
Hence tileDB only starts to perform better then standard netCDF in case of sparse array data (as described in the publication) I see great benefits in supporting netCDF files in form of a load_netcdf() method.
@jakebolewski
Copy link
Contributor

jakebolewski commented Jul 3, 2019 •
edited
Loading

cc @normanb about the GDAL issues, multidimensional support in GDAL is a bit of a hack (it's actively getting worked on in GDAL 3+), so I am not surprised there are issues in conversion.

You are right that having a native reader in python is probably what we should shoot for (and hdf5, rasterio, ...)

@aosterthun
Copy link
Author

Is there a way to transform a tiledb.DenseArray into a tiledb.SparseArray ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jakebolewski @aosterthun