Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

parrallel hdf5 reading #94

Open
Jhsmit opened this issue Mar 28, 2019 · 1 comment
Open

parrallel hdf5 reading #94

Jhsmit opened this issue Mar 28, 2019 · 1 comment
Milestone
Performance update

Comments

@Jhsmit
Copy link
Owner

Jhsmit commented Mar 28, 2019

current performance of reading large hdf5 files with many cell objects is slow, possibly multiprocessed reading of the files could yield an improvement

http://docs.h5py.org/en/stable/mpi.html
@Jhsmit Jhsmit added this to the Performance update milestone Apr 12, 2019
@Jhsmit
Copy link
Owner Author

Jhsmit commented Apr 16, 2019

perhaps pytables?
https://www.pytables.org/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
Performance update
Development

No branches or pull requests
1 participant
@Jhsmit