Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a more efficient mechanism for passing data and subsets to OpenSpace #5

Open
astrofrog opened this issue Jun 26, 2019 · 1 comment

Comments

@astrofrog
Copy link
Member

astrofrog commented Jun 26, 2019

This requires changes in OpenSpace, but tables with ~10^5-6 rows or more, it's going to be critical to have the ability to pass the data to OpenSpace in binary form, either using a binary file format, or by somehow sharing memory. The former is probably easier, and will be required anyway if OpenSpace is running on a separate machine from glue.

For subsets, the ideal solution would be to be able to tell OpenSpace that a data layer is a subset of another layer, and provide a bit/boolean mask array indicating which elements to pick.

@astrofrog
Copy link
Member Author

Somewhat related, we should update this plugin to use OpenSpace/OpenSpace#910

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant