Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow bulk ingest for version objects #1267

Open
rorlic opened this issue Apr 17, 2024 · 3 comments
Open

Allow bulk ingest for version objects #1267

rorlic opened this issue Apr 17, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request ingest move to JIRA Issue or FR too large to JIRA

Comments

@rorlic
Copy link
Contributor

rorlic commented Apr 17, 2024

Currently the LDES Server allows to ingest both state objects and versions objects. However, state objects can be ingested in bulk while version objects can not.

To determine individual state objects within a pool of RDF triples, we take each named node and collect all its triples as well as the triples of the blank nodes it directly or indirectly refers to. Preconditions are: no shared and no dangling blank nodes.

For version objects we can do something similar. Because no mix of state and version objects is allowed, we can first check the preconditions: no shared and no dangling blank nodes, all versions (named nodes) contain the configured versionOfPath and timestampPath predicates. We can collect the triples in exactly the same way as for state objects.

@rorlic rorlic added enhancement New feature or request ingest labels Apr 17, 2024
@github-project-automation github-project-automation bot moved this to 📋 Backlog in VSDS Backlog Apr 17, 2024
@Yalz Yalz added the move to JIRA Issue or FR too large to JIRA label Apr 17, 2024
@sandervd
Copy link
Contributor

sandervd commented May 2, 2024

@rorlic As we have the intention of deprecating version ingest in the future, do you think it makes sense to still spend time on this? Personally I wouldn't put any more effort in the version ingest.

@brechtvdv
Copy link

@rorlic As we have the intention of deprecating version ingest in the future, do you think it makes sense to still spend time on this? Personally I wouldn't put any more effort in the version ingest.

If version ingestion happens on the server, can you configure the timestamp path that should be used from the ingested state object? In the docs (https://informatievlaanderen.github.io/VSDS-LDESServer4J/ingest/http), a state object should not have the timestamp path.

@brechtvdv
Copy link

Version creation on the server should not be deprecated, as I want to have control on the used time stamp of the members. Versions may arrive out-of-order

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request ingest move to JIRA Issue or FR too large to JIRA
Projects
Status: 📋 Backlog
Development

No branches or pull requests

4 participants