Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SHACL - Batched revalidation #2283

Open
hmottestad opened this issue May 27, 2020 · 0 comments
Open

SHACL - Batched revalidation #2283

hmottestad opened this issue May 27, 2020 · 0 comments
Labels
📶 enhancement issue is a new feature or improvement 📦 SHACL affects the SHACL validator

Comments

@hmottestad
Copy link
Contributor

Currently the revalidation aspect of the ShaclSail loads all targets for a shape into memory, sorts them, then supplies them to the validation engine. The validation engine only operates on sorted data. A solution to this could be to load only the first 100 000 targets, sort and validate those, then load the next 100 000 and repeat. This wouldn't necessarily make things faster, but it would reduce memory usage and parallel validation might then be possible.

@hmottestad hmottestad added the 📦 SHACL affects the SHACL validator label May 27, 2020
@abrokenjester abrokenjester added the 📶 enhancement issue is a new feature or improvement label Jun 10, 2020
@github-project-automation github-project-automation bot moved this to 📋 Backlog in RDF4J Planning Jan 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
📶 enhancement issue is a new feature or improvement 📦 SHACL affects the SHACL validator
Projects
None yet
Development

No branches or pull requests

2 participants