You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Goal: Create a step in a in a workflow to hash content - to avoid duplicate records.
Description:
Create a python script step in a workflow to hash each chunk of text/content before it is converted into a node and sent to the graph.
Requirements:
Check that all content sent to the knowledge graph is hashed using a hash function prior to node creation.
If a hash already exists, content is not added to the graph (ends workflow).
Open Question:
How to pull and retrieve existing content in the graph to compare hash outputs (strings of hash) so that we don't create a duplicate record in our graph?
Do we store old content for version control?
if hash is the same between old content and new - then create an edge between "new_use" and "old_paragraph"
The text was updated successfully, but these errors were encountered:
olyveya
changed the title
Stub: Hash Content Before Creating Node in Workflow
Stub: Create a step to Hash Content in a workflow
Dec 18, 2024
Goal: Create a step in a in a workflow to hash content - to avoid duplicate records.
Description:
Create a python script step in a workflow to hash each chunk of text/content before it is converted into a node and sent to the graph.
Requirements:
Check that all content sent to the knowledge graph is hashed using a hash function prior to node creation.
If a hash already exists, content is not added to the graph (ends workflow).
Open Question:
How to pull and retrieve existing content in the graph to compare hash outputs (strings of hash) so that we don't create a duplicate record in our graph?
Do we store old content for version control?
if hash is the same between old content and new - then create an edge between "new_use" and "old_paragraph"
The text was updated successfully, but these errors were encountered: