Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Zep for chat history; auto-summarization, intent extraction #54

Open
danielchalef opened this issue Jul 14, 2023 · 0 comments
Open

Comments

@danielchalef
Copy link

danielchalef commented Jul 14, 2023

Please consider using Zep as a long-term chat history store. It's increasingly being used for larger Langchain / Langchain.js apps where a more sophisticated approach to chat history memory is required.

A snippet from the project's feature list:

  • Fast! Zep's async extractors operate independently of the your chat loop, ensuring a snappy user experience.
  • Long-term memory persistence, with access to historical messages irrespective of your summarization strategy.
  • Auto-summarization of memory messages based on a configurable message window.
  • Hybrid Vector search over memories and metadata, with messages automatically embedded on creation.
  • Entity Extractor that extracts named entities and intents from messages and stores them in the message metadata.
  • Auto-token counting of memories and summaries, allowing finer-grained control over prompt assembly.

Zep's GitHub repo: https://github.com/getzep/zep

Happy to assist with implementation + questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant