New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: improve late chunking context size #51

Open

lsorber wants to merge 1 commit into main from ls-increase-late-chunking-context

Member

lsorber commented Nov 25, 2024 •

edited

Loading

Changes:

Add a workaround for Improve late interaction/late chunking context window size #24 to increase the embedder's context size from 512 to a user-definable size.
Increase the default embedder context size to 4096 tokens.
Upgrade llama-cpp-python to the latest version.

Blockers:

The new llama-cpp-python version is printing to stdout/stderr even with verbose=False.
Some tests seem to be failing in CI/CD, specific to Postgres. To be investigated why.


          feat: improve late chunking context size

c0e4abc

lsorber self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet