Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support LLM Reranker #1423

Open
johnmara-pc14 opened this issue Nov 1, 2024 · 2 comments
Open

Support LLM Reranker #1423

johnmara-pc14 opened this issue Nov 1, 2024 · 2 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@johnmara-pc14
Copy link

Hi, I've built a chat application using llama_index typescript version.
Now, I want to add a reranker. I've tested in the python version the llm_rerank and I'm happy with the results.

My question is, since it is using LLM for rerank and not cross-encoder or other transformer, I do not see the need to be available only for python.
Is it in your plans to add a similar interface for ts?

@himself65 himself65 added enhancement New feature or request help wanted Extra attention is needed labels Nov 1, 2024
@himself65
Copy link
Member

I think you can put custom postprocessor into LITS. But PR is welcome

@marcusschiesser
Copy link
Collaborator

Meanwhile you can try one of the existing re-rankers that we already have implemented: https://legacy.ts.llamaindex.ai/modules/node_postprocessors/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants