Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[R-301] make llm and embeddigns required #1537

Open
jjmachan opened this issue Oct 19, 2024 · 4 comments · May be fixed by #1558
Open

[R-301] make llm and embeddigns required #1537

jjmachan opened this issue Oct 19, 2024 · 4 comments · May be fixed by #1558
Assignees
@jjmachan
Milestone
v0.3

Comments

@jjmachan
Copy link
Member

currently we use a lot of default llms - this makes Ragas very hard to change. We need to make all the llms and embeddings required so that users explicitly pass them

From SyncLinear.com | R-301
@jjmachan jjmachan self-assigned this Oct 19, 2024
@jjmachan jjmachan added this to the v.26 milestone Oct 21, 2024
@hunter-walden2113
Copy link
Contributor

100% agree. There have been a lot of issues opened regarding this problem and the issues its causing that are preventing people from producing testsets. I believe we should remove all the default llms and require users to pass in their llms/embeddings. I am happy to help in this effort, but would like to talk to a maintainer about the vision going forward.

@jjmachan
Copy link
Member Author

hey @hunter-walden2113 definetly - this is my cal cal.com/jjmachan/huddle - feel free to book some time there. Lookin forward to chatting 🙂

@jjmachan jjmachan linked a pull request Oct 23, 2024 that will close this issue
Draft
@jjmachan jjmachan modified the milestones: v.26, v0.3 Oct 23, 2024
@jjmachan
Copy link
Member Author

hey @hunter-walden2113 while this PR is would help a lot - it will also break a lot of code we have now. So we are putting this on pause and will take this up before v0.3

@hunter-walden2113
Copy link
Contributor

Sounds good. Let me know when you want to take it back up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jjmachan jjmachan

Labels
None yet
Projects
None yet
Milestone
v0.3
Development

Successfully merging a pull request may close this issue.

feat!: made llm and embedding default where ever we use them jjmachan/ragas
2 participants
@jjmachan @hunter-walden2113