Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Groq #42

Open
sorcerer2073 opened this issue Aug 4, 2024 · 1 comment
Open

Support for Groq #42

sorcerer2073 opened this issue Aug 4, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@sorcerer2073
Copy link

I was just wondering if anyone has been able to make it work with groq?

@sorcerer2073 sorcerer2073 added the enhancement New feature or request label Aug 4, 2024
@zhudotexe
Copy link
Owner

I haven't used Groq personally, but as a cloud-based provider it shouldn't be too difficult to implement an engine for it. You'll want to look at the docs for Implementing an Engine and an existing engine implementation (e.g. LlamaCppEngine as a less-complex example of using a Python library as an engine provider).

If you do implement a Groq engine it would make for a great extension package or PR!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants