Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Jlama inference support to rest-narration #1293

Open
edeandrea opened this issue Nov 21, 2024 · 1 comment
Open

Add Jlama inference support to rest-narration #1293

edeandrea opened this issue Nov 21, 2024 · 1 comment
Labels
enhancement New feature or request narration-service Narration service

Comments

@edeandrea
Copy link
Collaborator

edeandrea commented Nov 21, 2024

Currently the rest-narration service is configured for either OpenAI or Azure OpenAI. Add Jlama support to this.

One caveat though is that it needs to be able to support image generation. If it doesn't, then we will have to wait on this until it does.

We'll also need to follow a similar pattern for generating separate container images per-provider. I can certainly help out if needed, but if you look in the GitHub actions you'll see how this is done.

The documentation should be updated accordingly.

@edeandrea edeandrea added enhancement New feature or request narration-service Narration service labels Nov 21, 2024
@edeandrea
Copy link
Collaborator Author

@mariofusco ^^^

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request narration-service Narration service
Projects
None yet
Development

No branches or pull requests

1 participant