Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate dspy as the Application Layer with Azure Controller for LLM Integration #28

Open
4 tasks
kkiani opened this issue Sep 24, 2024 · 0 comments
Open
4 tasks
Labels
feature/integration Changes and suggestion for currently integrated or under integration application integration/openllm

Comments

@kkiani
Copy link
Contributor

kkiani commented Sep 24, 2024

Description:

This issue focuses on integrating the dspy library as the application layer for LLM models, by creating an Azure controller layer to manage resources and interactions between the application and infrastructure. This will enable streamlined deployment of dspy-based LLM applications using Damavand’s ARC pattern on Azure.

Key Tasks:

  • Integrate dspy as the core application layer for handling LLM logics.
  • Develop an Azure controller layer to manage communication between the dspy application layer and Azure resources.
  • Ensure the controller layer handles provisioning and scaling of Azure resources required for LLM applications, aligned with Damavand’s ARC structure.
  • Provide examples and documentation to help developers easily deploy dspy-based LLM applications on Azure.

Acceptance Criteria:

  • dspy is fully integrated as the application layer for LLM models within Damavand.
  • A functional Azure controller layer is developed to manage resource provisioning and communication for LLM applications.
  • Clear examples and documentation that guide developers in deploying dspy-based LLM applications using the Azure controller layer.
@kkiani kkiani added feature/integration Changes and suggestion for currently integrated or under integration application integration/openllm labels Sep 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature/integration Changes and suggestion for currently integrated or under integration application integration/openllm
Projects
None yet
Development

No branches or pull requests

1 participant