Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[model-controller] Periodically check MR and create InferenceService CRs #175

Open
Tracked by #173
lampajr opened this issue Nov 20, 2023 · 0 comments
Open
Tracked by #173
Assignees
Labels

Comments

@lampajr
Copy link
Contributor

lampajr commented Nov 20, 2023

Is your feature request related to a problem? Please describe.
Second step would be to monitor the MR state and create InferenceService CRs based on the Model Registry content.

Describe the solution you'd like
Create a background timer controller/reconciler that periodically fetches all inference services stored in the model registry, and for each of them creates a InferenceService CR (if not already existing).

Describe alternatives you've considered
n/a

Additional context
This polling/timer should trigger the reconciliation for each namespace where Model Registry is installed and at least one ServingRuntime is applied.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: In Progress
Development

Successfully merging a pull request may close this issue.

1 participant