Skip to content

Commit

Permalink
clarify prometheus annotation (#316)
Browse files Browse the repository at this point in the history
Signed-off-by: JuHyung-Son <[email protected]>
  • Loading branch information
JuHyung-Son authored Nov 26, 2023
1 parent 15779f4 commit f8e777d
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions docs/modelserving/observability/prometheus_metrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,9 @@ The default values for `serving.kserve.io/enable-prometheus-scraping` can be set

There is not currently a unified set of metrics exported by the model servers. Each model server may implement its own set of metrics to export.

!!! note
This annotation defines the prometheus port and path, but it does not trigger the prometheus to scrape. Users must configure prometheus to scrape data from inference service's pod according to the prometheus settings.

## Metrics for lgbserver, paddleserver, pmmlserver, sklearnserver, xgbserver, custom transformer/predictor

Prometheus latency histograms are emitted for each of the steps (pre/postprocessing, explain, predict).
Expand Down

0 comments on commit f8e777d

Please sign in to comment.