diff --git a/app/_hub/kong-inc/prometheus/overview/_index.md b/app/_hub/kong-inc/prometheus/overview/_index.md index e212a59d29dd..10689faa988f 100644 --- a/app/_hub/kong-inc/prometheus/overview/_index.md +++ b/app/_hub/kong-inc/prometheus/overview/_index.md @@ -50,6 +50,9 @@ license signature. Those metrics are only exported on {{site.base_gateway}}. measures the current number of database entities. - **Number of Nginx timers** : A gauge metric that measures the total number of Nginx timers, in Running or Pending state. +{% if_version gte:3.8.x %} +- **[AI LLM metrics](#ai-llm-metrics)** : AI LLM metrics are available per provider, model, cache, database name (if cached), embeddings provider (if cached), embeddings model (if cached), and workspace. +{% endif_version %} {% if_version gte:3.0.x %} ### Metrics disabled by default diff --git a/app/_src/gateway/ai-gateway/index.md b/app/_src/gateway/ai-gateway/index.md index 7c3fe911d386..a344156bee9a 100644 --- a/app/_src/gateway/ai-gateway/index.md +++ b/app/_src/gateway/ai-gateway/index.md @@ -196,7 +196,6 @@ Kong's AI Gateway allows you to configure semantic caching. Kong's AI Gateway enables comprehensive observability of your AI services through logging and metrics. These features provide insights into AI usage, performance, and costs, helping you optimize and govern AI operations effectively. #### Logging -{:.badge .enterprise} Kong's AI Gateway provides standardized logging formats for AI plugins, allowing you to track and analyze AI usage consistently across various providers. @@ -214,8 +213,17 @@ AI operations, helping you monitor performance and costs effectively. For more information, see [AI Metrics](/gateway/{{ page.release }}/production/monitoring/ai-metrics). +#### {{site.konnect_short_name}} Advanced Analytics + +Kong's AI Gateway allows you to expose and visualize AI metrics with {{site.konnect_short_name}} Advanced Analytics. These metrics include +the number of AI requests, the cost associated with AI services, and the token usage per provider and model. This setup provides a real-time view of +AI operations, helping you monitor performance and costs effectively. + +For more information, see [{{site.konnect_short_name}} Advanced Analytics](/konnect/analytics/). + {% endif_version %} + ## Quickstart script Kong offers an interactive AI quickstart script that launches a demo instance of {{site.base_gateway}} running AI Proxy: