-
Notifications
You must be signed in to change notification settings - Fork 0
/
catalog-entry.yaml
32 lines (31 loc) · 3.24 KB
/
catalog-entry.yaml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
name: RAG Monitoring
entries:
- title: RAG Monitoring
label: rag-monitoring
short_description: >
Monitor real-time metrics for a RAG pipeline and gather insights into the pipeline's behavior.
long_description: |
Build a monitoring dashboard over a RAG (Retrieval Augmented Generation) system. The dashboard should be able to monitor the model's performance and provide insights into the model's behavior. The AMP uses AWS Bedrock Models for indexing, response generation and evaluation and would need access keys for it to run.
---------------------------
IMPORTANT: Please read the following before proceeding. This AMP includes or otherwise depends on certain third party software packages. Information about such third party software packages are made available in the notice file associated with this AMP. By configuring and launching this AMP, you will cause such third party software packages to be downloaded and installed into your environment, in some instances, from third parties' websites. For each third party software package, please see the notice file and the applicable websites for more information, including the applicable license terms.
If you do not wish to download and install the third party software packages, do not configure, launch or otherwise use this AMP. By configuring, launching or otherwise using the AMP, you acknowledge the foregoing statement and agree that Cloudera is not responsible or liable in any way for the third party software packages.
long_description_html: |
Build a monitoring dashboard over a RAG (Retrieval Augmented Generation) system. The dashboard should be able to monitor the model's performance and provide insights into the model's behavior. The AMP uses AWS Bedrock Models for indexing, response generation and evaluation and would need access keys for it to run.
<div style="margin-top:10px"><b>IMPORTANT:</b> Please read the following before proceeding.</div>
<div style="margin-top:10px">This AMP includes or otherwise depends on certain third party software packages. Information about such third party software packages are made available in the notice file associated with this AMP. By configuring and launching this AMP, you will cause such third party software packages to be downloaded and installed into your environment, in some instances, from third parties' websites. For each third party software package, please see the notice file and the applicable websites for more information, including the applicable license terms.</div>
<div style="margin-top:10px">If you do not wish to download and install the third party software packages, do not configure, launch or otherwise use this AMP. By configuring, launching or otherwise using the AMP, you acknowledge the foregoing statement and agree that Cloudera is not responsible or liable in any way for the third party software packages.</div>
image_path: >-
https://github.infra.cloudera.com/raw/CAI/AmpRagMonitoring/main/assets/RAG-monitoring-tn.png
tags:
- Monitoring
- Evaluation
- Bedrock
- MLflow
- Qdrant
- Streamlit
- FastAPI
- RAG
- AI
- LLM
git_url: "https://github.infra.cloudera.com/CAI/AmpRagMonitoring"
is_prototype: true