SentryFlow E2E Pipeline for API Access Logs

[anurag-rajawat]

This issue tracks the end-to-end pipeline for ingesting, processing, and visualizing API access logs from end-user clusters to AccuKnox SaaS.

Key Tasks:

• Implement support in SentryFlow to ingest raw API access logs from multiple sources.
  refactor!: Refactor for better maintainability #17
• Develop a mechanism to summarize API events that occur multiple times within a defined timeframe.
  https://github.com/accuknox/dev2/pull/216
• Define schemas for:
  • Raw API access logs for ingestion from various sources.
    refactor!: Refactor for better maintainability #17
  • Summarized API access events.
    https://github.com/accuknox/dev2/pull/216
  • API request and response payloads for observability API and UI.
    https://github.com/accuknox/observability-api/pull/178
• Persist summarized API access events in a durable storage solution.
  https://github.com/accuknox/deo/pull/264
• Integrate the summarized API access logs into the AccuKnox UI for visualization and analysis.
  https://github.com/accuknox/observability-api/pull/178

[nandhued]

Blocked due to:

• https://github.com/accuknox/observability-api/pull/178
• https://github.com/accuknox/deo/pull/264