Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cloudwatch Input: Support multiple log groups #412

Open
jsirianni opened this issue Sep 2, 2021 · 0 comments
Open

Cloudwatch Input: Support multiple log groups #412

jsirianni opened this issue Sep 2, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@jsirianni
Copy link
Member

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

It would be nice if Cloudwatch input could take a list of log groups, allowing the user to have a single operator defined.

Describe the solution you'd like

  • The solution should be backwards compatible, meaning the parameter LogGroupName can stay the same.
  • When given something like /aws/rds/instance/*, Stanza should detect the log groups and build a list
  • During the polling cycle, we can spin off a Go routine to handle reading from each log group. There should probably be a max number of Go routines that are spawned, this could be user configurable.

If given a single log group, the list can just contain one entry.

Describe alternatives you've considered

Creating additional operators in the pipeline, but this is difficult when you have 10s of them.

Additional context

The end goal is to support something like

@jsirianni jsirianni added the enhancement New feature or request label Sep 2, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant