Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiline Parsing Options in Helm chart #3708

Closed
mskhor opened this issue May 16, 2024 · 1 comment
Closed

Multiline Parsing Options in Helm chart #3708

mskhor opened this issue May 16, 2024 · 1 comment
Labels
question Further information is requested

Comments

@mskhor
Copy link

mskhor commented May 16, 2024

Is there an option to have multiline parsing with a default format at collector level? Collector should process logs in a default format while sending to sumo something like https://github.com/fluent/helm-charts/blob/main/charts/fluent-bit/values.yaml#L428

Our applications use different format for logs and saw a possible solution here by having multiple condition for regex https://help.sumologic.com/docs/send-data/kubernetes/collecting-logs/#multiline-log-parsing

While this is a solution, we need to have multiple condition for different apps.

@mskhor mskhor added the question Further information is requested label May 16, 2024
@jagan2221
Copy link

jagan2221 commented May 29, 2024

@mskhor To be able to define multiple condition for different apps, we can use conditional multi-line parsing as mentioned in below doc.

https://help.sumologic.com/docs/send-data/kubernetes/collecting-logs/#multiline-log-parsing

Assuming multiple apps you say are apps containerized(say nginx for example), if this is not the case, please share your use case.
example:
sumologic:
logs:
multiline:
enabled: true
first_line_regex: "^\[?\d{4}-\d{1,2}-\d{1,2}.\d{2}:\d{2}:\d{2}"
additional:
- first_line_regex: "^@@@@ First Line"
condition: 'attributes["k8s.container.name"]= "mynginx*"'

@mskhor mskhor closed this as completed Jun 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants