Increased observability by having metrics, logs and traces in one place #12
Conversation
senthilcool
changed the title
senthilcool
changed the title
docker-compose.yml
Outdated
| @@ -84,11 +97,13 @@ services: | |||
| - MYSQL_PASSWORD=mysqlpw | |||
|
|
|||
| redis: | |||
| logging: *loki-logging | |||
There was a problem hiding this comment.
See other comments - the use of loki-logging needs to be optional.
is there an alternative to hardwiring logging: *loki-logging, e.g.
- Configure using environment variable
- Use promtail?
There was a problem hiding this comment.
Promtail uses Kubernetes service discovery to associate the log files with the services. In the docker/docker-compose world this is done by the loki logging driver plugin (https://grafana.com/docs/loki/latest/clients/docker-driver/).
Moved the logging driver configuration from the docker-compose file to the docker daemon (/etc/docker/daemon.json) as explained in https://grafana.com/docs/loki/latest/clients/docker-driver/configuration/. This will be a manual step in addition to the installation of the grafana/loki-docker-driver plugin.
There was a problem hiding this comment.
Having to configure the Docker daemon sounds problematic!
Why not just use logging: ${EVENTUATE_EXAMPLE_LOGGING_DRIVER:-json-file}
There was a problem hiding this comment.
@cer The loki logging driver configuration includes the loki-url as part of the options. As this option is not applicable for json-file, it needs to be included conditionally.
driver: loki
options:
loki-url: "http://localhost:3100/loki/api/v1/push"
Haven't figured out a way to do this. Let me know if you have any suggestions.
There was a problem hiding this comment.
two options come to mind:
- What happens if you configure json-file with loki-url - does it fail?
- copy/paste the service definitions into docker-compose-observability.yml
There was a problem hiding this comment.
- Yes, json-file with loki-url failed and so was not an option.
- Copy/pasted the service definitions into docker-compose-observable.yml.
…docker-compose file and moved logging driver configuration to the docker daemon
…endpoints/datasources accordingly
Adds integration with Prometheus, Loki and Grafana to be able to look at metrics, logs and traces in one place.