Kowl (previously known as Kafka Owl) is a web application that helps you to explore messages in your Apache Kafka cluster and get better insights on what is actually happening in your Kafka cluster in the most comfortable way:
- Message viewer: Explore your topics' messages in our message viewer through ad-hoc queries and dynamic filters. Find any message you want using JavaScript functions to filter messages. Supported encodings are: JSON, Avro, Protobuf, XML, MessagePack, Text and Binary (hex view). The used enconding (except Protobuf) is recognized automatically.
- Consumer groups: List all your active consumer groups along with their active group offsets, edit group offsets (by group, topic or partition) or delete a consumer group.
- Topic overview: Browse through the list of your Kafka topics, check their configuration, space usage, list all consumers who consume a single topic or watch partition details (such as low and high water marks, message count, ...), embed topic documentation from a git repository and more.
- Cluster overview: List available brokers, their space usage, rack id and other information to get a high level overview of your brokers in your cluster.
A roadmap is maintained using milestones.
| Kowl | Kowl Business | |
|---|---|---|
| Topic Overview | ✅ | ✅ |
| Consumer Group Overview | ✅ | ✅ |
| Broker/Cluster Overview | ✅ | ✅ |
| Message viewer | ✅ | ✅ |
| Login System (Google, GitHub, Okta) | ❌ | ✅ |
| RBAC permissions with group syncing | ❌ | ✅ |
| Screenshots | Preview .gif in README | https://cloudhut.dev/ |
| Price | Always free / Open source | Free during beta* |
*If you want to participate in the free beta sign in here: https://license.cloudhut.dev/ . You'll get a forever free license for 2 seats. If you need more than 2 seats, just drop us an email at [email protected]
- Kafka Cluster (v1.0.0+) connectivity
- At least one OAuth app for SSO (Kowl business only)
- Internet connectivity to validate license (Kowl business only)
We offer pre built docker images for Kowl (Business), a Helm chart and a Terraform module to make the installation as comfortable as possible for you. Please take a look at our dedicated Installation documentation.
Do you just want to test Kowl against one of your Kafka clusters without spending too much time on the test setup? Here are some docker commands that allow you to run it locally against an existing Kafka cluster:
Since Kowl runs in it's own container (which has it's own network scope), we have to use host.docker.internal as bootstrap server. That DNS resolves to the host system's ip address. However since Kafka brokers send a list of all brokers' DNS when a client has connected, you have to make sure your advertised listener is connected accordingly, e.g.: PLAINTEXT://host.docker.internal:9092
docker run -p 8080:8080 -e KAFKA_BROKERS=host.docker.internal:9092 quay.io/cloudhut/kowl:masterDocker supports the --network=host option only on Linux. So Linux users use localhost:9092 as advertised listener and use the host network namespace instead. Kowl will then be ran as it would be executed on the host machine.
docker run --network=host -p 8080:8080 -e KAFKA_BROKERS=localhost:9092 quay.io/cloudhut/kowl:masterProtected via SASL_SSL and trusted certificates (e.g. Confluent Cloud):
docker run -p 8080:8080 -e KAFKA_BROKERS=pkc-4r000.europe-west1.gcp.confluent.cloud:9092 -e KAFKA_TLS_ENABLED=true -e KAFKA_SASL_ENABLED=true -e KAFKA_SASL_USERNAME=xxx -e KAFKA_SASL_PASSWORD=xxx quay.io/cloudhut/kowl:masterWe maintain a docker-compose file that launches zookeeper, kafka and kowl: /docs/local.
We use Discord to communicate. If you are looking for more interactive discussions or support, you are invited to join our Discord server: https://discord.gg/KQj7P6v
Kowl is distributed under the Apache 2.0 License.