Kafka-workshop

This workshop seeks to instill a basic working knowledge of Kafka in a few hours' worth of practice. You can expect to have a basic grasp of basic consumers, consumer groups, partitioning, schemas and cleanup policies by the time you make it through the exercises provided. You will also have a basic knowledge of some of Kafka's more useful command line tools. If you want to try your hand at implementing usage of Kafka in a major framework, a basic Spring Boot setup and accompanying exercises are also provided.

Prerequisites

• docker
  • alternatively, a locally installed and configured Kafka + schema registry
• An IDE capable of using Gradle and Kotlin
• Bash

Setup

Before we get started, there are a few necessary introductory steps:

• Create your Kafka cluster by executing docker compose up
• Once the cluster is up and running, execute the setup script to set up topics used in exercises

Topics

Once setup is complete, find the exercises and further instructions here:

1. Producers and consumers
2. Consumer groups
3. Partitions and ordering
4. Schemas and serialization/deserialization
5. Deletion policy and log compaction
6. Kafka connect
7. Spring Kafka using Spring Boot