Employee data migration

This project which does a data migration from a CSV to a Database, using local partitioner technique.

Technologies Stack

• Docker
• Docker-compose
• Spring-Batch
• PostgresSQL
• Kafka
• Kafdrop
• ZooKeeper

---

Installing Stack

Due to the fact the project is using Docker in it stack, we'll need install docker and docker-compose.

curl -fsSL https://get.docker.com | bash

But this command only install docker, if you are using Ubuntu or derivations, you can run the code below.

sudo apt install docker-compose

Running the stack

Now, you can easily up our tools.

sudo docker-compose up

Or

sudo docker-compose up -d

This way, we'll have the terminal free, hawever we won't have tool logs.

Testing the project

./mvnw clean test

Data Processing

Output SplitEmployeeStep

Output StepitemWriterListener on Kafka

Output EmployeeWriter on PostgresSQL