Kafka

In earlier days, we used to have JMS in our applications to send out messages to other systems. However, there were so many issues with JMS related systems. One of which is JMS doesn't store messages once they are processed.

Then I learned the basics of Kafka and thought what could be the use cases of using Kafka. Two major uses of Kafka are Logs and File processing.

• Logs processing: A very basic example is to push log messages to Kafka topics and continue with your task. Since Kafka maintains the order of messages, we don't really have to worry about the sequence of logs.

• File processing: There are many applications that require file processing as daily batch jobs. Believe me, Kafka can improve this job in many ways.

​

In the list, you can see a couple of projects (Will add more as I learn new stuff in it).

• Project 1: This is a sample, very basic project, to understand how Kafka works. It a simple representation of creating Kafka topics, producing and consuming messages.

• Project 2: This application is an example of File Processing using Kafka. Another Spring boot application to show how powerful Kafka is. This application reads a CSV file, computes tax and displays Take Home salary.