What is Kafka?
- Apache Kafka is an open-source stream-processing software platform developed by LinkedIn and donated to the Apache Software Foundation, written in Scala and Java. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.
- Official website: https://kafka.apache.org/intro
You can run a Kafka cluster that has SSL and SASL enabled using Docker-compose. You can run the Kafka cluster on a single VM or multiple VMs (e.g. 6 VMs for 3 zookeepers and 3 brokers) by composing a private subnet.
More detailed instructions are described at https://github.com/fabric-testbed/fabric-docker-images/tree/master/kafka.