Inovatrend blog

Finally I caught some time to dig into Kafka, a high-throughput distributed messaging system, as authors define it. Essentially, Kafka is publish-subscribe messaging system, it can be used for several  use case scenarios  but in this post we will focus on tradinional message broker use case. Kafka stores every message on disk. Yet, it is very fast. If you are interested how is this achieved,  read it later  :) It is distributed by design - it is run as a cluster comprised of one or more servers each of which is called a broker. Important concepts - Kafka stores messages in categories called topics. - Topics consists of one or more "partitions" - Each partition is an ordered, immutable sequence of messages that is continually appended to - Processes that publish messages to Kafka are called producers - Processes that subscribe to topics and fetch messages are called consumers - Messages are not deleted after delivery, but after configured period of time. Pa