Versions Compared

Old Version 4

changes.mady.by.user John

Saved on

compared with

New Version 5

changes.mady.by.user John

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Overview

Apache Kafka is an open source project for a distributed publish-subscribe messaging system rethought as a distributed commit log.

...

Created by LinkedIn and is now an Open Source project maintained by Confluent.



Kafka Use Cases


Some use cases for using Kafka:

  • Messaging System
  • Activity Tracking
  • Gathering metrics from many different sources
  • Application Logs gathering
  • Stream processing (with the Kafka Streams API or Spark for example)
  • De-coupling of system dependencies
  • Integration with Spark, Flink, Storm, Hadoop and many other Big Data technologies


Installation on Kubernetes


Installing using the bitnami helm chart:

...

Code Block
$ kubectl get pods

NAME                     READY   STATUS    RESTARTS   AGE
kafka-0                  1/1     Running   3          3h9m
kafka-zookeeper-0        1/1     Running   0          3h9m




References

ReferenceURL
Apache Kafka in 5 minuteshttps://www.youtube.com/watch?v=PzPXRmVHMxI
Kafka Topics, Partitions and Offsets Explainedhttps://www.youtube.com/watch?v=_q1IjK5jjyU
Kafka Helm Charthttps://bitnami.com/stack/kafka/helm
Kafka Helm Chart Sourcehttps://github.com/bitnami/charts/tree/master/bitnami/kafka/#installing-the-chart

...