...
| Code Block |
|---|
$ kubectl get pods $ kubectl get pods NAME READY STATUS RESTARTS AGE confluent-kafka-cp-control-center-5cf9477c94-6j2tz 1/1 Running 7 49m confluent-kafka-cp-kafka-0 2/2 Running 0 49m confluent-kafka-cp-kafka-1 2/2 Running 0 38m confluent-kafka-cp-kafka-2 2/2 Running 0 38m confluent-kafka-cp-kafka-connect-7646bbff9-hhdqq 2/2 Running 3 49m confluent-kafka-cp-kafka-rest-57588d5cb5-4sfnp 2/2 Running 6 49m confluent-kafka-cp-ksql-server-5bdd6b999c-djrj2 2/2 Running 5 49m confluent-kafka-cp-schema-registry-8db5569b8-2qgm9 2/2 Running 6 49m confluent-kafka-cp-zookeeper-0 2/2 Running 0 49m confluent-kafka-cp-zookeeper-1 2/2 Running 0 38m confluent-kafka-cp-zookeeper-2 2/2 Running 0 38m |
Kafka Configuration
https://docs.confluent.io/platform/current/installation/configuration/broker-configs.html#
Sample values.yaml
| Code Block |
|---|
cp-zookeeper:
prometheus:
jmx:
enabled: false
securityContext:
runAsUser: 1000
cp-kafka:
nodeport:
enabled: true
servicePort: 19092
firstListenerPort: 31090
persistence:
enabled: true
size: 10Gi
configurationOverrides:
"log.retention.bytes": "7516192768"
"delete.topic.enable": "true"
"message.max.bytes": "1048588"
"advertised.listeners": |-
EXTERNAL://localhost:$((31090 + ${KAFKA_BROKER_ID}))
prometheus:
jmx:
enabled: false
securityContext:
runAsUser: 1000
cp-schema-registry:
prometheus:
jmx:
enabled: false
cp-kafka-rest:
prometheus:
jmx:
enabled: false
cp-ksql-server:
prometheus:
jmx:
enabled: false
cp-control-center:
prometheus:
jmx:
enabled: false |
Connectors
| Connector | Type | URL |
|---|---|---|
| Azure | Kafka Sink Connector | https://www.confluent.de/hub/chaitalisagesh/kafka-connect-log-analytics |
| Fluent | Output Plugin for fluentbit | https://github.com/fluent/fluent-plugin-kafka |
| Elasticsearch | Kafka Source Connector | https://www.confluent.io/hub/dariobalinzo/kafka-connect-elasticsearch-source |
| Elasticsearch | Kafka Sink Connector | https://github.com/confluentinc/kafka-connect-elasticsearch |
| *Fluent | Output Plugin for fluentbit | https://docs.fluentbit.io/manual/pipeline/outputs/kafka |
...