kafka dh #2

Supports: trusty

Add to new model

Description

Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.


Overview:

Apache Kafka is a high-throughput, distributed, publish-subscribe messaging system.
Charm must be deployed in the bundle with postgresql-dh, devicehive, zookeeper-dh and nginx-dh charms.
More deployment information is provided with devicehive charm.

Deploying:

juju deploy cs:~x3v947pl/trusty/kafka-dh -n 2
juju add-relation zookeper-dh kafka-dh
juju add-relation devicehive kafka-dh

Configuration:

There is only one parameter you can configure - REPLICATION_FACTOR. By default it is set to 2. This also means that you need at least two kafka-dh units or auto topic creation mechanism will fail.
If you need it to be changed you should do this before all topics created, otherwise you have to manually reconfigure topics to apply new replication factor.

Using:

If load gets higher you can add an extra unit of kafka-dh with the help of juju-gui or like this

juju add-unit kafka-dh [--to 23]

Configuration

REPLICATION_FACTOR
(int) The replication factor controls how many servers will replicate each message that is written. Don't set bigger than the quantity of kafka nodes you have. Doesn't make sense for already created topics
2