demos/kafka/monitoring
15 months agoWIP:brokers
Kai Moritz [Tue, 8 Aug 2023 19:08:12 +0000 (21:08 +0200)]
WIP:brokers

15 months agoWIP:Incre...
Kai Moritz [Tue, 8 Aug 2023 16:55:48 +0000 (18:55 +0200)]
WIP:Incre...

15 months agoWIP:brokers
Kai Moritz [Tue, 8 Aug 2023 16:52:27 +0000 (18:52 +0200)]
WIP:brokers

15 months agoIncreased number of Brokers from 3 to 5
Kai Moritz [Tue, 8 Aug 2023 16:45:04 +0000 (18:45 +0200)]
Increased number of Brokers from 3 to 5

15 months agoWIP:brokers
Kai Moritz [Mon, 7 Aug 2023 20:03:04 +0000 (22:03 +0200)]
WIP:brokers

15 months agoWIP:brokers
Kai Moritz [Mon, 7 Aug 2023 20:02:07 +0000 (22:02 +0200)]
WIP:brokers

15 months agoWIP:yaml
Kai Moritz [Mon, 7 Aug 2023 19:03:02 +0000 (21:03 +0200)]
WIP:yaml

15 months agoWIP:grafana
Kai Moritz [Mon, 7 Aug 2023 19:02:53 +0000 (21:02 +0200)]
WIP:grafana

15 months agoWIP:grafana
Kai Moritz [Mon, 7 Aug 2023 18:50:05 +0000 (20:50 +0200)]
WIP:grafana

15 months agoWIP:grafana
Kai Moritz [Mon, 7 Aug 2023 18:46:36 +0000 (20:46 +0200)]
WIP:grafana

15 months agoLowered scraping-interval of prometheus to 1s
Kai Moritz [Fri, 4 Aug 2023 20:31:30 +0000 (22:31 +0200)]
Lowered scraping-interval of prometheus to 1s

15 months agoStart of `jmx_exporter` is only delayed for 10 sec
Kai Moritz [Fri, 4 Aug 2023 20:30:00 +0000 (22:30 +0200)]
Start of `jmx_exporter` is only delayed for 10 sec

15 months agoFixed the `jmx_prometheus_javaagent`
Kai Moritz [Fri, 4 Aug 2023 20:18:53 +0000 (22:18 +0200)]
Fixed the `jmx_prometheus_javaagent`

15 months agoDie Bitnami-Images aktivieren KRaft jetzt automatisch
Kai Moritz [Fri, 4 Aug 2023 19:23:24 +0000 (21:23 +0200)]
Die Bitnami-Images aktivieren KRaft jetzt automatisch

15 months agoService `cli` zu dem Setup hinzugefügt
Kai Moritz [Fri, 4 Aug 2023 19:06:11 +0000 (21:06 +0200)]
Service `cli` zu dem Setup hinzugefügt

18 months agoWIP:clients
Kai Moritz [Sat, 6 May 2023 08:36:34 +0000 (10:36 +0200)]
WIP:clients

18 months agoWIP:clients
Kai Moritz [Sat, 6 May 2023 08:34:25 +0000 (10:34 +0200)]
WIP:clients

18 months agoFixed activation of JMX for Zookeeper
Kai Moritz [Tue, 2 May 2023 20:44:38 +0000 (22:44 +0200)]
Fixed activation of JMX for Zookeeper

18 months agoMetrics are now also available via JMX directly
Kai Moritz [Tue, 2 May 2023 20:30:17 +0000 (22:30 +0200)]
Metrics are now also available via JMX directly

18 months agoAdded Dashboard for kafka-lag-exporter
Kai Moritz [Tue, 2 May 2023 15:43:51 +0000 (17:43 +0200)]
Added Dashboard for kafka-lag-exporter

20 months agoWIP:burrow-uis
Kai Moritz [Sat, 25 Feb 2023 07:56:45 +0000 (08:56 +0100)]
WIP:burrow-uis

20 months agoWIP:burrow-uis
Kai Moritz [Fri, 24 Feb 2023 22:16:16 +0000 (23:16 +0100)]
WIP:burrow-uis

20 months agoWIP:volumes
Kai Moritz [Fri, 24 Feb 2023 21:46:06 +0000 (22:46 +0100)]
WIP:volumes

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:40:40 +0000 (22:40 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:37:22 +0000 (22:37 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:33:43 +0000 (22:33 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:29:31 +0000 (22:29 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:23:26 +0000 (22:23 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:18:28 +0000 (22:18 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:13:31 +0000 (22:13 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:09:16 +0000 (22:09 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:08:46 +0000 (22:08 +0100)]
WIP

20 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:08:45 +0000 (22:08 +0100)]
WIP

20 months agoBurrow's Zookeeper-Consumer is only needed, if offsets are stored there
Kai Moritz [Tue, 21 Feb 2023 23:08:52 +0000 (00:08 +0100)]
Burrow's Zookeeper-Consumer is only needed, if offsets are stored there

20 months agoAdded Burrow
Kai Moritz [Tue, 21 Feb 2023 23:00:23 +0000 (00:00 +0100)]
Added Burrow

- See: https://github.com/linkedin/Burrow

21 months agoAdded `seglo/kafka-lag-exporter`
Kai Moritz [Tue, 21 Feb 2023 22:11:41 +0000 (23:11 +0100)]
Added `seglo/kafka-lag-exporter`

- See: https://github.com/seglo/kafka-lag-exporter#monitoring-with-grafana

21 months agoFixed the problem with the missing data in the Grfana dashboard
Kai Moritz [Mon, 20 Feb 2023 20:01:00 +0000 (21:01 +0100)]
Fixed the problem with the missing data in the Grfana dashboard

- The naming (and selection) of the broker-metrics that was defined in the
  configurtaion of the jmx-exporter did not match the naming in the
  predefined dashboard.
- Replaced the configuration for the jmx-exporter with the one that was
  defined in the same example, as the dashboard.

21 months agoData!
Kai Moritz [Mon, 20 Feb 2023 17:38:23 +0000 (18:38 +0100)]
Data!

21 months agoEnabled the default metrics in the Bitnami image for Zookeeper
Kai Moritz [Sun, 19 Feb 2023 19:33:40 +0000 (20:33 +0100)]
Enabled the default metrics in the Bitnami image for Zookeeper

See: https://hub.docker.com/r/bitnami/zookeeper/

21 months agoAdded Zookeeper
Kai Moritz [Sun, 19 Feb 2023 19:33:40 +0000 (20:33 +0100)]
Added Zookeeper

Config from: https://github.com/confluentinc/jmx-monitoring-stacks/blob/7.2-post/shared-assets/jmx-exporter/zookeeper.yml
See: https://www.confluent.io/blog/monitor-kafka-clusters-with-prometheus-g

21 months agoAdded Grafana
Kai Moritz [Sun, 19 Feb 2023 10:31:52 +0000 (11:31 +0100)]
Added Grafana

Dashboard from: https://github.com/confluentinc/jmx-monitoring-stacks
See: https://www.confluent.io/blog/monitor-kafka-clusters-with-prometheus-grafana-and-confluent/

21 months agoAdded Prometheus
Kai Moritz [Sun, 19 Feb 2023 09:42:41 +0000 (10:42 +0100)]
Added Prometheus

21 months agoAdded `prometheus_jmx_exporter` as java-agent in the Kafka brokers
Kai Moritz [Sun, 19 Feb 2023 09:26:41 +0000 (10:26 +0100)]
Added `prometheus_jmx_exporter` as java-agent in the Kafka brokers

21 months agoSwitched from KRAFT to Zookeeper -- works :)
Kai Moritz [Sat, 18 Feb 2023 23:03:56 +0000 (00:03 +0100)]
Switched from KRAFT to Zookeeper -- works :)

21 months agoAdded `danielqsj/kafka-exporter` -- does not work :/
Kai Moritz [Sat, 18 Feb 2023 15:09:14 +0000 (16:09 +0100)]
Added `danielqsj/kafka-exporter` -- does not work :/

21 months agoEmpty setup for Docker Compose as basis for the monitoring examples
Kai Moritz [Sat, 18 Feb 2023 14:39:32 +0000 (15:39 +0100)]
Empty setup for Docker Compose as basis for the monitoring examples