demos/kafka/monitoring
15 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:18:28 +0000 (22:18 +0100)]
WIP

15 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:13:31 +0000 (22:13 +0100)]
WIP

15 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:09:16 +0000 (22:09 +0100)]
WIP

15 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:08:46 +0000 (22:08 +0100)]
WIP

15 months agoWIP
Kai Moritz [Fri, 24 Feb 2023 21:08:45 +0000 (22:08 +0100)]
WIP

15 months agoBurrow's Zookeeper-Consumer is only needed, if offsets are stored there
Kai Moritz [Tue, 21 Feb 2023 23:08:52 +0000 (00:08 +0100)]
Burrow's Zookeeper-Consumer is only needed, if offsets are stored there

15 months agoAdded Burrow
Kai Moritz [Tue, 21 Feb 2023 23:00:23 +0000 (00:00 +0100)]
Added Burrow

- See: https://github.com/linkedin/Burrow

15 months agoAdded `seglo/kafka-lag-exporter`
Kai Moritz [Tue, 21 Feb 2023 22:11:41 +0000 (23:11 +0100)]
Added `seglo/kafka-lag-exporter`

- See: https://github.com/seglo/kafka-lag-exporter#monitoring-with-grafana

15 months agoFixed the problem with the missing data in the Grfana dashboard
Kai Moritz [Mon, 20 Feb 2023 20:01:00 +0000 (21:01 +0100)]
Fixed the problem with the missing data in the Grfana dashboard

- The naming (and selection) of the broker-metrics that was defined in the
  configurtaion of the jmx-exporter did not match the naming in the
  predefined dashboard.
- Replaced the configuration for the jmx-exporter with the one that was
  defined in the same example, as the dashboard.

15 months agoData!
Kai Moritz [Mon, 20 Feb 2023 17:38:23 +0000 (18:38 +0100)]
Data!

15 months agoEnabled the default metrics in the Bitnami image for Zookeeper
Kai Moritz [Sun, 19 Feb 2023 19:33:40 +0000 (20:33 +0100)]
Enabled the default metrics in the Bitnami image for Zookeeper

See: https://hub.docker.com/r/bitnami/zookeeper/

15 months agoAdded Zookeeper
Kai Moritz [Sun, 19 Feb 2023 19:33:40 +0000 (20:33 +0100)]
Added Zookeeper

Config from: https://github.com/confluentinc/jmx-monitoring-stacks/blob/7.2-post/shared-assets/jmx-exporter/zookeeper.yml
See: https://www.confluent.io/blog/monitor-kafka-clusters-with-prometheus-g

15 months agoAdded Grafana
Kai Moritz [Sun, 19 Feb 2023 10:31:52 +0000 (11:31 +0100)]
Added Grafana

Dashboard from: https://github.com/confluentinc/jmx-monitoring-stacks
See: https://www.confluent.io/blog/monitor-kafka-clusters-with-prometheus-grafana-and-confluent/

15 months agoAdded Prometheus
Kai Moritz [Sun, 19 Feb 2023 09:42:41 +0000 (10:42 +0100)]
Added Prometheus

15 months agoAdded `prometheus_jmx_exporter` as java-agent in the Kafka brokers
Kai Moritz [Sun, 19 Feb 2023 09:26:41 +0000 (10:26 +0100)]
Added `prometheus_jmx_exporter` as java-agent in the Kafka brokers

15 months agoSwitched from KRAFT to Zookeeper -- works :)
Kai Moritz [Sat, 18 Feb 2023 23:03:56 +0000 (00:03 +0100)]
Switched from KRAFT to Zookeeper -- works :)

15 months agoAdded `danielqsj/kafka-exporter` -- does not work :/
Kai Moritz [Sat, 18 Feb 2023 15:09:14 +0000 (16:09 +0100)]
Added `danielqsj/kafka-exporter` -- does not work :/

15 months agoEmpty setup for Docker Compose as basis for the monitoring examples
Kai Moritz [Sat, 18 Feb 2023 14:39:32 +0000 (15:39 +0100)]
Empty setup for Docker Compose as basis for the monitoring examples