demos/kafka/wordcount
4 months agoWIP master
Kai Moritz [Tue, 25 Jun 2024 05:09:10 +0000 (07:09 +0200)]
WIP

4 months agoWIP
Kai Moritz [Tue, 25 Jun 2024 05:07:45 +0000 (07:07 +0200)]
WIP

4 months agoWIP
Kai Moritz [Tue, 25 Jun 2024 04:26:40 +0000 (06:26 +0200)]
WIP

4 months agoIf some images are missing, only the missing images are build wordcount-2.2.1
Kai Moritz [Sun, 23 Jun 2024 10:00:08 +0000 (12:00 +0200)]
If some images are missing, only the missing images are build

4 months agoSwitched all services to `eclipse-temurin:21-jre`
Kai Moritz [Sun, 23 Jun 2024 09:53:13 +0000 (11:53 +0200)]
Switched all services to `eclipse-temurin:21-jre`

* Kafka Streams uses RocksDB to store data locally.
* Unfortunatly, RocksDB dose _not_ work on Alpine Linux.
* Therefore, the bigger standard-image has to be used.

4 months agoUpgraded JDK-Version, Spring Boot & Docker for all servies
Kai Moritz [Sun, 23 Jun 2024 09:36:03 +0000 (11:36 +0200)]
Upgraded JDK-Version, Spring Boot & Docker for all servies

4 months agoIntroduced new generalized JSON-format for `top10` wordcount-2.2.0
Kai Moritz [Sun, 23 Jun 2024 07:03:35 +0000 (09:03 +0200)]
Introduced new generalized JSON-format for `top10`

* Added an attribute `type`, that denotes the type of the statistics.
* Introduces a common wording for the other attributes:
** Renamed `user` to `channel`.
** Renamed `word` to `key` (in the `key`/`counter`-pairing in the `Entry`).
* Adapted all services accordingly:
** `counter` generates statistics of the type `COUNTER`.
** `popular` generates statistics of the type `POPULAR`.
** `top10` generates `Ranking`s for _all_ types of statistics and hands
   the `type` through to its consumers.
** `query` is only intrested in rankings of the type `COUNTER`.

4 months agoRefined output JSON for service `popular` wordcount-2.1.2
Kai Moritz [Thu, 20 Jun 2024 19:53:03 +0000 (21:53 +0200)]
Refined output JSON for service `popular`

4 months agoService `popular` supresses intermediate results wordcount-2.1.1
Kai Moritz [Thu, 20 Jun 2024 19:35:54 +0000 (21:35 +0200)]
Service `popular` supresses intermediate results

4 months agoIntroduced service `popular` wordcount-2.1.0
Kai Moritz [Sat, 15 Jun 2024 11:05:29 +0000 (13:05 +0200)]
Introduced service `popular`

4 months agoFixed JSON-mismatch in messages from top10 to query wordcount-2.0.1
Kai Moritz [Sun, 16 Jun 2024 19:45:32 +0000 (21:45 +0200)]
Fixed JSON-mismatch in messages from top10 to query

4 months agoSwitched to `JsonSerializer` / `JsonDeserializer` wordcount-2.0.0
Kai Moritz [Sat, 4 Feb 2023 09:20:55 +0000 (10:20 +0100)]
Switched to `JsonSerializer` / `JsonDeserializer`

* Switched all services from manual serialization/deserialization with
  direct calls to the `ObjectMapper` to ``JsonSerializer`` /
  ``JsonDeserializer``.
* All keys and values are serialized as JSON (expect the key from `users`).

4 months agoFixed the name of the docker-image `juplo/wordcount--fortune` wordcount-1.0.0
Kai Moritz [Sun, 23 Jun 2024 07:15:15 +0000 (09:15 +0200)]
Fixed the name of the docker-image `juplo/wordcount--fortune`

5 months agoIntroduced helper-service `setup`
Kai Moritz [Sun, 26 May 2024 06:40:32 +0000 (08:40 +0200)]
Introduced helper-service `setup`

5 months agoSwitched `README.sh` to the build-in version of Docker Compose
Kai Moritz [Sun, 5 May 2024 07:58:42 +0000 (09:58 +0200)]
Switched `README.sh` to the build-in version of Docker Compose

5 months agoUpdated Confluent-Kafka to `7.5.1` and switched the cluster to KRAFT
Kai Moritz [Sun, 5 May 2024 07:54:47 +0000 (09:54 +0200)]
Updated Confluent-Kafka to `7.5.1` and switched the cluster to KRAFT

17 months agoDeactivated scale-up for service query in `README.sh` 2023-06-signal
Kai Moritz [Sat, 17 Jun 2023 08:55:08 +0000 (10:55 +0200)]
Deactivated scale-up for service query in `README.sh`

17 months agoService `fortune` aktualisiert: 21.04 -> 22.04 (LTS)
Kai Moritz [Thu, 2 Feb 2023 21:13:43 +0000 (22:13 +0100)]
Service `fortune` aktualisiert: 21.04 -> 22.04 (LTS)

21 months agoRemoved dependency to external network `trion`
Kai Moritz [Thu, 2 Feb 2023 20:55:01 +0000 (21:55 +0100)]
Removed dependency to external network `trion`

21 months agoRemoved unfunctional test in service `users`
Kai Moritz [Thu, 2 Feb 2023 20:54:26 +0000 (21:54 +0100)]
Removed unfunctional test in service `users`

3 years agoThe splitting of the recorded sentences is done by a separate service
Kai Moritz [Thu, 21 Oct 2021 20:12:14 +0000 (22:12 +0200)]
The splitting of the recorded sentences is done by a separate service

3 years agoAdded the Kafka-UI AKHQ to the setup 2021-11-signal
Kai Moritz [Sun, 17 Oct 2021 14:57:23 +0000 (16:57 +0200)]
Added the Kafka-UI AKHQ to the setup

3 years agoEnabled up/down-scaling of the services
Kai Moritz [Sat, 16 Oct 2021 15:01:51 +0000 (17:01 +0200)]
Enabled up/down-scaling of the services

* Changed the default-port of the services, so that all services can be
  started local in parallel
* The queriable Kafka-Streams-Apps derive their local address automatically,
  so that they can be scaled up/down in Docker-Compose
* Added traefik as reverse-proxy to the setup

3 years agoRemoved the automatic update of submodules during a rebuild
Kai Moritz [Sat, 16 Oct 2021 15:19:11 +0000 (17:19 +0200)]
Removed the automatic update of submodules during a rebuild

3 years agoSimplified & unified the endpoint-paths
Kai Moritz [Sat, 16 Oct 2021 15:18:15 +0000 (17:18 +0200)]
Simplified & unified the endpoint-paths

3 years agoAdded requests for the generated Top-10 to the demonstration
Kai Moritz [Sat, 16 Oct 2021 13:55:23 +0000 (15:55 +0200)]
Added requests for the generated Top-10 to the demonstration

3 years agoUsers are materialized as KTable
Kai Moritz [Sat, 16 Oct 2021 13:51:54 +0000 (15:51 +0200)]
Users are materialized as KTable

3 years agoConfigured juplo/toolbox:latest for the utility-service cli
Kai Moritz [Thu, 7 Oct 2021 19:24:37 +0000 (21:24 +0200)]
Configured juplo/toolbox:latest for the utility-service cli

3 years agoAdded some story-tellers, based on Fortune
Kai Moritz [Sat, 4 Sep 2021 22:13:46 +0000 (00:13 +0200)]
Added some story-tellers, based on Fortune

3 years agoQuery-results are enriched with user-data
Kai Moritz [Sat, 4 Sep 2021 19:12:28 +0000 (21:12 +0200)]
Query-results are enriched with user-data

3 years agoSimple processing pipeline
Kai Moritz [Wed, 1 Sep 2021 20:51:08 +0000 (22:51 +0200)]
Simple processing pipeline

* Input: Sentences, that are correlated to usernames
* Words are counted by username
* Top-10 rankings can by queried by usernam