Adopt a new architecture using Kafka, Druid and Superset.
The Discord client (bot) will be a Kafka producer. This allows other services to then access these events and process the data further if necessary (for example to perform sentiment analysis on messages). Finally, Druid ingests the processed data which is then shown on a Superset dashboard.
Discord => Kafka => (Spark => Kafka) => Druid => Superset
Adopt a new architecture using Kafka, Druid and Superset.
The Discord client (bot) will be a Kafka producer. This allows other services to then access these events and process the data further if necessary (for example to perform sentiment analysis on messages). Finally, Druid ingests the processed data which is then shown on a Superset dashboard.