We have to construct a messaging application that functions as a switch between other applications in the enterprise. Since our switch need only have a few days worth of messages, we are considering using Kafka as the means for persistence of the messages themselves, using something else such as Oracle or Elasticsearch to do inquiries and analytics. A query would resolve to a Kafka message ID which we would use to get the actual text if we needed it (many queries are for aggregates rather than the messages themselves). We value durability more than speed.
Has anyone ever done this? Michael D. Spence Mockingbird Data Systems, Inc