Hi, We use Kafka with Spark streaming, where we consume the messages every few mins.
Can we also use Kafka to store messages for longer duration in hours; The usecase is for a spark batch job that runs every few hours to consume messages from Kafka topic. Is it advisable to use Kafka for such use cases? Or should I be looking at a persistent store like Cassandra or HDFS, for longer durations? Regards, Firdousi
