Re: Using Kafka without persisting message to disk

2016-07-14 Thread Sharninder Khera
iday, July 15, 2016 12:12 AM Subject: Re: Using Kafka without persisting message to disk To: Users Hi Jack, No, kafka doesn't support not writing to disk. If you're really 100% sure of yourself you could use a ramdisk and mount Kafka on it, but that's not supported. I'd re

Re: Using Kafka without persisting message to disk

2016-07-14 Thread Tom Crayford
Hi Jack, No, kafka doesn't support not writing to disk. If you're really 100% sure of yourself you could use a ramdisk and mount Kafka on it, but that's not supported. I'd recommend "just" writing to disk, it's plenty fast enough for nearly all use cases. Thanks Tom Crayford Heroku Kafka On Thu

Using Kafka without persisting message to disk

2016-07-14 Thread Jack Huang
Hi all, Is there a way to make a topic to be stored in memory only and not writing to disk? If not, what's the best way to minimize writing to disk? For this application we only need the notion of partitions and a short retention time (1hr or so) from Kafka. We want to use Kafka because we want to