Re: Kafka disk recommendation for cloud

2018-07-10 Thread Ali Nazemian
Hi Dan, Thanks for the reply. It's not many publishers right now, but it should become many publishers. Message size is pretty small, but we use batch writing. Based on architecture, Kafka relies on seq read/write, but still SSD might be a cost effective option in the case of too many publishers?

RE: Kafka disk recommendation for cloud

2018-07-10 Thread Dan Rosanova
In Azure we recommend using managed disks for Kafka. HD Insight Kafka uses them. I generally see SSD for Kafka, but I guess part of that could depend on if you write larger writes from fewer publishers or small writes from many publishers. What does your workload look like? Kind Regards, -Dan