RE: Create a Topic if Not Exists

2018-07-10 Thread Dan Rosanova
Hi Chinchu, I thought the default behavior of Kafka was to create topics if you send to them and they don't exist. I could be wrong. We had to support that in one of our products, so I am pretty sure that's the default. You do need to be mindful of the default partition count though, which I thi

RE: Kafka disk recommendation for cloud

2018-07-10 Thread Dan Rosanova
In Azure we recommend using managed disks for Kafka. HD Insight Kafka uses them. I generally see SSD for Kafka, but I guess part of that could depend on if you write larger writes from fewer publishers or small writes from many publishers. What does your workload look like? Kind Regards, -Dan

Re: Monitor the state of an event-based choreography

2018-07-19 Thread Dan Rosanova
Are you looking more for an Actor or orchestration layer and visibility? I don’t know of one per se, it would also be interested. Dan From: Jonathan Roy Sent: Thursday, July 19, 2018 3:22 AM To: users@kafka.apache.org Subject: Monitor the state of an event-bas