Hi, In DEV, Kafka and Zookeeper services can be co- located on the same physical hosts
In Prod moving forward do we need to set up Zookeeper on its own cluster not sharing with Hadoop cluster? Can these services be shared within the Hadoop cluster? Additionally if there many topics for Kafka what would be an optimum setup specifically with separation of hard disks How best to set up Zookeeper that is needed for Kafka for use with Spark Streaming? In the diagram below [image: Inline images 1] there is one topic "My Topic". How would there be if you have multiple topics. Wouk there be one set of partitions for each topic, say for two topics there will be 6 patitions? Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.
