Re: [!!Mass Mail]Re: Dual commit with zookeeper and kafka

2015-10-10 Thread Ben Stopford
Dual commits are only really designed to aid migration of topics that were started using ZK and want to move offset storage to Kafka. They are completely separate offset storage mechanisms. I suggest you pick one and use that. I’d suggest Kafka. In the crash case you describe, offsets would be

RE: [!!Mass Mail]Re: Dual commit with zookeeper and kafka

2015-10-10 Thread Рябков Алексей Николаевич
Hello! >> Whether you commit offsets to Kafka itself (stored in offsets topic) or ZK >> or both depends on the settings in two properties: offset.storage and >> >>dual.commit.enabled (here >> ). Currently ZK >> is the default. Thanks