Zookeeper server failover with kakfa

2018-02-26 Thread Biplob Biswas
, so that thy can connect to the new server. Thanks & Regards Biplob Biswas

Offset for consumer group set to Null in __consumer_offsets, leads to data loss

2018-08-24 Thread Biplob Biswas
tting the offsets after processing each batch of data within the spark job.Few important kafka properties are as follows: > > *group.id <http://group.id/>=spark-job-consumer-group* > *auto.offset.reset=latest**enable.auto.commit=false * We still don't have any root cause for the issue and its worrisome as this behaviour on production is not really acceptable. Any help or pointers would be really appreciated. Also please let me know if you need any more information from my Thanks & Regards Biplob Biswas

Re: Offset for consumer group set to Null in __consumer_offsets, leads to data loss

2018-08-27 Thread Biplob Biswas
Hi, Can anyone provide any insights to the issue we faced? Thanks & Regards Biplob Biswas On Fri, Aug 24, 2018 at 4:50 PM Biplob Biswas wrote: > Hi everyone, > > *Short Version:* > We had an unusual situation where after restart of our spark job, rather > than reading

Re: Offset for consumer group set to Null in __consumer_offsets, leads to data loss

2018-08-27 Thread Biplob Biswas
and report back. Thanks & Regards Biplob Biswas On Mon, Aug 27, 2018 at 10:12 AM Manikumar wrote: > What is the value set for offsets.retention.minutes? Default value is > `1day` in Kafka 0.11 release. > Based on your requirement, you may need to increase this value. > > O