Re: commitSync CommitFailedException

2016-01-17 Thread Franco Giacosa
Hi Jason, Thanks for the detailed explanation, I hope that KIP-41 gets added fast. A few questions: (1) The only way to send a heartbeat is to poll? if I poll with do poll(0) does it renew the token? (2) What happens to the coordinator if all consumers die? Franco. 2016-01-15 19:30 GMT+01:00

Re: Possible WAN Replication Setup

2016-01-17 Thread Ben Stopford
Jason Don’t forget that Kafka relies on redundant replicas for fault tolerance rather than disk persistence, so your single instances might lose messages straight out of the box if they’re not terminated cleanly. You could set flush.messages to 1 though. Don’t forget about Zookeeper either. Th

Support customized security protocol

2016-01-17 Thread tao xiao
Hi Kafka team, I want to know if I can plug-in my own security protocol to Kafka to implement project specific authentication mechanism. The current supported authentication protocols, SASL/GSSAPI and SSL, are not supported in my company and we have own security protocol to do authentication. Is