RE: adding more partition

2017-01-03 Thread Tauzell, Dave
, 2017 1:26 AM To: users@kafka.apache.org Subject: Re: adding more partition where does kafka runs RAM or SSD ? My question how to delete message frm Kafka topics. Is message expire is only way ? *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473

Re: adding more partition

2017-01-02 Thread Laxmi Narayan NIT DGP
where does kafka runs RAM or SSD ? My question how to delete message frm Kafka topics. Is message expire is only way ? *Regards,* *Laxmi Narayan Patel* *MCA NIT Durgapur (2011-2014)* *Mob:-9741292048,8345847473* On Tue, Jan 3, 2017 at 12:46 PM, Kunal Gupta wrote: > For your Questio

Re: adding more partition

2017-01-02 Thread Kunal Gupta
For your Question 1 No, Message will be read only once by anyone of the consumer in a consumer group For your Question 2 Yes, Because each consumer group will read a message exactly once. Kafka is meant for Guaranteed Message Processing There are three ways of Guaranteed Message Processing 1) Exa

Re: adding more partition

2017-01-02 Thread Laxmi Narayan NIT DGP
Hi , If I have kafka cluster along with replication . Say cluster of 3 kafka-server and replication factor of message with 2. Que 1: I have 1-consumer group but 2 consumer in one group reading from 1-Topic, If I enable auto commit true in consumer , will same message will be read twice ? Que

Re: adding more partition

2017-01-02 Thread Kunal Gupta
I don't think so because more partition can led to unavailability but yes can led to higher throughput. But it cause more problems like increasing end to end latency, requires more open file handler and require more memory at client side. *Thanks, Kunal* *+91-9958189589* *Data Analyst* *First Pape