Re: Independent zookeep for kafka multi node

2017-08-29 Thread mayank rathi
Are you trying to create 3 separate ZK+Kafka Broker pairs? On Wed, Aug 23, 2017 at 12:12 PM, IT Consultant <0binarybudd...@gmail.com> wrote: > Hi All > > Can I have three independent zookeepers tagged to three kafka brokers > without any clustering or quorum ? > > Would it be a good idea ? > -

Kafka Producer/Consumer APIs vs Apache Camel

2017-08-09 Thread mayank rathi
Hello All, Are their any advantages of using Kafka Producer/Consumer APIs over Apache Camel? Thanks!! -- NOTICE: This email message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution

Kafka Connect - Sink File - Header Record

2017-07-28 Thread mayank rathi
Hello All, Is their a way to generate a Sink File with Header using Kafka Connect? Thanks and Regards MR

Re: kafka connect

2017-07-15 Thread mayank rathi
In case you do not find Kafka Connector for listening to TCP sockets, you can use NiFi for this task. NiFi has a processor to listen to TCP messages. On Tue, Jul 4, 2017 at 1:26 PM, Clay Teahouse wrote: > Hello All, > > I have a few questions regarding kafka connect. I'd appreciate your > replie

How does Zookeeper node failure impact Kafka cluster?

2017-06-22 Thread mayank rathi
Hello All, Let's assume I have a 3-Node Zookeeper ensemble and a 3-Node Kafka Cluster in my Kafka environment and one of ZK node goes down. What would be the impact of 1 ZK node failure on Kafka Cluster? I am just trying to understand difference between 2 node Zookeeper ensemble and a 3 node Zoo

Re: Max message size and compression

2017-06-22 Thread mayank rathi
nd mention of it. > > Thanks > Eli > > > On 22 Jun 2017, at 05:50, mayank rathi wrote: > > > > If you are compressing messages than size of "compressed" message should > be > > less than what's specified in these parameters. >

Re: Max message size and compression

2017-06-21 Thread mayank rathi
If you are compressing messages than size of "compressed" message should be less than what's specified in these parameters. On Sat, Jun 17, 2017 at 7:46 PM, Eli Jordan wrote: > Hi > > max.message.bytes controls the maximum message size the kafka server will > process > > message.max.bytes contro

How to shutdown Kafka Connect worker running in distributed mode?

2017-06-18 Thread mayank rathi
Hello All, Besides using "kill" command, is their any other graceful way to shutdown Kafka Connect worker running in distributed mode? Thanks!!

Connector configuration is invalid

2017-06-02 Thread mayank rathi
Hello All, I am getting "Connector configuration is invalid" error with following configuration. Can someone please help me in finding out what I am doing wrong here name=topic_see connector.class=io.confluent.connect.jdbc.JdbcSourceConnector tasks.max=1 connection.url=jdbc:db2://*.*.*.com:6/