KeeperException

2019-05-12 Thread Gagan Sabharwal
Hi team, I have just started to learn kafka following https://kafka.apache.org/quickstart When I have started my zookeeper server and kafka server, I got a few exceptions in the log which are all "KepperExcetion". Even when i created a topic with name test I got the same exception. Can anyone thr

Re: Kafka Connect - HDFS or FileStream

2019-05-12 Thread Robin Moffatt
Can you explain more about why you're writing a file with the data? Presumably, this is for another application to consume; could it not take the data from Kafka directly, whether with a native client or over the REST proxy? Oftentimes local files are unnecessary 'duck tape' for integration that ca

Kafka Connect - HDFS or FileStream

2019-05-12 Thread Vinay Jain
Hi I would like to consume a Topic and save the AVRO messages in local directory in the AVRO file formats. As per Kafka Connect File Stream documentation, it is not for production use. Other Option I am thinking to use Kafka Connect - HDFS Sink but I am not sure if it can also write to the Local

Re: [VOTE] 2.2.1 RC0

2019-05-12 Thread Jonathan Santilli
Hello Vahid, am testing one of our Kafka Stream Apps with the 2.2.1-rc, after few minutes, I see this WARN: 2019-05-09 13:14:37,025 WARN [test-app-id-dc27624a-8e02- 4031-963b-7596a8a77097-StreamThread-1] internals.ProcessorStateManager ( ProcessorStateManager.java:349) - task [0_0] Failed to w