kafka connector for mongodb as a source

Hi All, I am creating kafka connector for mongodb as a source .My connector is starting and connecting with kafka but it is not committing any offset. This is output after starting connector. [root@localhost kafka_2.11-0.10.1.1]# bin/connect-standalone.sh config/connect-standalone.properties con

Creating-kafka-connect

Hi All, I want to create my own kafka connector which will connect multiple data source. Could anyone please help me in doing so...

kafka-connect-salesforce

Hi All, I am trying to use kafka-connect-salesforce . topic is created but there is no data in it. should i have to start producer also to send data ? Thank you.

kafka-connect-salesforce

Hi All, I want to use kafka-connect-salesforce but i am not able to use it . can any one provide steps to how to use it. Thank you.

Re: Kafkaconnect

, Philippe Derome wrote: > watch some videos from Ewan Cheslack-Postava. > > https://www.google.ca/webhp?sourceid=chrome-instant&rlz= > 1C5CHFA_enCA523CA566&ion=1&espv=2&ie=UTF-8#q=youtube+ > ewan+Cheslack-Postava&* > > On Tue, Feb 28, 2017 at 6:55 AM, VIVEK KUMA

Kafkaconnect

Hi All, What is the use of kafka-connect.

Re: Kafka Connect

t can only run sql queries, though, so out of the box > it will just get you updated and new rows. If you want to get a list of > changes you'll either need to build that into your schema or use something > else that does CDC (Change Data Capture) on your source. > > -

Updation of data in kafka topic based on changes in data sources.

Hi All, Is it possible to update kafka topic data based on changes in data sources using python?

Kafka Connect

How to use kafka connect using python to get information about update,delete and insertion of data at various data sources?

partition creation using python api

There is one partition class in pykafka package in partition.py .Could you please tell me how to use that class. Thank you.

Re: Creating topic partitions automatically using python

ing partitions right now, so > pykafka is likely hacking around this by calling out to internal Java APIs, > so it will be brittle > > On Thu, Feb 23, 2017 at 5:13 AM, VIVEK KUMAR MISHRA 13BIT0066 < > vivekkumar.mishra2...@vit.ac.in> wrote: > > > Hi All, > > > &

Re: creating partitions programmatically

nc. > * h...@confluent.io (650)924-2670 > */ > > On Sun, Feb 26, 2017 at 5:44 PM, VIVEK KUMAR MISHRA 13BIT0066 < > vivekkumar.mishra2...@vit.ac.in> wrote: > > > My question is can we create partitions in topic using any pythonic API? > > > > On Sun, Feb 26, 20

Re: creating partitions programmatically

ar > interfaces. > In the meantime I’m afraid we just need to use the existing Java admin > utils or the CLI tools for just a little while longer. > > -hans > > > > > > On Feb 26, 2017, at 2:42 PM, VIVEK KUMAR MISHRA 13BIT0066 < > vivekkumar.mishra2...@vit.ac

creating partitions programmatically

Hi All, In kafka java driver, we have kafka.admin.AdminUtils class which has methods like createTopic and addPartitions(). Do we have these type of class and methods in any of kafka python drivers.If there is please do suggest. Thank you .

Creating topic partitions using python

Hi All, I want to create kafka partitions for topic automatically using pykafka or kafka-python. Please do suggest me any solution through which I can do this using python. Thank You! Regards, Vivek Mishra

Creating topic partitions automatically using python

me any solution through which I can do this using python. Thank You! Regards, Vivek Mishra

sending mailchimp data to kafka cluster using producer api

Hello sir, I want to send mailchimp data to kafka broker(Topic) using producer api. counld you please help me?

about producer and consumer api

Hello sir, I am learning Kafka. I know how to run kafka producers and consumers using terminal but know i want to run by my terminal i have written my sampleProducer and consumer code in java but i am not able to run . would you please help me out . Kindly look into that matter. thanks and regar

Zookeeper fails to see all the brokers at once

bytes=102400 socket.receive.buffer.bytes=102400 socket.request.max.bytes=104857600 zookeeper.connection.timeout.ms=6 zookeeper.session.timeout.ms=1 Thanks, Vivek

Re: KStream-to-KStream Join Example

Yes, there are same number of partitions to both the topic, also same partition key i.e userId If I just join the streams without applying the map functions (in this case userClickStream and userEventSrtream) , it works. Thanks, Vivek On Wed, Jul 13, 2016 at 4:53 PM, Philippe Derome wrote

KStream-to-KStream Join Example

hClicks) -> new KeyValue<>(channelWithClicks > .getChannel(), channelWithClicks.getClicks())) > .reduceByKey( > (firstClicks, secondClicks) -> firstClicks + > secondClicks, > stringSerde, longSerde, "ClicksPerChannelUnwindowed" > ); When I run this topology, I get an exception Invalid topology building: KSTREAM-MAP-03 and KSTREAM-MAP-06 are not joinable I looking for a way to join 2 KStreams. Thanks, Vivek

Re: Kafka Streams : Old Producer

Thanks a lot Micheal. I used WallClockTimeStampExtractor for now. Thanks, Vivek > On Jul 8, 2016, at 1:25 AM, Michael Noll wrote: > > Vivek, > > in this case you should manually embed a timestamp within the payload of > the produced messages (e.g. as a Long field in an Av

Re: Kafka Streams : Old Producer

Thats right Ismael, I am looking for work arounds either on 0.9.0.1 Producer side or on the Kafka Streams side so that I can process messages produced by 0.9.0.1 producer using Kafka Streams Library. Thanks, Vivek On Thu, Jul 7, 2016 at 9:05 AM, Ismael Juma wrote: > Hi, > > Matthias

Kafka Streams : Old Producer

can try to use Kafka Streams? Thanks, Vivek

Re: Kafka Producer connection issue on AWS private EC2 instance

gt; > In my case, the problem was the firewall that blocked access to zk from > Kafka. > > > On Jun 29, 2016, at 6:56 PM, vivek thakre > wrote: > > > > I have Kafka Cluster setup on AWS Public Subnet with all brokers having > > elastic IPs > > My pr

Kafka Producer connection issue on AWS private EC2 instance

uot;host.name" if configured. Otherwise, it will use the value returned from # java.net.InetAddress.getCanonicalHostName(). advertised.host.name= Please let me know if I am doing something wrong. Thank you Vivek

Kafka Consumer - Java

Hello All, Can you please help with the below : I was reading up on Kafka 0.9 API version and came across the below : The following is a draft design that uses a high-available consumer coordinator at the broker side to handle consumer rebalance. By migrating the rebalance logic from the consume

Re: future of Camus?

/ Thanks, Vivek Thakre On Thu, Oct 22, 2015 at 2:29 PM, Hawin Jiang wrote: > Very useful information for us. > Thanks Guozhang. > On Oct 22, 2015 2:02 PM, "Guozhang Wang" wrote: > > > Hi Adrian, > > > > Another alternative approach is to use Kafka's