Kafka Streams + Serverless

2018-11-23 Thread Artur Mrozowski
Hi, has anyone been running KStreams in serveless functions and managed to keep them stateful? The joins and aggregation are the requirement in this setup. Just, curious if anyone has been down that path? Best Regards Artur

Re: Kafka Producer Buffer and Broker Connection Failure

2018-11-23 Thread Mayuresh Gharat
Hi Mark, The initial understanding is correct. To understand the timeout scenarios, you might want to take a look at KIP-91 : https://cwiki.apache.org/confluence/display/KAFKA/KIP-91+Provide+Intuitive+User+Timeouts+in+The+Producer If the producer sends a request to the old leader of a topic parti

Re: Mirrormaker producing to only one partition in a topic

2018-11-23 Thread bruce . ma
On 2018/05/29 20:28:40, Ryan En wrote: > Hi, I'm using Kafka version 0.10.2.0 and trying to use Mirrormaker to the > messages from one Kafka cluster to another. > > > The source and target Kafka cluster are pretty much set up the same... > replication factor is 3, number of partitions is 3

Re: Please explain Rest API

2018-11-23 Thread Satendra Pratap Singh
Hi Ryan, Thanks. Since I am new to Kafka don’t understand how to configures rest api and how to reconfigure connectors. In general I don’t know how to run GET /connector command and where to run. Please elaborate. Sent from my iPhone > On 23-Nov-2018, at 21:43, Ryanne Dolan wrote: > > Sat

Kafka Producer Buffer and Broker Connection Failure

2018-11-23 Thread Mark Anderson
Hi, I'm currently testing Kafka Producers in cases of broker connection failure due to the broker process dieing or network connection timeout. I'd like to make sure that I understand how the Producer buffer functions in this case. Note that I have retries set to 0. >From what I can see when send

Re: Please explain Rest API

2018-11-23 Thread Ryanne Dolan
Satendra, the Connect REST API enables starting, stopping, and reconfiguring Connecters in a distributed Connect cluster. Kafka Connect, more generally, is a framework for connecting Kafka to external data sources, e.g. Change Data Capture from relational databases, etc. Ryanne On Fri, Nov 23, 20

Please explain Rest API

2018-11-23 Thread Satendra Pratap Singh
Hi Team, Please click on this link : https://kafka.apache.org/documentation/#connect_rest I am kafka beginner recently started learning kafka. i want to get my hands dirty in kafka. most of the topics have explained well but i couldn't understand Rest API. what is used for? how to use it? all com