Re: Kafka CDC from Databases to S3

2019-02-14 Thread Alan Salewski
> On Fri, 15 Feb. 2019, 7:03 am John Ziebro > > We are planning on implementing Kafka to stream changes from a MariaDB as > > well as a MS SQL Server database into an S3 bucket and [...] > > What are your suggestions for handling this scenario? > > > > Thank you, > > John Z On 2019-02-15 07:26:

Re: Kafka work stealing question

2019-04-23 Thread Alan Salewski
Hi Gagan, It is true that a consumer will only poll for messages from the partitions to which it is assigned, but any single consumer can be assigned to poll from multiple partitions. That will happen whenever the number of partitions is greater than the number of consumers. In your example of 5