Intial Data Load

2020-05-29 Thread Suresh Chidambaram
Hi Team, My requirement is that I have to perform an One Time Data Load(intial load) to the topic, later I have to perform the delta load to the topic. So could someone guide me how to achieve this requirement in Confluent Kafka/Apache Kafka? Thanks C Suresh

Re: Clients may fetch incomplete set of topic partitions during cluster startup

2020-05-29 Thread John Roesler
Hello, Thanks for the question. It looks like the ticket is still open, so I think it's safe to say it's not fixed. If you're affected by the issue, it would be helpful to leave a comment on the ticket to that effect. Thanks, -John On Fri, May 29, 2020, at 00:05, Debraj Manna wrote: > Anyone an

Apache Kafka MirrorMaker2 issue

2020-05-29 Thread Peri, Viswanadh
Hi Team We have configured KafkaMirrorMaker2 as shown below. apiVersion: kafka.strimzi.io/v1alpha1 kind: KafkaMirrorMaker2 metadata: name: brcm-mirror-maker2 spec: version: 2.4.0 replicas: 1 connectCluster: "mm-backup-cluster" clusters: - alias: "mm-src-cluster" authentication: certificateAndKey:

AW: Repeated UnknownProducerIdException

2020-05-29 Thread Schmidt-Dumont Georg (BCI/ESW17)
Hi Matthias, Thanks for the hint! My application is not using any repartition topics though. Best regards / Mit freundlichen Grüßen / Üdvözlettel / 致以诚挚的问候 Mr. Georg Schmidt-Dumont Bosch Connected Industry – BCI/ESW17 Robert Bosch GmbH | Postfach 10 60 50 | 70049 Stuttgart | GERMANY | www.bosc

Single Task running both worker node

2020-05-29 Thread Deepak Raghav
Hi Team Recently, I had seen strange behavior in kafka-connect. We have source connector with single task only, which reads from S3 bucket and copy to kafka topic.We have two worker node in a cluster, so at any point of time a task can be assigned to single worker node. I saw in logs that both th