Can't agree with Shahar Frank more
On 2023/04/19 18:17:15 Shahar Frank wrote:
> Hi Daniel,
>
> I think I've already answered these in a previous email but let me answer
> them again.
>
> I was specifically responding to quoted points from your last email. I
>> really don't understand why you,
Hi,
my two cents on this. While it would perfectly possible to use consumer
group in KafkaIO, it has its own issues. The most visible would be, that
using subscriptions might introduce unnecessary duplicates in downstream
processing. The reason for this is that consumer in a consumer group
mi
Can't agree with Shahar Frank more
On 2023/04/19 18:17:15 Shahar Frank wrote:
> Hi Daniel,
>
> I think I've already answered these in a previous email but let me answer
> them again.
>
> I was specifically responding to quoted points from your last email. I
> > really don't understand why you,
Why do you want to use a consumer group? If you have consumers in other
jobs, your beam job will fail to receive all messages it should for the
topic.
> It seems the code attempts to circumvent the partition assignment
mechanism provided by Kafka to use it's own.
All beam I/Os for partitioned sou
