Re: [KafkaIO] Use of sinkGroupId with Exactly Once Semantics

Thanks for the input folks! Sounds like a singular value across my application (despite that application writing to multiple topics) is what I want. On Fri, Nov 11, 2022 at 1:34 PM Byron Ellis via user wrote: > The Kafka consumer offset key >

Re: [KafkaIO] Use of sinkGroupId with Exactly Once Semantics

The Kafka consumer offset key is (group, topic, partition) On Fri, Nov 11, 2022 at 7:58 AM John Casey via user wrote: > I haven't done this experimentally before, so take this with a grain of

Re: [KafkaIO] Use of sinkGroupId with Exactly Once Semantics

I haven't done this experimentally before, so take this with a grain of salt, but... Kafka Group Ids are essentially used to track where a logical (aka application level, not thread/machine level) producer / consumer is at. As such, I think it would be fine to use just one group id, even when writ