Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-05-09 Thread Gwen Shapira
Same. There is a backward compatibility risk (we are changing the behavior, and the assessment that it won't affect anyone may be correct - but there is a risk that people depend on existing behaviors in ways we didn't consider) Remember that users are yelling on twitter even when we do small an

Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-05-08 Thread Matthias J. Sax
With the discussion about a 3.0 release and deprecating the old MM, I am wondering if it's worth to do anything. Please should just switch to MM2 that has a better default. Thoughts? On 4/27/20 10:48 AM, Ryanne Dolan wrote: > Conversely, we could consider making MM2 use "latest" in "legacy mode

Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-05-01 Thread Jeff Widman
Thanks for chiming in Ryanne. Personally, I'd rather fix MM1 to have a default of not-skipping-messages, as that seems more correct, rather than fix the MM2 "legacy" switch to match the bad behavior. Especially since this won't affect currently-running mirrormakers, so there's not that much break

Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-04-27 Thread Ryanne Dolan
Conversely, we could consider making MM2 use "latest" in "legacy mode", and leave MM1 as it is? (Just thinking out loud.) Ryanne On Mon, Apr 27, 2020 at 12:39 PM Jeff Widman wrote: > Good questions: > > > *I agree that `auto.offset.reset="earliest"` would be a better default. > However, I am a

Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-04-27 Thread Jeff Widman
Good questions: *I agree that `auto.offset.reset="earliest"` would be a better default. However, I am a little worried about backwardcompatibility. * Keep in mind that existing mirrormaker instances will *not* be affected for topics they are currently consuming because they will already have sav

Re: [DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-04-11 Thread Matthias J. Sax
Jeff, thanks for the KIP. I agree that `auto.offset.reset="earliest"` would be a better default. However, I am a little worried about backward compatibility. And even if the current default is not idea, users can still change it. What I am also wondering thought is, does this only affect MirrorMa

[DISCUSS] KIP-592: MirrorMaker should replicate topics from earliest

2020-04-10 Thread Jeff Widman
https://cwiki.apache.org/confluence/display/KAFKA/KIP-592%3A+MirrorMaker+should+replicate+topics+from+earliest It's a relatively minor change, only one line of code. :-D -- *Jeff Widman* jeffwidman.com | 740-WIDMAN-J (943-6265) <><