Re: Kafka SQL Connector: dropping events if more partitions then source tasks

2021-02-26 Thread Shengkai Fang
he Datastream API. > > > > The problem is only on the SQL site. > > > > > > Best, > > Jan > > > > *Von:* Benchao Li > *Gesendet:* Donnerstag, 25. Februar 2021 00:04 > *An:* Jan Oelschlegel > *Cc:* Arvid Heise ; user ; Timo > Walther > *Be

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

2021-02-26 Thread Shengkai Fang
gt; > > > The problem is only on the SQL site. > > > > > > Best, > > Jan > > > > *Von:* Benchao Li > *Gesendet:* Donnerstag, 25. Februar 2021 00:04 > *An:* Jan Oelschlegel > *Cc:* Arvid Heise ; user ; Timo > Walther > *Betreff:* Re: Ka

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

2021-02-24 Thread Benchao Li
> > > > *Von:* Arvid Heise > *Gesendet:* Mittwoch, 24. Februar 2021 14:10 > *An:* Jan Oelschlegel > *Cc:* user ; Timo Walther > *Betreff:* Re: Kafka SQL Connector: dropping events if more partitions > then source tasks > > > > Hi Jan, > > > > Are you r

Re: Kafka SQL Connector: dropping events if more partitions then source tasks

2021-02-24 Thread Arvid Heise
Hi Jan, Are you running on historic data? Then your partitions might drift apart quickly. However, I still suspect that this is a bug (Watermark should only be from the slowest partition). I'm pulling in Timo who should know more. On Fri, Feb 19, 2021 at 10:50 AM Jan Oelschlegel < oelschle...@