Re: FlinkSource to read iceberg table in Batch mode

2024-03-15 Thread Péter Váry
Hi Chetas, How sure are you that your job has no other unbounded source? I have seen this working in several cases, but if you could help with providing a sort executable example, I would like to take a look. Thanks, Peter On Wed, Mar 13, 2024, 20:55 Chetas Joshi wrote: > Hello, > > I am usin

Help with using multiple Windows in the Table API

2024-03-15 Thread Nick Hecht
Hello, I'm working on a pyflink application (1.15 deployed to aws). I have made a few applications and I feel like I'm making good progress, but I have a different problem that I think requires that I have multiple stages each with their own window. I'm not sure how I can properly pass time into m

Re: Unaligned checkpoint blocked by long Async operation

2024-03-15 Thread Gyula Fóra
Posting this to dev as well... Thanks Zakelly, Sounds like a solution could be to add a new different version of yield that would actually yield to the checkpoint barrier too. That way operator implementations could decide whether any state modification may or may not have happened and can optiona