Re: Savepoint a failing job

2022-12-26 Thread Timothy Bess
Hi Hangxiang and Martijn, Thanks for the tips! That state processor API looks interesting, I'll have to dig into that more. The point about the query plan makes sense, but it also means that using SQL in my job end-to-end is a little dangerous if I need to guarantee that I'll never have to dump st

Re: Understanding pipelined regions

2022-12-26 Thread Raihan Sunny
Thanks for the clarification Gen. On Fri, Dec 23, 2022, 14:20 Gen Luo wrote: > Hi Raihan, > If the job is a streaming job, all exchanges are pipeline exchanges. That > means the upstream and downstream tasks must be running at the same time > and exchange data realtimely. While blocking data exc