Re: Write to Aliyun OSS via FileSystem connector hang Job Master on Finishing

2022-04-25 Thread Yi Tang
Thanks Guowei. Good to know it may have been fixed in another way. I'll have a try. BTW, which version is this kind of sink supported from? Does it also work for batch mode? On Mon, Apr 25, 2022 at 2:42 PM Guowei Ma wrote: > Hi > > Afaik the commit files action happens at the committer operat

Re: Write to Aliyun OSS via FileSystem connector hang Job Master on Finishing

2022-04-24 Thread Guowei Ma
Hi Afaik the commit files action happens at the committer operator instead of the JM size after the new sink api [1]. It means this would not happen if you use the new `FlinkSink`.[2] [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-143%3A+Unified+Sink+API [2] https://github.com/apach