?????? checkpoint upload thread

[Enric Ott]

Thanks for the clarification,Yanfei.And I will dig it deeper later.




------------------ ???????? ------------------
??????:                                                                         
                                               "Yanfei Lei"                     
                                                               
<fredia...@gmail.com&gt;;
????????:&nbsp;2024??8??1??(??????) ????5:52
??????:&nbsp;"Enric Ott"<243816...@qq.com&gt;;
????:&nbsp;"user"<user@flink.apache.org&gt;;
????:&nbsp;Re: checkpoint upload thread



Hi Enric,

Sorry for the confusion, I mean "It can be done theoretically, and it
depends on the specific implementation of the file system client in
fact."

I think there are two ways to let different tasks share a connection
(In other words: "socket"):
1. Share one *Output Stream*;
2. Use different Output Streams, but those OutputStreams share one
underlying socket(which is implemented by the specific file system
client).

Back to Flink, currently different tasks do not share the output
streams, but I am not sure whether the underlying sockets are shared.


Enric Ott <243816...@qq.com&gt; ??2024??8??1?????? 10:04??????

&gt;
&gt; Hi,Yanfei:
&gt;&nbsp;&nbsp; What do you mean by using the word possible in statment it is 
possible to use the same
&gt; connection for an operator chain? Meaning able to be done but not applied 
in fact? Or actually applied but with applied probability?
&gt;
&gt;&nbsp;&nbsp; Thanks.
&gt;
&gt;
&gt; ------------------ ???????? ------------------
&gt; ??????: "Yanfei Lei" <fredia...@gmail.com&gt;;
&gt; ????????: 2024??7??30??(??????) ????5:15
&gt; ??????: "Enric Ott"<243816...@qq.com&gt;;
&gt; ????: "user"<user@flink.apache.org&gt;;
&gt; ????: Re: checkpoint upload thread
&gt;
&gt; Hi Enric,
&gt;
&gt; If I understand correctly, one subtask would use one
&gt; `asyncOperationsThreadPool`[1,2], it is possible to use the same
&gt; connection for an operator chain.
&gt;
&gt; [1] 
https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/StreamTask.java#L443
&gt; [2] 
https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/SubtaskCheckpointCoordinatorImpl.java#L716
&gt;
&gt; Enric Ott <243816...@qq.com&gt; ??2024??7??30?????? 11:11??????
&gt; &gt;
&gt; &gt; Hi,Community:
&gt; &gt;&nbsp;&nbsp; Does Flink upload states and inflight buffers within the 
same opratorchain using the same connection (instead of per connection per 
operator)?
&gt;
&gt;
&gt;
&gt; --
&gt; Best,
&gt; Yanfei



--
Best,
Yanfei