Re: [DISCUSS] FLIP-414: Support Retry Mechanism in RocksDBStateDataTransfer

2024-02-21 Thread xiangyu feng
rall LGTM. > > > I just have a small question. There are other places in Flink that > > interact > > > with external storage. Should we consider adding a general retry > > mechanism > > > to them? > > > > > > xiangyu feng 于2024年1月8日周一 11:31写道

Re: [DISCUSS] FLIP-414: Support Retry Mechanism in RocksDBStateDataTransfer

2024-01-11 Thread Piotr Nowojski
eneral retry > mechanism > > to them? > > > > xiangyu feng 于2024年1月8日周一 11:31写道: > > > > > Hi devs, > > > > > > I'm opening this thread to discuss FLIP-414: Support Retry Mechanism in > > > RocksDBStateDataTransfer[1]. > > > >

Re: [DISCUSS] FLIP-414: Support Retry Mechanism in RocksDBStateDataTransfer

2024-01-11 Thread Hangxiang Yu
adding a general retry mechanism > to them? > > xiangyu feng 于2024年1月8日周一 11:31写道: > > > Hi devs, > > > > I'm opening this thread to discuss FLIP-414: Support Retry Mechanism in > > RocksDBStateDataTransfer[1]. > > > > Currently, there is no retry mec

Re: [DISCUSS] FLIP-414: Support Retry Mechanism in RocksDBStateDataTransfer

2024-01-10 Thread yue ma
m opening this thread to discuss FLIP-414: Support Retry Mechanism in > RocksDBStateDataTransfer[1]. > > Currently, there is no retry mechanism for downloading and uploading > RocksDB state files. Any jittering of remote filesystem might lead to a > checkpoint failure. By

[DISCUSS] FLIP-414: Support Retry Mechanism in RocksDBStateDataTransfer

2024-01-07 Thread xiangyu feng
Hi devs, I'm opening this thread to discuss FLIP-414: Support Retry Mechanism in RocksDBStateDataTransfer[1]. Currently, there is no retry mechanism for downloading and uploading RocksDB state files. Any jittering of remote filesystem might lead to a checkpoint failure. By supporting