Re: Flink checkpointing with Azure block storage

2020-08-24 Thread Boris Lublinsky
ey" > ) > FileSystem.initialize(conf) // this ensures the AzureFS is initialized > and with correct creds > } > // other checkpoint config stuff > } > > -- Piyush > > > From: Boris Lublinsky > Date: Saturday, August 22, 2020 at 10:08 PM > To: Y

Re: Flink checkpointing with Azure block storage

2020-08-24 Thread Piyush Narang
gust 22, 2020 at 10:08 PM To: Yun Tang Cc: user Subject: Re: Flink checkpointing with Azure block storage Thanks Yun, I make it work, but now I want to set appropriate config programmatically. I can set state.checkpointing.dir by: val fsStateBackend = new FsStateBackend(new URI(&quo

Re: Flink checkpointing with Azure block storage

2020-08-22 Thread Boris Lublinsky
;https://ci.apache.org/projects/flink/flink-docs-stable/ops/filesystems/azure.html#credentials-configuration> > > Best > Yun Tang > > From: Boris Lublinsky > Sent: Friday, August 21, 2020 7:18 > To: user > Subject: Re: Flink checkpointing with Azure block storage > >

Re: Flink checkpointing with Azure block storage

2020-08-20 Thread Yun Tang
s-configuration Best Yun Tang From: Boris Lublinsky Sent: Friday, August 21, 2020 7:18 To: user Subject: Re: Flink checkpointing with Azure block storage To test it, I created flink-conf.yaml file and put it in resource directory of my project T

Re: Flink checkpointing with Azure block storage

2020-08-20 Thread Boris Lublinsky
To test it, I created flink-conf.yaml file and put it in resource directory of my project The file contains the following: #== # Fault tolerance and checkpointing #=

Flink checkpointing with Azure block storage

2020-08-20 Thread Boris Lublinsky
Is there somewhere a complete configuration example for such option?