Re: Flink with Openstack Swift example

2018-12-12 Thread Tejash Tarun
Hi Andrey, Thanks for the help. Let me try it out. Regards, Tejash On Wed, Dec 12, 2018 at 10:32 PM Andrey Zagrebin wrote: > Hi Tejash, > > Flink has an implementation for swift file system (see > SwiftFileSystemFactory). > It should be enough just prepend your checkpoint/savepoint paths with

Re: Flink with Openstack Swift example

2018-12-12 Thread Andrey Zagrebin
Hi Tejash, Flink has an implementation for swift file system (see SwiftFileSystemFactory). It should be enough just prepend your checkpoint/savepoint paths with “swift://“ (e.g. instead of "hdfs://“). See configuration 'how to’ in Flink docs [1], [2]. Best, Andrey [1] https://ci.apache.org/pr

Flink with Openstack Swift example

2018-12-12 Thread Tejash Tarun
Hi Users, Can somebody help me by pointing to any document listing out the steps if I want to configure checkpoint and savepoint in OpenStack Swift ? Thanks in advance, Tejash