Hi Andrey, Thanks for your detailed answer, and I have created a JIRA issue to discuss it [1]. Please check the description and help me to fill the details, like component/s, since I'm not sure where it should be put. Thank you very much.
Best, Tony Wei [1] https://issues.apache.org/jira/browse/FLINK-11034 Andrey Zagrebin <and...@data-artisans.com> 於 2018年11月27日 週二 下午10:43寫道： > Hi Tony, > > File system factories are class-loaded in running JVMs of task executors. > That is why their configured objects are shared by different Flink jobs. > It is not possible to change their options per created file system and per > job at the moment. > > This could be changed, e.g. for s3, by providing "rewriting config” to > file system factory “get" method, > but this method is not usually called by users directly in user facing > components, like checkpointing or file sink. The user API is now mainly the > file system URI string without any specific config. > > I see that making it possible has value but it would require some > involving changes in file system dependent APIs or changing the way how > file systems are created in general. > You could create a JIRA issue to discuss it. > > Best, > Andrey > > > On 27 Nov 2018, at 10:06, yinhua.dai <yinhua.2...@outlook.com> wrote: > > > > It might be difficult as you the task manager and job manager are > pre-started > > in a session mode. > > > > It seems that flink http server will always use the configuration that > you > > specified when you start your flink cluster, i.e. start-cluster.sh, I > don't > > find a way to override it. > > > > > > > > -- > > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ > >
