Re: Reload DistributedCache file?

2017-08-17 Thread Conrad Crampton
refreshing this on a local level (to the taskmanager node). I may have to read HDFS directly in the FilterFunction to keep it up to date. Thanks Conrad From: Ted Yu Date: Wednesday, 16 August 2017 at 18:11 To: Conrad Crampton Cc: "user@flink.apache.org" Subject: Re: Reload Distributed

Reload DistributedCache file?

2017-08-16 Thread Conrad Crampton
Hi, I have a simple text file that is stored in HDFS which I use in a RichFilterFunction by way of DistributedCache file. The file is externally edited periodically to have other lines added to it. My FilterFunction also implements Runnable whose run method is run as a scheduleAtFixedRate method

Re: Classloader and removal of native libraries

2017-08-11 Thread Conrad Crampton
From: Aljoscha Krettek Date: Thursday, 10 August 2017 at 15:57 To: Conrad Crampton Cc: "user@flink.apache.org" Subject: Re: Classloader and removal of native libraries Hi Conrad, I'm afraid you're running in the same problem that we already encountered with loading the na

Classloader and removal of native libraries

2017-08-10 Thread Conrad Crampton
Hi, First time posting here so ‘hi’. I have been using Flink (1.31 now) for a couple of months now and loving it. My deployment is to JobManager running as a long running session on Yarn. I have a problem where I have a Flink streaming job that involves loading native libraries as part of one of