Yup, I shall open an issue for both this one and my other thread (re:
Kerberos).
Thanks for the pointer on this issue.
On Tue, Mar 29, 2016 at 12:44 PM, Maximilian Michels wrote:
> Hi Stefano,
>
> Thanks for pointing out this bug. Your analysis is correct. The per-job
> cluster does not ship the
Hi Stefano,
Thanks for pointing out this bug. Your analysis is correct. The per-job
cluster does not ship the /lib directory by default. Would you like to open
an issue/PR? We should let the ship_path default to the /lib directory.
The mechanism with the environment variables is the same. They us
Thanks for pointing out Max's work (awesome PR, btw). It actually seem to
have introduced an environment variable regarding ship directories, it
would be good to have his feedback on this.
On Tue, Mar 22, 2016 at 10:24 PM, Ufuk Celebi wrote:
> On Tue, Mar 22, 2016 at 8:42 PM, Stefano Baghino
>
On Tue, Mar 22, 2016 at 8:42 PM, Stefano Baghino
wrote:
> My feeling is that running a job on YARN should
> end up in having more or less the same effect, regardless of the way the
> job is run.
+1
I think that the current behaviour is buggy. The resource management
is currently undergoing a mas
Hello everybody,
in the past few days me and my colleagues ran some tests with Flink on YARN
and detected a possible inconsistent behavior in the way the contents of
the flink/lib directory is shipped to the cluster when run on YARN,
depending on the fact that the jobs are deployed individually or
