Re: Use specific worker for heavy computations

2016-10-12 Thread Stephan Ewen
So far, we have not introduced location constraints. The reason is that this goes a bit against the paradigm of location transparency, which is necessary for failover, dynamically adjusting parallelism (which is a feature being worked on), etc. On Wed, Oct 12, 2016 at 10:35 AM, Robert Metzger wro

Re: Use specific worker for heavy computations

2016-10-12 Thread Robert Metzger
Hi Mariano, currently, there is nothing available in Flink to execute an operation on a specific machine. Regards, Robert On Wed, Sep 28, 2016 at 9:40 PM, Mariano Gonzalez < mariano.gonza...@uptake.com> wrote: > I need to load a PFA (portable format for analytics) that can be around 30 > GB an

Use specific worker for heavy computations

2016-09-28 Thread Mariano Gonzalez
I need to load a PFA (portable format for analytics) that can be around 30 GB and later process it with hadrian which is the java implementation for PFA's (https://github.com/opendatagroup/hadrian). I would like to execute this transformation step inside a specific worker of the cluster (since I d