Just some more info.
I use a ContinousMapper within a task that sends off these jobs. Can this
maybe be the reason?
On Fri, 30 Aug 2019 at 21:49, Pascoe Scholle
wrote:
> Hi Illya,
>
> So I have exciting news. Like you say we have to configure some of the
> nodes manually and I have done this us
Hi Illya,
So I have exciting news. Like you say we have to configure some of the
nodes manually and I have done this using the Collision spi and it works
great!
I have nodes configured for more powerful pc's that also have more ram
available and limit the number of jobs that can run in parallel,
Hello!
I think you will have to do it semi-manually: on every node you should know
how many resources are available, don't allow jobs to overconsume.
You could try to use LoadBalancingSpi but as far as I have heard, it is not
trivial.
Ignite it not a scheduler, so we don't have any built-ins for
Hi,
I have a question regarding the workings of the load balancer and running
prcesses which are outside the jvm.
We have a python commandline tool which is used for processing big data.
The tool is highly optimized and is able to instantly load data into ram.
Some data can be as large as 20 Gb.
