Hi,
I am not sure since people normally don't run Flink on such large machines.
They rather run it on many smaller machines.
I will definitely be interesting too see your new results where the Job can
actually use all the memory available on the machine.
--
aljoscha
On Mon, 4 Apr 2016 at 15:54 S
Dear Aljoscha and Ufuk,
Thank you for clarifying! Yes I'm running this wordcount application
on a 64-core machine with 120GB ram allocated for users.
> In that case, the amount of RAM you give to the TaskManager seems to low.
> Could you try re-running your experiments with:
> jobmanager.heap.mb:
Just to clarify: Shinhyung is running one a single node with 4 CPUs,
each having 16 cores.
On Mon, Apr 4, 2016 at 10:32 AM, Robert Metzger wrote:
> Hi,
>
> usually it doesn't make sense to run multiple task managers on a single
> machine to get more slots.
> Your machine has only 4 CPU cores, so
Hi,
I'm afraid no one read your email carefully. You indeed have one very big
machine with 64 physical CPU cores and 120 GB of RAM, correct?
In that case, the amount of RAM you give to the TaskManager seems to low.
Could you try re-running your experiments with:
jobmanager.heap.mb: 5000
taskmanage
Hi,
usually it doesn't make sense to run multiple task managers on a single
machine to get more slots.
Your machine has only 4 CPU cores, so you are just putting a lot of
pressure on the cpu scheduler..
On Thu, Mar 31, 2016 at 7:16 PM, Shinhyung Yang
wrote:
> Thank you for replying!
>
> I am tr
Thank you for replying!
I am trying to do this on a single machine in fact. Since it has 64
cores, it would be interesting to look at the performance in that
regard.
> How many machines are you using for this?
>
> The fact that you are giving 64 slots to each TaskManager means that a
> single Tas
g to test scaling a flink streaming application on a single
> node and here I summarize my configuration and preliminary result. It
> would be really helpful if you take some time and consult my settings.
>
> test application: flink-1.0.0/examples/streaming/WordCount.jar
> input fil
Dear flink users and developers,
I am trying to test scaling a flink streaming application on a single
node and here I summarize my configuration and preliminary result. It
would be really helpful if you take some time and consult my settings.
test application: flink-1.0.0/examples/streaming
