Just a quick remark about memory and number of slots: with your configuration
of 30 slots but only ~20gb of RAM each processing slot does not have a lot of
memory to work with. For batch programs this can be a problem. I would suggest
to use less but bigger slots, even if the number of cores is
Some documentation on application profiling with Flink 1.3 (can be manually
inserted into the scripts for Flink 1.2):
https://ci.apache.org/projects/flink/flink-docs-release-1.3/monitoring/application_profiling.html
> On Jun 22, 2017, at 9:24 AM, Stefan Richter
> wrote:
>
> Hi,
>
> the an
Hi,
the answer highly depends on what you job is doing and there is no information
about that. Also what is your target in performance? Are you using batch or
streaming? If you feel like the performance is lower than expected, I suggest
that you do some profiling to figure out the hotspots.
For
Hi All,
This query regarding the flink performance improvement .
*Flink Configuration:*
using flink in clustor mode with 3 salves and a master configuration
slots used 30 (as the system has 30 core)
task manager memory 30GB
parallelism used : 30
jobmanager.heap.mb: 20480
taskmanager.heap.mb: 2048
