How do you start the flink cluster? If it's a standalone cluster and you
don't use a shared directory, then you'll find the log of the taskmanager
on the machine on which the taskmanager runs. If you use YARN then you can
activate log aggregation to retrieve the log easily after the job has
finishe
Hi Stephan, Till
I am looking for the memory usage info in flink__jobmanager... log.
As there are no other log files in /log dir I assumed this is the right
place to look. I will try to setup a new clean instance and check whether
it will work.
Thank you very much for your assistance!
Best regard
Hi Filip!
Someone else just used the memory logging with the exact described settings
- it worked.
There is probably some mixup, you may be looking into the wrong log file,
or may setting the a value in a different config...
Stephan
On Wed, Dec 9, 2015 at 10:58 AM, Till Rohrmann wrote:
> I a
I assume you're looking in the taskmanager log file for the memory usage
logging statements, right?
Cheers,
Till
On Wed, Dec 9, 2015 at 12:15 AM, Filip Łęczycki
wrote:
> Hi,
>
> Thank you for your reply!
>
> I have made sure I restarted the TaskManager after changing config, but it
> didn't res
Hi,
Thank you for your reply!
I have made sure I restarted the TaskManager after changing config, but it
didn't resolve the issue.The config is loaded as I can see the following
line in the log:
09:12:2015 00:00:21,894 DEBUG
org.apache.flink.configuration.GlobalConfiguration- Loading
Hi!
That is exactly the right way to do it. Logging has to be at least INFO and
the parameter "taskmanager.debug.memory.startLogThread" set to true.
The log output should be under
"org.apache.flink.runtime.taskmanager.TaskManager".
Do you see other outputs for that class in the log?
Make sure yo
Hi,
I am trying to enable logging of memory usage on flink 0.10.0 by adding:
taskmanager.debug.memory.startLogThread: true
to config.yaml and setting log4j level to DEBUG however in the logs
after running the job I cannot see any info regarding memory usage.My
job lasted 30s so it should catch f
