I assume you're looking in the taskmanager log file for the memory usage
logging statements, right?
Cheers,
Till
On Wed, Dec 9, 2015 at 12:15 AM, Filip Łęczycki <filipleczy...@gmail.com>
wrote:
> Hi,
>
> Thank you for your reply!
>
> I have made sure I restarted the TaskManager after changing config, but it
> didn't resolve the issue.The config is loaded as I can see the following
> line in the log:
> 09:12:2015 00:00:21,894 DEBUG
> org.apache.flink.configuration.GlobalConfiguration - Loading
> configuration property: taskmanager.debug.memory.startLogThread, true
>
> I am running a job on local standalone flink instance and my
> log4j.properties look like this:
> log4j.rootLogger=DEBUG, file
>
> # Log all infos in the given file
> log4j.appender.file=org.apache.log4j.FileAppender
> log4j.appender.file.file=${log.file}
> log4j.appender.file.append=false
> log4j.appender.file.layout=org.apache.log4j.PatternLayout
> log4j.appender.file.layout.ConversionPattern=%d{dd:MM:YYY HH:mm:ss,SSS}
> %-5p %-60c %x - %m%n
>
> # suppress the irrelevant (wrong) warnings from the netty channel handler
> log4j.logger.org.jboss.netty.channel.DefaultChannelPipeline=ERROR, file
>
> Maybe I can set some property in the job's code so that it would force
> such verbose logging? I need those logs to run some flink performance
> tests but maybe I can somehow extract the benchmark results without them, do
> you know any other way to monitor Flink Job's memory usage and GC time,
> other than looking at web interface?
>
> Best regards,
> Filip Łęczycki
>
> Pozdrawiam,
> Filip Łęczycki
>
> 2015-12-08 20:48 GMT+01:00 Stephan Ewen <se...@apache.org>:
>
>> Hi!
>>
>> That is exactly the right way to do it. Logging has to be at least INFO
>> and the parameter "taskmanager.debug.memory.startLogThread" set to true.
>> The log output should be under
>> "org.apache.flink.runtime.taskmanager.TaskManager".
>>
>> Do you see other outputs for that class in the log?
>>
>> Make sure you restarted the TaskManager processes after you changed the
>> config file.
>>
>> Greetings,
>> Stephan
>>
>>
>>
>> On Tue, Dec 8, 2015 at 6:56 PM, Filip Łęczycki <filipleczy...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I am trying to enable logging of memory usage on flink 0.10.0 by adding:
>>>
>>> taskmanager.debug.memory.startLogThread: true
>>>
>>> to config.yaml and setting log4j level to DEBUG however in the logs after
>>> running the job I cannot see any info regarding memory usage.My job lasted
>>> 30s so it should catch few intervals. Should I change something else in the
>>> configuration?
>>>
>>>
>>> Best regards/Pozdrawiam,
>>>
>>> Filip Łęczycki
>>>
>>
>>
>
