Re: Flink not rolling log files

2018-08-18 Thread Gary Yao
Hi, When using org.apache.log4j.rolling.RollingFileAppender, it is apparently not allowed to set: log4j.appender.file.file=${log.file} It works for me if I remove this property from the log4j.properties file. Moreover, you have configured: log4j.appender.file.RollingPolicy.FileNamePatt

Re: Flink not rolling log files

2018-08-17 Thread Dominik WosiƄski
I am using this *log4j.properties *file config for rolling files once per day and it is working perfectly. Maybe this will give You some hint: log4j.appender.file=org.apache.log4j.DailyRollingFileAppender log4j.appender.file.file=${log.file} log4j.appender.file.append=false log4j.appender.file.lay

Re: Flink not rolling log files

2018-08-17 Thread Gary Yao
Hello Navneet Kumar Pandey, org.apache.log4j.rolling.RollingFileAppender is part of Apache Extras Companion for Apache log4j [1]. Is that library in your classpath? Are there hints in taskmanager.err? Can you run: cat /usr/lib/flink/conf/log4j.properties on the EMR master node and show the

Flink not rolling log files

2018-08-17 Thread Navneet Kumar Pandey
I am using Flink in EMR with following configuration. { "Classification": "flink-log4j", "Properties": { "log4j.logger.no":"DEBUG", "log4j.appender.file":"org.apache.log4j.rolling.RollingFileAppender", "log4j.appender.file.RollingPolicy.FileNamePattern":"logs/log.%d{