Re: Logging in Flink 0.9.0-milestone-1

2015-06-26 Thread Till Rohrmann
Hi Stefan, You can do this if you disableSysoutLogging and change your log4j-cli.properties file to also print to console. There you can then control what is logged to console. However, I think that you have to set disableSysoutLogging in your program. Cheers, Till ​ On Fri, Jun 26, 2015 at 11:4

Re: Logging in Flink 0.9.0-milestone-1

2015-06-26 Thread Stephan Ewen
There are two different forms of progress logging: - The log4j framework logs everything (as configured in the log4j.properties) - Additionally, the client sysout prints the progress reports If you want the command line to be quiet, you need to disable sysout logging on the execution environmen

Re: Logging in Flink 0.9.0-milestone-1

2015-06-26 Thread Stefan Bunk
Hi Robert, this problem persists in the 0.9 release. Using `disableSysoutLogging()` works, but I'd rather configure this in the log4j.xml. Is this possible? Best, Stefan On 14 April 2015 at 20:55, Robert Metzger wrote: > You can control the logging behavior from the ExecutionConfig > (env.getE

Re: Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Robert Metzger
You can control the logging behavior from the ExecutionConfig (env.getExecutionConfig()). There is a method (disableSysoutLogging()) that you can use. (In 0.9-SNAPSHOT only). Sorry again that you ran into this issue. On Tue, Apr 14, 2015 at 8:45 PM, Robert Metzger wrote: > Ah, I see. > > The is

Re: Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Robert Metzger
Ah, I see. The issue is this line in the JobClient.scala here: https://github.com/apache/flink/blob/release-0.9.0-milestone-1-rc1/flink-runtime/src/main/scala/org/apache/flink/runtime/client/JobClient.scala#L97 As you can see, its doing sysout logging. In the current master, this has been reworke

Re: Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Stefan Bunk
Hi, I am also using IntelliJ, and I am starting directly from the IDE. Local execution. This is what my logging output looks like: [1]. I am getting my logger via: val log = org.apache.log4j.Logger.getLogger(getClass) [1] https://gist.github.com/knub/1c11683601b4eeb5d51b On 14 April 2015 at 18:

Re: Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Robert Metzger
Hi, how are you starting Flink? Out of the IDE? Using the scripts? I just created a new flink project with the milestone version. Just putting your log4j.xml into the resources folder enabled the logging (I've set it to INFO for flink and it worked). I've used IntelliJ and started the WordCount.j

Re: Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Stefan Bunk
Hi Robert, thanks for the info. Adding the parameter didn't help. My logging file is found and my logging configuration for my own logging is working (even without the parameter), it's just that the file in the jar seems to be preferred over my file. Best, Stefan On 14 April 2015 at 17:16, Rober

Re: Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Robert Metzger
Hi Stefan, we made a stupid mistake in the 0.9.0-milestone-1 release by including our log4j.properties into the flink-runtime jar. its also in the fat jar in flink-dist. Maybe you can pass the name of your log4j file to your application with - Dlog4j.configuration=log4j.xml? The issue is already

Logging in Flink 0.9.0-milestone-1

2015-04-14 Thread Stefan Bunk
Hi Flinkers, I just switched to 0.9.0-milestone-1, and now I get Flink's logging output again in my console (local execution). I have a log4j.xml under src/main/resources, which says not to log any Flink job progress updates, and which worked fine so far: [...]