Thanks. I will give it a try! *Alessandro Liparoti*
2018-06-20 21:21 GMT+02:00 Ruslan Dautkhanov <dautkha...@gmail.com>: > > Something like this for log4j should do > > log4j.rootLogger = INFO, dailyfile >> log4j.appender.stdout = org.apache.log4j.ConsoleAppender >> log4j.appender.stdout.layout = org.apache.log4j.PatternLayout >> log4j.appender.stdout.layout.ConversionPattern=%5p [%d] ({%t} %F[%M]:%L) >> - %m%n >> log4j.appender.dailyfile.DatePattern=.yyyy-MM-dd >> log4j.appender.dailyfile.Threshold = DEBUG >> log4j.appender.dailyfile = org.apache.log4j.DailyRollingFileAppender >> log4j.appender.dailyfile.File = ${zeppelin.log.file} >> log4j.appender.dailyfile.layout = org.apache.log4j.PatternLayout >> log4j.appender.dailyfile.layout.ConversionPattern=%5p [%d] ({%t} >> %F[%M]:%L) - %m%n >> >> log4j.logger.org.apache.zeppelin.interpreter.InterpreterFactory=DEBUG >> log4j.logger.org.apache.zeppelin.notebook.Paragraph=DEBUG >> log4j.logger.org.apache.zeppelin.scheduler=DEBUG >> log4j.logger.org.apache.zeppelin.spark=DEBUG >> log4j.logger.org.apache.zeppelin.python=DEBUG >> log4j.logger.org.apache.zeppelin.interpreter.util=DEBUG >> log4j.logger.org.apache.zeppelin.interpreter.remote=DEBUG >> log4j.logger.org.apache.zeppelin.interpreter.remote. >> RemoteInterpreterServer=DEBUG >> log4j.logger.org.glassfish.jersey.internal.inject.Providers=SEVERE > > > > > -- > Ruslan Dautkhanov > > > On Wed, Jun 20, 2018 at 3:01 AM Alessandro Liparoti < > alessandro.l...@gmail.com> wrote: > >> Hi, >> yes spark UI is a tool I already use for it but as Rusian mentioned would >> be good to have this functionality. >> Rusian: which verbose level allows me to have stdout in log files? Is >> there an attribute to add to the appender for this? >> >> *Alessandro Liparoti* >> >> 2018-06-19 19:52 GMT+02:00 Ruslan Dautkhanov <dautkha...@gmail.com>: >> >>> If you set pretty verbose level in log4j then you can see output in log >>> files. I've seen it there. >>> Then you can use regexps to strip out paragraph outputs from rest of >>> debugging messages. >>> May work as a one off effort. Might be a good idea to file an >>> enhancement request - this can be also useful >>> for scheduled notebook runs - would be great to go back and review each >>> scheduled note executions etc. >>> >>> >>> >>> On Tue, Jun 19, 2018 at 2:56 AM Alessandro Liparoti < >>> alessandro.l...@gmail.com> wrote: >>> >>>> I am comparing performances between different implementations of a >>>> spark job and I am testing a chunk of code which prints partial results and >>>> info to sdtout. I can surely replace all the prints with logger calls and >>>> collect them. I just wanted to know if there was a way to avoid this or if >>>> this functionality was of easier implementation. >>>> >>>> *Alessandro Liparoti* >>>> >>>> 2018-06-19 10:52 GMT+02:00 Jeff Zhang <zjf...@gmail.com>: >>>> >>>>> >>>>> Not sure what kind of analysis you want to do, is the logging info in >>>>> the interpreter log file enough for you ? (You can update the log level in >>>>> log4j.properties to get more logs) >>>>> >>>>> Alessandro Liparoti <alessandro.l...@gmail.com>于2018年6月19日周二 下午4:47写道: >>>>> >>>>>> I would like to post-analyze the output of verbose jobs in the >>>>>> notebook and save them, avoiding to relaunch the jobs again. It would be >>>>>> also good to have the stderr logged to file. >>>>>> >>>>>> Thanks >>>>>> >>>>>> *Alessandro Liparoti* >>>>>> >>>>>> 2018-06-19 10:43 GMT+02:00 Jeff Zhang <zjf...@gmail.com>: >>>>>> >>>>>>> >>>>>>> I am not afraid it is not possible now. The stdout of notebooks is >>>>>>> not based on log4j. If you want it output to file as well, you might >>>>>>> need >>>>>>> to change the code of the interpreter itself. >>>>>>> Usually it is not necessary to log it to log file as well, could you >>>>>>> tell why you want that ? Thanks >>>>>>> >>>>>>> >>>>>>> >>>>>>> alessandro.l...@gmail.com <alessandro.l...@gmail.com>于2018年6月19日周二 >>>>>>> 下午3:52写道: >>>>>>> >>>>>>>> Good morning, >>>>>>>> I would like to have stdout of notebooks both printed out to >>>>>>>> console and file. How can I achieve that? I tried to play around with >>>>>>>> log4j >>>>>>>> but without any success; it seems it requires a custom appender >>>>>>>> implementation. Any other simpler idea? >>>>>>>> >>>>>>> >>>>>> >>>> >>