Re: Sending yarn application logs to web socket

2015-09-08 Thread Jeetendra Gangele
1.in order to change log4j.properties at the name node, u can change /home/hadoop/log4j.properties. 2.in order to change log4j.properties for the container logs, u need to change it at the yarn containers jar, since they hard-coded loading the file directly from project resources. 2.1 ssh to the

Re: Sending yarn application logs to web socket

2015-09-07 Thread Yana Kadiyska
Hopefully someone will give you a more direct answer but whenever I'm having issues with log4j I always try -Dlog4j.debug=true.This will tell you which log4j settings are getting picked up from where. I've spent countless hours due to typos in the file, for example. On Mon, Sep 7, 2015 at 11:47 AM

Re: Sending yarn application logs to web socket

2015-09-07 Thread Jeetendra Gangele
I also tried placing my costomized log4j.properties file under src/main/resources still no luck. won't above step modify the default YARN and spark log4j.properties ? anyhow its still taking log4j.properties from YARn. On 7 September 2015 at 19:25, Jeetendra Gangele wrote: > anybody here t

Re: Sending yarn application logs to web socket

2015-09-07 Thread Jeetendra Gangele
anybody here to help? On 7 September 2015 at 17:53, Jeetendra Gangele wrote: > Hi All I have been trying to send my application related logs to socket so > that we can write log stash and check the application logs. > > here is my log4j.property file > > main.logger=RFA,SA > > log4j.appender.S

Sending yarn application logs to web socket

2015-09-07 Thread Jeetendra Gangele
Hi All I have been trying to send my application related logs to socket so that we can write log stash and check the application logs. here is my log4j.property file main.logger=RFA,SA log4j.appender.SA=org.apache.log4j.net.SocketAppender log4j.appender.SA.Port=4560 log4j.appender.SA.RemoteHost=