RE: Spark logging strategy on YARN

2014-07-07 Thread Andrew Lee
actice. Anyone else have ideas? thoughts? > From: kudryavtsev.konstan...@gmail.com > Subject: Spark logging strategy on YARN > Date: Thu, 3 Jul 2014 22:26:48 +0300 > To: user@spark.apache.org > > Hi all, > > Could you please share your the best practices on writing logs in Spark?

Spark logging strategy on YARN

2014-07-03 Thread Kostiantyn Kudriavtsev
Hi all, Could you please share your the best practices on writing logs in Spark? I’m running it on YARN, so when I check logs I’m bit confused… Currently, I’m writing System.err.println to put a message in log and access it via YARN history server. But, I don’t like this way… I’d like to use l