Re: Add Caller Context in Spark

Yes, it is a string. Jira SPARK-15857 is created. Thanks, WQ On Thu, Jun 9, 2016 at 4:40 PM, Reynold Xin wrote: > Is this just to set some string? That makes sense. One thing you would > need to make sure is that Spark should still work outsid

Re: Add Caller Context in Spark

Is this just to set some string? That makes sense. One thing you would need to make sure is that Spark should still work outside of Hadoop, and also in older versions of Hadoop. On Thu, Jun 9, 2016 at 4:37 PM, Weiqing Yang wrote: > Hi, > > Hadoop has implemented a feature of log tracing – caller

Add Caller Context in Spark

Hi, Hadoop has implemented a feature of log tracing – caller context (Jira: HDFS-9184 and YARN-4349 ). The motivation is to better diagnose and understand how specific applications impacting parts of