Re: Spark SQL: Day of month from Timestamp

You can use the functions Arush mentioned if you use HiveContext instead of SparkContext. On Tue, Mar 24, 2015 at 12:59 PM, Arush Kharbanda < ar...@sigmoidanalytics.com> wrote: > Hi > > You can use functions like year(date),month(date) > > Thanks > Arush > > On Tue, Mar 24, 2015 at 12:46 PM, Haru

Re: Spark-on-YARN architecture

Thanks for the quick reply. I am running the application in YARN client mode. And I want to run the AM on the same node as RM inorder use the node which otherwise would run AM. How can I get AM run on the same node as RM? On Tue, Mar 10, 2015 at 3:49 PM, Sean Owen wrote: > In YARN cluster mod

Re: Running multiple threads with same Spark Context

Hi Yana, I tried running the program after setting the property "spark.scheduler.mode" to FAIR. But the result is same as previous. Are there any other properties that have to be set? On Tue, Feb 24, 2015 at 10:26 PM, Yana Kadiyska wrote: > It's hard to tell. I have not run this on EC2 but thi