Re: Ever increasing physical memory for a Spark Application in YARN

2016-05-03 Thread Nitin Goyal
spaceSize was around 60-70MB. >> >> FYI, I am on Spark 1.2 and Hadoop 2.4.0 and my spark application is based >> on >> Spark SQL and it's an HDFS read/write intensive application and caches >> data >> in Spark SQL's in-memory caching >> >

Re: Ever increasing physical memory for a Spark Application in YARN

2016-05-02 Thread Daniel Darabos
> Spark SQL and it's an HDFS read/write intensive application and caches data > in Spark SQL's in-memory caching > > Any help would be highly appreciated. Or any hint that where should I look > to debug memory leak or if any tool already there. Let me know if any other >

Ever increasing physical memory for a Spark Application in YARN

2015-07-27 Thread Nitin Goyal
: http://apache-spark-developers-list.1001551.n3.nabble.com/Ever-increasing-physical-memory-for-a-Spark-Application-in-YARN-tp13446.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscri