Thanks Akhil. When I set it up in spark-defaults.conf it didn't work . But
when I passed it as a property for spark-submit it worked.
--conf spark.driver.maxResultSize=3G .
Also because I'm trying reset configuration in the code and I think it work
this away . As you were saying , creating the sp
You can set it in your conf/spark-defaults.conf file, or you will have to
set it before you create the SparkContext.
Thanks
Best Regards
On Fri, Oct 30, 2015 at 4:31 AM, karthik kadiyam <
karthik.kadiyam...@gmail.com> wrote:
> Hi,
>
> In spark streaming job i had the following setting
>
>
