Re: Spark - configuration setting doesn't work

2019-10-29 Thread Chetan Khatri
Ok, thanks. I wanted to confirm that. On Sun, Oct 27, 2019 at 12:55 PM hemant singh wrote: > You should add the configurations while creating the session, I don’t > think you can override it once the session is created. Few are though. > > Thanks, > Hemant > > On Sun, 27 Oct 2019 at 11:02 AM, Ch

Re: Spark - configuration setting doesn't work

2019-10-27 Thread hemant singh
You should add the configurations while creating the session, I don’t think you can override it once the session is created. Few are though. Thanks, Hemant On Sun, 27 Oct 2019 at 11:02 AM, Chetan Khatri wrote: > Could someone please help me. > > On Thu, Oct 17, 2019 at 7:29 PM Chetan Khatri >

Re: Spark - configuration setting doesn't work

2019-10-26 Thread Chetan Khatri
Could someone please help me. On Thu, Oct 17, 2019 at 7:29 PM Chetan Khatri wrote: > Hi Users, > > I am setting spark configuration in below way; > > val spark = SparkSession.builder().appName(APP_NAME).getOrCreate() > > spark.conf.set("spark.speculation", "false") > spark.conf.set("spark.broadc