Re: Relation between threads and executor core

2015-08-26 Thread Jem Tucker
ontrol? * > > > > Regards, > > Sam > > > > *From:* Jem Tucker [mailto:jem.tuc...@gmail.com] > *Sent:* Wednesday, August 26, 2015 2:26 PM > *To:* Samya MAITI ; user@spark.apache.org > *Subject:* Re: Relation between threads and executor core > > > > Hi S

RE: Relation between threads and executor core

2015-08-26 Thread Samya MAITI
user control? Regards, Sam From: Jem Tucker [mailto:jem.tuc...@gmail.com] Sent: Wednesday, August 26, 2015 2:26 PM To: Samya MAITI ; user@spark.apache.org Subject: Re: Relation between threads and executor core Hi Samya, When submitting an application with spark-submit the cores per executor can

Re: Relation between threads and executor core

2015-08-26 Thread Jem Tucker
Hi Samya, When submitting an application with spark-submit the cores per executor can be set with --executor-cores, meaning you can run that many tasks per executor concurrently. The page below has some more details on submitting applications: https://spark.apache.org/docs/latest/submitting-appli