Re: Multiple cores/executors in Pyspark standalone mode

2017-03-28 Thread Gourav Sengupta
hi, any particular reason why you would not use spark server and then create your own spark session? Regards, Gourav On Fri, Mar 24, 2017 at 7:43 PM, Li Jin wrote: > Hi, > > I am wondering does pyspark standalone (local) mode support multi > cores/executors? > > Thanks, > Li >

Re: EXT: Multiple cores/executors in Pyspark standalone mode

2017-03-24 Thread Li Jin
t; Date: Friday, March 24, 2017 at 3:43 PM > To: "user@spark.apache.org<mailto:user@spark.apache.org>" < > user@spark.apache.org<mailto:user@spark.apache.org>> > Subject: EXT: Multiple cores/executors in Pyspark standalone mode > > Hi, > > I am wondering does pyspark standalone (local) mode support multi > cores/executors? > > Thanks, > Li >

Re: EXT: Multiple cores/executors in Pyspark standalone mode

2017-03-24 Thread Kadam, Gangadhar (GE Aviation, Non-GE)
should use master node address to create (spark://host:port) Thanks! Gangadhar From: Li Jin mailto:ice.xell...@gmail.com>> Date: Friday, March 24, 2017 at 3:43 PM To: "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: EXT: M

Multiple cores/executors in Pyspark standalone mode

2017-03-24 Thread Li Jin
Hi, I am wondering does pyspark standalone (local) mode support multi cores/executors? Thanks, Li