Re: Spark driver CPU usage

2017-03-01 Thread Yong Zhang
e.org Subject: RE: Spark driver CPU usage Does that configuration parameter affect the CPU usage of the driver? If it does, we have that property unchanged from its default value of "1" yet the same behaviour as before. -Original Message- From: Rohit Verma [mailto:rohit.ve...@roki

RE: Spark driver CPU usage

2017-03-01 Thread Phadnis, Varun
7 06:08 To: Phadnis, Varun Cc: user@spark.apache.org Subject: Re: Spark driver CPU usage Use conf spark.task.cpus to control number of cpus to use in a task. On Mar 1, 2017, at 5:41 PM, Phadnis, Varun wrote: > > Hello, > > Is there a way to control CPU usage for driver when running app

Re: Spark driver CPU usage

2017-03-01 Thread Rohit Verma
Use conf spark.task.cpus to control number of cpus to use in a task. On Mar 1, 2017, at 5:41 PM, Phadnis, Varun wrote: > > Hello, > > Is there a way to control CPU usage for driver when running applications in > client mode? > > Currently we are observing that the driver occupies all the co