Re: Best way to determine # of workers

2016-03-25 Thread Aaron Jackson
6 at 8:23 AM, Ajaxx wrote: > >>> > >>> I'm building some elasticity into my model and I'd like to know when my > >>> workers have come online. It appears at present that the API only > >>> supports > >>> getting information abou

Re: Best way to determine # of workers

2016-03-25 Thread Jacek Laskowski
PI only >>> supports >>> getting information about applications. Is there a good way to determine >>> how many workers are available? >>> >>> >>> >>> -- >>> View this message in context: >>> http://apache-spark-user-list.1001560.n3.nabb

Re: Best way to determine # of workers

2016-03-25 Thread Ted Yu
s a sc.sparkDefaultParallelism parameter that I use to dynamically > maintain elasticity in my application. Depending upon your scenario this > might be enough. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determi

Re: Best way to determine # of workers

2016-03-25 Thread manasdebashiskar
There is a sc.sparkDefaultParallelism parameter that I use to dynamically maintain elasticity in my application. Depending upon your scenario this might be enough. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determine-of-workers

Re: Best way to determine # of workers

2016-03-24 Thread Aaron Jackson
gt;> supports >> getting information about applications. Is there a good way to determine >> how many workers are available? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-de

Re: Best way to determine # of workers

2016-03-24 Thread Takeshi Yamamuro
PI only supports > getting information about applications. Is there a good way to determine > how many workers are available? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determine-of-workers-tp26586.html > S

Best way to determine # of workers

2016-03-23 Thread Ajaxx
ext: http://apache-spark-user-list.1001560.n3.nabble.com/Best-way-to-determine-of-workers-tp26586.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apac