RE: can i process multiple batch in parallel in spark streaming

2015-12-09 Thread Tim Barthram
.scheduler.mode", "FAIR"), ("spark.streaming.concurrentJobs", "5")) Thanks, From: prateek arora [mailto:prateek.arora...@gmail.com] Sent: Thursday, 10 December 2015 8:07 AM To: Ted Yu Cc: user Subject: Re: can i process multiple batch in parallel in spar

Re: can i process multiple batch in parallel in spark streaming

2015-12-09 Thread prateek arora
IFO manner . is it >> possible >> all my Active batches start processing in parallel. >> >> Regards >> Prateek >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/can-i-process-mul

Re: can i process multiple batch in parallel in spark streaming

2015-12-09 Thread Ted Yu
art processing in parallel. > > Regards > Prateek > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/can-i-process-multiple-batch-in-parallel-in-spark-streaming-tp25653.html > Sent from the Apache Spark User List maili

can i process multiple batch in parallel in spark streaming

2015-12-09 Thread prateek arora
- processing it seems batches push into queue and work like FIFO manner . is it possible all my Active batches start processing in parallel. Regards Prateek -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/can-i-process-multiple-batch-in-parallel-in