RE: can i process multiple batch in parallel in spark streaming

2015-12-09 Thread Tim Barthram
.scheduler.mode", "FAIR"), ("spark.streaming.concurrentJobs", "5")) Thanks, From: prateek arora [mailto:prateek.arora...@gmail.com] Sent: Thursday, 10 December 2015 8:07 AM To: Ted Yu Cc: user Subject: Re: can i process multiple batch in parallel in spar

Re: can i process multiple batch in parallel in spark streaming

2015-12-09 Thread prateek arora
Hi Thanks In my scenario batches are independent .so is it safe to use in production environment ? Regards Prateek On Wed, Dec 9, 2015 at 11:39 AM, Ted Yu wrote: > Have you seen this thread ? > > http://search-hadoop.com/m/q3RTtgSGrobJ3Je > > On Wed, Dec 9, 2015 at 11:12 AM, prateek arora > w

Re: can i process multiple batch in parallel in spark streaming

2015-12-09 Thread Ted Yu
Have you seen this thread ? http://search-hadoop.com/m/q3RTtgSGrobJ3Je On Wed, Dec 9, 2015 at 11:12 AM, prateek arora wrote: > Hi > > when i run my spark streaming application .. following information show on > application streaming UI. > i am using spark 1.5.0 > > > Batch Time Inp