Re: Pause Spark Streaming reading or sampling streaming data

2015-08-06 Thread Dimitris Kouzis - Loukas
are you asking about my streaming >> input source? I implemented a custom receiver and have been using that. >> Thanks. >> >> From: Dimitris Kouzis - Loukas >> Date: Wednesday, August 5, 2015 at 5:27 PM >> To: Heath Guo >> Cc: "user@spark.apache.org&quo

Re: Pause Spark Streaming reading or sampling streaming data

2015-08-06 Thread Dimitris Kouzis - Loukas
g" > Subject: Re: Pause Spark Streaming reading or sampling streaming data > > What driver do you use? Sounds like something you should do before the > driver... > > On Thu, Aug 6, 2015 at 12:50 AM, Heath Guo wrote: > >> Hi, I have a question about sampling Spark Strea

Re: Pause Spark Streaming reading or sampling streaming data

2015-08-05 Thread Heath Guo
:heath...@fb.com>> Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" mailto:user@spark.apache.org>> Subject: Re: Pause Spark Streaming reading or sampling streaming data What driver do you use? Sounds like something you should do before the driver... On Thu,

Re: Pause Spark Streaming reading or sampling streaming data

2015-08-05 Thread Dimitris Kouzis - Loukas
What driver do you use? Sounds like something you should do before the driver... On Thu, Aug 6, 2015 at 12:50 AM, Heath Guo wrote: > Hi, I have a question about sampling Spark Streaming data, or getting part > of the data. For every minute, I only want the data read in during the > first 10 seco