are you asking about my streaming
>> input source? I implemented a custom receiver and have been using that.
>> Thanks.
>>
>> From: Dimitris Kouzis - Loukas
>> Date: Wednesday, August 5, 2015 at 5:27 PM
>> To: Heath Guo
>> Cc: "user@spark.apache.org&quo
g"
> Subject: Re: Pause Spark Streaming reading or sampling streaming data
>
> What driver do you use? Sounds like something you should do before the
> driver...
>
> On Thu, Aug 6, 2015 at 12:50 AM, Heath Guo wrote:
>
>> Hi, I have a question about sampling Spark Strea
:heath...@fb.com>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Pause Spark Streaming reading or sampling streaming data
What driver do you use? Sounds like something you should do before the driver...
On Thu,
What driver do you use? Sounds like something you should do before the
driver...
On Thu, Aug 6, 2015 at 12:50 AM, Heath Guo wrote:
> Hi, I have a question about sampling Spark Streaming data, or getting part
> of the data. For every minute, I only want the data read in during the
> first 10 seco
Hi, I have a question about sampling Spark Streaming data, or getting part of
the data. For every minute, I only want the data read in during the first 10
seconds, and discard all data in the next 50 seconds. Is there any way to pause
reading and discard data in that period? I'm doing this to sa
is to sample from
a stream of huge amount of data, which saves processing time in the
real-time program. Thanks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Pause-Spark-Streaming-reading-or-sampling-streaming-data-tp24146.html
Sent from the Apache Spark User
