gt;> wrote:
Other than setting the following.
sparkConf.set("spark.streaming.unpersist", "true")
sparkConf.set("spark.cleaner.ttl", "7200s")
On Wed, Nov 4, 2015 at 5:03 PM, swetha
mailto:swethakasire...@gmail.com>> wrote:
Hi,
How to unpersist
>> Other than setting the following.
>>>
>>> sparkConf.set("spark.streaming.unpersist", "true")
>>> sparkConf.set("spark.cleaner.ttl", "7200s")
>>>
>>>
>>> On Wed, Nov 4, 2015 at 5:03 PM, swe
ot;true")
>> sparkConf.set("spark.cleaner.ttl", "7200s")
>>
>>
>> On Wed, Nov 4, 2015 at 5:03 PM, swetha wrote:
>>
>>> Hi,
>>>
>>> How to unpersist a DStream in Spark Streaming? I know that we can persist
>>>
onf.set("spark.cleaner.ttl", "7200s")
>
>
> On Wed, Nov 4, 2015 at 5:03 PM, swetha wrote:
>
>> Hi,
>>
>> How to unpersist a DStream in Spark Streaming? I know that we can persist
>> using dStream.persist() or dStream.cache. But, I don't see an
Hi,
DStream->Discretized Streams are made up of multiple RDDs
You can unpersist each RDD by accessing the individual RDD's using
dstreamrdd.foreachRDD
{
rdd.unpersist().
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-unpersist-a-DS
Other than setting the following.
sparkConf.set("spark.streaming.unpersist", "true")
sparkConf.set("spark.cleaner.ttl", "7200s")
On Wed, Nov 4, 2015 at 5:03 PM, swetha wrote:
> Hi,
>
> How to unpersist a DStream in Spark Streaming? I know
Hi,
How to unpersist a DStream in Spark Streaming? I know that we can persist
using dStream.persist() or dStream.cache. But, I don't see any method to
unPersist.
Thanks,
Swetha
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-unpersist-a-DStre
