>>> tweets.map(tweet=>(tweetText,
>>> tweet).groupByKey(tweetText).map((tweetText, _) =>tweetText)
>>> }
>>>
>>>
>>> Above example shows I am doing the same thing but I have to replicate the
>>> code as there is no common abstra
mon abstraction it would have been much simlper:
>>
>> tweets = context.read("tweet", Stream or Batch)
>>
>> def getUniqueTweets(tweets: SparkObject[Tweet])= {
>> tweets.map(tweet=>(tweetText,
>> tweet).groupByKey(tweetText).map((tweetText, _
any
> plan to add this support? Is it intentionally not supported because of
> design choice?
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Generic-Interface-between-RDD-and-DStream-tp9331.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
.map((tweetText, _) =>tweetText)
}
I would appreciate thoughts on it. Is it already available? Is there any
plan to add this support? Is it intentionally not supported because of
design choice?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Generic-In
