How can I tell if it's the sample stream or full stream ? Thanks Sent from my iPhone
On Jul 23, 2015, at 4:17 PM, Enno Shioji <[email protected]<mailto:[email protected]>> wrote: You are probably listening to the sample stream, and THEN filtering. This means you listen to 1% of the twitter stream, and then looking for the tweet by Bloomberg, so there is a very good chance you don't see the particular tweet. In order to get all Bloomberg related tweets, you must connect to twitter using the filter API and not the sample API: https://dev.twitter.com/streaming/reference/post/statuses/filter On Thu, Jul 23, 2015 at 8:23 PM, pjmccarthy <[email protected]<mailto:[email protected]>> wrote: Hopefully this is an easy one. I am trying to filter a twitter dstream by user ScreenName - my code is as follows val stream = TwitterUtils.createStream(ssc, None) .filter(_.getUser.getScreenName.contains("markets")) however nothing gets returned and I can see that Bloomberg has tweeted. If I remove the filter I get tweets If I change the code to looke for engligh or french tweets that works Is there a better way to do it ? Can anyone assist ? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Twitter4J-streaming-question-tp23974.html Sent from the Apache Spark User List mailing list archive at Nabble.com<http://Nabble.com>. --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected]<mailto:[email protected]> For additional commands, e-mail: [email protected]<mailto:[email protected]>
