Re: Json parsing library for Spark Streaming?

2015-08-10 Thread pradyumnad
I use Play json, may be its very famous. If you would like to try below is the sbt dependency "com.typesafe.play" % "play-json_2.10" % "2.2.1", -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Json-parsing-library-for-Spark-Streaming-tp24016p24204.html Sent

Re: TFIDF Transformation

2015-08-10 Thread pradyumnad
If you want to convert the hash to word, the very thought defies the usage of hashing. You may map the words with hashing, but that wouldn't be good. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/TFIDF-Transformation-tp24086p24203.html Sent from the Apach

Re: Twitter live Streaming

2015-08-10 Thread pradyumnad
Streaming API, as in the name, gives out the live stream of tweets which are posted right then. If you would like to get the old tweets use the rest API from Twitter. Twitter4j is the twitter library that I use and suggest for the task. -- View this message in context: http://apache-spark-user

Re: can't start master node on a standalone environment

2015-08-10 Thread pradyumnad
It seems like the jars are missing. Can you post the full log ? Expand ..6 more -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/can-t-start-master-node-on-a-standalone-environment-tp24160p24201.html Sent from the Apache Spark User List mailing list archive