Tathagata Das wrote
> *Answer 1:*Make sure you are using master as "local[n]" with n > 1
> (assuming you are running it in local mode). The way Spark Streaming
> works is that it assigns a code to the data receiver, and so if you
> run the program with only one core (i.e., with local or local[1]),
> then it wont have resources to process data along with receiving it.


I've been struggling with this exact issue for a very, very long time and
was happy to finally have found this... *BUT* is this documented anywhere?  
Was it just me that couldn't find it?  It seems that "local" is a perfectly
reasonable thing to assume will work, but when you never get output that
just seems broken.

As I said, maybe I just didn't see it somewhere so apologies if that's the
case, but if not this should be a big red warning on the javadoc, tutorials,
etc.



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/streaming-questions-tp3281p8655.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Reply via email to