Thanks all - I still don't know what the underlying problem is, but I KIND
OF got it working by dumping my random-words stuff to a file and pointing
spark streaming to that.  So it's not "Streaming", as such, but I got
output.

More investigation to follow =)


On Sat, Jun 7, 2014 at 8:22 AM, Gino Bustelo <lbust...@gmail.com> wrote:

> I would make sure that your workers are running. It is very difficult to
> tell from the console dribble if you just have no data or the workers just
> disassociated from masters.
>
> Gino B.
>
> On Jun 6, 2014, at 11:32 PM, Jeremy Lee <unorthodox.engine...@gmail.com>
> wrote:
>
> Yup, when it's running, DStream.print() will print out a timestamped block
> for every time step, even if the block is empty. (for v1.0.0, which I have
> running in the other window)
>
> If you're not getting that, I'd guess the stream hasn't started up
> properly.
>
>
> On Sat, Jun 7, 2014 at 11:50 AM, Michael Campbell <
> michael.campb...@gmail.com> wrote:
>
>> I've been playing with spark and streaming and have a question on stream
>> outputs.  The symptom is I don't get any.
>>
>> I have run spark-shell and all does as I expect, but when I run the
>> word-count example with streaming, it *works* in that things happen and
>> there are no errors, but I never get any output.
>>
>> Am I understanding how it it is supposed to work correctly?  Is the
>> Dstream.print() method supposed to print the output for every (micro)batch
>> of the streamed data?  If that's the case, I'm not seeing it.
>>
>> I'm using the "netcat" example and the StreamingContext uses the network
>> to read words, but as I said, nothing comes out.
>>
>> I tried changing the .print() to .saveAsTextFiles(), and I AM getting a
>> file, but nothing is in it other than a "_temporary" subdir.
>>
>> I'm sure I'm confused here, but not sure where.  Help?
>>
>
>
>
> --
> Jeremy Lee  BCompSci(Hons)
>   The Unorthodox Engineers
>
>

Reply via email to