Yup, when it's running, DStream.print() will print out a timestamped block for every time step, even if the block is empty. (for v1.0.0, which I have running in the other window)
If you're not getting that, I'd guess the stream hasn't started up properly. On Sat, Jun 7, 2014 at 11:50 AM, Michael Campbell < michael.campb...@gmail.com> wrote: > I've been playing with spark and streaming and have a question on stream > outputs. The symptom is I don't get any. > > I have run spark-shell and all does as I expect, but when I run the > word-count example with streaming, it *works* in that things happen and > there are no errors, but I never get any output. > > Am I understanding how it it is supposed to work correctly? Is the > Dstream.print() method supposed to print the output for every (micro)batch > of the streamed data? If that's the case, I'm not seeing it. > > I'm using the "netcat" example and the StreamingContext uses the network > to read words, but as I said, nothing comes out. > > I tried changing the .print() to .saveAsTextFiles(), and I AM getting a > file, but nothing is in it other than a "_temporary" subdir. > > I'm sure I'm confused here, but not sure where. Help? > -- Jeremy Lee BCompSci(Hons) The Unorthodox Engineers
