Re: let spark streaming sample come to stop

2015-12-09 Thread Renyi Xiong
I see, thanks a lot On Mon, Nov 16, 2015 at 6:29 PM, Bryan Cutler wrote: > Hi Renyi, > > This is the intended behavior of the streaming HdfsWordCount example. It > makes use of a 'textFileStream' which will monitor a hdfs directory for any > newly created files and push them into a dstream. It

Re: let spark streaming sample come to stop

2015-11-16 Thread Bryan Cutler
Hi Renyi, This is the intended behavior of the streaming HdfsWordCount example. It makes use of a 'textFileStream' which will monitor a hdfs directory for any newly created files and push them into a dstream. It is meant to be run indefinitely, unless interrupted by ctrl-c, for example. -bryan