Re: hdfs streaming context

o it's not correct to write "hdfs:///...") > > On Mon, Dec 1, 2014 at 10:41 PM, Benjamin Cuthbert > wrote: >> All, >> >> Is it possible to stream on HDFS directory and listen for multiple files? >> >> I have tried the following >> >

hdfs streaming context

All, Is it possible to stream on HDFS directory and listen for multiple files? I have tried the following val sparkConf = new SparkConf().setAppName("HdfsWordCount") val ssc = new StreamingContext(sparkConf, Seconds(2)) val lines = ssc.textFileStream("hdfs://localhost:8020/user/data/*") lines.fi