Re: How to get and parse whole xml file in HDFS by Spark Streaming

2015-06-22 Thread Yong Feng
t; > On Mon, Jun 22, 2015 at 5:45 PM, Yong Feng wrote: > >> Thanks a lot, Akhil >> >> I saw this mail thread before, but still do not understand how to use >> XmlInputFormatof mahout in Spark Streaming (I am not Spark Streaming >> Expert yet ;-)). Can you

Re: How to get and parse whole xml file in HDFS by Spark Streaming

2015-06-22 Thread Yong Feng
est Regards > > On Mon, Jun 22, 2015 at 12:23 AM, Yong Feng wrote: > >> >> Hi Spark Experts >> >> I have a customer who wants to monitor coming data files (with xml >> format), and then analysize them after that put analysized data into DB. >> The si

Fwd: How to get and parse whole xml file in HDFS by Spark Streaming

2015-06-21 Thread Yong Feng
Hi Spark Experts I have a customer who wants to monitor coming data files (with xml format), and then analysize them after that put analysized data into DB. The size of each file is about 30MB (or even less in future). Spark streaming seems promising. After learning Spark Streaming and also googl