Re: Zip File and XML parsing with Spark Streaming

2016-03-21 Thread tjb305
Many thanks I will try that and come back with my findings. Toby On 21 March 2016 at 03:15, firemonk91 [via Apache Spark User List] < ml-node+s1001560n26544...@n3.nabble.com> wrote: > You can write the incoming message to a temp location and use Java > ZipInputStream to unzip the file. You proba

Zip File and XML parsing with Spark Streaming

2016-03-19 Thread tjb305
Hello, I am trying to figure out how to unzip zip files in Spark Streaming. Within each zip file will be a series of xml files which will also need parsing. Are there libraries that work with DStream that parse a zip or parse an xml file?. I have seen the databricks xml library but I do not think