Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed..

concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Please suggest your answer Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Is there a way to insert data into existing parquet file using spark ?

to impala. I want to insert data into existing parquet file instead of creating new parquet file. I have tried with INSERT statement but it makes performance too slow. Please suggest is there any way to insert or append data into existing parquet file. Regards, Rafeeq S *(“What you do is what

How to make Spark Streaming write its output so that Impala can read it?

ingle directory or otherwise in a form that is instantly readable by Impala? Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*

Spark RuntimeException due to Unsupported datatype NullType

at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) at scala.collection.AbstractTraversable.map(Tr

Re: Spark stream data from kafka topics and output as parquet file on HDFS

*as parquet file on HDFS ?* *Please give your suggestion.* Regards, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )* On Tue, Aug 5, 2014 at 11:55 AM, Dibyendu Bhattacharya < dibyendu.bhattach...@gmail.com> wrote: > You can try this Kafka Spark Consume

Spark stream data from kafka topics and output as parquet file on HDFS

, Rafeeq S *(“What you do is what matters, not what you think or say or plan.” )*