Spark 2.0 history server summary page gets stuck at "loading history summary" with 10K+ application history

The summary page of Spark 2.0 history server web UI keep displaying "Loading history summary..." all the time and crashes the browser when there are more than 10K application history event logs on HDFS. I did some investigation, "historypage.js" file sends a REST request to /api/v1/applications en

Re: Spark dev-setup

Thanks a lot for the guidelines. I could successfully configure and debug On Wed, Aug 24, 2016 at 7:05 PM, Jacek Laskowski wrote: > On Wed, Aug 24, 2016 at 2:32 PM, Steve Loughran > wrote: > > > no reason; the key thing is : not in cluster mode, as there your work > happens elsewhere > > Righ

Latest Release of Receiver based Kafka Consumer for Spark Streaming.

Hi , Released latest version of Receiver based Kafka Consumer for Spark Streaming. Receiver is compatible with Kafka versions 0.8.x, 0.9.x and 0.10.x and All Spark Versions Available at Spark Packages : https://spark-packages.org/package/dibbhatt/kafka-spark-consumer Also at github : https://g

Spark Kerberos proxy user

Hi devs, I'm working (at Stratio) on use spark over mesos and standalone, with a kerberized HDFS We are working to solve these scenarios, - We have an long term running spark sql context using concurrently by many users like Thrift server called CrossData, we need access to hdfs data