Re: [VOTE] Apache Spark 2.1.0 (RC5)

2016-12-17 Thread Liwei Lin
+1 Cheers, Liwei On Sat, Dec 17, 2016 at 10:29 AM, Yuming Wang wrote: > I hope https://github.com/apache/spark/pull/16252 can be fixed until > release 2.1.0. It's a fix for broadcast cannot fit in memory. > > On Sat, Dec 17, 2016 at 10:23 AM, Joseph Bradley > wrote: > >> +1 >> >> On Fri, Dec 1

Re: Kafka Spark structured streaming latency benchmark.

2016-12-17 Thread Prashant Sharma
Furthermore, I ran the same thing with 26 GB as the memory, which would mean 1.3GB per thread of memory. My jmap results and jstat results