Hi, Have you seen https://issues.apache.org/jira/browse/SPARK-4633 ?
// maropu On Mon, Sep 12, 2016 at 11:00 PM, Nasser Ebrahim <enas...@linux.vnet.ibm.com > wrote: > Hi, > > Can we use GZIP compression for internal data such as RDD partitions, > broadcast variables and shuffle outputs so that user will have more choice > compared to the available LZ4, LZF and Snappy? Is there any specific > reason we are not supporting the JDK inbuilt compression? If not, shall I > create a JIRA to get this implemented. > > Thank you, > Nasser Ebrahim > > -- --- Takeshi Yamamuro
