Re: Storing Compressed data in HDFS into Spark

2015-10-22 Thread Adnan Haider
t is cached is also decompressed. >> Can >> a partition be compressed in spark? I know spark allows for data to be >> compressed, after serialization. But what if, I only want the partitions >> compressed. >> >> >> >> -- >> View this message in c

Re: Storing Compressed data in HDFS into Spark

2015-10-22 Thread Igor Berman
I know spark allows for data to be > compressed, after serialization. But what if, I only want the partitions > compressed. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Storing-Compressed-data-in-HDFS-into-Spark-tp25123.htm

Re: Storing Compressed data in HDFS into Spark

2015-10-22 Thread Akhil Das
decompressed. Can > a partition be compressed in spark? I know spark allows for data to be > compressed, after serialization. But what if, I only want the partitions > compressed. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabbl

Storing Compressed data in HDFS into Spark

2015-10-19 Thread ahaider3
compressed. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Storing-Compressed-data-in-HDFS-into-Spark-tp25123.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To