Dear Spark Developer Community, I hope this email finds you well.
My name is Balaji, and I am a Software Engineer working with Apache Spark in IBM Z Systems (z/OS). We are exploring a scenario where we would like to move away from using the Snappy compression library within our Spark applications and leverage either LZ4 or LZF compression exclusively. This includes ensuring that all data persistence, shuffle operations, and internal data representations consistently utilize the chosen alternative (LZ4 or LZF), including the test cases. Product Owner, IBM Z Platform for Apache Spark India Systems Development Lab Bangalore, EGL D Block 6th Floor Mobile : +91 9600778246 Mail : balaji.sudharsa...@ibm.com<mailto:balaji.sudharsa...@ibm.com>
